-- Logs begin at Mon 2022-07-18 01:23:00 UTC, end at Mon 2022-07-18 04:24:58 UTC. -- Jul 18 01:59:46.800606 n-d-849796-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 01:59:46.812079 n-d-849796-1 devstack@n-api.service[104098]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 01:59:46 2022] *** Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: nodename: n-d-849796-1 Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: machine: x86_64 Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: clock source: unix Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: pcre jit disabled Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: detected number of CPU cores: 4 Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: current working directory: / Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: detected binary path: /usr/bin/uwsgi-core Jul 18 01:59:46.814124 n-d-849796-1 devstack@n-api.service[104098]: your processes number limit is 47680 Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: your memory page size is 4096 bytes Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: detected max file descriptor number: 2048 Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: lock engine: pthread robust mutexes Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: thunder lock: enabled Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 01:59:46.814942 n-d-849796-1 devstack@n-api.service[104098]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 01:59:46.854603 n-d-849796-1 devstack@n-api.service[104098]: Python main interpreter initialized at 0x55c8b12689c0 Jul 18 01:59:46.854603 n-d-849796-1 devstack@n-api.service[104098]: python threads support enabled Jul 18 01:59:46.854603 n-d-849796-1 devstack@n-api.service[104098]: your server socket listen backlog is limited to 100 connections Jul 18 01:59:46.854603 n-d-849796-1 devstack@n-api.service[104098]: your mercy for graceful operations on workers is 90 seconds Jul 18 01:59:46.854985 n-d-849796-1 devstack@n-api.service[104098]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 01:59:46.855078 n-d-849796-1 devstack@n-api.service[104098]: *** Operational MODE: preforking *** Jul 18 01:59:46.855282 n-d-849796-1 devstack@n-api.service[104098]: *** uWSGI is running in multiple interpreter mode *** Jul 18 01:59:46.855282 n-d-849796-1 devstack@n-api.service[104098]: spawned uWSGI master process (pid: 104098) Jul 18 01:59:46.855496 n-d-849796-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 01:59:46.856055 n-d-849796-1 devstack@n-api.service[104098]: spawned uWSGI worker 1 (pid: 104099, cores: 1) Jul 18 01:59:46.856406 n-d-849796-1 devstack@n-api.service[104098]: spawned uWSGI worker 2 (pid: 104100, cores: 1) Jul 18 01:59:46.856561 n-d-849796-1 devstack@n-api.service[104098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 01:59:47.528665 n-d-849796-1 devstack@n-api.service[104100]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 01:59:47.537546 n-d-849796-1 devstack@n-api.service[104099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 01:59:48.631708 n-d-849796-1 devstack@n-api.service[104099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:59:48.631708 n-d-849796-1 devstack@n-api.service[104099]: from cryptography.utils import int_from_bytes Jul 18 01:59:48.632376 n-d-849796-1 devstack@n-api.service[104099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:59:48.632376 n-d-849796-1 devstack@n-api.service[104099]: from cryptography.utils import int_from_bytes Jul 18 01:59:48.643840 n-d-849796-1 devstack@n-api.service[104100]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:59:48.643840 n-d-849796-1 devstack@n-api.service[104100]: from cryptography.utils import int_from_bytes Jul 18 01:59:48.644348 n-d-849796-1 devstack@n-api.service[104100]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 01:59:48.644348 n-d-849796-1 devstack@n-api.service[104100]: from cryptography.utils import int_from_bytes Jul 18 01:59:51.161239 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 01:59:51.162199 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 01:59:51.162294 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 01:59:51.162294 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 01:59:51.162733 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 01:59:51.162819 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 01:59:51.162898 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 01:59:51.162898 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 01:59:51.163059 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 01:59:51.163059 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 01:59:51.163212 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.163293 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.163371 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.163584 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.163682 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.163909 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164008 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164226 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164314 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164532 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164638 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164853 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.164962 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165200 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165344 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165519 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165626 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165777 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.165870 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166090 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166183 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166405 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166506 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849796-1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166743 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.166844 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849796-1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167029 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167116 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167337 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167430 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167649 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167743 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.167950 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168043 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168258 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168405 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168554 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168644 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.168880 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.169085 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.169493 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.169633 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.169750 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.169864 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170007 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170155 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170342 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170472 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170651 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170751 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.170964 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171052 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171275 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171370 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171596 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171734 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171906 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.171995 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.172229 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.172364 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.172535 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.172629 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849796-1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.172957 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173047 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849796-1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173264 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173353 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173576 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173660 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.173891 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174029 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174285 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174383 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174594 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174691 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174900 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.174997 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175221 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175309 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175525 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175620 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175849 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.175946 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.176766 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.176970 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177109 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177282 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177432 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177591 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177726 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.177814 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178051 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178165 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178340 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178427 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178648 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178740 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.178951 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179047 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179256 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179352 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179506 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179595 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.179796 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.180130 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.180359 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.180518 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.180677 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.180764 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181018 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181108 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181270 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181369 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181521 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181618 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181820 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.181908 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182141 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182228 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182448 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182537 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182756 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.182841 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183059 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183144 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183364 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183452 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183665 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183750 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.183970 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184056 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184271 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184367 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184639 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184737 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.184880 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185013 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185221 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185311 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185537 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185630 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185842 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.185928 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186152 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186238 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186473 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186561 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186778 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.186893 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187088 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187189 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187406 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187492 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187728 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.187850 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188029 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188119 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188346 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188433 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188666 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188813 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.188993 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189100 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189301 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189397 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189607 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189711 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.189914 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190008 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190235 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190323 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190538 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190684 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190791 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.190879 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191089 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191186 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191391 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191478 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191755 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.191905 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192053 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192221 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192379 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192495 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192650 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192786 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.192969 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193121 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193279 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193428 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193584 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193736 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.193894 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194045 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194198 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194354 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194503 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194662 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194809 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.194969 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195114 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195277 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195419 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195584 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195723 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.195893 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196043 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196200 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196363 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196519 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196668 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196840 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.196994 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197176 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197287 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197485 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197585 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197791 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.197888 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198097 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198185 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198418 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198504 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198730 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.198827 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199036 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199126 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199354 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199442 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199663 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199752 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.199964 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200057 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200270 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200357 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200574 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200670 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200871 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.200991 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201202 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201306 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201501 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201587 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201808 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.201895 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202109 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202209 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202508 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202717 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.202843 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203018 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203117 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203319 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203412 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203622 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203707 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.203921 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204020 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204220 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204308 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204523 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204608 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204822 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.204978 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205163 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205251 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205469 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205558 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205775 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.205862 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.206082 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.206182 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.206390 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.206479 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.206709 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 01:59:51.206798 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.207047 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.207140 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.207901 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208052 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208233 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208393 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208611 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208741 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.208952 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209110 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209295 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209384 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209617 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209713 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.209930 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210027 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210245 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210341 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210572 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210660 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210889 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.210991 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211203 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211290 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211513 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211599 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211832 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.211949 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212146 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212234 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212464 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212553 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212782 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.212879 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213120 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213213 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213437 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213525 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213750 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.213846 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214068 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214156 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214376 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214462 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214706 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.214794 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215017 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215113 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215338 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215424 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215661 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215749 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.215982 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216077 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216294 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216382 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216604 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216693 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.216914 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217034 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217246 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217335 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217559 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217655 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217877 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.217987 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218195 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218300 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218503 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218602 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218817 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.218921 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219124 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219238 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219432 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219528 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219740 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.219827 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220051 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220148 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220360 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220448 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220669 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.220755 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221000 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221105 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221317 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221626 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221712 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.221935 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222032 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222244 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222332 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222549 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222636 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.222852 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.223017 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.223753 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.223851 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224077 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224198 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224381 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224472 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224705 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.224794 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225029 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225120 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225352 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225447 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225675 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225769 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.225978 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226072 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226290 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226381 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226601 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226695 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.226909 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227008 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227216 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227311 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227524 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227610 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227831 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.227931 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228133 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228222 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228443 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228529 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228749 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.228850 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229074 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229163 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229396 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229486 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229698 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229795 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.229999 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230093 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230311 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230404 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230616 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230706 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.230922 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231015 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231231 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231318 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231541 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231630 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231850 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.231936 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232161 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232248 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232469 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232556 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232785 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.232879 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233118 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233208 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233431 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233520 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233757 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.233860 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234053 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234149 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234373 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234463 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234674 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234762 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.234985 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235084 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235283 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235369 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235583 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235669 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235882 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.235976 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236181 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236269 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236481 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236568 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236785 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.236883 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237107 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237208 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237527 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237706 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.237795 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238007 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238102 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238311 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238607 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238696 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.238908 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239209 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239351 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239482 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239659 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239812 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.239935 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240026 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240144 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240310 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240446 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240649 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240783 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.240988 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241145 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241313 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241466 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241624 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241788 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.241941 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242100 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242252 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242416 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242563 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242728 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.242873 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243039 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243184 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243350 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243502 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243660 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243817 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.243979 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244134 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244286 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244445 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244603 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244765 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.244911 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245099 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245254 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245416 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245563 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245721 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.245881 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246035 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246185 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246373 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246499 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246704 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.246836 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247020 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247167 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247340 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247484 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247651 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247798 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.247964 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248107 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248274 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248424 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248582 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248729 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.248891 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249186 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249399 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249542 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249694 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249831 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.249965 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250055 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250144 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250375 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250531 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250634 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250718 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.250857 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251035 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251163 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251347 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251462 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251767 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.251890 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.252068 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.252192 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.252515 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.252657 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.252859 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253199 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253307 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253520 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253643 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253859 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.253949 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.254184 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.254297 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.254501 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.254590 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.254909 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255002 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255171 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255258 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255436 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255523 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255713 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.255808 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256027 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256121 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256335 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256428 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256647 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.256740 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257360 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257478 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257552 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257619 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257691 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.257759 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258091 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258188 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258278 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258354 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258518 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258607 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.258922 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259020 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259091 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259165 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259412 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259519 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259779 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.259883 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260055 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260142 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260310 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260397 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260624 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260725 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.260944 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.261037 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.261259 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.261351 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.261953 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262027 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262094 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262168 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262168 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262785 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262873 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.262942 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263009 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263075 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263140 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263216 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263354 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263466 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263668 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263763 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.263986 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264089 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264297 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264384 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264602 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264690 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.264910 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265077 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265240 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265343 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265546 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265637 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265856 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.265946 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266167 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266311 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266470 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266567 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266778 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.266873 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267087 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267175 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267392 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267479 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267702 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.267791 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268010 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268096 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268311 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268407 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268619 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268705 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.268984 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.269078 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.269252 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.269528 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.269619 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.270525 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.270704 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.270849 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271014 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271150 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271302 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271392 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271619 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271707 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.271947 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272046 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272272 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272369 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272613 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272711 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.272936 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273042 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273250 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273341 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273554 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273653 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273864 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.273953 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274167 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274267 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274465 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274553 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274767 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.274856 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275070 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275165 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275375 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275463 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275674 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275760 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.275977 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276067 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276276 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276371 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276574 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276669 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276872 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.276990 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277207 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277303 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277518 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277612 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277818 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.277907 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278126 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278219 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278427 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278515 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278727 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.278815 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279029 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279118 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279334 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279434 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279641 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279735 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.279944 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280033 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280282 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280377 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280588 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280696 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.280977 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281077 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281258 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281373 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281564 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281653 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281886 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.281974 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282188 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282276 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282488 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282583 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282790 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.282883 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283091 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283186 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283420 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283517 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283691 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283778 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.283998 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284098 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284300 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284388 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284606 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284704 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.284909 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285020 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285231 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285318 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285611 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285738 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.285906 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286062 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286187 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286303 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286491 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286612 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286802 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.286918 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287109 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287221 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287410 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287531 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287712 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.287837 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288021 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288139 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288328 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288448 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288628 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288755 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.288952 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289144 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289257 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289450 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289576 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289752 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.289878 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290056 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290179 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290367 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290480 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290685 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290820 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.290982 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291081 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291306 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291396 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291620 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291707 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.291924 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292020 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292229 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292326 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292539 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292628 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292844 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.292969 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293170 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293259 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293473 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293562 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293782 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.293870 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294100 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294194 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294404 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294500 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294702 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.294792 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295007 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295095 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295308 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295394 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295606 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295701 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295904 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.295989 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296203 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296298 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296500 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296588 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296796 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.296883 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297116 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297223 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297415 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297502 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297712 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.297799 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298027 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298127 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298330 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298418 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298631 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298728 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.298929 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299024 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299230 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299321 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299551 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299645 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299861 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.299956 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300195 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300292 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300506 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300594 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300815 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.300967 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.301674 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.301827 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.301977 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302131 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302274 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302364 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302572 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302669 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.302882 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303019 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303189 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303305 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303493 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303580 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303798 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.303897 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304097 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304192 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304397 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304485 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304708 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.304804 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.305290 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.305383 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.305602 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.305692 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.305920 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306022 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306241 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306341 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306537 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306625 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.306844 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307009 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307153 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307240 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307457 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307544 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307763 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.307860 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308067 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308154 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308373 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308460 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308678 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.308774 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309008 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309147 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309320 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309407 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309629 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309717 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.309933 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310022 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310234 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310328 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310543 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310632 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310845 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.310931 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311146 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311240 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311468 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311562 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311771 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.311859 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312072 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312167 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312373 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312460 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312675 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312762 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.312999 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.313104 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.313303 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.313434 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.313736 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.313824 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314049 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314145 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314350 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314445 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314653 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314739 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.314961 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315060 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315266 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315351 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315576 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315662 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315881 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.315979 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.316180 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.316292 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.316592 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.316723 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.316989 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317155 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317307 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317421 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317574 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317663 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317874 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.317970 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318174 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318264 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318482 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318568 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318785 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.318880 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319091 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319216 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319390 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319484 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319696 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.319785 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320015 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320102 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320318 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320637 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.320779 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321085 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321187 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321399 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321495 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321703 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.321813 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322114 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322209 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322422 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322518 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322729 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.322816 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323048 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323181 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323367 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323454 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323673 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323759 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.323975 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324071 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324283 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324369 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324590 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324691 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.324913 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325043 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325246 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325334 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325556 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325644 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325858 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.325946 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326156 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326249 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326475 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326565 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326783 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.326870 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327091 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327177 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327408 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327498 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327813 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.327901 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328126 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328226 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328430 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328516 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328750 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.328838 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329079 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329183 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329386 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329482 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329692 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329778 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.329993 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330088 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330293 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330387 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330596 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330685 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.330906 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331001 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331209 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331303 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331516 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331603 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331820 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.331907 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.332122 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.332209 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333021 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333166 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333393 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333557 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333765 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.333858 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334079 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334195 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334403 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334501 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334719 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.334807 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335039 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335126 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335347 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335444 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335648 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335735 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.335965 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336052 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336269 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336358 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336573 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336669 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.336872 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337004 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337201 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337297 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337529 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337617 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337832 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.337931 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338155 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338244 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338481 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338570 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338792 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.338891 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339104 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339190 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339435 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339522 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339751 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.339830 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340065 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340142 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340381 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340505 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340706 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.340818 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341037 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341164 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341336 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341447 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341647 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341750 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.341951 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342039 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342256 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342395 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342560 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342650 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342867 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.342955 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343170 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343272 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343471 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343560 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343772 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.343861 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344092 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344194 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344399 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344494 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344706 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.344794 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345032 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345135 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345338 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345433 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345638 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345725 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.345939 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346034 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346267 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346354 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346569 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346656 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346900 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.346991 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347214 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347301 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347529 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347615 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347841 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.347995 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.348324 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.348476 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.348650 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.348807 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349007 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349102 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349296 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349386 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349617 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349708 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.349930 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350028 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350243 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350331 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350555 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350643 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350865 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.350962 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351174 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351275 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351485 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351625 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351795 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.351882 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.352112 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.352351 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.352668 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.352764 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353006 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353099 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353323 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353422 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353643 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353777 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.353950 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354040 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354262 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354350 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354573 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354663 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354881 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.354967 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355190 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355326 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355499 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355596 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355810 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.355898 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356128 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356217 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356445 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356541 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356768 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.356861 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357123 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357225 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357437 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357525 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357748 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.357835 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358060 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358155 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358372 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358460 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358714 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.358801 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359022 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359112 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359323 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359409 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359635 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359721 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.359947 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360035 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360255 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360350 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360563 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360649 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360872 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.360991 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361207 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361305 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361514 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361676 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361823 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.361912 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362132 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362226 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362442 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362584 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362753 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.362841 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.363076 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.363165 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.363394 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364014 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364287 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364439 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364589 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364742 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.364899 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.365135 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.365237 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.365657 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.365754 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.365975 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366074 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366309 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366398 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366636 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366732 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.366962 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367059 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367276 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367363 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367591 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367679 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.367916 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368006 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368220 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368308 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368524 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368619 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368834 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.368942 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369168 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369256 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369469 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369555 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369791 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.369882 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370103 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370191 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370403 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370489 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370719 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.370809 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371028 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371115 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371556 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371653 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371902 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.371997 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372214 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372302 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372538 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372633 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372858 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.372985 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373198 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373288 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373504 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373606 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373825 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.373912 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374127 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374222 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374430 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374527 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374741 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.374828 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375045 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375132 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375347 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375435 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375646 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375733 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.375953 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376040 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376258 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376347 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376559 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376647 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376867 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.376988 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377190 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377281 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377514 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377622 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377817 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.377906 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378120 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378209 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378419 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378507 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378727 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.378823 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379026 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379143 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379458 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379614 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379787 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.379941 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380141 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380231 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380455 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380553 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380763 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.380861 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381100 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381192 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381404 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381492 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381714 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.381820 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382016 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382117 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382323 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382412 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382671 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382761 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.382991 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383080 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383293 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383381 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383594 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383683 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383906 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.383994 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.384213 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.384308 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.384533 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.384621 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.384840 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385054 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385177 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385256 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385525 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385606 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385841 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.385927 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.386383 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.386503 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.386713 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.386852 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387033 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387124 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387369 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387456 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387701 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.387791 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388010 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388099 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388318 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388417 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388623 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388722 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.388966 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389073 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389282 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389381 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389594 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389688 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389905 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.389993 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390215 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390304 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390524 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390611 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390834 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.390920 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391142 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391232 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391451 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391537 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391760 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.391844 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392068 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392166 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392386 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392490 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392687 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.392802 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393013 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393104 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393331 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393428 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393668 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393770 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.393990 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.394080 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.394307 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.394396 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.394626 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.394724 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.395472 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.395608 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.395786 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.395907 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.396100 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.396274 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.396413 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.396693 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.396791 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397030 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397145 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397351 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397438 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397661 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397757 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.397964 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.398066 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.398284 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.398373 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.398686 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.398773 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399003 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399093 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399322 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399422 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399630 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399725 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.399945 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400095 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400261 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400349 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400570 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400666 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400886 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.400995 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401219 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401307 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401533 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401633 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401862 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.401951 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402187 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402275 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402510 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402610 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402817 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.402907 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403123 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403211 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403424 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403524 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403729 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.403821 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404039 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404127 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404344 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404440 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404645 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404771 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.404965 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405056 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405272 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405363 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405572 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405661 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.405874 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406004 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406174 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406263 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406474 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406561 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406777 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.406856 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407075 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407153 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407373 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407460 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407674 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407762 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.407973 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408061 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408272 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408359 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408572 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408671 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408873 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.408976 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409200 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409288 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409501 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409601 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409801 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.409889 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.410101 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.410187 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.410436 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411050 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411416 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411591 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411739 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411837 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.411976 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412076 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412300 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412397 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412611 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412700 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.412983 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413078 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413265 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413366 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413587 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413677 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413907 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.413998 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414226 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414313 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414534 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414621 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414843 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.414931 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415172 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415267 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415483 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415577 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415791 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.415887 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416098 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416190 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416407 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416505 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416716 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.416810 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417060 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417192 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417386 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417488 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417694 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.417788 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.418852 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.418933 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419004 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419082 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419152 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419219 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419287 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419353 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419428 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419496 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419571 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419638 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419824 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.419925 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420132 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420218 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420440 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420528 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420747 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.420834 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421076 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421167 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421387 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421488 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421694 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.421860 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422002 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422091 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422313 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422404 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422626 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422722 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.422938 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423033 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423262 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423350 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423572 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423669 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.423930 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424065 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424248 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424445 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424613 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424777 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.424941 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425151 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425292 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425463 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425620 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425812 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.425934 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.426165 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.426407 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.426571 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.426736 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.426888 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.427020 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 01:59:51.427109 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 01:59:51.427306 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 01:59:51.488478 n-d-849796-1 devstack@n-api.service[104100]: INFO dbcounter [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Registered counter for database nova_api Jul 18 01:59:51.488685 n-d-849796-1 devstack@n-api.service[104099]: INFO dbcounter [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Registered counter for database nova_api Jul 18 01:59:51.602885 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_db.sqlalchemy.engines [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.608203 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_db.sqlalchemy.engines [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.610198 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writer thread running {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.614809 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writer thread running {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.668412 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.context [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=104100) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 01:59:51.671179 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.context [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=104099) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 01:59:51.672385 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:59:51.674045 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:59:51.674858 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:59:51.675247 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_concurrency.lockutils [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:59:51.677427 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:59:51.677552 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_concurrency.lockutils [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:59:51.678387 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_concurrency.lockutils [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 01:59:51.679458 n-d-849796-1 devstack@n-api.service[104100]: INFO dbcounter [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Registered counter for database nova_cell0 Jul 18 01:59:51.680766 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_concurrency.lockutils [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 01:59:51.682806 n-d-849796-1 devstack@n-api.service[104099]: INFO dbcounter [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Registered counter for database nova_cell0 Jul 18 01:59:51.683662 n-d-849796-1 devstack@n-api.service[104100]: INFO dbcounter [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Registered counter for database nova_cell1 Jul 18 01:59:51.686670 n-d-849796-1 devstack@n-api.service[104099]: INFO dbcounter [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Registered counter for database nova_cell1 Jul 18 01:59:51.691388 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_db.sqlalchemy.engines [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.693176 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_db.sqlalchemy.engines [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.697125 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_db.sqlalchemy.engines [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.699279 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_db.sqlalchemy.engines [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.700096 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writer thread running {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.704288 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writer thread running {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.705137 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writer thread running {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.709995 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writer thread running {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.849788 n-d-849796-1 devstack@n-api.service[104100]: INFO dbcounter [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Registered counter for database nova_cell0 Jul 18 01:59:51.855841 n-d-849796-1 devstack@n-api.service[104099]: INFO dbcounter [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Registered counter for database nova_cell0 Jul 18 01:59:51.858691 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_db.sqlalchemy.engines [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.863007 n-d-849796-1 devstack@n-api.service[104099]: DEBUG oslo_db.sqlalchemy.engines [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 01:59:51.863153 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writer thread running {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:51.868894 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writer thread running {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 01:59:52.205041 n-d-849796-1 devstack@n-api.service[104100]: WARNING keystonemiddleware.auth_token [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:59:52.213154 n-d-849796-1 devstack@n-api.service[104100]: WARNING keystonemiddleware.auth_token [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:59:52.219170 n-d-849796-1 devstack@n-api.service[104099]: WARNING keystonemiddleware.auth_token [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:59:52.227894 n-d-849796-1 devstack@n-api.service[104099]: WARNING keystonemiddleware.auth_token [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:59:52.560403 n-d-849796-1 devstack@n-api.service[104100]: WARNING keystonemiddleware.auth_token [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:59:52.566349 n-d-849796-1 devstack@n-api.service[104100]: WARNING keystonemiddleware.auth_token [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:59:52.572052 n-d-849796-1 devstack@n-api.service[104100]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8b12689c0 pid: 104100 (default app) Jul 18 01:59:52.574149 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 01:59:52.575326 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jul 18 01:59:52.575745 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Mon Jul 18 01:59:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 01:59:52.590946 n-d-849796-1 devstack@n-api.service[104099]: WARNING keystonemiddleware.auth_token [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 01:59:52.597134 n-d-849796-1 devstack@n-api.service[104099]: WARNING keystonemiddleware.auth_token [None req-7ffc9bce-a15d-47e3-8079-1adf8eafe4ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 01:59:52.602974 n-d-849796-1 devstack@n-api.service[104099]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8b12689c0 pid: 104099 (default app) Jul 18 02:01:11.402596 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:11.405411 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003360 Jul 18 02:01:11.406189 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:11.423888 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_api:SELECT=3 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:11.425636 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_cell1:SELECT=3 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:11.427017 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_cell0:SELECT=3 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:11.428220 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:12.379540 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-99edfc65-77fc-478c-bf74-7df3e3f94dae admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:12.410352 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-99edfc65-77fc-478c-bf74-7df3e3f94dae admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.994263 Jul 18 02:01:12.411159 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:01:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:01:14.688855 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:14.690521 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-142246ba-811a-4e33-b6ca-b6d7951c8f93 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 18 02:01:14.691071 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:15.175115 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-0ab80e94-65bf-485b-8e04-ecfd51acb805 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:15.193642 n-d-849796-1 devstack@n-api.service[104099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:01:15.193642 n-d-849796-1 devstack@n-api.service[104099]: warnings.warn(msg) Jul 18 02:01:15.222541 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-0ab80e94-65bf-485b-8e04-ecfd51acb805 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525278 Jul 18 02:01:15.223319 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:15.448297 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-33f46c81-c405-4bac-911e-54ba0c1846e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:15.452974 n-d-849796-1 devstack@n-api.service[104100]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:01:15.452974 n-d-849796-1 devstack@n-api.service[104100]: warnings.warn(msg) Jul 18 02:01:15.457631 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_api:SELECT=3 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:15.458558 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_cell0:SELECT=3 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:15.459261 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_cell1:SELECT=3 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:15.460109 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:15.523828 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-33f46c81-c405-4bac-911e-54ba0c1846e4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292075 Jul 18 02:01:15.524792 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Jul 18 02:01:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:17.817547 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-0ab80e94-65bf-485b-8e04-ecfd51acb805 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:17.818519 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-0ab80e94-65bf-485b-8e04-ecfd51acb805 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jul 18 02:01:17.818922 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:18.677951 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-0a097059-4444-4d3f-9fad-9b24dac9ed9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:18.696065 n-d-849796-1 devstack@n-api.service[104100]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:01:18.696065 n-d-849796-1 devstack@n-api.service[104100]: warnings.warn(msg) Jul 18 02:01:18.716478 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-0a097059-4444-4d3f-9fad-9b24dac9ed9e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.884639 Jul 18 02:01:18.725939 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:18.730252 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-b5ab2f68-8463-47f4-b8cf-c1d831156085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:18.731813 n-d-849796-1 devstack@n-api.service[104099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:01:18.731813 n-d-849796-1 devstack@n-api.service[104099]: warnings.warn(msg) Jul 18 02:01:18.767244 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-b5ab2f68-8463-47f4-b8cf-c1d831156085 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040669 Jul 18 02:01:18.768779 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Jul 18 02:01:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:21.239381 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-0a097059-4444-4d3f-9fad-9b24dac9ed9e admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:21.240446 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-0a097059-4444-4d3f-9fad-9b24dac9ed9e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Jul 18 02:01:21.240850 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:21.918228 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-b0639046-ece5-40d6-b094-f565b9bdcae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "id": "d2"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:21.939186 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-b0639046-ece5-40d6-b094-f565b9bdcae8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688279 Jul 18 02:01:21.948741 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:21.953205 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-38aa80d1-f10f-480c-acff-a98e09ae0c2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:21.978354 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-38aa80d1-f10f-480c-acff-a98e09ae0c2a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028827 Jul 18 02:01:21.979565 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Jul 18 02:01:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:01:24.657578 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-b0639046-ece5-40d6-b094-f565b9bdcae8 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:24.659088 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-b0639046-ece5-40d6-b094-f565b9bdcae8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Jul 18 02:01:24.669818 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:25.139021 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-d5bf13ae-5117-4d84-95d9-cb59706f6728 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:25.159231 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-d5bf13ae-5117-4d84-95d9-cb59706f6728 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493513 Jul 18 02:01:25.159718 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:01:25.171996 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-38597e00-7b7a-4c54-acb8-90377c00d888 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:25.198048 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-38597e00-7b7a-4c54-acb8-90377c00d888 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029729 Jul 18 02:01:25.199048 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Jul 18 02:01:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:27.505068 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-d5bf13ae-5117-4d84-95d9-cb59706f6728 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:27.506021 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-d5bf13ae-5117-4d84-95d9-cb59706f6728 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 18 02:01:27.506774 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:28.030100 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:28.076646 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.560281 Jul 18 02:01:28.085492 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:01:28.092711 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-e657c4b4-5883-4612-b60d-901c6946327e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:28.120843 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-e657c4b4-5883-4612-b60d-901c6946327e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031669 Jul 18 02:01:28.121451 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Jul 18 02:01:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:30.483034 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:30.483838 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 18 02:01:30.484402 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:30.989146 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-ef46306c-6459-4a80-bfaf-7712837b2951 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:31.016037 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-ef46306c-6459-4a80-bfaf-7712837b2951 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.524616 Jul 18 02:01:31.037874 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:01:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:01:33.392097 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:33.393396 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-36d1d5dd-bb02-496a-9bea-99ab507d4907 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001861 Jul 18 02:01:33.394100 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:33.915393 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-f974e2cb-ab39-4d74-95ba-d08567fcb56a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:33.938604 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-f974e2cb-ab39-4d74-95ba-d08567fcb56a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.536132 Jul 18 02:01:33.944975 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:01:33.956807 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-c552280c-9f5a-4107-a064-f22caaa3ad43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:33.981834 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-c552280c-9f5a-4107-a064-f22caaa3ad43 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029574 Jul 18 02:01:33.982419 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Jul 18 02:01:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:01:36.490599 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-f974e2cb-ab39-4d74-95ba-d08567fcb56a admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:36.492391 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-f974e2cb-ab39-4d74-95ba-d08567fcb56a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002917 Jul 18 02:01:36.493231 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:37.035015 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-5ffbf227-ae52-4c96-b443-283d1f529cae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:37.057324 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-5ffbf227-ae52-4c96-b443-283d1f529cae admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.556327 Jul 18 02:01:37.058142 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:37.072593 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-d39ded72-62fc-492e-9819-d9f8832bc75f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:37.098554 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-d39ded72-62fc-492e-9819-d9f8832bc75f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029456 Jul 18 02:01:37.098957 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Jul 18 02:01:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:39.665149 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-5ffbf227-ae52-4c96-b443-283d1f529cae admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:39.666173 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-5ffbf227-ae52-4c96-b443-283d1f529cae admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 18 02:01:39.666587 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:40.140747 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-9d5396ae-b7ec-46d0-bf34-b609fdac596f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "vcpus": 2, "ram": 4096}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:40.160976 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-9d5396ae-b7ec-46d0-bf34-b609fdac596f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.487752 Jul 18 02:01:40.161892 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:40.174794 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-02d705ca-1ca9-43a5-a8a4-a11774a90bd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:40.200374 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-02d705ca-1ca9-43a5-a8a4-a11774a90bd0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029994 Jul 18 02:01:40.200983 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Jul 18 02:01:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:01:42.543219 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-9d5396ae-b7ec-46d0-bf34-b609fdac596f admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:42.544202 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-9d5396ae-b7ec-46d0-bf34-b609fdac596f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 02:01:42.544777 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:42.977012 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-9be22dc8-7b52-498b-9ce5-4a7484f9b902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "4", "disk": 80}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:42.993538 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:01:43.009951 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-9be22dc8-7b52-498b-9ce5-4a7484f9b902 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458902 Jul 18 02:01:43.011168 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:43.023288 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-f0c09456-9ca2-49aa-9118-60955230809e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:43.047068 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-f0c09456-9ca2-49aa-9118-60955230809e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027399 Jul 18 02:01:43.048824 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Jul 18 02:01:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:01:45.367013 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-9be22dc8-7b52-498b-9ce5-4a7484f9b902 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:01:45.367983 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-9be22dc8-7b52-498b-9ce5-4a7484f9b902 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jul 18 02:01:45.368403 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:01:45.875769 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "swap": 0, "disk": 160, "vcpus": 8}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:45.897343 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.520956 Jul 18 02:01:45.898096 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Jul 18 02:01:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:01:45.911680 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-41d8af83-d34e-4a74-a46d-31aae26fa482 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:01:45.942079 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-41d8af83-d34e-4a74-a46d-31aae26fa482 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035963 Jul 18 02:01:45.942671 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Jul 18 02:01:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:02:09.864949 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:09.865964 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 18 02:02:09.866364 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:09.876888 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:02:10.272858 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-32b31de0-2a28-4e2d-94e1-b97566a5ed8e admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:10.289753 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-32b31de0-2a28-4e2d-94e1-b97566a5ed8e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417392 Jul 18 02:02:10.290219 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:02:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:02:11.401817 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:11.402821 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-b375c3c8-5d75-44ae-850f-d1f9520fee55 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 18 02:02:11.403223 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:11.969133 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-ef0ed7f6-54fd-46cb-bcd3-e42c3055f4a0 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:11.975464 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.wsgi [None req-ef0ed7f6-54fd-46cb-bcd3-e42c3055f4a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-ef0ed7f6-54fd-46cb-bcd3-e42c3055f4a0 admin admin] Request method failure captured: Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Accept: application/json Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Accept-Encoding: gzip, deflate Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Connection: keep-alive Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Content-Length: 0 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Host: 10.222.0.67 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: Openstack-System-Scope: None Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: User-Agent: python-novaclient Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Auth-Token: gAAAAABi1L8jGju9gpCAJlF-Sz-dhzrA5O5ZGZG3HmeidC0mphuUtk9WDaJcwCrqlMx_R7dIGv7HkZeM5uAdboikI9_UvUoF9izKmXbXotKleEi_ODzR_PrJlRBltefOH-kCxyCg6UF9W_3BiADdF2v3-eQ4ODwMsHNbN_TWwVjQW2Q7uUQzzV0 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Id: None Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Name: None Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Identity-Status: Confirmed Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Is-Admin-Project: True Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Id: default Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Name: Default Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Name: admin Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Role: admin,reader,member Jul 18 02:02:11.978795 n-d-849796-1 devstack@n-api.service[104099]: X-Roles: admin,reader,member Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant: admin Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Name: admin Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-User: admin Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Id: default Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Name: Default Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: X-User-Name: admin Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: method: > Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: exception: Flavor 42 could not be found. Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: action_args: {'id': '42'} Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:11.980394 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:11.981299 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:11.982604 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-ef0ed7f6-54fd-46cb-bcd3-e42c3055f4a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:11.983631 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-ef0ed7f6-54fd-46cb-bcd3-e42c3055f4a0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.419693 Jul 18 02:02:11.984111 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:02:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:02:11.990057 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-0090cd8f-e28a-45a2-8555-6e6fd630db65 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:11.992984 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:02:12.012496 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-0090cd8f-e28a-45a2-8555-6e6fd630db65 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025901 Jul 18 02:02:12.013090 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:12.029971 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-e4661615-6ff0-46bf-9af9-05795706bfb1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:12.050663 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-e4661615-6ff0-46bf-9af9-05795706bfb1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024234 Jul 18 02:02:12.051201 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:12.061316 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1d14bcb5-be66-4683-995f-8d817dfb0e47 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:12.068252 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.wsgi [None req-1d14bcb5-be66-4683-995f-8d817dfb0e47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1d14bcb5-be66-4683-995f-8d817dfb0e47 admin admin] Request method failure captured: Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Accept: application/json Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Accept-Encoding: gzip, deflate Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Connection: keep-alive Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Content-Length: 0 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Host: 10.222.0.67 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: Openstack-System-Scope: None Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: User-Agent: python-novaclient Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Auth-Token: gAAAAABi1L8jGju9gpCAJlF-Sz-dhzrA5O5ZGZG3HmeidC0mphuUtk9WDaJcwCrqlMx_R7dIGv7HkZeM5uAdboikI9_UvUoF9izKmXbXotKleEi_ODzR_PrJlRBltefOH-kCxyCg6UF9W_3BiADdF2v3-eQ4ODwMsHNbN_TWwVjQW2Q7uUQzzV0 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Id: None Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Name: None Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Identity-Status: Confirmed Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Is-Admin-Project: True Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Id: default Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Name: Default Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Name: admin Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Role: admin,reader,member Jul 18 02:02:12.071811 n-d-849796-1 devstack@n-api.service[104100]: X-Roles: admin,reader,member Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant: admin Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Name: admin Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-User: admin Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Id: default Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Name: Default Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: X-User-Name: admin Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: method: > Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: exception: Flavor 42 could not be found. Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: action_args: {'id': '42'} Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:12.073516 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:12.074437 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:12.075519 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1d14bcb5-be66-4683-995f-8d817dfb0e47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:12.076565 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-1d14bcb5-be66-4683-995f-8d817dfb0e47 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015713 Jul 18 02:02:12.076565 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:02:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:02:13.071182 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-e4661615-6ff0-46bf-9af9-05795706bfb1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:13.072216 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-e4661615-6ff0-46bf-9af9-05795706bfb1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 18 02:02:13.072610 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:13.737700 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1417306e-b843-4904-9600-d15290697b2a admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:13.743540 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.wsgi [None req-1417306e-b843-4904-9600-d15290697b2a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1417306e-b843-4904-9600-d15290697b2a admin admin] Request method failure captured: Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Accept: application/json Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Accept-Encoding: gzip, deflate Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Connection: keep-alive Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Content-Length: 0 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Host: 10.222.0.67 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: Openstack-System-Scope: None Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: User-Agent: python-novaclient Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Auth-Token: gAAAAABi1L8k4mzIvcbhZIcAvRKyAOrjLxPZG32E51b1fqXHypkVCSk4ykgFWcrOHUs-Hco3aHyG-EkX9pPr0cGzjt-MVvsfUzeR7AUKpMPGdq8bIxSv1jthbBtgFCULTmw2XRnBe21ucJRL8_Me7YHvPmX_kpSpzOfjTKGY4DV4HUzwNSrlIpA Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Id: None Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Name: None Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Identity-Status: Confirmed Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Is-Admin-Project: True Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Id: default Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Name: Default Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Name: admin Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Role: admin,reader,member Jul 18 02:02:13.745148 n-d-849796-1 devstack@n-api.service[104100]: X-Roles: admin,reader,member Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant: admin Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Name: admin Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-User: admin Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Id: default Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Name: Default Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: X-User-Name: admin Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: method: > Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: exception: Flavor 84 could not be found. Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: action_args: {'id': '84'} Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:13.746738 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:13.747587 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.748688 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-1417306e-b843-4904-9600-d15290697b2a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:13.749788 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-1417306e-b843-4904-9600-d15290697b2a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.533506 Jul 18 02:02:13.749788 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:02:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:02:13.756256 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-018ccd79-f100-4cb8-95bb-15fa12e8f2f5 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:13.770275 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-018ccd79-f100-4cb8-95bb-15fa12e8f2f5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017570 Jul 18 02:02:13.770803 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:13.781357 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-cb4ac7da-10dc-4613-b9c6-16d16adc3a3f admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:13.795565 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-cb4ac7da-10dc-4613-b9c6-16d16adc3a3f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018444 Jul 18 02:02:13.796103 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:13.805997 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-c87e0ee7-77e8-4660-ab4f-9417818a2ea1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:13.811339 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.wsgi [None req-c87e0ee7-77e8-4660-ab4f-9417818a2ea1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-c87e0ee7-77e8-4660-ab4f-9417818a2ea1 admin admin] Request method failure captured: Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Accept: application/json Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Accept-Encoding: gzip, deflate Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Connection: keep-alive Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Content-Length: 0 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Host: 10.222.0.67 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: Openstack-System-Scope: None Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: User-Agent: python-novaclient Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Auth-Token: gAAAAABi1L8k4mzIvcbhZIcAvRKyAOrjLxPZG32E51b1fqXHypkVCSk4ykgFWcrOHUs-Hco3aHyG-EkX9pPr0cGzjt-MVvsfUzeR7AUKpMPGdq8bIxSv1jthbBtgFCULTmw2XRnBe21ucJRL8_Me7YHvPmX_kpSpzOfjTKGY4DV4HUzwNSrlIpA Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Id: None Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Name: None Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Identity-Status: Confirmed Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Is-Admin-Project: True Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Id: default Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Name: Default Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Name: admin Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Role: admin,reader,member Jul 18 02:02:13.812847 n-d-849796-1 devstack@n-api.service[104099]: X-Roles: admin,reader,member Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant: admin Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Name: admin Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-User: admin Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Id: default Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Name: Default Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: X-User-Name: admin Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: method: > Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: exception: Flavor 84 could not be found. Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: action_args: {'id': '84'} Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:13.814493 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:13.815320 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:13.816388 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-c87e0ee7-77e8-4660-ab4f-9417818a2ea1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:13.817435 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-c87e0ee7-77e8-4660-ab4f-9417818a2ea1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012365 Jul 18 02:02:13.817435 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:02:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:02:14.790033 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-cb4ac7da-10dc-4613-b9c6-16d16adc3a3f admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:14.791175 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-cb4ac7da-10dc-4613-b9c6-16d16adc3a3f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 18 02:02:14.791593 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:15.323893 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-98f13c9b-e3b8-417d-b22a-6d64b80781f2 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:15.330327 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.wsgi [None req-98f13c9b-e3b8-417d-b22a-6d64b80781f2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-98f13c9b-e3b8-417d-b22a-6d64b80781f2 admin admin] Request method failure captured: Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Accept: application/json Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Accept-Encoding: gzip, deflate Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Connection: keep-alive Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Content-Length: 0 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Host: 10.222.0.67 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: Openstack-System-Scope: None Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: User-Agent: python-novaclient Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Auth-Token: gAAAAABi1L8mUB-FEXyqxZNgnznDVCv3vaa_0JINn0LeVr10oj3c9ROdueg27jb1mqiJKLmVyUbHDYU_LVg3vGCzpzHXRolNGMTwZ0KRU1CYPUWs13GNdbyypvmfW3ayiCSeuHSEcFVWg1r0pVGOPdcI4LtqHCbGJLFTfxAS4U7WxagbPotOM84 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Id: None Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Domain-Name: None Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Identity-Status: Confirmed Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Is-Admin-Project: True Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Id: default Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Domain-Name: Default Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Project-Name: admin Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Role: admin,reader,member Jul 18 02:02:15.331832 n-d-849796-1 devstack@n-api.service[104099]: X-Roles: admin,reader,member Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant: admin Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-Tenant-Name: admin Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-User: admin Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Id: default Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-User-Domain-Name: Default Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: X-User-Name: admin Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: method: > Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: exception: Flavor 451 could not be found. Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: action_args: {'id': '451'} Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:15.333448 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:15.337629 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.338803 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-98f13c9b-e3b8-417d-b22a-6d64b80781f2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:15.339822 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-98f13c9b-e3b8-417d-b22a-6d64b80781f2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405304 Jul 18 02:02:15.339822 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:02:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:02:15.343008 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-d14992ce-40de-486e-8c9c-de3654435cb1 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:15.357152 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-d14992ce-40de-486e-8c9c-de3654435cb1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017733 Jul 18 02:02:15.357682 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:15.367083 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:15.381754 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018101 Jul 18 02:02:15.382287 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:02:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:02:15.392225 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-87ee2df0-a469-4ad4-a288-7883ab5aa34a admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:15.397834 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.wsgi [None req-87ee2df0-a469-4ad4-a288-7883ab5aa34a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-87ee2df0-a469-4ad4-a288-7883ab5aa34a admin admin] Request method failure captured: Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Accept: application/json Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Accept-Encoding: gzip, deflate Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Connection: keep-alive Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Content-Length: 0 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Host: 10.222.0.67 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Openstack-Api-Version: compute 2.90 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: Openstack-System-Scope: None Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: User-Agent: python-novaclient Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Auth-Token: gAAAAABi1L8mUB-FEXyqxZNgnznDVCv3vaa_0JINn0LeVr10oj3c9ROdueg27jb1mqiJKLmVyUbHDYU_LVg3vGCzpzHXRolNGMTwZ0KRU1CYPUWs13GNdbyypvmfW3ayiCSeuHSEcFVWg1r0pVGOPdcI4LtqHCbGJLFTfxAS4U7WxagbPotOM84 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Id: None Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Domain-Name: None Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Identity-Status: Confirmed Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Is-Admin-Project: True Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Id: default Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Domain-Name: Default Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Project-Name: admin Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Role: admin,reader,member Jul 18 02:02:15.399341 n-d-849796-1 devstack@n-api.service[104100]: X-Roles: admin,reader,member Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ba5ec5c070ad4302808d664784e1a578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant: admin Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Id: ba5ec5c070ad4302808d664784e1a578 Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-Tenant-Name: admin Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-User: admin Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Id: default Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-User-Domain-Name: Default Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-User-Id: 2b4561f6df424fcbb0dca1957cc34e50 Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: X-User-Name: admin Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: method: > Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: exception: Flavor 451 could not be found. Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: action_args: {'id': '451'} Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:02:15.400900 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:15.401923 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: ERROR nova.api.openstack.wsgi Jul 18 02:02:15.403204 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-87ee2df0-a469-4ad4-a288-7883ab5aa34a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:02:15.404417 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-87ee2df0-a469-4ad4-a288-7883ab5aa34a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012683 Jul 18 02:02:15.404417 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:02:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:02:16.375236 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:16.377096 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Jul 18 02:02:16.377491 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:16.921499 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-9d791c57-7be7-4793-9d3f-4e43dca2936e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:02:16.942167 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-9d791c57-7be7-4793-9d3f-4e43dca2936e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.427210 Jul 18 02:02:16.942710 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Jul 18 02:02:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:02:17.939954 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:17.941026 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 18 02:02:17.941424 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:18.476815 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-2bb5eabc-e2f6-4bff-a4c7-ea51e27453ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:02:18.493992 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-2bb5eabc-e2f6-4bff-a4c7-ea51e27453ef admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.415552 Jul 18 02:02:18.494541 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Jul 18 02:02:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:02:19.466297 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:19.467321 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 18 02:02:19.467705 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:20.006509 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-de3accc1-4d63-4bdf-b2a6-1af95b8c725f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:02:20.024100 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-de3accc1-4d63-4bdf-b2a6-1af95b8c725f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.416575 Jul 18 02:02:20.024647 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Jul 18 02:02:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:02:21.005534 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:21.006534 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 18 02:02:21.006926 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:21.544095 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-e0253a57-0188-453a-b791-347c855fe2a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:02:21.562036 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-e0253a57-0188-453a-b791-347c855fe2a2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.418801 Jul 18 02:02:21.562570 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Jul 18 02:02:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:02:22.550750 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:22.551755 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 18 02:02:22.552152 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:02:23.090533 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-f2a08c67-e1da-4ae1-9058-b83debe114c2 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:02:23.110113 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-f2a08c67-e1da-4ae1-9058-b83debe114c2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420684 Jul 18 02:02:23.110560 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Mon Jul 18 02:02:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:03:15.231868 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.232868 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-19b4477f-7d76-4496-9119-975af55e3ff1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 18 02:03:15.233284 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:03:15.243639 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:03:15.632427 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-a0c321bd-c6f0-4c6a-a758-90ab1ba553bb admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.651805 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-a0c321bd-c6f0-4c6a-a758-90ab1ba553bb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412646 Jul 18 02:03:15.652354 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:03:15.674661 n-d-849796-1 devstack@n-api.service[104099]: DEBUG dbcounter [-] [104099] Writing DB stats nova_api:SELECT=14 {{(pid=104099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:03:15.678638 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-02dc3e9f-640b-4d22-b78f-b8aba59e72a3 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.686647 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-02dc3e9f-640b-4d22-b78f-b8aba59e72a3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014021 Jul 18 02:03:15.687176 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:03:15.698937 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-04bc60ff-46da-4c0d-b63d-47abce1f4b17 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.706591 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-04bc60ff-46da-4c0d-b63d-47abce1f4b17 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011308 Jul 18 02:03:15.707105 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:03:15.718401 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.726525 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011794 Jul 18 02:03:15.727047 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:03:15.739459 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-9b5883a4-98a3-476b-b331-c756d69ecc5c admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:03:15.747809 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-9b5883a4-98a3-476b-b331-c756d69ecc5c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013092 Jul 18 02:03:15.748335 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Mon Jul 18 02:03:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:09:13.114534 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:13.116150 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Jul 18 02:09:13.116877 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:09:13.262575 n-d-849796-1 devstack@n-api.service[104100]: DEBUG dbcounter [-] [104100] Writing DB stats nova_api:SELECT=6 {{(pid=104100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:09:13.429129 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:13.430407 n-d-849796-1 devstack@n-api.service[104100]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:13.430407 n-d-849796-1 devstack@n-api.service[104100]: warnings.warn(msg) Jul 18 02:09:13.431700 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:13.432150 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:13.433412 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:13.433852 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:13.479665 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-d31d6240-cb73-4d23-912a-08595e9f0eae admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.218446 Jul 18 02:09:13.480258 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:09:13 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:09:14.361709 n-d-849796-1 devstack@n-api.service[104099]: DEBUG nova.api.openstack.wsgi [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] Calling method '>' {{(pid=104099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:14.363190 n-d-849796-1 devstack@n-api.service[104099]: INFO nova.api.openstack.requestlog [None req-4ad69517-7021-4989-adc2-044dad7a2273 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jul 18 02:09:14.363609 n-d-849796-1 devstack@n-api.service[104099]: [pid: 104099|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Jul 18 02:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:09:14.573572 n-d-849796-1 devstack@n-api.service[104100]: DEBUG nova.api.openstack.wsgi [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] Calling method '>' {{(pid=104100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:09:14.575047 n-d-849796-1 devstack@n-api.service[104100]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:09:14.575047 n-d-849796-1 devstack@n-api.service[104100]: warnings.warn(msg) Jul 18 02:09:14.576381 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.576836 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.578612 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:09:14.579115 n-d-849796-1 devstack@n-api.service[104100]: DEBUG oslo_concurrency.lockutils [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:09:14.604679 n-d-849796-1 devstack@n-api.service[104100]: INFO nova.api.openstack.requestlog [None req-e00fc409-34a9-41e3-9f93-e9387e7f41b1 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.092812 Jul 18 02:09:14.605300 n-d-849796-1 devstack@n-api.service[104100]: [pid: 104100|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:09:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:09:59.554479 n-d-849796-1 devstack@n-api.service[104098]: Mon Jul 18 02:09:59 2022 - graceful shutdown triggered... Jul 18 02:09:59.555400 n-d-849796-1 devstack@n-api.service[104099]: Gracefully killing worker 1 (pid: 104099)... Jul 18 02:09:59.556009 n-d-849796-1 devstack@n-api.service[104100]: Gracefully killing worker 2 (pid: 104100)... Jul 18 02:09:59.558349 n-d-849796-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 02:10:00.555442 n-d-849796-1 devstack@n-api.service[104098]: worker 1 buried after 1 seconds Jul 18 02:10:00.555442 n-d-849796-1 devstack@n-api.service[104098]: worker 2 buried after 1 seconds Jul 18 02:10:00.555442 n-d-849796-1 devstack@n-api.service[104098]: goodbye to uWSGI. Jul 18 02:10:00.557998 n-d-849796-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 18 02:10:00.558610 n-d-849796-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 02:10:00.563143 n-d-849796-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 02:10:00.582516 n-d-849796-1 devstack@n-api.service[119427]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 02:10:00 2022] *** Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: nodename: n-d-849796-1 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: machine: x86_64 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: clock source: unix Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: pcre jit disabled Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: detected number of CPU cores: 4 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: current working directory: / Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: detected binary path: /usr/bin/uwsgi-core Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: your processes number limit is 47680 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: your memory page size is 4096 bytes Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: detected max file descriptor number: 2048 Jul 18 02:10:00.601450 n-d-849796-1 devstack@n-api.service[119427]: lock engine: pthread robust mutexes Jul 18 02:10:00.603321 n-d-849796-1 devstack@n-api.service[119427]: thunder lock: enabled Jul 18 02:10:00.603321 n-d-849796-1 devstack@n-api.service[119427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 02:10:00.603321 n-d-849796-1 devstack@n-api.service[119427]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 02:10:00.659034 n-d-849796-1 devstack@n-api.service[119427]: Python main interpreter initialized at 0x55b543d449c0 Jul 18 02:10:00.659034 n-d-849796-1 devstack@n-api.service[119427]: python threads support enabled Jul 18 02:10:00.659034 n-d-849796-1 devstack@n-api.service[119427]: your server socket listen backlog is limited to 100 connections Jul 18 02:10:00.659034 n-d-849796-1 devstack@n-api.service[119427]: your mercy for graceful operations on workers is 90 seconds Jul 18 02:10:00.659702 n-d-849796-1 devstack@n-api.service[119427]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 02:10:00.659702 n-d-849796-1 devstack@n-api.service[119427]: *** Operational MODE: preforking *** Jul 18 02:10:00.659947 n-d-849796-1 devstack@n-api.service[119427]: *** uWSGI is running in multiple interpreter mode *** Jul 18 02:10:00.659947 n-d-849796-1 devstack@n-api.service[119427]: spawned uWSGI master process (pid: 119427) Jul 18 02:10:00.660087 n-d-849796-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 18 02:10:00.661575 n-d-849796-1 devstack@n-api.service[119427]: spawned uWSGI worker 1 (pid: 119439, cores: 1) Jul 18 02:10:00.661575 n-d-849796-1 devstack@n-api.service[119427]: spawned uWSGI worker 2 (pid: 119440, cores: 1) Jul 18 02:10:00.661575 n-d-849796-1 devstack@n-api.service[119427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 02:10:01.437833 n-d-849796-1 devstack@n-api.service[119439]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:10:01.441649 n-d-849796-1 devstack@n-api.service[119440]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:10:02.772193 n-d-849796-1 devstack@n-api.service[119440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:10:02.772193 n-d-849796-1 devstack@n-api.service[119440]: from cryptography.utils import int_from_bytes Jul 18 02:10:02.773431 n-d-849796-1 devstack@n-api.service[119440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:10:02.773431 n-d-849796-1 devstack@n-api.service[119440]: from cryptography.utils import int_from_bytes Jul 18 02:10:02.829636 n-d-849796-1 devstack@n-api.service[119439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:10:02.829636 n-d-849796-1 devstack@n-api.service[119439]: from cryptography.utils import int_from_bytes Jul 18 02:10:02.830597 n-d-849796-1 devstack@n-api.service[119439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:10:02.830597 n-d-849796-1 devstack@n-api.service[119439]: from cryptography.utils import int_from_bytes Jul 18 02:10:05.445153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:10:05.446005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:10:05.446005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:10:05.446307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:10:05.446670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:10:05.447004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.447342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.447675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.448012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.448346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.448674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.449058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.449386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.449724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.449990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.450330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.450828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849796-1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.451345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.451678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.451678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.452394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.452702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.453074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.453406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.453934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.455050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.455050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.455334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.455707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.456025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.456348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.456710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.457082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.457425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.457766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.458249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849796-1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.458506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.458831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.459155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.459607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.459917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.460238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.460569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.460905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.461259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.461592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.461922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.462255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.462585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.462968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.463219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.463542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.463875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.464192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.464623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.464813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.465215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.465436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.465769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.466104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.466906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.467320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.467953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.468289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.468614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.468946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.469351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.469602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.469921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.470261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.470555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.470873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.471205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.471528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.471862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.472180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.472526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.473133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.473357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.473567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.473899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.474230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.474543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.475144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.475373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.475561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.475810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.476126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.476456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.476810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.477156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.477416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.477726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.478042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.478368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.478682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.479000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.479314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.479624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.480649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.480649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.480649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.481254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.481254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.481634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.482287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.482287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.482739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.483274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.483614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.484012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.484251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.484576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.484945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.485657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.485657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.486087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.486299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.486507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.486831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.487159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.487475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.487792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.488123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.488434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.488752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.489111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.489429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.489743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.490057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.490370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.490682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.490994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.491305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.491616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.492070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.492328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.492579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.492900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.493274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.493612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.493946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:05.494296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.494645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.495037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.495740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.495740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.496200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.496430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.496643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.500957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.502451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.503965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.503965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.503965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.503965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.503965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.505048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.505048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.505048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.506775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.507392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.507392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.507816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.508056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.508386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.508745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.509147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.509554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.509801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.510034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.510514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.510758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.511001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.511394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.511626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.511997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.512230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.512547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.512899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.513395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.513963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.514513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.514836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.515164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.515491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.516291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.516291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.516825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.516825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.517236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.517430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.517738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.518056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.518454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.518795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.519030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.519361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.519835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.520105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.520311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.520608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.520972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.521300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.521705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.521960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.522305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.522608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.522983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.523266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.523595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.523947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.524229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.524676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.525065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.525324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.525651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.526089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.526607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.526607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.526966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.527178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.527535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.527859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.529703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.529703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.530651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.531054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.531374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.531823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.532107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.532455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.532798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.533164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.533500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.533829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.534156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.534482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.534808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.535148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.535618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.536044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.536480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.537106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.537106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.537552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.537552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.538022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.538245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.538567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.538897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.539236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.539561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.539889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.540219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.540543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.540867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.541365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.541696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.542024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.542353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.542679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.543154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.543314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.543649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.543966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.544684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.545375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.545835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.546161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.546583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.546843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.547270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.547502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.547735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.548054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.548368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.548688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.549051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.549373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.549695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.550010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.550357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.550653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.550970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.551284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.551608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.551946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.552264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.552594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.552954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.553267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.553587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.553918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.554240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.554552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.554865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.555177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.555534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.555857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.556169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.556494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.556876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.557160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.557796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.558058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.558378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.558715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.559040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.559356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.559676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.560857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.561487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.561878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.562225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.562552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.562879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.563205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.563551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.563876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.564232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.565737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.566135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.566486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.566838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.567153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.567490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.567848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.568199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.568560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.573043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.573043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.573471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.573795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.576901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.577966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.577966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.577966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.578368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.578499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.579277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.579277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.579697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.579834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.580177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.580419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.581098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.581098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.581614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.581868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.582192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.582494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.583345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.583345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.583761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.583898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.584325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.584479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.584725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.585093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.585402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.585728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.586053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.586833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.586833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.587366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.587366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.587841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.588080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.588314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.588560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.588955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.589310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.589573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.589897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.590889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.590889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.590889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.596372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.598289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.600131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.603041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.604869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.607626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.609341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.610595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.610595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.610595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.610595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.611371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.611371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.611810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.611810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.612966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.612966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.612966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.613728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.613728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.613728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.614389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.614389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.614843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.615074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.615289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.615551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.615965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.616290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.616613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.616965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.617281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.617603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.617934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.618262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.618573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.619025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.619345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.619666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.619986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.620303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.620613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.620958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.621299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.621726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.621926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.622247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.623894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.623894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.624380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.624735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.625104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.625426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.626026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.626289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.626533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.626813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.627173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.627518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.627839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.628165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.628486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.628820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.629316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.629496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.629811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.630130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.630462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.630798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.631123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.631580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.631898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.632234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.632557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.632890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.633256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.633571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.633886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.634216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.634530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.634840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.635179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.635493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.635817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.636138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.636445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.636760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.637120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.637463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.637775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.638177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.638560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.639150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.639637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.639961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.640301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.640625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.640974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.641297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.641615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.641980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.642296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.642632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.642974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.643315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.643639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.643994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.644337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.644677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.645052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.645480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.645745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.646426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.646426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.646719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.647017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.648187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.648526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.648832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.649181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.649496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.649846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.650165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.650501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.650824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.651160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.651456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.651773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.652137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.652581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.653042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.653295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.653694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.654029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.654597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.655076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.655397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.655733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.656064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.656400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.656726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.657077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.657408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.657727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.658058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.658385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.658714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.659365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.659649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.659977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.660303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.660624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.662990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.663251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.663549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.663865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.664198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.664523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.664853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.665212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.665593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.665920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.666242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.666567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.666896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.667229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.667572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.667874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.668197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.668520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.668845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.669217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.670084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.670590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.671195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.671563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.671900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.672228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.672554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.672884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.673512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.673841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.674200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.674526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.674861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.675187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.675516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.675856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.676173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.676490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.676813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.677179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.677496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.677836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.678154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.678477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.678801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.679120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.679731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.680089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.680417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.680757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.681123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.681455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.681963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.682192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.682652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.683020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.683305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.683680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.683940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.684260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.684603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.685197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.685650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.685988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.686425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.686774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.687165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.687407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.687729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.688052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.688367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.688682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.689032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.689411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.689854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.690063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.690364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.690681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.691002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.691320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.691644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.692019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.692365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.692680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.693189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.693444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.693678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.694017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.694344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.694665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.695042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.695449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.695977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.696325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.696662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.697048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.697429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.697707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.698016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.698337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.698675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.698994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.699317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.699638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.700091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.700322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.701117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.701638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.702459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.702789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.703186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.703575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.703795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.704049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.704385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.704748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.705112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.705445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.705816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.706091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.706419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.706741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.707063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.707384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.707731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.708048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.708378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.708696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.709945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.709945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.709945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.710586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.710586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.711019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.711346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.711539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.711747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.712007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.712349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.712700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.713132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.713402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.713867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.714077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.714323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.714647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.714976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.715300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.715615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.716002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.716324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.717380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.717792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.718039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.718367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.718696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.719015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.719336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.719834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.720065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.720281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.720606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.720907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.721275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.721721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.721939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.722220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.722512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.722871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.723382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.723602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.723977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.724177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.724496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.724815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.725179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.725520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.725852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.726239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.726515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.726836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.727158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.727483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.727803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.728165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.728425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.728774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.729141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.729471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.729787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.730116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.730451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.730776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.731095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.731438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.732395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.743943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.745679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:05.747108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:10:05.905865 n-d-849796-1 devstack@n-api.service[119440]: INFO dbcounter [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Registered counter for database nova_api Jul 18 02:10:05.929593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_db.sqlalchemy.engines [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:05.938054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writer thread running {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:06.000766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.context [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119440) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:10:06.006845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:06.007387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:06.008311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:06.010567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:06.013643 n-d-849796-1 devstack@n-api.service[119440]: INFO dbcounter [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Registered counter for database nova_cell0 Jul 18 02:10:06.018931 n-d-849796-1 devstack@n-api.service[119440]: INFO dbcounter [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Registered counter for database nova_cell1 Jul 18 02:10:06.030729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_db.sqlalchemy.engines [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:06.034524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_db.sqlalchemy.engines [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:06.041092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writer thread running {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:06.041431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writer thread running {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:06.201963 n-d-849796-1 devstack@n-api.service[119440]: INFO dbcounter [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Registered counter for database nova_cell0 Jul 18 02:10:06.209744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_db.sqlalchemy.engines [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:06.215176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writer thread running {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:06.295153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:10:06.296202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:10:06.296202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:10:06.296533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:10:06.296533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:10:06.296980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.297318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.297645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.297970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.298306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.298620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.298956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.299284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.299617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.299885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.300207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.300537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-849796-1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.300868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.301230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.301548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.301875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.302188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.302516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.302831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.303364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.303678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.303987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.304307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.304657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.305003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.305321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.305647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.305960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.306292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.306605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.307022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-849796-1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.307344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.307932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.308248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.308673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.309015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.309339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.309667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.310585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.310905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.311242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.311568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.311893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.312726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.313077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.313405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.313722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.314049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.314357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.314669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.314942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.315235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.315564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.315890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.316210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.316469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.316727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.317079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.317402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.317715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.318031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.318341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.318654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.318967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.319288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.319597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.319911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.320234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.320551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.320880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.321219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.321544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.321959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.322211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.322531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.322871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.323197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.323514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.323833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.324166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.324480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.324787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.325126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.325457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.325873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.326183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.326443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.326755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.327064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.327387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.327700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.328012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.328324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.328629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.328977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.329271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.329585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.329897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.330210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.330518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.330827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.331137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.331441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.331828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.332157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.332468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.332776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.333113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.333425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.333753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.334060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.334370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.334703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.335014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.335321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.335648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.335960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.336269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.336590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.336892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.337229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.337557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.337865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.338173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.338477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.338793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.339102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.339409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.339721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.340029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.340332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.340656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.341005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.341897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.342182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.342491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.342961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:10:06.343209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.343617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.343856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.344193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.344639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.344854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.345215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.345684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.345866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.346174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.346549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.346809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.347376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.347672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.348167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.348386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.348646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.349039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.349319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.349638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.349968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.350342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.350635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.350955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.351453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.353513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.353513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.353513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.353513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.353513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.354935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.354935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.354935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.354935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.355608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.355608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.355921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.356100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.356247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.356576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.357615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.358306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.358561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.358869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.359200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.359531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.359930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.360274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.360576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.360895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.361236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.361551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.361869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.362184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.362574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.362860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.363221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.363636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.363849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.364334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.364510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.364802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.365146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.365468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.365785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.366096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.366435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.366749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.367062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.367394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.367705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.368015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.368338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.368656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.369033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.369315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.369636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.369973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.370291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.370610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.370958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.371299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.371609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.371932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.372268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.372814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.373040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.373252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.373753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.373923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.374170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.374575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.374786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.375102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.375411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.375717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.376031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.376365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.376678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.377123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.377367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.377648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.378004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.378318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.378677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.379224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.379783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.380117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.380464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.380795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.381144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.381467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.381787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.382102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.382425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.382790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.383142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.383398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.383992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.383992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.384469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.385167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.385167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.385623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.385623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.386226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.386549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.386892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.387198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.387604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.387875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.388719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.389709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.389709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.389709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.390237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.390396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.390769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.391088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.391480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.391723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.392052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.392397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.392739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.393083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.393404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.393799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.394428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.394428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.394735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.394989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.395467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.395686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.395924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.396227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.396540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.396855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.397247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.397610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.397819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.398133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.398451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.398785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.399109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.399438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.399772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.400083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.400396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.400725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.401066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.401382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.401692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.402028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.402359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.402677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.402985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.403311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.403660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.404766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.405225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.405710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.405950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.406169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.406532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.406802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.407122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.407439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.407757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.408071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.408405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.408720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.409062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.409383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.409693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.410017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.410342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.410944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.411288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.411614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.411937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.412268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.412594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.412991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.413295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.413659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.413974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.414291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.414849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.415023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.415221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.415535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.415956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.416157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.416774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.417113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.417429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.417741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.418055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.418382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.418720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.419042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.419382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.419724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.420047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.420564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.420884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.421227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.421585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.421896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.422248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.422585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.422962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.423241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.423555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.423884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.424199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.424509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.424818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.425158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.426242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.426667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.426864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.427189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.427509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.427827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.428138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.428453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.428764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.429115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.429428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.429735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.430053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.430375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.430689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.431001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.431344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.431654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.431981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.432295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.432884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.433226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.433559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.433880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.434202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.434542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.434863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.435221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.435688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.436009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.436311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.436727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.437159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.437387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.437610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.437922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.438458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.438702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.438961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.439250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.439479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.439765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.440220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.440447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.440664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.441025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.441363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.441675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.441985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.442312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.442622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.442981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.443310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.443693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.444113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.444368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.444701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.445050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.445386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.445701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.446012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.446322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.446647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.446969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.447298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.447622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.447910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.448234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.448553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.448879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.449231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.479565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.483139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.484587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.486392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.490531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.493016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.495246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.497127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.499158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.500740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.502803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.502803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.502803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.503213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.503672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.504173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.504814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.505298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.505928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.506479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.507004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.507575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.508196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.509267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.509267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.509753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.510427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.510963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.511517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.512140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.512636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.513876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.514294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.514856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.515385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.515921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.516504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.517095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.517588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.518235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.518647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.519166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.519691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.520223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.520748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.521298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.521819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.522378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.522899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.523445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.524068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.524499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.525382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.525569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.526162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.526680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.527247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.527791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.528370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.530174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.530716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.531268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.531806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.532443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.532866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.533435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.533972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.534500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.535020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.535549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.536085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.536636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.537220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.538344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.538751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.539268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.539795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.540328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.540854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.541433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.541968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.542603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.543039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.543543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.544104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.545230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.545777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.546343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.546892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.547425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.547962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.548540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.549128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.549665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.550186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.550713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.551659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.551828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.552398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.552952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.553504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.554032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.554571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.555786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.555786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.556147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.556698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.557299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.558106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.558733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.559175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.559713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.561351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.562132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.562688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.563237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.563780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.564317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.564863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.565474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.565992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.566512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.567086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.567613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.568134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.568681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.569248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.569768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.570315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.570839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.571817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.572396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.572960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.573520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.574071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.574606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.575128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.576347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.576901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.577450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.577996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.578521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.579040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.579568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.580111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.580637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.581200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.581728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.582248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.582810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.583331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.583854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.584377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.584908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.585459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.585964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.586483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.587003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.587540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.588055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.588576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.589125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.589656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.590174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.590705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.591344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.591937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.592454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.593016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.593560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.594087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.594634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.595168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.595705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.596305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.596841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.597878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.598431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.598979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.599535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.600091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.600601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.601153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.601672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.602233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.602770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.603301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.603828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.604365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.604902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.605476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.606020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.606526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.607589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.608125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.608655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.609222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.609757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.610299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.610889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.611436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.611969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.612512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.613087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.613611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.614153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.614672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.615193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.615742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.616301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.616841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.617398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.618113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.618643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.619186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.619735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.620261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.620804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.621385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.621893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.622994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.623659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.624210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.624781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.625355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.625908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.626432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.626950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.627469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.627994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.628546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.629106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.629629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.630147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.630688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.631210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.631731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.632259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.632769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.633320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.633838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.634359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.634881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.635400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.635922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.636444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.637011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.637531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.638588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.640767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.641432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.641971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.642593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.643202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.643783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.644328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.644892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.645460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.646015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.646563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.647141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.647726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.648295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.648879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.649447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.649989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.650519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.651058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.651595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.652206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.652779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.653351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.654644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.655176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.655709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.656258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.656801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.657375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.658471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.659024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.659648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.660182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.660717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.661276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.661820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.662351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.662891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.663430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.664154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.664720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.665306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.665820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.666374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.666926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.667726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.668264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.668841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.669659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.670202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.670732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.671248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:10:06.671664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:10:06.733942 n-d-849796-1 devstack@n-api.service[119440]: WARNING keystonemiddleware.auth_token [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:10:06.746851 n-d-849796-1 devstack@n-api.service[119440]: WARNING keystonemiddleware.auth_token [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:10:06.929731 n-d-849796-1 devstack@n-api.service[119439]: INFO dbcounter [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Registered counter for database nova_api Jul 18 02:10:06.970077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_db.sqlalchemy.engines [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:06.983219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writer thread running {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:07.100794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.context [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119439) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:10:07.109341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:07.113371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:07.114940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:10:07.119018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:10:07.121033 n-d-849796-1 devstack@n-api.service[119440]: WARNING keystonemiddleware.auth_token [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:10:07.123789 n-d-849796-1 devstack@n-api.service[119439]: INFO dbcounter [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Registered counter for database nova_cell0 Jul 18 02:10:07.128123 n-d-849796-1 devstack@n-api.service[119440]: WARNING keystonemiddleware.auth_token [None req-957e46d9-2c37-44a7-a54f-76279235136b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:10:07.131932 n-d-849796-1 devstack@n-api.service[119439]: INFO dbcounter [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Registered counter for database nova_cell1 Jul 18 02:10:07.133866 n-d-849796-1 devstack@n-api.service[119440]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b543d449c0 pid: 119440 (default app) Jul 18 02:10:07.145702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_db.sqlalchemy.engines [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:07.147934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_db.sqlalchemy.engines [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:07.159904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writer thread running {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:07.162379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writer thread running {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:07.431436 n-d-849796-1 devstack@n-api.service[119439]: INFO dbcounter [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Registered counter for database nova_cell0 Jul 18 02:10:07.440271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_db.sqlalchemy.engines [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:10:07.444906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writer thread running {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:10:07.797085 n-d-849796-1 devstack@n-api.service[119439]: WARNING keystonemiddleware.auth_token [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:10:07.806002 n-d-849796-1 devstack@n-api.service[119439]: WARNING keystonemiddleware.auth_token [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:10:08.178598 n-d-849796-1 devstack@n-api.service[119439]: WARNING keystonemiddleware.auth_token [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:10:08.186014 n-d-849796-1 devstack@n-api.service[119439]: WARNING keystonemiddleware.auth_token [None req-29163344-e5f7-4e6e-9442-2c284646a406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:10:08.191721 n-d-849796-1 devstack@n-api.service[119439]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55b543d449c0 pid: 119439 (default app) Jul 18 02:10:58.777194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:58.779711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:58.781270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:58.783393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:59.274870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:59.278257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:59.281000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:10:59.283667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:00.793817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Calling method '.version_select at 0x7fab07f65820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:00.796984 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:00.796984 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:00.804574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119440) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 02:11:00.805915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.806631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.850958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.852668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.876951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:00.877854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:00.888099 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53e389ec-fb68-42f3-93c8-6ebab743420d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 2.128729 Jul 18 02:11:00.889326 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1207 bytes} [Mon Jul 18 02:10:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:11:00.905569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13239d55-b465-4380-a151-55587c7fd11d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1143798840"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:00.940597 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:00.940597 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:00.942795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-13239d55-b465-4380-a151-55587c7fd11d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Generated uuid b8310e41-8fa9-4e70-913c-0b4d93265bdd for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:11:01.059449 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13239d55-b465-4380-a151-55587c7fd11d tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.157407 Jul 18 02:11:01.064154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2/2] 10.222.0.67 () {62 vars in 1204 bytes} [Mon Jul 18 02:11:00 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:11:01.076403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64bb37a0-2795-42aa-ae2e-64e3bb326521 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-386734920"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:01.285248 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:01.285248 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:01.298840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '.version_select at 0x7fab07f2f820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.303205 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:01.303205 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:01.313041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119439) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 18 02:11:01.314293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.314999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.393288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.393749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.406349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64bb37a0-2795-42aa-ae2e-64e3bb326521 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.334893 Jul 18 02:11:01.407317 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3/3] 10.222.0.67 () {62 vars in 1209 bytes} [Mon Jul 18 02:11:01 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:01.432068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.439899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:01.455886 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-80cec6b2-7328-43ef-a239-ab22915aa346 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 2.197881 Jul 18 02:11:01.457508 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1/4] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:10:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:01.468330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7f37b4f-6f86-40d1-88d9-af481b9d5ef2 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:01.470119 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:01.470119 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:01.520124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7f37b4f-6f86-40d1-88d9-af481b9d5ef2 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.057827 Jul 18 02:11:01.521742 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2/5] 10.222.0.67 () {60 vars in 1189 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:01.548768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6025b61-b60b-4dd0-9246-d4063a63c596 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:01.552067 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:01.552067 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:01.595792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6025b61-b60b-4dd0-9246-d4063a63c596 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:01.596451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6025b61-b60b-4dd0-9246-d4063a63c596 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.106707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.110355 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:02.110355 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:02.112267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.112973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.114246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.114841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.170475 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e96c68ef-194d-4bc0-b61d-1ec9d61768d4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.761583 Jul 18 02:11:02.177909 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4/6] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:11:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:02.347473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d46e72f-191c-41e4-8c5e-2c9be750b89b tempest-AZAdminNegativeTestJSON-1403249731 tempest-AZAdminNegativeTestJSON-1403249731-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.348433 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:02.348433 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:02.349683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d46e72f-191c-41e4-8c5e-2c9be750b89b tempest-AZAdminNegativeTestJSON-1403249731 tempest-AZAdminNegativeTestJSON-1403249731-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '7165f713f60f453b88e7a75bbb022656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76388929327e44e3864b7fdfc9d0a1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d46e72f-191c-41e4-8c5e-2c9be750b89b tempest-AZAdminNegativeTestJSON-1403249731 tempest-AZAdminNegativeTestJSON-1403249731-project] Request method failure captured: Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MExyRtL3kWJzpwFB2USmIZZNqY47tPLdw-QgwC0d6LkyC1h142ALR83bkRAUvSLk9Ph0gjnCyUpixzZJoT-Sm8HrPuKmhOpVKjbds57c9sQx_SYxVrtrMknr9GZs33dtsYc3_5Gk0rXrKk52H0M5pkegIGH8X6RVac5lFkf_99SzPo Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 76388929327e44e3864b7fdfc9d0a1cc Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1403249731 Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:11:02.353253 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76388929327e44e3864b7fdfc9d0a1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_76388929327e44e3864b7fdfc9d0a1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/76388929327e44e3864b7fdfc9d0a1cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/76388929327e44e3864b7fdfc9d0a1cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AZAdminNegativeTestJSON-1403249731 Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 76388929327e44e3864b7fdfc9d0a1cc Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1403249731 Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AZAdminNegativeTestJSON-1403249731-project Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7165f713f60f453b88e7a75bbb022656 Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AZAdminNegativeTestJSON-1403249731-project Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:11:02.354389 n-d-849796-1 devstack@n-api.service[119440]: action_args: {} Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:11:02.354987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 18 02:11:02.356515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:02.360189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d46e72f-191c-41e4-8c5e-2c9be750b89b tempest-AZAdminNegativeTestJSON-1403249731 tempest-AZAdminNegativeTestJSON-1403249731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:02.362428 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d46e72f-191c-41e4-8c5e-2c9be750b89b tempest-AZAdminNegativeTestJSON-1403249731 tempest-AZAdminNegativeTestJSON-1403249731-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.182868 Jul 18 02:11:02.367996 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 5/7] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:02.551312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab06505f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:02.552294 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:02.552294 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:02.553584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.554049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.610409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.610867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.650025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:02.650525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:02.670814 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40c15e46-6f47-4de8-aef6-c14dfca4df2f tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.302851 Jul 18 02:11:02.673130 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 6/8] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:03.276724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d0a65e5-adaf-4fcf-9264-f64457ede500 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-644187344", "id": 1925376491, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:03.279515 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.279515 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:03.380390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d0a65e5-adaf-4fcf-9264-f64457ede500 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.704890 Jul 18 02:11:03.383843 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 7/9] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:11:02 2022] POST /compute/v2.1/flavors => generated 470 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:03.395259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab064bfaf0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.400727 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.400727 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:03.402869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.406059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.473670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.475949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.508156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.509454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.528056 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efc913ae-9d0d-4723-8f2b-00f3a9a329f5 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.140472 Jul 18 02:11:03.528955 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 8/10] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:03.645358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6025b61-b60b-4dd0-9246-d4063a63c596 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 2.114137 Jul 18 02:11:03.651695 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3/11] 10.222.0.67 () {62 vars in 1231 bytes} [Mon Jul 18 02:11:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:03.667690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35025c78-735e-4e44-9224-051be248da96 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:03.670348 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.670348 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:03.825850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e4b0e74-e421-41e3-8c29-189779c95d1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1585351101", "id": 1605086213, "os-flavor-access:is_public": "False"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:03.827783 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.827783 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:03.863459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e4b0e74-e421-41e3-8c29-189779c95d1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.327267 Jul 18 02:11:03.864615 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 9/12] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:03 2022] POST /compute/v2.1/flavors => generated 439 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:03.877893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab06475430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:03.879882 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.879882 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:03.882021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.882887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.903437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.904663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.942412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.943693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:03.957730 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a43353b-c95d-411b-8a5b-daccabbc6b8b tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.091805 Jul 18 02:11:03.958494 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 10/13] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:03.964482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9159ebcc-f82c-4108-931c-dfdca6f67d91 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:03.968335 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:03.968335 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:03.980002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9159ebcc-f82c-4108-931c-dfdca6f67d91 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:03.982853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9159ebcc-f82c-4108-931c-dfdca6f67d91 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:04.209968 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35025c78-735e-4e44-9224-051be248da96 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1925376491/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.555991 Jul 18 02:11:04.217763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4/14] 10.222.0.67 () {62 vars in 1264 bytes} [Mon Jul 18 02:11:03 2022] POST /compute/v2.1/flavors/1925376491/os-extra_specs => generated 62 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:04.231694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ffdd1ac-e05d-4ccb-8705-f54f993f02ad tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:04.234187 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:04.234187 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:04.604761 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ffdd1ac-e05d-4ccb-8705-f54f993f02ad tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1605086213/action" status: 200 len: 97 microversion: 2.1 time: 0.384851 Jul 18 02:11:04.606308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 5/15] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:04 2022] POST /compute/v2.1/flavors/1605086213/action => generated 97 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:04.617654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab06536280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:04.618500 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:04.618500 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:04.619773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:04.620234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:04.666272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:04.667173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:04.677707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83159e0c-4409-42be-a288-08b4266c5d84 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.069852 Jul 18 02:11:04.688443 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 6/16] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:11:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:04.693548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b54a35c5-0732-4124-ba8a-5db42262368e tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:04.694463 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:04.694463 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:04.756784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b54a35c5-0732-4124-ba8a-5db42262368e tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1925376491" status: 202 len: 0 microversion: 2.86 time: 0.066950 Jul 18 02:11:04.758958 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 7/17] 10.222.0.67 () {60 vars in 1201 bytes} [Mon Jul 18 02:11:04 2022] DELETE /compute/v2.1/flavors/1925376491 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:04.771906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e7141a3-b459-45fa-899d-a6075b651531 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:04.779263 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:04.779263 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:04.838469 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9159ebcc-f82c-4108-931c-dfdca6f67d91 tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.876260 Jul 18 02:11:04.846864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 11/18] 10.222.0.67 () {62 vars in 1231 bytes} [Mon Jul 18 02:11:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:04.870480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-349de259-5fc9-4e16-9312-9046221d3b46 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab075550d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:04.876452 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:04.876452 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:04.879898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-349de259-5fc9-4e16-9312-9046221d3b46 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:04.882436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-349de259-5fc9-4e16-9312-9046221d3b46 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:04.935384 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-349de259-5fc9-4e16-9312-9046221d3b46 tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.088067 Jul 18 02:11:04.946588 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 12/19] 10.222.0.67 () {58 vars in 1178 bytes} [Mon Jul 18 02:11:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:04.956546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-499475c7-924d-4b21-b203-931ab6c0d3f2 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.032912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-499475c7-924d-4b21-b203-931ab6c0d3f2 tempest-FlavorMetadataValidation-87951133 tempest-FlavorMetadataValidation-87951133-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.085056 Jul 18 02:11:05.037249 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 13/20] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:11:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:11:05.060201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b9eebcd-9f07-4a28-82e7-e7bcc0b306eb tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.065604 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.065604 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:05.112561 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6e7141a3-b459-45fa-899d-a6075b651531 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e7141a3-b459-45fa-899d-a6075b651531 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Request method failure captured: Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/flavors/1605086213/action HTTP/1.1 Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 67 Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME0zpa20SpBeoAu1l2hyk2Yfb_2Ke2JSRLLvz0kYtHzzjdCNh60NtZ1RCmihv8hJs42KpuUJ95kegCiP5pM-JmAtOf60HHSSblPkAxe3cL19Y897Z0Id4CokwCaKS2-vSwUtlzs9C4sRWn3Q_4nNKMTWuupIEdxKbQmsiEwaThs2uM Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:11:05.162753 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_701c21560be24995b18d0d00197f300e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/701c21560be24995b18d0d00197f300e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 13ac1a6afcf646a3b0101d0771b4a5d7 Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} Jul 18 02:11:05.164144 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1605086213', 'body': {'addTenantAccess': {'tenant': '0d54193dfc824fc0ad30cb4c11b0b5fc'}}} Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:11:05.164917 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-0d54193dfc824fc0ad30cb4c11b0b5fc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:11:05.166042 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:11:05.167218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:11:05.169685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-0d54193dfc824fc0ad30cb4c11b0b5fc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 11, 5, 101285), 'updated_at': None, 'flavor_id': 16, 'project_id': '0d54193dfc824fc0ad30cb4c11b0b5fc'}] Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:05.171062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:05.172300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:05.174716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:05.175968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. Jul 18 02:11:05.175968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:05.178733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e7141a3-b459-45fa-899d-a6075b651531 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 0d54193dfc824fc0ad30cb4c11b0b5fc combination. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:05.181480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e7141a3-b459-45fa-899d-a6075b651531 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1605086213/action" status: 409 len: 152 microversion: 2.1 time: 0.420203 Jul 18 02:11:05.186065 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 8/21] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:04 2022] POST /compute/v2.1/flavors/1605086213/action => generated 152 bytes in 426 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:05.200535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab062755e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.202847 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b9eebcd-9f07-4a28-82e7-e7bcc0b306eb tempest-AggregatesAdminTestV241-1049504687 tempest-AggregatesAdminTestV241-1049504687-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.159831 Jul 18 02:11:05.203339 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.203339 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.206409 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 14/22] 10.222.0.67 () {60 vars in 1192 bytes} [Mon Jul 18 02:11:05 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.210712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.211933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.215594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64218757-978e-41db-961d-a343a3badb19 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:05.223090 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.223090 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:05.271414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.272383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.332093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.335860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.364559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34b97b7c-8e96-4e98-b3ce-63fcbeecc1af tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.174793 Jul 18 02:11:05.366521 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 9/23] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.381794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-563d30d3-9678-4926-bb52-af1e1db5bb4b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-165241306", "name": "tempest-test_aggregate-1719738860"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:05.485246 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.485246 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.487775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-563d30d3-9678-4926-bb52-af1e1db5bb4b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid f1452d1e-2cc2-4851-98a2-671367868cd0 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:11:05.610374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-563d30d3-9678-4926-bb52-af1e1db5bb4b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.242060 Jul 18 02:11:05.622468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 10/24] 10.222.0.67 () {60 vars in 1164 bytes} [Mon Jul 18 02:11:05 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.633698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab06275ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.637870 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.637870 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.640972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.642840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.709441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.710505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.720103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7970cee9-5263-42c1-b231-3eb640279e0a tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.096246 Jul 18 02:11:05.729826 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 11/25] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.743155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f1396461-dd1d-4ded-a9af-1da56beb7082 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.744940 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.744940 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.773922 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f1396461-dd1d-4ded-a9af-1da56beb7082 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.040968 Jul 18 02:11:05.775379 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 12/26] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.784412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab06275310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:05.785987 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.785987 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.788740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.790097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.828248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.829396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:05.844377 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-979673b7-cc1f-469d-b5d5-873cc9c99cdd tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.067146 Jul 18 02:11:05.846339 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 13/27] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:11:05 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:05.875358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8826b7a-65d7-4412-b10f-db878daa8da7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:05.878885 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:05.878885 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:05.899903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8826b7a-65d7-4412-b10f-db878daa8da7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:05.900983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8826b7a-65d7-4412-b10f-db878daa8da7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.271571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64218757-978e-41db-961d-a343a3badb19 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1605086213/action" status: 200 len: 21 microversion: 2.1 time: 1.062786 Jul 18 02:11:06.272424 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 15/28] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:05 2022] POST /compute/v2.1/flavors/1605086213/action => generated 21 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:06.277979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Calling method '.version_select at 0x7fab064798b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.279012 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:06.279012 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:06.280715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.281318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.311336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8826b7a-65d7-4412-b10f-db878daa8da7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.444900 Jul 18 02:11:06.314065 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 14/29] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:11:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:06.317497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.318123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.341575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a4e9d3a-2c75-4c2f-9756-bf0387145d4b tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.343207 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:06.343207 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:06.348500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.350927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.383307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7115ee3-b4d9-4733-afd1-2f47cb6c3aff tempest-HypervisorAdminTestJSON-1734397795 tempest-HypervisorAdminTestJSON-1734397795-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:11:06.391126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.393835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.396320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:06.398462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:06.413712 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a4e9d3a-2c75-4c2f-9756-bf0387145d4b tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1605086213" status: 202 len: 0 microversion: 2.1 time: 0.096827 Jul 18 02:11:06.415460 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 15/30] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:06 2022] DELETE /compute/v2.1/flavors/1605086213 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:06.430040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e8c6feb-4e6d-43ef-949c-b6aca1cc5e9d tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.430813 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.rpcapi [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:11:06.432079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] Releasing lock "compute-rpcapi-router" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:11:06.539683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15b2205c-f05e-4d1f-a7b4-998ab7d18ced None None] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.265198 Jul 18 02:11:06.541206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 16/31] 10.222.0.67 () {58 vars in 1172 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:06.549048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e8c6feb-4e6d-43ef-949c-b6aca1cc5e9d tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.121424 Jul 18 02:11:06.553527 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 16/32] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:06.594597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dbe25e4e-4b16-48e8-9612-47448cfef740 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1754173381", "id": 1137909601, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:06.601401 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:06.601401 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:06.681819 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dbe25e4e-4b16-48e8-9612-47448cfef740 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.093612 Jul 18 02:11:06.686783 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 17/33] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:06.711905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37f86e8f-381f-49cc-9ff1-3174d8a1623c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.713587 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:06.713587 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:06.766252 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-37f86e8f-381f-49cc-9ff1-3174d8a1623c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37f86e8f-381f-49cc-9ff1-3174d8a1623c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Request method failure captured: Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/flavors/1137909601/os-flavor-access HTTP/1.1 Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME0zpa20SpBeoAu1l2hyk2Yfb_2Ke2JSRLLvz0kYtHzzjdCNh60NtZ1RCmihv8hJs42KpuUJ95kegCiP5pM-JmAtOf60HHSSblPkAxe3cL19Y897Z0Id4CokwCaKS2-vSwUtlzs9C4sRWn3Q_4nNKMTWuupIEdxKbQmsiEwaThs2uM Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:11:06.768968 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_701c21560be24995b18d0d00197f300e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/701c21560be24995b18d0d00197f300e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 13ac1a6afcf646a3b0101d0771b4a5d7 Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: exception: Access list not available for public flavors. Jul 18 02:11:06.771194 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1137909601'} Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 18 02:11:06.772553 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:06.776225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37f86e8f-381f-49cc-9ff1-3174d8a1623c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:06.784679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37f86e8f-381f-49cc-9ff1-3174d8a1623c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1137909601/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.079200 Jul 18 02:11:06.789657 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 17/34] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/flavors/1137909601/os-flavor-access => generated 91 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:11:06.800640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1769d55a-e1bc-4c80-9a67-51638234ab27 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:06.892451 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1769d55a-e1bc-4c80-9a67-51638234ab27 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1137909601" status: 202 len: 0 microversion: 2.1 time: 0.097858 Jul 18 02:11:06.894493 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 18/35] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:06 2022] DELETE /compute/v2.1/flavors/1137909601 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:11:06.926611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd710b06-666e-4b9a-94ba-37a8843ebe1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.043798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd710b06-666e-4b9a-94ba-37a8843ebe1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.141952 Jul 18 02:11:07.047432 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 19/36] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:07.094484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be1973e1-267a-44e5-822c-20a528b1238e tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1985195931", "id": 1893503572, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:07.098354 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:07.098354 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:07.141306 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be1973e1-267a-44e5-822c-20a528b1238e tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.067281 Jul 18 02:11:07.142727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 20/37] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:07.659591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9fa0e36-fee7-4b8f-b0cd-3140f8f9a3bb tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:07.661910 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:07.661910 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:07.665486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9fa0e36-fee7-4b8f-b0cd-3140f8f9a3bb tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dfa80b1369374494bfeaaae6a4637e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d54193dfc824fc0ad30cb4c11b0b5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9fa0e36-fee7-4b8f-b0cd-3140f8f9a3bb tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Request method failure captured: Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/flavors/1893503572/action HTTP/1.1 Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 67 Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEwbKZvi3n8NTMH9NH1ooGkcJd6KkwIaul3ZRNby6n2KtTjkCzXLD63-qn0BnfhTc-0OKzuzj4X8XZX_GIrd3i_bT03EMNsL6JF-AoT_LWt1ferQKEIMW88WhvfixGMkHLNSmwm_K7PxuVp6R09htV97YHz5sIxUSD99k23EIAUzEc Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0d54193dfc824fc0ad30cb4c11b0b5fc Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:11:07.670319 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0d54193dfc824fc0ad30cb4c11b0b5fc Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAccessNegativeTestJSON-1288492142-project Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: dfa80b1369374494bfeaaae6a4637e60 Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142-project Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} Jul 18 02:11:07.672836 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1893503572', 'body': {'addTenantAccess': {'tenant': '0d54193dfc824fc0ad30cb4c11b0b5fc'}}} Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:11:07.674179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 18 02:11:07.676296 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:07.680208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9fa0e36-fee7-4b8f-b0cd-3140f8f9a3bb tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:07.682165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d9fa0e36-fee7-4b8f-b0cd-3140f8f9a3bb tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] 10.222.0.67 "POST /compute/v2.1/flavors/1893503572/action" status: 403 len: 130 microversion: 2.1 time: 0.527572 Jul 18 02:11:07.684546 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 21/38] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:07 2022] POST /compute/v2.1/flavors/1893503572/action => generated 130 bytes in 531 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:07.706151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7dd27126-f9e8-4c43-bdf6-bd7ee67f549f tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.734577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-779205314", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "availability_zone": "tempest-test_az-165241306"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:07.775000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:07.785600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7dd27126-f9e8-4c43-bdf6-bd7ee67f549f tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1893503572" status: 202 len: 0 microversion: 2.1 time: 0.096184 Jul 18 02:11:07.786567 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 22/39] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:07 2022] DELETE /compute/v2.1/flavors/1893503572 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:07.801732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-082be6b9-9ee1-4101-bacb-4388ed1d12b5 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:07.823474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.824522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.829004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:07.829787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:07.900426 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-082be6b9-9ee1-4101-bacb-4388ed1d12b5 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108715 Jul 18 02:11:07.903249 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 23/40] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:07.919620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b63ff777-b9f8-48be-9ad5-fba578ace0c4 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-264644653", "id": 1228503753, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:07.951829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b63ff777-b9f8-48be-9ad5-fba578ace0c4 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.036656 Jul 18 02:11:07.959254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 24/41] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:07.968292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-728e2023-e5b5-4e03-b97c-308b35761a9b tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:09.488602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-728e2023-e5b5-4e03-b97c-308b35761a9b tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1228503753/action" status: 200 len: 97 microversion: 2.1 time: 1.526006 Jul 18 02:11:09.491173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 25/42] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:07 2022] POST /compute/v2.1/flavors/1228503753/action => generated 97 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:09.506361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45b89e19-5d0a-49af-85f2-07133b706c55 tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:09.510827 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:09.510827 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:09.514190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45b89e19-5d0a-49af-85f2-07133b706c55 tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dfa80b1369374494bfeaaae6a4637e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d54193dfc824fc0ad30cb4c11b0b5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45b89e19-5d0a-49af-85f2-07133b706c55 tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Request method failure captured: Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/flavors/1228503753/action HTTP/1.1 Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 70 Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEwbKZvi3n8NTMH9NH1ooGkcJd6KkwIaul3ZRNby6n2KtTjkCzXLD63-qn0BnfhTc-0OKzuzj4X8XZX_GIrd3i_bT03EMNsL6JF-AoT_LWt1ferQKEIMW88WhvfixGMkHLNSmwm_K7PxuVp6R09htV97YHz5sIxUSD99k23EIAUzEc Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0d54193dfc824fc0ad30cb4c11b0b5fc Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:11:09.518867 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d54193dfc824fc0ad30cb4c11b0b5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0d54193dfc824fc0ad30cb4c11b0b5fc Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142 Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAccessNegativeTestJSON-1288492142-project Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: dfa80b1369374494bfeaaae6a4637e60 Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1288492142-project Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: {"removeTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} Jul 18 02:11:09.525068 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1228503753', 'body': {'removeTenantAccess': {'tenant': '0d54193dfc824fc0ad30cb4c11b0b5fc'}}} Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can( Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:11:09.526798 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 18 02:11:09.533435 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:09.535635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45b89e19-5d0a-49af-85f2-07133b706c55 tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:09.535635 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45b89e19-5d0a-49af-85f2-07133b706c55 tempest-FlavorsAccessNegativeTestJSON-1288492142 tempest-FlavorsAccessNegativeTestJSON-1288492142-project] 10.222.0.67 "POST /compute/v2.1/flavors/1228503753/action" status: 403 len: 133 microversion: 2.1 time: 0.023905 Jul 18 02:11:09.535635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 26/43] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:09 2022] POST /compute/v2.1/flavors/1228503753/action => generated 133 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:11:09.546197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef325679-ade3-4d00-a90b-3cf16f054afc tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d54193dfc824fc0ad30cb4c11b0b5fc"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:10.288771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:11.214085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef325679-ade3-4d00-a90b-3cf16f054afc tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1228503753/action" status: 200 len: 21 microversion: 2.1 time: 1.676486 Jul 18 02:11:11.218869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 27/44] 10.222.0.67 () {60 vars in 1199 bytes} [Mon Jul 18 02:11:09 2022] POST /compute/v2.1/flavors/1228503753/action => generated 21 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:11.250471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d491b72-e377-4396-adb9-16e2e2feb281 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.259510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:11.259942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:11.260439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:11.260865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:11.262134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:11.302364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.303383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.312047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:11.312594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:11.362525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d491b72-e377-4396-adb9-16e2e2feb281 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1228503753" status: 202 len: 0 microversion: 2.1 time: 0.135082 Jul 18 02:11:11.366070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 28/45] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:11 2022] DELETE /compute/v2.1/flavors/1228503753 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:11.401525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9df5ac96-e8a7-499f-90ba-d542b7dbbb37 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.441094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Getting quotas for project 1ee88fcbd94749b68e23000827f35029. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:11.463955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Getting quotas for user 27d5ded9f0eb4664852708afafa14395 and project 1ee88fcbd94749b68e23000827f35029. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:11.467237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9df5ac96-e8a7-499f-90ba-d542b7dbbb37 tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092607 Jul 18 02:11:11.470059 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 29/46] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:11.512452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-686b8c01-9f21-4bce-84fc-543a1abc33bb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1567491094", "id": 261924834, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:11.571750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:11.581290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:11.592973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-686b8c01-9f21-4bce-84fc-543a1abc33bb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.096332 Jul 18 02:11:11.609401 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 30/47] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:11 2022] POST /compute/v2.1/flavors => generated 436 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:11.634559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9114cbf7-81c7-4809-9aed-7961678796fb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ac97d213536f44b6a69342f45e794e17"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:11.735112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26b3d9c5-3bc8-4c3a-99c5-f02cfad839c6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.024667 Jul 18 02:11:11.741925 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 18/48] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 5033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:11.755261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99719d4b-23a6-421a-bf9e-6554929bbc1f tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:11.757397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-99719d4b-23a6-421a-bf9e-6554929bbc1f tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:11.985842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-99719d4b-23a6-421a-bf9e-6554929bbc1f tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:12.025328 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99719d4b-23a6-421a-bf9e-6554929bbc1f tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1241 microversion: 2.1 time: 0.277270 Jul 18 02:11:12.026518 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 19/49] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:11 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1241 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.045660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6529a6c1-4c19-4c53-987b-1c657cae2781 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.046679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6529a6c1-4c19-4c53-987b-1c657cae2781 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:13.172969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6529a6c1-4c19-4c53-987b-1c657cae2781 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:13.185079 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6529a6c1-4c19-4c53-987b-1c657cae2781 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1241 microversion: 2.1 time: 0.144649 Jul 18 02:11:13.203718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 20/50] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:13.582747 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9114cbf7-81c7-4809-9aed-7961678796fb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] HTTP exception thrown: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9114cbf7-81c7-4809-9aed-7961678796fb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Request method failure captured: Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/flavors/261924834/action HTTP/1.1 Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 70 Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME0zpa20SpBeoAu1l2hyk2Yfb_2Ke2JSRLLvz0kYtHzzjdCNh60NtZ1RCmihv8hJs42KpuUJ95kegCiP5pM-JmAtOf60HHSSblPkAxe3cL19Y897Z0Id4CokwCaKS2-vSwUtlzs9C4sRWn3Q_4nNKMTWuupIEdxKbQmsiEwaThs2uM Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:11:13.586230 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_701c21560be24995b18d0d00197f300e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/701c21560be24995b18d0d00197f300e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/701c21560be24995b18d0d00197f300e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 701c21560be24995b18d0d00197f300e Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726 Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 13ac1a6afcf646a3b0101d0771b4a5d7 Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: {"removeTenantAccess": {"tenant": "ac97d213536f44b6a69342f45e794e17"}} Jul 18 02:11:13.588698 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '261924834', 'body': {'removeTenantAccess': {'tenant': 'ac97d213536f44b6a69342f45e794e17'}}} Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 18 02:11:13.591514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.594713 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9114cbf7-81c7-4809-9aed-7961678796fb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Returning 404 to user: Flavor access not found for 20 / ac97d213536f44b6a69342f45e794e17 combination. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:13.602099 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9114cbf7-81c7-4809-9aed-7961678796fb tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/261924834/action" status: 404 len: 124 microversion: 2.1 time: 1.974649 Jul 18 02:11:13.610053 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 31/51] 10.222.0.67 () {60 vars in 1196 bytes} [Mon Jul 18 02:11:11 2022] POST /compute/v2.1/flavors/261924834/action => generated 124 bytes in 2000 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:13.618945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32e4f794-38c8-4461-856f-0c16d92ade1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.621306 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:13.621306 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:13.673354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:13.739433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32e4f794-38c8-4461-856f-0c16d92ade1a tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/261924834" status: 202 len: 0 microversion: 2.1 time: 0.121315 Jul 18 02:11:13.746796 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 21/52] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:13 2022] DELETE /compute/v2.1/flavors/261924834 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:13.770739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11a9a6a4-a5b7-4abe-b20e-a8b18053df2c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:13.890839 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11a9a6a4-a5b7-4abe-b20e-a8b18053df2c tempest-FlavorsAccessNegativeTestJSON-1411049726 tempest-FlavorsAccessNegativeTestJSON-1411049726-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.137100 Jul 18 02:11:13.896034 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 32/53] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:14.209556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92bf38bb-ed2c-4c7e-8600-381a0767e2b1 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:14.210450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92bf38bb-ed2c-4c7e-8600-381a0767e2b1 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:14.599167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92bf38bb-ed2c-4c7e-8600-381a0767e2b1 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:14.624709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92bf38bb-ed2c-4c7e-8600-381a0767e2b1 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1241 microversion: 2.1 time: 0.420955 Jul 18 02:11:14.641791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 22/54] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:14 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1241 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:15.661431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:15.662839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:15.721351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:15.722336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:15.723706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:15.724454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:16.778918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0037c109-ccd8-4cba-bba9-e14acb4a145d tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1606591885", "id": 999027723, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:16.781843 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:16.781843 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:16.832592 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0037c109-ccd8-4cba-bba9-e14acb4a145d tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.669935 Jul 18 02:11:16.840221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 23/55] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:16 2022] POST /compute/v2.1/flavors => generated 427 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:16.853552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c187b8f4-c07e-4016-ac40-3e09dba285cd tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:16.854112 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:16.854112 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:16.921292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c187b8f4-c07e-4016-ac40-3e09dba285cd tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/999027723" status: 202 len: 0 microversion: 2.1 time: 0.078633 Jul 18 02:11:16.925369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 24/56] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:16 2022] DELETE /compute/v2.1/flavors/999027723 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:16.930274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12f02e50-4a7f-4870-b4e8-213972bd8094 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:16.978929 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12f02e50-4a7f-4870-b4e8-213972bd8094 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052175 Jul 18 02:11:16.979439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 25/57] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.001739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebdbc0c0-9b81-4249-8a79-fde34b4ba271 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-526148067", "id": 414854483, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:17.041725 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ebdbc0c0-9b81-4249-8a79-fde34b4ba271 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049236 Jul 18 02:11:17.050585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 26/58] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:17.057558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb5efb1b-2289-4c1a-ab9a-cbf617a81550 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.090642 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb5efb1b-2289-4c1a-ab9a-cbf617a81550 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.038623 Jul 18 02:11:17.102000 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 27/59] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.108292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8213ee70-906d-447e-bbac-93977208a5c5 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.137066 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8213ee70-906d-447e-bbac-93977208a5c5 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/414854483" status: 202 len: 0 microversion: 2.1 time: 0.032996 Jul 18 02:11:17.141664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 28/60] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:17 2022] DELETE /compute/v2.1/flavors/414854483 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:17.147263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96c89fbb-7506-4d49-a691-ea3e2715b657 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.213232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96c89fbb-7506-4d49-a691-ea3e2715b657 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069731 Jul 18 02:11:17.221097 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 29/61] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.239907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9336117d-088a-4b52-8c35-c087187149f1 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1999272359", "id": 140317967, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:17.283632 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9336117d-088a-4b52-8c35-c087187149f1 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.054119 Jul 18 02:11:17.286801 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 30/62] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:17 2022] POST /compute/v2.1/flavors => generated 426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:17.303652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9732cb2-22d0-46b3-b199-c0a4315fa248 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.334573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:17.353571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9732cb2-22d0-46b3-b199-c0a4315fa248 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/140317967" status: 202 len: 0 microversion: 2.1 time: 0.059536 Jul 18 02:11:17.354739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 31/63] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:17 2022] DELETE /compute/v2.1/flavors/140317967 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:17.373449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b49c43a-d23e-4779-97cc-d4a14e7ce1ef tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.399532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed87a1ef-8897-4ca5-b86b-dc9bd7538b16 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1289 microversion: 2.1 time: 1.747166 Jul 18 02:11:17.403854 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 33/64] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:15 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1289 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.448228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b49c43a-d23e-4779-97cc-d4a14e7ce1ef tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086590 Jul 18 02:11:17.453809 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 32/65] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:17.484623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c687e380-e92a-41e2-8eab-409a0199e230 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1756959525", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:17.491612 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:17.491612 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:17.584202 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c687e380-e92a-41e2-8eab-409a0199e230 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.105784 Jul 18 02:11:17.601863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d075cea-3108-416b-88d1-9352f70020d6 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.602469 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:17 2022] POST /compute/v2.1/flavors => generated 507 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:17.647683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d075cea-3108-416b-88d1-9352f70020d6 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/07ad6fda-8610-44ba-8bbd-e54db58c61dd" status: 202 len: 0 microversion: 2.1 time: 0.050307 Jul 18 02:11:17.648884 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 33/67] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:17 2022] DELETE /compute/v2.1/flavors/07ad6fda-8610-44ba-8bbd-e54db58c61dd => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:17.660142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f694219-4562-45d3-b98f-749557573735 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.695361 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f694219-4562-45d3-b98f-749557573735 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039058 Jul 18 02:11:17.709757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 35/68] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:17.715828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a19974d4-9514-4372-b189-070665bbc267 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-190714295", "id": "ed8e185b-2f37-4f97-bc83-9a476310c2bd", "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:17.749310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a19974d4-9514-4372-b189-070665bbc267 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.038663 Jul 18 02:11:17.753331 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 34/69] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:17 2022] POST /compute/v2.1/flavors => generated 506 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:17.765779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c84541a-7fb8-4357-8c49-c6489253326c tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.766896 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:17.766896 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:17.810948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c84541a-7fb8-4357-8c49-c6489253326c tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/ed8e185b-2f37-4f97-bc83-9a476310c2bd" status: 202 len: 0 microversion: 2.1 time: 0.048257 Jul 18 02:11:17.811791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 36/70] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:17 2022] DELETE /compute/v2.1/flavors/ed8e185b-2f37-4f97-bc83-9a476310c2bd => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:17.825957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4bf2a82-6740-4b10-996b-2593c2ee5cf6 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.883521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4bf2a82-6740-4b10-996b-2593c2ee5cf6 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066190 Jul 18 02:11:17.896383 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 35/71] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:17.903511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ee368e6-e0ad-460d-8567-6418a3ec7118 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-7395113", "id": 1054643229, "os-flavor-access:is_public": "True"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:17.929642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ee368e6-e0ad-460d-8567-6418a3ec7118 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.030975 Jul 18 02:11:17.932317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:17.942235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8ea62b4-f72f-4fa1-8d7d-27c74774c44b tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:17.954507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8ea62b4-f72f-4fa1-8d7d-27c74774c44b tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1054643229" status: 200 len: 411 microversion: 2.1 time: 0.016198 Jul 18 02:11:17.955115 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 36/73] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/1054643229 => generated 411 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:18.441938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:18.443148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:18.456606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.465973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:18.468636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:18.471861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:19.257623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61b31e34-7041-41c8-878e-43755e71816b tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:19.321369 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61b31e34-7041-41c8-878e-43755e71816b tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 1.359088 Jul 18 02:11:19.334337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 38/74] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:17 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:19.348365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b13cc1f-b1f8-4fba-8929-2d58dd6dbadc tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:19.396744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b13cc1f-b1f8-4fba-8929-2d58dd6dbadc tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1054643229" status: 202 len: 0 microversion: 2.1 time: 0.057118 Jul 18 02:11:19.402756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 39/75] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:19 2022] DELETE /compute/v2.1/flavors/1054643229 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:19.425963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0fcd3e69-ba3e-4f7c-80a1-ea2e2ee7f15e tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:19.574682 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0fcd3e69-ba3e-4f7c-80a1-ea2e2ee7f15e tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.152068 Jul 18 02:11:19.574682 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 40/76] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:19.604864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfceaf06-cd83-4b11-8b28-06e4a320ffe0 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1652505423", "id": 1899072610, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:19.732657 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cfceaf06-cd83-4b11-8b28-06e4a320ffe0 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.143830 Jul 18 02:11:19.737914 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 41/77] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:19.766196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d85c746d-029c-4f5b-935b-5414900be0cd tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "1899072610"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:19.891737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d85c746d-029c-4f5b-935b-5414900be0cd tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] HTTP exception thrown: Flavor 1899072610 could not be found. Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d85c746d-029c-4f5b-935b-5414900be0cd tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Request method failure captured: Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 107 Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFAoxveUjWT7z9FhJO16AOnQOFZ3Nr9KEZely7Phz5NW4iSEG9GY5nfIxz0Wy1XCRiaIKWjhI5eIswctYxhq_AOXKzqgMkb9R_Z1FuAX2_UaL1DiJDAUNIGMy4POXcji5f0aLpT_c1h0oJauBCyaOIZI1cphCFHcTiw3ViWOS1bL_k Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: fc9409fa9f1a4683a50ab407c843625d Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsAdminTestJSON-894944572 Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:11:19.906947 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc9409fa9f1a4683a50ab407c843625d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fc9409fa9f1a4683a50ab407c843625d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fc9409fa9f1a4683a50ab407c843625d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc9409fa9f1a4683a50ab407c843625d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsAdminTestJSON-894944572 Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: fc9409fa9f1a4683a50ab407c843625d Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-894944572 Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsAdminTestJSON-894944572-project Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 321f35f37f424339b65ca0b31c29bccb Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsAdminTestJSON-894944572-project Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "test", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "1899072610"}} Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:19.909309 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor 1899072610 could not be found. Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '1899072610'}}} Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1899072610 could not be found. Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:19.910774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1899072610 could not be found. Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:19.912912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:19.915143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:19.915143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:19.915143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:19.915143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1899072610 could not be found. Jul 18 02:11:19.915143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:19.920336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d85c746d-029c-4f5b-935b-5414900be0cd tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Returning 400 to user: Flavor 1899072610 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:19.924458 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d85c746d-029c-4f5b-935b-5414900be0cd tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.180617 Jul 18 02:11:19.931278 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 42/78] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:19 2022] POST /compute/v2.1/servers => generated 81 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:11:20.216468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:20.300991 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e936232d-a241-47e5-adcd-c06af9955cb8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1295 microversion: 2.1 time: 1.879575 Jul 18 02:11:20.319359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 37/79] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:18 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1295 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:20.361254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5e5b8547-0dc6-49ee-9cc1-421e0e68d031 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:20.369882 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:20.369882 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:20.468430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5e5b8547-0dc6-49ee-9cc1-421e0e68d031 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1899072610" status: 202 len: 0 microversion: 2.1 time: 0.145028 Jul 18 02:11:20.469822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 38/80] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:20 2022] DELETE /compute/v2.1/flavors/1899072610 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:20.489355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90718265-b1ff-4d29-a861-bca4d937ef65 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:20.604731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90718265-b1ff-4d29-a861-bca4d937ef65 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.128367 Jul 18 02:11:20.614429 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 39/81] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:20.661957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c1339a8-16a8-4d11-9da6-b4f415926122 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-846898726", "id": 1203134090, "os-flavor-access:is_public": "False"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:20.674035 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:20.674035 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:20.752138 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c1339a8-16a8-4d11-9da6-b4f415926122 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.123806 Jul 18 02:11:20.760225 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 40/82] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:20 2022] POST /compute/v2.1/flavors => generated 414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:20.782060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f71b6eec-fa4e-42aa-b10c-15f0e5558992 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-329850511", "id": 1352910869, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:20.880095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f71b6eec-fa4e-42aa-b10c-15f0e5558992 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.111272 Jul 18 02:11:20.881516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d79651e-6e68-4702-840a-d47a1d06d275 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-605639102", "id": 721111730, "os-flavor-access:is_public": "True"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:20.888290 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 41/83] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:20.904032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab53397c-297c-456a-896d-f998375f0734 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:20.970525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d79651e-6e68-4702-840a-d47a1d06d275 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 1.030458 Jul 18 02:11:20.977541 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 43/84] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:11:19 2022] POST /compute/v2.1/flavors => generated 445 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:21.003584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab53397c-297c-456a-896d-f998375f0734 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.107369 Jul 18 02:11:21.006680 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 42/85] 10.222.0.67 () {58 vars in 1168 bytes} [Mon Jul 18 02:11:20 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:21.023198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-47372992-03ad-48ea-8f9c-a3bef4f8611f tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.068679 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-47372992-03ad-48ea-8f9c-a3bef4f8611f tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.051314 Jul 18 02:11:21.074800 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 43/86] 10.222.0.67 () {58 vars in 1176 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:21.346958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:21.551804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67d30f51-d18d-455b-9e2d-1a5c24c63029 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.565311 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:21.565311 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:21.571023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ba9795c-2f1c-4f7c-bf73-45b0fcb748ee tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.585615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ba9795c-2f1c-4f7c-bf73-45b0fcb748ee tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] 10.222.0.67 "GET /compute/v2.1/flavors/721111730" status: 200 len: 445 microversion: 2.55 time: 0.598414 Jul 18 02:11:21.601284 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 44/87] 10.222.0.67 () {60 vars in 1195 bytes} [Mon Jul 18 02:11:20 2022] GET /compute/v2.1/flavors/721111730 => generated 445 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:11:21.601571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-67d30f51-d18d-455b-9e2d-1a5c24c63029 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67d30f51-d18d-455b-9e2d-1a5c24c63029 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin] Request method failure captured: Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MFIsYKAKclkM5ST0sr4SQCpK35AfVho9MDuXSmOBYSdocIS46bcXSwCZMNiI9jx52_ARv63VG6jVH6qC519rMgE1txgix7Ivxh-RpDY9qOyqWMznrhwZe10fCtBXOWLhbuPmGWA0qVIXlMccE3DCSbVE1bANVwo7Vd_6NBDoaH-O0k Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a0728099e241417084c7e5f7dc23d564 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:11:21.614530 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a0728099e241417084c7e5f7dc23d564"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a0728099e241417084c7e5f7dc23d564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a0728099e241417084c7e5f7dc23d564"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a0728099e241417084c7e5f7dc23d564"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a0728099e241417084c7e5f7dc23d564 Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b75438a5f78483bb9b676f4b5c73c3b Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:11:21.616538 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid timestamp for date invalid_time Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'invalid_time'} Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:21.617625 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:11:21.620068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67d30f51-d18d-455b-9e2d-1a5c24c63029 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:21.622359 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-67d30f51-d18d-455b-9e2d-1a5c24c63029 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475 tempest-InstanceUsageAuditLogNegativeTestJSON-1842225475-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.540328 Jul 18 02:11:21.623210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 44/88] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 547 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:11:21.633158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12a8fb78-3751-465b-b4df-c24f16dcea42 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.662189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12a8fb78-3751-465b-b4df-c24f16dcea42 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.053298 Jul 18 02:11:21.663426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 45/89] 10.222.0.67 () {58 vars in 1170 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:21.671522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d081c8c4-db13-45d9-ab40-254f34bc3878 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] Action: 'update', calling method: .version_select at 0x7fab082eda60>, body: {"flavor": {"description": "new"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:21.678122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:21.679939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:21.692200 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:21.692200 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:21.711771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.719976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.725513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:21.726696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:21.778212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d081c8c4-db13-45d9-ab40-254f34bc3878 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/721111730" status: 200 len: 446 microversion: 2.55 time: 0.110954 Jul 18 02:11:21.789950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 46/90] 10.222.0.67 () {62 vars in 1215 bytes} [Mon Jul 18 02:11:21 2022] PUT /compute/v2.1/flavors/721111730 => generated 446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:11:22.081980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:22.104338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2def0547-b6d9-4789-8fba-527ebca33ac3 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1295 microversion: 2.1 time: 0.469832 Jul 18 02:11:22.106769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 45/91] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1295 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.119279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b9894f5-8f43-4b1f-bb68-0f0e3a8c2210 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.142951 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b9894f5-8f43-4b1f-bb68-0f0e3a8c2210 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.034606 Jul 18 02:11:22.143731 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 46/92] 10.222.0.67 () {58 vars in 1168 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:22.159207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33885999-03f6-4612-8c92-a0ff45191280 tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.180761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b78c4252-79a3-4381-b3cd-2f4dde3da52b tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.187722 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:22.187722 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:22.196263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b78c4252-79a3-4381-b3cd-2f4dde3da52b tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b79a4b04e9c044508e05b5be88d8e4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9ffafaa09942a1a5123ac496798e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b78c4252-79a3-4381-b3cd-2f4dde3da52b tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Request method failure captured: Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFFMsiZXwFtGrhZ_gDU1Y4cjqLDToWxubAZE7Rh-fk-SwC5TmD2xpUK9ZI5eqeAewqT6p3U-H5v2_goDaxXJLMqPD-Ik_qgH7t6Oj0eGQsbgdCvnkbCSOvLGohRhuTvHYJlOrGOfbKsdE2XrDqAVjY9XHSf1dNx-OUbmDcQoFGYNZg Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 8d9ffafaa09942a1a5123ac496798e56 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:11:22.208880 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 8d9ffafaa09942a1a5123ac496798e56 Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: b79a4b04e9c044508e05b5be88d8e4b7 Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:22.211334 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:11:22.212970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 18 02:11:22.216139 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.218590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b78c4252-79a3-4381-b3cd-2f4dde3da52b tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:22.221498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b78c4252-79a3-4381-b3cd-2f4dde3da52b tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.429831 Jul 18 02:11:22.225301 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 47/93] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:11:21 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 435 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:22.239490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80e771a2-1cb8-4cc7-adb4-3637e59ff0e4 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.312334 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33885999-03f6-4612-8c92-a0ff45191280 tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6145 microversion: 2.55 time: 0.156000 Jul 18 02:11:22.312866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-80e771a2-1cb8-4cc7-adb4-3637e59ff0e4 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5808 microversion: 2.1 time: 0.083163 Jul 18 02:11:22.315532 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 48/94] 10.222.0.67 () {58 vars in 1168 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5808 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.322162 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 47/95] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail => generated 6145 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:11:22.346567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91329f5-b6ca-4654-862f-6d115eecfef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.357259 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:22.357259 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:22.363138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c91329f5-b6ca-4654-862f-6d115eecfef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b79a4b04e9c044508e05b5be88d8e4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9ffafaa09942a1a5123ac496798e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:22.368213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42bc270a-9e50-4f54-9788-7135b76069e7 tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91329f5-b6ca-4654-862f-6d115eecfef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Request method failure captured: Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002:11:22 HTTP/1.1 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFFMsiZXwFtGrhZ_gDU1Y4cjqLDToWxubAZE7Rh-fk-SwC5TmD2xpUK9ZI5eqeAewqT6p3U-H5v2_goDaxXJLMqPD-Ik_qgH7t6Oj0eGQsbgdCvnkbCSOvLGohRhuTvHYJlOrGOfbKsdE2XrDqAVjY9XHSf1dNx-OUbmDcQoFGYNZg Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 8d9ffafaa09942a1a5123ac496798e56 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:11:22.377211 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8d9ffafaa09942a1a5123ac496798e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 8d9ffafaa09942a1a5123ac496798e56 Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: b79a4b04e9c044508e05b5be88d8e4b7 Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:11:22.379159 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2022-07-18 02:11:22'} Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:11:22.380031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:11:22.381186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91329f5-b6ca-4654-862f-6d115eecfef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:11:22.384514 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c91329f5-b6ca-4654-862f-6d115eecfef2 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673 tempest-InstanceUsageAuditLogNegativeTestJSON-1177892673-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 02:11:22" status: 403 len: 128 microversion: 2.1 time: 0.063089 Jul 18 02:11:22.390345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 49/96] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002%3A11%3A22 => generated 128 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:11:22.428546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca0068df-d0a1-4998-8048-ce741773b5e0 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.489387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca0068df-d0a1-4998-8048-ce741773b5e0 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5808 microversion: 2.1 time: 0.096647 Jul 18 02:11:22.491881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 50/97] 10.222.0.67 () {58 vars in 1174 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5808 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.508585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42bc270a-9e50-4f54-9788-7135b76069e7 tempest-FlavorsV255TestJSON-1567193749 tempest-FlavorsV255TestJSON-1567193749-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3406 microversion: 2.55 time: 0.175124 Jul 18 02:11:22.510178 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 48/98] 10.222.0.67 () {60 vars in 1165 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors => generated 3406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:11:22.532789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b80f8a3d-4d77-4a27-b336-fd3d80168f91 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.546361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fbec8b80-e433-4721-b860-abe463c87582 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.554694 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:22.554694 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:22.581312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=14,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:22.614375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:DELETE=19,nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:22.683351 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fbec8b80-e433-4721-b860-abe463c87582 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/721111730" status: 202 len: 0 microversion: 2.55 time: 0.137513 Jul 18 02:11:22.683351 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 49/99] 10.222.0.67 () {60 vars in 1198 bytes} [Mon Jul 18 02:11:22 2022] DELETE /compute/v2.1/flavors/721111730 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:22.688817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0640eb49-83c6-46aa-af86-15853860a5b7 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.703629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b80f8a3d-4d77-4a27-b336-fd3d80168f91 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5808 microversion: 2.1 time: 0.181837 Jul 18 02:11:22.713026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 51/100] 10.222.0.67 () {58 vars in 1172 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.744895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0586e731-a007-4d87-89e2-ba2c3578d88d tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.820455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0640eb49-83c6-46aa-af86-15853860a5b7 tempest-FlavorsV255TestJSON-1903730202 tempest-FlavorsV255TestJSON-1903730202-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5709 microversion: 2.55 time: 0.117283 Jul 18 02:11:22.824546 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0586e731-a007-4d87-89e2-ba2c3578d88d tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.084802 Jul 18 02:11:22.825633 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 50/101] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail => generated 5709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:11:22.826793 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 52/102] 10.222.0.67 () {58 vars in 1168 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:22.872765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b669d503-290d-4bba-83e2-c1d191cc186b tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:22.963940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b669d503-290d-4bba-83e2-c1d191cc186b tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1352910869" status: 202 len: 0 microversion: 2.1 time: 0.099743 Jul 18 02:11:22.989069 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 51/103] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:22 2022] DELETE /compute/v2.1/flavors/1352910869 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:11:23.007203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-358ea957-c830-454c-ae9d-b252ad0dad01 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.142557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.143973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:23.158669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-358ea957-c830-454c-ae9d-b252ad0dad01 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.182308 Jul 18 02:11:23.163373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:23.164495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:23.171495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:23.172581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:23.174505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 53/104] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:23.232588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d49338c-580d-428e-9459-a4b5d9467449 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.317871 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d49338c-580d-428e-9459-a4b5d9467449 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1203134090" status: 202 len: 0 microversion: 2.1 time: 0.118963 Jul 18 02:11:23.324681 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 54/105] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:23 2022] DELETE /compute/v2.1/flavors/1203134090 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:23.330926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20d55953-c54e-40dd-b459-1d2d1bf57e23 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.415754 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20d55953-c54e-40dd-b459-1d2d1bf57e23 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088391 Jul 18 02:11:23.439075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 55/106] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:23.456971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-623bc45e-747e-499e-9a00-343eb66e3077 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-136107086", "id": 1195324297, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:23.515841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-623bc45e-747e-499e-9a00-343eb66e3077 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.063263 Jul 18 02:11:23.516909 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 56/107] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:23.536135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5acbe3d9-45b0-4e55-adcd-53f4dd33ad30 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.593698 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5acbe3d9-45b0-4e55-adcd-53f4dd33ad30 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063921 Jul 18 02:11:23.596266 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 57/108] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:23.634383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5030e984-2a1a-4c7d-99dd-c5a5b5f3f79c tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.702345 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5030e984-2a1a-4c7d-99dd-c5a5b5f3f79c tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072160 Jul 18 02:11:23.706093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 58/109] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:23.735961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-759a85dc-128b-4886-8405-c9d5cd173e31 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:23.843985 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-759a85dc-128b-4886-8405-c9d5cd173e31 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1195324297" status: 202 len: 0 microversion: 2.1 time: 0.112532 Jul 18 02:11:23.845302 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 59/110] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:23 2022] DELETE /compute/v2.1/flavors/1195324297 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:11:23.889349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05d5e382-d2e2-4e91-86a9-6bb720bd384e tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.004811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05d5e382-d2e2-4e91-86a9-6bb720bd384e tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.151618 Jul 18 02:11:24.007749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 60/111] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:24.047709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fefe482b-b759-4b3e-9a47-bbb64cfd67c8 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-830205007", "id": 1736062106, "os-flavor-access:is_public": "True"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:24.124784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fefe482b-b759-4b3e-9a47-bbb64cfd67c8 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.082697 Jul 18 02:11:24.137744 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 61/112] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:11:24.172769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de8a186d-5cd5-4f47-a9a6-f272ebe296bf tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.300803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de8a186d-5cd5-4f47-a9a6-f272ebe296bf tempest-FlavorsAdminTestJSON-894944572 tempest-FlavorsAdminTestJSON-894944572-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.159979 Jul 18 02:11:24.318576 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 62/113] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:24 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:24.336566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07222275-7008-4958-b3e6-182f371d97a3 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.381721 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07222275-7008-4958-b3e6-182f371d97a3 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1736062106" status: 202 len: 0 microversion: 2.1 time: 0.052844 Jul 18 02:11:24.390625 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 63/114] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:11:24 2022] DELETE /compute/v2.1/flavors/1736062106 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:24.399607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-250c0ff2-980f-4e60-bcb3-00d70f9737d5 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:24.467589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-250c0ff2-980f-4e60-bcb3-00d70f9737d5 tempest-FlavorsAdminTestJSON-671467564 tempest-FlavorsAdminTestJSON-671467564-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072578 Jul 18 02:11:24.468589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 64/115] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:24.619744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:24.641702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:24.661603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b795273-0dd0-4417-9e17-b84404260588 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 1.532645 Jul 18 02:11:24.671210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 52/116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:23 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:25.709818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:25.713734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:25.775225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.776008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:25.789395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:25.790306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:26.901385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:26.941271 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8f5ae1d-e85f-4a37-b9fd-3e88a1b0a193 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 1.229670 Jul 18 02:11:26.942447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 65/117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:25 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:27.977577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:27.978510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:28.013051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.014883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:28.019785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:28.020249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:29.018995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:29.026652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=67 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:29.053348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17c592ac-5922-447e-a80e-a89e00d04329 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 1.081655 Jul 18 02:11:29.058540 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 53/118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:27 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:30.101958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:30.112417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:30.137839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.143577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:30.154451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:30.155439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.172697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:31.228487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e6566125-735b-4dee-b205-412b79150095 req-f1d8d746-94d5-4b06-b990-f2877387a37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3013623f-faf9-4857-ada5-e328601bbbb9", "tag": "b7e3571d-3be3-4148-bfc3-ec745204dde2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:31.233612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a4b162d-2ad8-4c42-92c1-4839ff85b5ee tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 1.161841 Jul 18 02:11:31.234641 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 54/119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:30 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:31.260691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6566125-735b-4dee-b205-412b79150095 req-f1d8d746-94d5-4b06-b990-f2877387a37a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.262525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6566125-735b-4dee-b205-412b79150095 req-f1d8d746-94d5-4b06-b990-f2877387a37a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.396077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=45 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:31.404964 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e6566125-735b-4dee-b205-412b79150095 req-f1d8d746-94d5-4b06-b990-f2877387a37a service nova] Creating event network-changed:b7e3571d-3be3-4148-bfc3-ec745204dde2 for instance 3013623f-faf9-4857-ada5-e328601bbbb9 on n-h1-849796-1 Jul 18 02:11:31.413198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6566125-735b-4dee-b205-412b79150095 req-f1d8d746-94d5-4b06-b990-f2877387a37a service nova] Acquired lock "compute-rpcapi-router" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:11:31.422745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.428262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.432261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:31.433367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:31.502542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.rpcapi [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:11:31.504093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] Releasing lock "compute-rpcapi-router" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:11:31.619341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-860cd107-5997-430a-818b-16ac3b196f90 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.800377 Jul 18 02:11:31.620035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 66/120] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:32.292139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:32.296242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:32.341290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:32.351628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:32.355519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:32.359291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:32.966511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:33.000859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf8eb8cf-1cca-429c-8917-c870778d7411 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.750553 Jul 18 02:11:33.017908 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 67/121] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:32 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:33.364563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-786594297", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:33.626475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:33.924361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20ab84f4-d6e0-4227-8998-f749f0f35150 tempest-InstanceUsageAuditLogTestJSON-1295321764 tempest-InstanceUsageAuditLogTestJSON-1295321764-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:33.927710 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:33.927710 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:34.015455 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20ab84f4-d6e0-4227-8998-f749f0f35150 tempest-InstanceUsageAuditLogTestJSON-1295321764 tempest-InstanceUsageAuditLogTestJSON-1295321764-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18 02:11:33" status: 200 len: 318 microversion: 2.1 time: 0.576375 Jul 18 02:11:34.017663 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 68/122] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 02:11:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-18%2002%3A11%3A33 => generated 318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:34.350991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:34.352361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:34.353730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:34.355483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:34.357074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:34.376198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.378888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.381549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.383106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.413895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Getting quotas for project 0855591e3a664a5d8110f637a3172a00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:34.423672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Getting quotas for user 0c7dfafed8804a84b705d3f685f5916d and project 0855591e3a664a5d8110f637a3172a00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:34.434732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab44ed03-50af-4019-b0a4-b51eadbad860 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.451322 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab44ed03-50af-4019-b0a4-b51eadbad860 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.431231 Jul 18 02:11:34.452299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:34.457747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:34.460965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 69/123] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:34.470775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d3cd056-fcb0-4b3c-a242-247a5bef06a6 tempest-InstanceUsageAuditLogTestJSON-1295321764 tempest-InstanceUsageAuditLogTestJSON-1295321764-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.471558 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:34.471558 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:34.517385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d3cd056-fcb0-4b3c-a242-247a5bef06a6 tempest-InstanceUsageAuditLogTestJSON-1295321764 tempest-InstanceUsageAuditLogTestJSON-1295321764-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052624 Jul 18 02:11:34.530626 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 70/124] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:34.530912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:34.532380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:34.553103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.553877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.554723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:34.555161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:34.572779 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17897d77-9d2d-4bd4-a4bd-6f55db045644 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930585 Jul 18 02:11:34.574607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 55/125] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:34.963518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:34.987339 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-593587c3-893e-4455-8abe-a457166b7aa8 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.465302 Jul 18 02:11:35.001985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 71/126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:34 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:35.020690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21328fa7-75ef-43b5-ac07-e5df5bc3ada4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:35.021846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21328fa7-75ef-43b5-ac07-e5df5bc3ada4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:35.257628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-21328fa7-75ef-43b5-ac07-e5df5bc3ada4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:35.296272 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21328fa7-75ef-43b5-ac07-e5df5bc3ada4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1219 microversion: 2.1 time: 0.292269 Jul 18 02:11:35.297321 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 72/127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:35 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1219 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:35.737692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f91ba5e7-0985-4e7a-b3f7-cc8687bf859b tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-956039057", "id": 875054882, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:35.741048 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:35.741048 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:35.788707 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f91ba5e7-0985-4e7a-b3f7-cc8687bf859b tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 1.212052 Jul 18 02:11:35.813589 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 56/128] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:34 2022] POST /compute/v2.1/flavors => generated 421 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:35.819835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0700a50d-38d0-4196-b2bf-3d564c59ee99 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:35.835844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0700a50d-38d0-4196-b2bf-3d564c59ee99 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020545 Jul 18 02:11:35.841013 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 73/129] 10.222.0.67 () {58 vars in 1181 bytes} [Mon Jul 18 02:11:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:11:35.858651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ac072af-cd4c-44d9-9eff-d9ea01a0de9f tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1841910415", "id": 1014338745, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:35.931881 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ac072af-cd4c-44d9-9eff-d9ea01a0de9f tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.081264 Jul 18 02:11:35.934222 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 57/130] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:35 2022] POST /compute/v2.1/flavors => generated 425 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:35.955014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a866498-c5d5-470e-98e5-dc39c2c845c4 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:36.034402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a866498-c5d5-470e-98e5-dc39c2c845c4 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.088571 Jul 18 02:11:36.035486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:36.037904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:36.038824 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 74/131] 10.222.0.67 () {58 vars in 1181 bytes} [Mon Jul 18 02:11:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:36.061741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56fd5a8f-c2e9-4bec-8eba-319ea020c93e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Action: 'create', calling method: .version_select at 0x7fab0608c550>, body: {"keypair": {"name": "tempest-keypair-660151589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOg1nDnWxwX2GwikYaQF14l1O6w3IZqFsNhKpYCJ5lT/rjHn33ca1HZ1AaNiO3evk3f2TfTnjxk+vfU6kqUCQGPeJc0VZMkOxjXCE5F6vtDeqtUNRVdWPNTkGg3TloFcBA=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:36.073575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:36.074866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.081334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:36.083042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:36.126951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-56fd5a8f-c2e9-4bec-8eba-319ea020c93e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for project 26519510f3bf4d98814641c3f445ee9f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:36.141011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-56fd5a8f-c2e9-4bec-8eba-319ea020c93e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for user d8f728feedf3481e9495821fbd27813a and project 26519510f3bf4d98814641c3f445ee9f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:36.228312 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-56fd5a8f-c2e9-4bec-8eba-319ea020c93e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173681 Jul 18 02:11:36.255260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 75/132] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:11:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:36.332090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63ab9e5b-25c3-4a65-8c1a-8e2b96ed7c5a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:36.341100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63ab9e5b-25c3-4a65-8c1a-8e2b96ed7c5a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:36.399876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:36.433250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0205e76-48a2-4fc8-a6f2-85536f244197 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.412688 Jul 18 02:11:36.458726 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 58/133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:36 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:36.891733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63ab9e5b-25c3-4a65-8c1a-8e2b96ed7c5a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:36.962600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63ab9e5b-25c3-4a65-8c1a-8e2b96ed7c5a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1219 microversion: 2.1 time: 0.638817 Jul 18 02:11:36.965945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 76/134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:36 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1219 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:37.468344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.469819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:37.489786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.490245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.496286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:37.498817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:37.809745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:37.819611 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95a8b1a7-e400-4ece-bb0a-c4222c7582eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.360524 Jul 18 02:11:37.820221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 59/135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:37.996594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:37.998227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:38.017197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.017581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.019977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.025180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.296041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:38.330696 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c6830730-74cb-4458-92de-9871dd61004c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1289 microversion: 2.1 time: 0.340921 Jul 18 02:11:38.346129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 77/136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:37 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1289 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:38.848241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:38.849083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:38.874667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.877899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:38.884304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:38.885377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.368702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:39.371995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:39.435740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:39.436572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.441964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:39.442845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:39.733137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:39.767331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8d3a3256-bf75-459f-a5f5-6560bb036688 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.923297 Jul 18 02:11:39.768753 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 60/137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:38 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:39.869727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:39.900549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-880e0205-27f1-4ea0-8c84-266b4c8cd8d2 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1277 microversion: 2.1 time: 0.538222 Jul 18 02:11:39.902609 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 78/138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:39 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1277 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:40.490470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.492202 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:40.492202 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:40.493790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.494357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.500584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.501596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.577857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04e0a498-3521-47d7-bc84-907edf8bcf68 tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.807095 Jul 18 02:11:40.590943 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 61/139] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:11:39 2022] GET /compute/v2.1/os-services => generated 965 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:40.614157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.616742 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:40.616742 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:11:40.622687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.631436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.633482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.634525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.781316 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94b24cf2-2859-488f-96bd-2010530ed3aa tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-849796-1" status: 200 len: 578 microversion: 2.1 time: 0.165144 Jul 18 02:11:40.781316 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 79/140] 10.222.0.67 () {58 vars in 1171 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/os-services?host=n-d-849796-1 => generated 578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:40.818661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.821520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:40.826976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:40.830142 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:40.830142 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:40.838772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.843544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.850079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.851341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.861441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.864458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.866534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:40.875911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:40.975224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0dcbd555-54fa-4350-bf74-5814e33f0f8c tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.177443 Jul 18 02:11:40.986949 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 62/141] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:41.002589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.004297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:41.024308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.028506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.031437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.032848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.192154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:41.210436 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ff7c489-c8ea-4c96-9169-cad1e1c9d7c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1277 microversion: 2.1 time: 0.220619 Jul 18 02:11:41.228653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 63/142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:41.242588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:41.246721 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:41.246721 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:41.255123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.256356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.258349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:41.259585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:41.418345 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c05681d4-a426-4320-a777-8a612eb1488b tempest-ServicesAdminTestJSON-237344719 tempest-ServicesAdminTestJSON-237344719-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.186342 Jul 18 02:11:41.423865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 64/143] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:11:41 2022] GET /compute/v2.1/os-services => generated 965 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:41.470167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:41.486424 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa2bf2cb-6746-4e95-9c0e-1b77ff7a274d tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.686157 Jul 18 02:11:41.487190 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 80/144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:40 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:42.243425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:42.244902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:42.273300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.274660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.277933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:42.281971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:42.868972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:42.892652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4edf5460-c64d-4958-986f-06c4561b9ff3 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-898889812", "ram": 512, "vcpus": 1, "disk": 10, "id": 701538625, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:42.916798 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:42.916798 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:42.956163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8f70b41-c749-4e5c-99e4-0522d8503a78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1277 microversion: 2.1 time: 0.719234 Jul 18 02:11:42.964891 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 81/145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:42 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1277 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:42.971882 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4edf5460-c64d-4958-986f-06c4561b9ff3 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.223977 Jul 18 02:11:42.985170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 65/146] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:41 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:42.996149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:43.000962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:43.005605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6e92aca0-817f-4abc-a91e-be1aca306a4f tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:43.007464 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:43.007464 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:43.027562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:43.031443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:43.034146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:43.035227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:43.115781 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6e92aca0-817f-4abc-a91e-be1aca306a4f tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.129172 Jul 18 02:11:43.133310 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 66/147] 10.222.0.67 () {60 vars in 1220 bytes} [Mon Jul 18 02:11:42 2022] POST /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:43.534775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-778f7a8e-bed4-4b8d-968c-dea81a014fe5 tempest-FlavorsExtraSpecsTestJSON-882347217 tempest-FlavorsExtraSpecsTestJSON-882347217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:43.555476 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-778f7a8e-bed4-4b8d-968c-dea81a014fe5 tempest-FlavorsExtraSpecsTestJSON-882347217 tempest-FlavorsExtraSpecsTestJSON-882347217-project] 10.222.0.67 "GET /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.411268 Jul 18 02:11:43.558154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 67/148] 10.222.0.67 () {58 vars in 1199 bytes} [Mon Jul 18 02:11:43 2022] GET /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:43.576986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3af10e2-db4c-406f-9dc7-37968304a25b tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:43.619631 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3af10e2-db4c-406f-9dc7-37968304a25b tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052824 Jul 18 02:11:43.622371 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 68/149] 10.222.0.67 () {60 vars in 1220 bytes} [Mon Jul 18 02:11:43 2022] POST /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:43.640141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e0f43e7-e08d-4355-bb58-83ff764b76d8 tempest-FlavorsExtraSpecsTestJSON-882347217 tempest-FlavorsExtraSpecsTestJSON-882347217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:43.670650 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e0f43e7-e08d-4355-bb58-83ff764b76d8 tempest-FlavorsExtraSpecsTestJSON-882347217 tempest-FlavorsExtraSpecsTestJSON-882347217-project] 10.222.0.67 "GET /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039184 Jul 18 02:11:43.698956 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 69/150] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:11:43 2022] GET /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes => generated 22 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:11:43.729107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17385b8d-5f88-42ab-8de2-23c45939b255 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:43.775669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=4,nova_api:INSERT=8,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:43.794339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17385b8d-5f88-42ab-8de2-23c45939b255 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091339 Jul 18 02:11:43.794962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 70/151] 10.222.0.67 () {60 vars in 1220 bytes} [Mon Jul 18 02:11:43 2022] POST /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:43.823027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36a60ca3-bb15-4649-bce7-ffec6bd5573a tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:43.857306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36a60ca3-bb15-4649-bce7-ffec6bd5573a tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052641 Jul 18 02:11:43.865113 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 71/152] 10.222.0.67 () {58 vars in 1199 bytes} [Mon Jul 18 02:11:43 2022] GET /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:43.887593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1930c57-d458-42a8-952f-d6b563636bb9 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:43.890017 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:43.890017 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:43.930551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:43.952433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0136b08-bf9b-4f3d-b0ff-c48ebd3d05cd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.983012 Jul 18 02:11:43.971670 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 82/153] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:42 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:43.997457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:43.998999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:44.027007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.027947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.030104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1930c57-d458-42a8-952f-d6b563636bb9 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.162758 Jul 18 02:11:44.039769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 72/154] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:11:43 2022] PUT /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes => generated 22 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:44.049752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:44.050690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:44.064397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f815a8d4-5d13-4575-87c4-4c542eddf25c tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.100146 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f815a8d4-5d13-4575-87c4-4c542eddf25c tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056447 Jul 18 02:11:44.117397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 73/155] 10.222.0.67 () {58 vars in 1199 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/flavors/701538625/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:44.130337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66498655-c009-4a25-a911-b1bdc83c17e9 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.136388 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:44.136388 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:44.202855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66498655-c009-4a25-a911-b1bdc83c17e9 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.083134 Jul 18 02:11:44.203946 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 74/156] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:11:44 2022] DELETE /compute/v2.1/flavors/701538625/os-extra_specs/hw:numa_nodes => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:11:44.257963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-908b99ff-4fbb-42e9-99f6-ef6dc27f85cc tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.355390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-908b99ff-4fbb-42e9-99f6-ef6dc27f85cc tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/701538625/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.120900 Jul 18 02:11:44.359719 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 75/157] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:11:44 2022] DELETE /compute/v2.1/flavors/701538625/os-extra_specs/hw:cpu_policy => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:11:44.373470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b87cefd-0012-436c-8449-3967f31ec8ec tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.411484 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b87cefd-0012-436c-8449-3967f31ec8ec tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/701538625/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.046580 Jul 18 02:11:44.429670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 76/158] 10.222.0.67 () {58 vars in 1199 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/flavors/701538625/os-extra_specs => generated 19 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:11:44.460268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da82b3da-428c-4456-9198-600e10c05b5b tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.466854 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:11:44.466854 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:11:44.479782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:44.583343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da82b3da-428c-4456-9198-600e10c05b5b tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/701538625" status: 202 len: 0 microversion: 2.1 time: 0.151609 Jul 18 02:11:44.588023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 77/159] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:11:44 2022] DELETE /compute/v2.1/flavors/701538625 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:11:44.613431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0810341d-3bcc-4454-b7a3-6d2d5a1c4d07 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:44.745533 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0810341d-3bcc-4454-b7a3-6d2d5a1c4d07 tempest-FlavorsExtraSpecsTestJSON-715462281 tempest-FlavorsExtraSpecsTestJSON-715462281-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.149932 Jul 18 02:11:44.751795 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 78/160] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:11:44 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:11:44.922171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-354363176", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "1014338745", "adminPass": "***", "networks": [{"uuid": "984b8d18-5204-49d0-bf99-739f2ee61cd3"}], "security_groups": [{"name": "tempest-securitygroup--558784529"}], "key_name": "tempest-keypair-660151589", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:45.018193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:45.062196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55f08e3f-71c6-4d7f-9179-5ebe3249cb45 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.072089 Jul 18 02:11:45.076431 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 83/161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:43 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:45.091328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:45.092234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:45.139907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:45.140687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:45.148889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:45.150078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:45.621985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] validate_networks() for [('984b8d18-5204-49d0-bf99-739f2ee61cd3', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:45.742336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:45.771564 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e76cccc-d54b-4ba5-914b-4fb4aed842cc tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 0.692792 Jul 18 02:11:45.792463 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 84/162] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:45 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:46.305992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d7c851c4-7264-4218-85ea-df0984d9df02 req-c226a0e7-698b-49ad-9732-70a73e2f466f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3013623f-faf9-4857-ada5-e328601bbbb9", "name": "network-vif-plugged", "status": "completed", "tag": "b7e3571d-3be3-4148-bfc3-ec745204dde2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:46.332741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d7c851c4-7264-4218-85ea-df0984d9df02 req-c226a0e7-698b-49ad-9732-70a73e2f466f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:46.347294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d7c851c4-7264-4218-85ea-df0984d9df02 req-c226a0e7-698b-49ad-9732-70a73e2f466f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:46.381218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d7c851c4-7264-4218-85ea-df0984d9df02 req-c226a0e7-698b-49ad-9732-70a73e2f466f service nova] Creating event network-vif-plugged:b7e3571d-3be3-4148-bfc3-ec745204dde2 for instance 3013623f-faf9-4857-ada5-e328601bbbb9 on n-h1-849796-1 Jul 18 02:11:46.412852 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d7c851c4-7264-4218-85ea-df0984d9df02 req-c226a0e7-698b-49ad-9732-70a73e2f466f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.608568 Jul 18 02:11:46.417509 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 85/163] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:46.925157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-167174721", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:46.958908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:46.963604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=16 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:47.198637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:11:48.106485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:48.108760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:48.109751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:48.126635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:48.128459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:48.153197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.154295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.156670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.157853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.196301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for project 26519510f3bf4d98814641c3f445ee9f. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:48.205019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for user d8f728feedf3481e9495821fbd27813a and project 26519510f3bf4d98814641c3f445ee9f. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:48.227716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:48.232833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:48.366420 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29895622-d5c2-40fe-ab19-b2ca576fa5f4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.464801 Jul 18 02:11:48.373943 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 79/164] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:48.401305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:48.420101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:48.453453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.458547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.464715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.470998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.692957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:11:48.701780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:11:48.702546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:11:48.703153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:11:48.703739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:11:48.723131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.728458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.730689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:48.733946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:48.799566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Getting quotas for project 9bd68bb21b5342f79e7b7791f86bed46. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:11:48.808701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Getting quotas for user 0ea8026d405a4803b54b77de93cb9d01 and project 9bd68bb21b5342f79e7b7791f86bed46. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:11:48.840123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:11:48.847203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:11:49.006205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0c15cb2-fb8f-444b-90cc-941d7f3ae4ab tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574140 Jul 18 02:11:49.015193 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 86/165] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:11:49.034947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:49.036406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:49.058855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:49.059856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:49.065146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:49.066810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:49.703570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:49.732554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab813558-460e-4bff-adc7-8d4404369026 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.356148 Jul 18 02:11:49.736739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 80/166] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:48 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:49.763472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:49.767569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:49.811890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:49.814753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:49.824369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:49.826583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.129097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:50.181145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b022cea9-1b13-4069-b730-6c75e2649c14 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1337 microversion: 2.1 time: 1.160823 Jul 18 02:11:50.189685 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 87/167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:49 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1337 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:50.226495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:50.234661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:50.297173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.297993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.304392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.306648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.363112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:50.424405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-061b8e76-ba84-4125-b6fd-66631f126577 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1288 microversion: 2.1 time: 0.675624 Jul 18 02:11:50.430549 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 81/168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:49 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1288 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:50.623921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:50.651448 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c5406e30-d71f-4290-8e02-bc12cc4d2813 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1243 microversion: 2.1 time: 0.458909 Jul 18 02:11:50.659209 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 88/169] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:50 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1243 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:50.765689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:50.766978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:50.800294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.817639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:50.824909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:50.825919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.220126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:51.221329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:51.244559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.257621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.266333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:51.267478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:51.959037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:51.974378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a088a92-5dd3-4452-a180-0ed09b8605d7 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1487 microversion: 2.1 time: 0.761384 Jul 18 02:11:51.986791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 89/170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:51 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1487 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:52.317917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-499719aa-f029-43a8-b461-014e7d37c450 req-4cc8a0ee-e2dc-4ae2-add4-ab5039e4fce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6cf10e-b489-4d5d-9c45-808a207bfd79", "tag": "bfde49fa-1a76-47b7-b6e0-4057ecdbf45a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:52.335716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-499719aa-f029-43a8-b461-014e7d37c450 req-4cc8a0ee-e2dc-4ae2-add4-ab5039e4fce8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.336366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-499719aa-f029-43a8-b461-014e7d37c450 req-4cc8a0ee-e2dc-4ae2-add4-ab5039e4fce8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.361996 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-499719aa-f029-43a8-b461-014e7d37c450 req-4cc8a0ee-e2dc-4ae2-add4-ab5039e4fce8 service nova] Creating event network-changed:bfde49fa-1a76-47b7-b6e0-4057ecdbf45a for instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 on n-h2-849796-1 Jul 18 02:11:52.370195 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-499719aa-f029-43a8-b461-014e7d37c450 req-4cc8a0ee-e2dc-4ae2-add4-ab5039e4fce8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381112 Jul 18 02:11:52.371093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 90/171] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:52.378520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:52.381689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:52.392312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.393176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.394308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.395068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.477518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:52.501923 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e3026646-cc63-4507-aeab-4e1aeecbb3a5 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.751029 Jul 18 02:11:52.504063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 82/172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:50 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:52.543872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:52.546024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:52.559713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.560518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.562171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.562932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.745682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:52.787226 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21c171df-9849-4362-8f7f-e1877b941506 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1297 microversion: 2.1 time: 0.280115 Jul 18 02:11:52.792212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:52.795972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 83/173] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:52 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1297 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:52.823950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:52.825244 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63afc753-fd0d-44cb-9408-30acfd04d4b9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1342 microversion: 2.1 time: 0.452579 Jul 18 02:11:52.826898 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 91/174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:52 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1342 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:52.845364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:52.859820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.860938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:52.862900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:52.864032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.530655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:53.537171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:53.567895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.569198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:53.578020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:53.579195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:54.056547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:54.082784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e32e326-1d6d-4216-b31b-d6a0feff1960 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 0.563328 Jul 18 02:11:54.083480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 92/175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:53 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:54.106316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:54.108274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:54.139026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:54.141970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:54.143760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:54.144789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:54.295811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:54.298715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:54.319394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43d29e2d-ed5b-4419-b9f2-d3059874d370 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1297 microversion: 2.1 time: 0.233778 Jul 18 02:11:54.329663 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 93/176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:54 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1297 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:54.343814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:54.345919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:54.362193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:54.364036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:54.366589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:54.367846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:54.576817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:54.594616 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1342 microversion: 2.1 time: 0.262780 Jul 18 02:11:54.608990 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 94/177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:54 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1342 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:54.741412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:54.744210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-308ed974-c531-48bb-842f-9fdbf9f2f3cf tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003007 Jul 18 02:11:54.745691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 95/178] 10.222.0.67 () {56 vars in 885 bytes} [Mon Jul 18 02:11:54 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:11:55.109014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:55.109730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:55.124134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.132616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.134571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.142310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.567795 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2ef3bbe-c6fd-49dd-bd68-1c259792c129 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1638 microversion: 2.1 time: 2.766538 Jul 18 02:11:55.573988 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 84/179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:52 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1638 bytes in 2777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:55.582244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:55.582871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:55.602813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.603327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.605400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.606126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.751609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:55.766881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ec4ddf1-bade-4a90-9e3f-b3ce5b7f896d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 0.662865 Jul 18 02:11:55.767809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 96/180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:55 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:55.777176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:55.777958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:55.785323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.786020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.787098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:55.787747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:55.847009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:11:56.077893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:56.094790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3174412-af22-4244-b1f9-bdf6ad07829b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1339 microversion: 2.1 time: 0.519231 Jul 18 02:11:56.095776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 85/181] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:55 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1339 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:56.101217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.107719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.126737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4348f0a-ec98-441b-bef5-e13742c031eb tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 204 len: 0 microversion: 2.1 time: 0.357038 Jul 18 02:11:56.128463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.129348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.131198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.132625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.133313 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 97/182] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:11:55 2022] DELETE /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:11:56.145858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.147165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.164118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.165011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.167176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.167339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.514993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:56.524960 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a37f23cb-407f-421e-83bd-81f5833ea63c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1409 microversion: 2.1 time: 0.427530 Jul 18 02:11:56.526478 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 86/183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:56.802812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:56.804672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:56.824720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.831139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:56.831988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:56.832433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.205343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:57.271143 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f7c27ae-d27a-4b59-be72-424cf44bc97a tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 0.472578 Jul 18 02:11:57.277826 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 87/184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:57.286641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dd2f184a-f75f-4ece-8b9b-44fc04ea4673 req-fa9f956c-d86b-459c-8d4d-950958f37b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa628e8-e79b-4680-a7ab-ccf7ab9031ac", "tag": "1430593b-230c-4072-8775-d099fb6d7a72"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:11:57.312391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd2f184a-f75f-4ece-8b9b-44fc04ea4673 req-fa9f956c-d86b-459c-8d4d-950958f37b6d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.315634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd2f184a-f75f-4ece-8b9b-44fc04ea4673 req-fa9f956c-d86b-459c-8d4d-950958f37b6d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.353651 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dd2f184a-f75f-4ece-8b9b-44fc04ea4673 req-fa9f956c-d86b-459c-8d4d-950958f37b6d service nova] Creating event network-changed:1430593b-230c-4072-8775-d099fb6d7a72 for instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac on n-h1-849796-1 Jul 18 02:11:57.368615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dd2f184a-f75f-4ece-8b9b-44fc04ea4673 req-fa9f956c-d86b-459c-8d4d-950958f37b6d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084840 Jul 18 02:11:57.370039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 88/185] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:11:57.392840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:57.394973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:57.411601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.413164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.418550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:57.419937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.452863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.460153 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e7b105ad-b21c-4e16-a557-7f809c030009 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1493 microversion: 2.1 time: 1.324102 Jul 18 02:11:57.486407 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 98/186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:56 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1493 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:57.549910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:57.557132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:57.590628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.591397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:57.593009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:57.593824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:58.184381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.220346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.288711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:58.312188 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78baf90b-fda8-4cee-af10-dc0a7db0be75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1339 microversion: 2.1 time: 0.939833 Jul 18 02:11:58.312982 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 89/187] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:57 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1339 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:58.371554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:58.377460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:58.398370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.401938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:58.404278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.405981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:58.474933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.752407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.829949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:11:58.850632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:58.877469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e48a722-cfd6-4cc3-bb92-33562a2c1652 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1409 microversion: 2.1 time: 1.336595 Jul 18 02:11:58.897624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 99/188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:57 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1409 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:58.910828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:58.912482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:58.927945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.929320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:58.931837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:58.933383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.510134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:59.539297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-894760d3-0c3d-4344-b7da-6168e88e75b6 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1493 microversion: 2.1 time: 0.635942 Jul 18 02:11:59.541715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 100/189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:58 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1493 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:59.550796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:59.559482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:59.583587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.585107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.589268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.589935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.848313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:11:59.888322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7fcd81b6-c3b7-4538-94be-b20ac115f999 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.532361 Jul 18 02:11:59.895039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 90/190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:58 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:11:59.917337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:11:59.921347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:11:59.937634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.938907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:11:59.940709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:11:59.941879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.026701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:00.041262 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adf3bcef-2924-41fb-a764-a48279a4b0a1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1339 microversion: 2.1 time: 0.497438 Jul 18 02:12:00.081331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 101/191] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:59 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1339 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:00.561569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:00.563330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:00.570131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.570583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.590654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.594374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.741662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:00.759722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a98f5da-375e-4be1-8ec3-fd898f81fda7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1409 microversion: 2.1 time: 0.854517 Jul 18 02:12:00.773419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 91/192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:11:59 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1409 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:00.781893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-34c896fa-15b0-4c78-8e02-a6f514106345 req-70fa88ff-b6c8-4621-9248-5075b30ed9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3013623f-faf9-4857-ada5-e328601bbbb9", "name": "network-vif-deleted", "tag": "b7e3571d-3be3-4148-bfc3-ec745204dde2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:00.817585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-34c896fa-15b0-4c78-8e02-a6f514106345 req-70fa88ff-b6c8-4621-9248-5075b30ed9a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.820996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-34c896fa-15b0-4c78-8e02-a6f514106345 req-70fa88ff-b6c8-4621-9248-5075b30ed9a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.829527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:00.838684 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36296095-0467-4872-8778-5ba59a0729bd tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1451 microversion: 2.1 time: 0.283637 Jul 18 02:12:00.839351 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 102/193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:00 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1451 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:00.867022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-34c896fa-15b0-4c78-8e02-a6f514106345 req-70fa88ff-b6c8-4621-9248-5075b30ed9a9 service nova] Creating event network-vif-deleted:b7e3571d-3be3-4148-bfc3-ec745204dde2 for instance 3013623f-faf9-4857-ada5-e328601bbbb9 on n-h1-849796-1 Jul 18 02:12:00.883486 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-34c896fa-15b0-4c78-8e02-a6f514106345 req-70fa88ff-b6c8-4621-9248-5075b30ed9a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107670 Jul 18 02:12:00.886444 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 92/194] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:00.910050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:00.911188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:00.923910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.925070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:00.926657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:00.927640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.076074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:01.078785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:01.100415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.103084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.105419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.107216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.620545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:01.629563 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e76d34d2-cbe3-4b0a-a71d-50ff57872418 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1339 microversion: 2.1 time: 0.570741 Jul 18 02:12:01.630900 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 93/195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:01 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:01.779457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:01.780465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:01.788497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.789610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.791131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.791965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.907017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:01.917939 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd077df7-ac97-4165-9513-e2005cc84b1b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.015002 Jul 18 02:12:01.934715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 103/196] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:00 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:01.942975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:01.947279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:01.964827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.967111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:01.970104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:01.971053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.036357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:02.078361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca68f7c6-5099-4f27-a65f-6b578f979202 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1409 microversion: 2.1 time: 0.302336 Jul 18 02:12:02.088836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 94/197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:01 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1409 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:02.112115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d5ded9f0eb4664852708afafa14395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee88fcbd94749b68e23000827f35029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:02.136035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab3911ff-622d-45ef-b692-19b7d880ba23 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 200 len: 1451 microversion: 2.1 time: 0.191149 Jul 18 02:12:02.140203 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 104/198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:01 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 1451 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:02.658985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:02.659869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:02.671688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.679241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.682160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.687463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.941256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:02.942096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:02.965706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.966180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:02.967149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:02.975319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:03.804560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:03.832877 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1060c164-2b34-4c3a-8e30-ce67a1f0d3aa tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1339 microversion: 2.1 time: 1.173430 Jul 18 02:12:03.833588 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 95/199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:02 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1339 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:03.852680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-efe1f4f7-732b-4117-b15c-aeca23c42b47 req-6512d0d0-47a4-47b4-b714-a4081d2f2e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9eaca4-4373-41ba-9017-7cb68dca58fb", "tag": "ffc606bf-c733-45cf-ad7c-3e7bbec54391"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:03.885470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-efe1f4f7-732b-4117-b15c-aeca23c42b47 req-6512d0d0-47a4-47b4-b714-a4081d2f2e7d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:03.886692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-efe1f4f7-732b-4117-b15c-aeca23c42b47 req-6512d0d0-47a4-47b4-b714-a4081d2f2e7d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:03.914113 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-efe1f4f7-732b-4117-b15c-aeca23c42b47 req-6512d0d0-47a4-47b4-b714-a4081d2f2e7d service nova] Creating event network-changed:ffc606bf-c733-45cf-ad7c-3e7bbec54391 for instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb on n-h1-849796-1 Jul 18 02:12:03.924773 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-efe1f4f7-732b-4117-b15c-aeca23c42b47 req-6512d0d0-47a4-47b4-b714-a4081d2f2e7d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089413 Jul 18 02:12:03.928177 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 96/200] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:03.943477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5caf1252-8c0f-4e2a-bf19-22ab4a4d7442 req-cd7a40c2-22cc-4ad8-a573-fae1293ec539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6cf10e-b489-4d5d-9c45-808a207bfd79", "name": "network-vif-plugged", "status": "completed", "tag": "bfde49fa-1a76-47b7-b6e0-4057ecdbf45a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:03.989132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5caf1252-8c0f-4e2a-bf19-22ab4a4d7442 req-cd7a40c2-22cc-4ad8-a573-fae1293ec539 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:03.994178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5caf1252-8c0f-4e2a-bf19-22ab4a4d7442 req-cd7a40c2-22cc-4ad8-a573-fae1293ec539 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.037801 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5caf1252-8c0f-4e2a-bf19-22ab4a4d7442 req-cd7a40c2-22cc-4ad8-a573-fae1293ec539 service nova] Creating event network-vif-plugged:bfde49fa-1a76-47b7-b6e0-4057ecdbf45a for instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 on n-h2-849796-1 Jul 18 02:12:04.063812 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5caf1252-8c0f-4e2a-bf19-22ab4a4d7442 req-cd7a40c2-22cc-4ad8-a573-fae1293ec539 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127361 Jul 18 02:12:04.065298 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 97/201] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:04.122188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.123528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:04.147266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.147785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.148620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.154227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.367931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:04.383325 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f93478a4-6f6c-4730-9676-546c6f2a2795 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.445833 Jul 18 02:12:04.397703 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 105/202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:02 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:04.403270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.404166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:04.412072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.413215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.414413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.420240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.449830 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] HTTP exception thrown: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Request method failure captured: Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 HTTP/1.1 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEv0Zvdj17ccKAKaJy_cZwoUQ5wt80XrgzSwsSKcXxI-vykVANudjYqBeTUBTZlNqBriAVYLA3HBfvb8KdipfI6BANus-o671bogEHL5Z6RycAp3dBC0t9Tg8s9C1aCDBGaUgHA2ettsvmrJ0uK2F5-JipCDRbmLZXJn-cz5QY2h34 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:04.472407 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee88fcbd94749b68e23000827f35029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 27d5ded9f0eb4664852708afafa14395 Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:04.474087 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '3013623f-faf9-4857-ada5-e328601bbbb9'} Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:04.474831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:04.483418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:04.485512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Returning 404 to user: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:04.485512 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcfb416c-13eb-4632-ac25-509bb4e2b471 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 404 len: 111 microversion: 2.1 time: 0.075027 Jul 18 02:12:04.485512 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 106/203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:04.491430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97d31d44-19bc-45f8-9627-436366b1b621 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:04.494109 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:04.494109 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:04.522426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97d31d44-19bc-45f8-9627-436366b1b621 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.524007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97d31d44-19bc-45f8-9627-436366b1b621 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.692060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:04.702745 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61904509-91a7-4e7a-be52-9f14574279f8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1409 microversion: 2.1 time: 0.630876 Jul 18 02:12:04.707470 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 98/204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1409 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:04.763999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97d31d44-19bc-45f8-9627-436366b1b621 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.280961 Jul 18 02:12:04.764960 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 107/205] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:04.776200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ef88a96-87c2-4fdc-9f7c-c2d592c6ebf0 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.777727 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:04.777727 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:04.789269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:04.820358 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ef88a96-87c2-4fdc-9f7c-c2d592c6ebf0 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.048722 Jul 18 02:12:04.823845 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 99/206] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:04 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:04.837714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0013eb84-5266-4799-899a-46eafe6c7456 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1305015652"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:04.840697 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:04.840697 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:04.842438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-0013eb84-5266-4799-899a-46eafe6c7456 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid be030353-b4a9-4cbf-8eac-7a577fb88585 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:04.852023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:04.852917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:04.873920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.874418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.875261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.877853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:04.921894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0013eb84-5266-4799-899a-46eafe6c7456 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.089252 Jul 18 02:12:04.929361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 108/207] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:04.940258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-078d9053-defc-493a-bccf-ef6f3a0b12c5 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:04.944359 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:04.944359 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:04.962307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-078d9053-defc-493a-bccf-ef6f3a0b12c5 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:04.963609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-078d9053-defc-493a-bccf-ef6f3a0b12c5 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.243272 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-078d9053-defc-493a-bccf-ef6f3a0b12c5 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.312588 Jul 18 02:12:05.243893 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 109/208] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:05.250897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:05.263969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf6a6b43-c35e-4f17-b504-338a2116e0be tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.270358 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c68ecf6-7a88-4481-bf6d-645eb2a26f52 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1318 microversion: 2.1 time: 0.423543 Jul 18 02:12:05.272841 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:05.272841 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:05.277419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 100/209] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:04 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:05.297178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf6a6b43-c35e-4f17-b504-338a2116e0be tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.042287 Jul 18 02:12:05.300874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 110/210] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:05.321679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44465d04-62c1-4969-a073-df97c900a3e3 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:05.324996 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:05.324996 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:05.345290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44465d04-62c1-4969-a073-df97c900a3e3 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.347734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44465d04-62c1-4969-a073-df97c900a3e3 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.411758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.413577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:05.441729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.442535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.445881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.447323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.636706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44465d04-62c1-4969-a073-df97c900a3e3 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.322266 Jul 18 02:12:05.642181 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 101/211] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:05.658220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59190c71-5f2f-4823-851f-df9f107c670c tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.659612 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:05.659612 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:05.720132 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59190c71-5f2f-4823-851f-df9f107c670c tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.069536 Jul 18 02:12:05.722256 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 102/212] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:05.729237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:05.731384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:05.738751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.739384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.741578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:05.742165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:05.957635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:05.967628 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05698a7d-26ee-4b8d-84fd-a043f8365812 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.243896 Jul 18 02:12:05.968368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 103/213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:05.983707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f04c6822-fe4d-410f-a2a2-961e46ee5838 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1569298836"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:05.985194 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:05.985194 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:05.986195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-f04c6822-fe4d-410f-a2a2-961e46ee5838 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid fe76343d-e02b-4b70-a6b0-1d605f70e1c5 for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:06.011046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:06.020602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64708dc8-75c3-4380-988a-043cbb370927 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 0.619336 Jul 18 02:12:06.021393 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 111/214] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:05 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:06.046067 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f04c6822-fe4d-410f-a2a2-961e46ee5838 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067012 Jul 18 02:12:06.047916 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 104/215] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:06.067040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-222971df-c0cf-4aa6-a67e-a7bb33ec3225 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:06.068702 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:06.068702 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:06.079209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-222971df-c0cf-4aa6-a67e-a7bb33ec3225 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.079947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-222971df-c0cf-4aa6-a67e-a7bb33ec3225 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.323673 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-222971df-c0cf-4aa6-a67e-a7bb33ec3225 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.259953 Jul 18 02:12:06.330170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 105/216] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:06.337017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:06.340856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Calling method '.version_select at 0x7fab05da8310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:06.341703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:06.348452 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:06.348452 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:06.357508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.359867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.363824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.364608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.367632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.368762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.371726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.373030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:06.506929 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88f3e2de-761d-42d4-a4ad-1e530cc9eea0 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.483544 Jul 18 02:12:06.517644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 112/217] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:12:06 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:06.530586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e851ae4-a89d-4bc8-8a8b-ce42fcfb78f0 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:06.533709 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:06.533709 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:06.552077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e851ae4-a89d-4bc8-8a8b-ce42fcfb78f0 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.030978 Jul 18 02:12:06.553686 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 113/218] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:12:06 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:06.825446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f441df68-7076-4158-a1db-0aacfe3e115b tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Calling method '.version_select at 0x7fab05fde280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:06.828200 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:06.828200 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:06.829750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f441df68-7076-4158-a1db-0aacfe3e115b tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f441df68-7076-4158-a1db-0aacfe3e115b tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:06.836711 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:12:06.839306 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:06.840545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 18 02:12:06.842270 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:06.846754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f441df68-7076-4158-a1db-0aacfe3e115b tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:06.850235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f441df68-7076-4158-a1db-0aacfe3e115b tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.292082 Jul 18 02:12:06.851979 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 114/219] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:12:06 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:06.868613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1c45534e-a98f-4711-94ed-40dbc2b1b2ac tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:06.876448 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:06.876448 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:06.903991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c45534e-a98f-4711-94ed-40dbc2b1b2ac tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:06.905016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c45534e-a98f-4711-94ed-40dbc2b1b2ac tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.160912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1c45534e-a98f-4711-94ed-40dbc2b1b2ac tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.304616 Jul 18 02:12:07.161570 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 115/220] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:07.171139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53f61a67-5a4f-4d98-9c57-e75a7a908bff tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Calling method '.version_select at 0x7fab05da81f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.172082 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.172082 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.173412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-53f61a67-5a4f-4d98-9c57-e75a7a908bff tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53f61a67-5a4f-4d98-9c57-e75a7a908bff tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/n-d-849796-1/reboot HTTP/1.1 Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:07.175111 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'n-d-849796-1'} Jul 18 02:12:07.176368 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:07.177125 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 18 02:12:07.178399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.179382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53f61a67-5a4f-4d98-9c57-e75a7a908bff tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:07.179382 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-53f61a67-5a4f-4d98-9c57-e75a7a908bff tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-849796-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.013975 Jul 18 02:12:07.186853 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 116/221] 10.222.0.67 () {58 vars in 1187 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/os-hosts/n-d-849796-1/reboot => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:07.200551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.201234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:07.233794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.234273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.235119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.235577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.249927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:07.327502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.341484 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b1ece45-e482-4dd8-917b-ab5efced32fd tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1318 microversion: 2.1 time: 1.014310 Jul 18 02:12:07.344045 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 106/222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:06 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1318 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:07.359743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.361834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:07.377516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.386263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.387509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:07.388656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:07.388968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:07.692506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.708911 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6fbf96a-8928-473a-a6fd-9604febacaf0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.515894 Jul 18 02:12:07.725965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 117/223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:07.740210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4508c3c3-2649-4ccb-abd3-68ab173f4271 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.742895 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.742895 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.800723 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4508c3c3-2649-4ccb-abd3-68ab173f4271 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.072694 Jul 18 02:12:07.803849 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 118/224] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:07.814995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ce47ca9-a8a2-4976-98f4-c6a27b7a80a7 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Calling method '.version_select at 0x7fab05db6ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.820346 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.820346 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.847714 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1ce47ca9-a8a2-4976-98f4-c6a27b7a80a7 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ce47ca9-a8a2-4976-98f4-c6a27b7a80a7 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:07.850877 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:12:07.852623 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:07.853423 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:12:07.855159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ce47ca9-a8a2-4976-98f4-c6a27b7a80a7 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:07.856158 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ce47ca9-a8a2-4976-98f4-c6a27b7a80a7 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.047165 Jul 18 02:12:07.858046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 119/225] 10.222.0.67 () {58 vars in 1211 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:07.878118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ac3b073-0d37-44a9-b6d9-a8faea22af8b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1553422699"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:07.879740 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.879740 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.880903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-1ac3b073-0d37-44a9-b6d9-a8faea22af8b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid 8c9a6f79-c64d-4291-ab12-9cef7f1e0073 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:07.921001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ac3b073-0d37-44a9-b6d9-a8faea22af8b tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060995 Jul 18 02:12:07.934787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 120/226] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:07.944863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50f93180-4037-4bd1-b50b-e28069d87e41 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Calling method '.version_select at 0x7fab05dadc10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:07.946918 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.946918 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.949343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50f93180-4037-4bd1-b50b-e28069d87e41 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50f93180-4037-4bd1-b50b-e28069d87e41 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/n-d-849796-1 HTTP/1.1 Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:07.952846 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'n-d-849796-1'} Jul 18 02:12:07.954373 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:07.955318 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 18 02:12:07.956608 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:07.958104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50f93180-4037-4bd1-b50b-e28069d87e41 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:07.958104 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50f93180-4037-4bd1-b50b-e28069d87e41 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-849796-1" status: 403 len: 109 microversion: 2.1 time: 0.019592 Jul 18 02:12:07.958104 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 121/227] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/os-hosts/n-d-849796-1 => generated 109 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:07.968825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43e2e19d-3300-4adf-a5d7-9edc26d58465 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:07.971766 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:07.971766 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:07.999851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43e2e19d-3300-4adf-a5d7-9edc26d58465 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.000661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43e2e19d-3300-4adf-a5d7-9edc26d58465 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.295377 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43e2e19d-3300-4adf-a5d7-9edc26d58465 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.335960 Jul 18 02:12:08.301530 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 122/228] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:08.315434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19909aac-7e5f-4783-9ba5-bb0fa85f49a3 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Calling method '.version_select at 0x7fab05dad430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.317077 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:08.317077 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:08.330067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-19909aac-7e5f-4783-9ba5-bb0fa85f49a3 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19909aac-7e5f-4783-9ba5-bb0fa85f49a3 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:08.332225 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:12:08.333495 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.334223 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.335267 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.338887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19909aac-7e5f-4783-9ba5-bb0fa85f49a3 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:08.340072 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19909aac-7e5f-4783-9ba5-bb0fa85f49a3 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037531 Jul 18 02:12:08.341124 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 123/229] 10.222.0.67 () {58 vars in 1190 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:08.346954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc4e7ba5-ba8f-4901-abc0-30fc79250323 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:08.352275 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:08.352275 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:08.364562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc4e7ba5-ba8f-4901-abc0-30fc79250323 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.365586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc4e7ba5-ba8f-4901-abc0-30fc79250323 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.626532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc4e7ba5-ba8f-4901-abc0-30fc79250323 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.283787 Jul 18 02:12:08.633883 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 124/230] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:08 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:08.654614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd9ea65b-eb6e-465e-be50-cb3245c9a8fa tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Calling method '.version_select at 0x7fab05dad820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.655797 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:08.655797 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:08.657347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd9ea65b-eb6e-465e-be50-cb3245c9a8fa tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd9ea65b-eb6e-465e-be50-cb3245c9a8fa tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/n-d-849796-1/shutdown HTTP/1.1 Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:08.659264 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'n-d-849796-1'} Jul 18 02:12:08.660583 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:08.661549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 18 02:12:08.662721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.665438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd9ea65b-eb6e-465e-be50-cb3245c9a8fa tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:08.667827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd9ea65b-eb6e-465e-be50-cb3245c9a8fa tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-849796-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027920 Jul 18 02:12:08.672639 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 125/231] 10.222.0.67 () {58 vars in 1193 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/os-hosts/n-d-849796-1/shutdown => generated 113 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:08.686406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.687894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:08.715418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.717617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.719474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.720614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.755046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:08.764777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81a56447-2feb-4ff3-9b61-c0ac4af712ac tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1319 microversion: 2.1 time: 1.418097 Jul 18 02:12:08.773744 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 107/232] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:07 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1319 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:08.795895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac0384fb-8b66-438a-abb5-587f4d2bb482 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.804908 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:08.804908 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:08.851049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac0384fb-8b66-438a-abb5-587f4d2bb482 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059529 Jul 18 02:12:08.852578 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 108/233] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:08.866165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d7a699b-16ca-4cc7-8527-0226990c0ee6 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Calling method '.version_select at 0x7fab05a75700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.867428 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:08.867428 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:08.882913 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-4d7a699b-16ca-4cc7-8527-0226990c0ee6 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d7a699b-16ca-4cc7-8527-0226990c0ee6 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:08.890687 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:12:08.892204 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:08.893132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:12:08.894667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:08.897429 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:08.900790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d7a699b-16ca-4cc7-8527-0226990c0ee6 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:08.902147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d7a699b-16ca-4cc7-8527-0226990c0ee6 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.043175 Jul 18 02:12:08.912227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 109/234] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:08.921181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:08.922597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:08.938250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.939588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:08.940671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:08.941519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.343620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:09.356370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04009b94-da74-4e29-80e4-8e39e2f822db tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1318 microversion: 2.1 time: 0.682147 Jul 18 02:12:09.370101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 126/235] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:09.371456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e143d9d9-d2b0-4489-9988-69c4a2ba1a45 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796901190"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.378238 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.378238 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:09.383056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-e143d9d9-d2b0-4489-9988-69c4a2ba1a45 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid 717b55e6-cbc9-4744-9e04-e00754398446 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:09.443901 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e143d9d9-d2b0-4489-9988-69c4a2ba1a45 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082196 Jul 18 02:12:09.449800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 127/236] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.473510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfc8ed5d-159d-4f23-909b-0e8c15130a62 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1337245469"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.486730 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.486730 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:09.491534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-cfc8ed5d-159d-4f23-909b-0e8c15130a62 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid e2763576-7b8b-48a6-b991-8280e25a87d0 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:09.555956 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cfc8ed5d-159d-4f23-909b-0e8c15130a62 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.104204 Jul 18 02:12:09.559299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 128/237] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.568709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cb9d5dc-6827-4135-b831-73bfc34f3be6 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Calling method '.version_select at 0x7fab05da88b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.570946 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.570946 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:09.574994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cb9d5dc-6827-4135-b831-73bfc34f3be6 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cb9d5dc-6827-4135-b831-73bfc34f3be6 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hosts/n-d-849796-1/startup HTTP/1.1 Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:09.577272 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'n-d-849796-1'} Jul 18 02:12:09.578838 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:09.579677 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 18 02:12:09.580834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.583729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cb9d5dc-6827-4135-b831-73bfc34f3be6 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:09.584801 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9cb9d5dc-6827-4135-b831-73bfc34f3be6 tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-849796-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.024281 Jul 18 02:12:09.585927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 129/238] 10.222.0.67 () {58 vars in 1190 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/os-hosts/n-d-849796-1/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:09.595696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b223bb4-84a1-455a-aefa-fb23f44a46c7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.597005 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.597005 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:09.653021 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b223bb4-84a1-455a-aefa-fb23f44a46c7 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.062465 Jul 18 02:12:09.656103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 130/239] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:09.669328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f174edb-3d44-4958-841b-22c3f3b6f95c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:09.671680 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.671680 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:09.690873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f174edb-3d44-4958-841b-22c3f3b6f95c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:09.693281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f174edb-3d44-4958-841b-22c3f3b6f95c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:09.839932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:09.865460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99131d88-46fa-4e73-b718-025bca48c8f6 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.949368 Jul 18 02:12:09.868666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 110/240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:08 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:09.890367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d1b0d34-9258-48b7-bf69-46729ce499a9 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Calling method '.version_select at 0x7fab057aef70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.892493 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.892493 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:09.909554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6d1b0d34-9258-48b7-bf69-46729ce499a9 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d1b0d34-9258-48b7-bf69-46729ce499a9 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:09.913666 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'nonexistent_hostname'} Jul 18 02:12:09.915971 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:09.918496 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 18 02:12:09.920397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:09.923939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.926226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d1b0d34-9258-48b7-bf69-46729ce499a9 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:09.935954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d1b0d34-9258-48b7-bf69-46729ce499a9 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.056523 Jul 18 02:12:09.946782 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 111/241] 10.222.0.67 () {58 vars in 1214 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:09.946782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-911eec28-7c76-49a0-813a-45de52a904a4 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:09.947728 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:09.947728 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:09.972448 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-911eec28-7c76-49a0-813a-45de52a904a4 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 18 02:12:09.973459 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f174edb-3d44-4958-841b-22c3f3b6f95c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.313854 Jul 18 02:12:09.974769 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 131/242] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:09 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-911eec28-7c76-49a0-813a-45de52a904a4 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Request method failure captured: Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEzQf23nDG7eLBSgzkmOOzY_7--GF-wSHlKdfzZK91WKiCAQHkb_W5pPRm060DCuuJ-rEwfLY1-pc_Jt3RoMOR6BFqjSDY6dybA-ufaRHHkSPZwZc2SkbdToQrX4PfQxDa67z8kSu5DFZq0-Solb_5Z18-9peDImVrl2iL9fY-ZmEs Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:09.975978 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 48a4d373f982416d90600e3ef828d3df Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: exception: Aggregate 6 could not be found. Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6'} Jul 18 02:12:09.978991 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.981223 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 18 02:12:09.985463 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:09.990598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-911eec28-7c76-49a0-813a-45de52a904a4 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:09.990598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-911eec28-7c76-49a0-813a-45de52a904a4 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.039278 Jul 18 02:12:09.990598 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 112/243] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:09.991372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a91244cd-3f7a-464e-9b2f-1c0c8db6c209 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Action: 'update', calling method: .version_select at 0x7fab057b6f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.000526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.022655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a91244cd-3f7a-464e-9b2f-1c0c8db6c209 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/os-hosts/n-d-849796-1 HTTP/1.1 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 51 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:10.033192 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: {"status": "enable", "maintenance_mode": "invalid"} Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:10.036190 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'n-d-849796-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.037750 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.042697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a91244cd-3f7a-464e-9b2f-1c0c8db6c209 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a91244cd-3f7a-464e-9b2f-1c0c8db6c209 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-849796-1" status: 400 len: 199 microversion: 2.1 time: 0.053533 Jul 18 02:12:10.046747 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 113/244] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:12:09 2022] PUT /compute/v2.1/os-hosts/n-d-849796-1 => generated 199 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:10.048574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.048574 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.048574 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:10.070121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.074488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.075432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.080908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.081454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.082025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.147809 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-849796-1. Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 39 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:10.190371 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: {"add_host": {"host": "n-h1-849796-1"}} Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:10.192787 n-d-849796-1 devstack@n-api.service[119440]: exception: Aggregate 7 already has host n-h1-849796-1. Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-849796-1'}}} Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:12:10.195514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-849796-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:12:10.200088 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:12:10.207572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:12:10.212108 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-849796-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 12, 10, 127311), 'updated_at': None, 'host': 'n-h1-849796-1', 'aggregate_id': 7}] Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.216672 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-849796-1. Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.221467 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-849796-1. Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:10.226520 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-849796-1. Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-849796-1. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54af7b77-6392-445f-8c21-1e6f2187edc4 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.155417 Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 114/245] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6522b6-0c68-460f-8f47-a1f5b611b97d tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.231125 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:10.242330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8c6522b6-0c68-460f-8f47-a1f5b611b97d tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6522b6-0c68-460f-8f47-a1f5b611b97d tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Request method failure captured: Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEzQf23nDG7eLBSgzkmOOzY_7--GF-wSHlKdfzZK91WKiCAQHkb_W5pPRm060DCuuJ-rEwfLY1-pc_Jt3RoMOR6BFqjSDY6dybA-ufaRHHkSPZwZc2SkbdToQrX4PfQxDa67z8kSu5DFZq0-Solb_5Z18-9peDImVrl2iL9fY-ZmEs Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:10.244067 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 48a4d373f982416d90600e3ef828d3df Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: exception: Aggregate 6 could not be found. Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6'} Jul 18 02:12:10.247100 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:10.249434 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.253015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6522b6-0c68-460f-8f47-a1f5b611b97d tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c6522b6-0c68-460f-8f47-a1f5b611b97d tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.053112 Jul 18 02:12:10.257668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 115/246] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:10 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:10.274374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ba30092-5b27-4a68-b635-9a2bb3e7ad33 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Action: 'update', calling method: .version_select at 0x7fab057ae940>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ba30092-5b27-4a68-b635-9a2bb3e7ad33 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/os-hosts/n-d-849796-1 HTTP/1.1 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 51 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:10.281252 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: {"status": "invalid", "maintenance_mode": "enable"} Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:10.283496 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'n-d-849796-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.284892 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.289868 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ba30092-5b27-4a68-b635-9a2bb3e7ad33 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ba30092-5b27-4a68-b635-9a2bb3e7ad33 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-849796-1" status: 400 len: 189 microversion: 2.1 time: 0.030865 Jul 18 02:12:10.294689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 116/247] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:12:10 2022] PUT /compute/v2.1/os-hosts/n-d-849796-1 => generated 189 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:10.299002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-422dc438-ca8a-4696-be48-60536f105c34 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.310490 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.310490 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:10.330694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-422dc438-ca8a-4696-be48-60536f105c34 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.330980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-422dc438-ca8a-4696-be48-60536f105c34 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.582427 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-422dc438-ca8a-4696-be48-60536f105c34 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.288722 Jul 18 02:12:10.584774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 117/248] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:10.591585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-982b3d74-014a-41f3-a6c0-0c1ac56da3d1 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-354775352", "name": "tempest-test_aggregate-1081982960"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.613860 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.613860 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:10.615453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-982b3d74-014a-41f3-a6c0-0c1ac56da3d1 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid 3dc1ccb5-7e54-4e91-87c8-3a355190b467 for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:10.664694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-982b3d74-014a-41f3-a6c0-0c1ac56da3d1 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.077428 Jul 18 02:12:10.666977 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 118/249] 10.222.0.67 () {60 vars in 1164 bytes} [Mon Jul 18 02:12:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:10.674339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6d37878-bff1-4126-92e3-195461c3138f tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Action: 'update', calling method: .version_select at 0x7fab057aeb80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:10.676248 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:10.676248 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:10.678494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6d37878-bff1-4126-92e3-195461c3138f tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '83b2046fc93c406b823663d339ff70c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90dc91052ca4f749bf69605a1aa43cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6d37878-bff1-4126-92e3-195461c3138f tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Request method failure captured: Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/os-hosts/n-d-849796-1 HTTP/1.1 Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 50 Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF0kLvSwijgsTDBakJjTIezVs7-80WHDhNbhqZseDV2YOufGlo2SvlXox-qgeZPA4nQUaLkhpcm3rPKZOV56TmRJIUibpswMvDT6xeCTig_mQtf-5YHUgui2vJKkJ5x5GyHfwMT0dFAzeCLCtHOaT3W10t07og3Sta50rYbx061BDM Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:12:10.680845 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e90dc91052ca4f749bf69605a1aa43cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e90dc91052ca4f749bf69605a1aa43cd Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090500774 Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 83b2046fc93c406b823663d339ff70c3 Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090500774-project Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:12:10.682867 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'n-d-849796-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:10.684095 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 18 02:12:10.685366 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:10.690308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6d37878-bff1-4126-92e3-195461c3138f tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:10.691676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6d37878-bff1-4126-92e3-195461c3138f tempest-HostsAdminNegativeTestJSON-1090500774 tempest-HostsAdminNegativeTestJSON-1090500774-project] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-849796-1" status: 403 len: 111 microversion: 2.1 time: 0.023417 Jul 18 02:12:10.692510 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 119/250] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:12:10 2022] PUT /compute/v2.1/os-hosts/n-d-849796-1 => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:10.700251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:10.701303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:10.711564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.712349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:10.715496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:10.716279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.060157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:11.074929 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68d2eec3-07ab-479a-bd8b-323b283187c4 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1469 microversion: 2.1 time: 1.098626 Jul 18 02:12:11.075489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 132/251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:09 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1469 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:11.099867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8e5c24b-3781-42c0-a36f-cbe096b69925 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.106015 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:11.106015 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:11.159436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:11.160273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8e5c24b-3781-42c0-a36f-cbe096b69925 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.081615 Jul 18 02:12:11.169450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 133/252] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:11.176027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f93605b8-eb2f-4a72-8232-eeb57514959d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1318 microversion: 2.1 time: 0.481993 Jul 18 02:12:11.179465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f1238a7-488f-4833-887c-07d698dbad4f tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.181442 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:11.181442 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:11.190433 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 120/253] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:10 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:11.199935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b20bbae-4a27-41b4-ae27-04841a737e9c tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Action: 'update', calling method: .version_select at 0x7fab05969c10>, body: {"status": null, "maintenance_mode": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b20bbae-4a27-41b4-ae27-04841a737e9c tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/os-hosts/n-d-849796-1 HTTP/1.1 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 42 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:11.205659 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: {"status": null, "maintenance_mode": null} Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:12:11.208093 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'n-d-849796-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'disable', Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Enable', Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'Disable', Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi None Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:11.210007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:11.214662 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b20bbae-4a27-41b4-ae27-04841a737e9c tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:11.219514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b20bbae-4a27-41b4-ae27-04841a737e9c tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-849796-1" status: 400 len: 127 microversion: 2.1 time: 0.021384 Jul 18 02:12:11.222226 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 121/254] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:12:11 2022] PUT /compute/v2.1/os-hosts/n-d-849796-1 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:11.255043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.261859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:11.279744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f1238a7-488f-4833-887c-07d698dbad4f tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.108453 Jul 18 02:12:11.286354 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 134/255] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:11.302810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.303775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.306353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.308339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.792356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:11.795671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:11.823163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.825384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.830989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:11.833116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:11.958108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:12:11.995200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:12.027293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ec58e32-ef49-415f-8259-729974a5cd2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.797553 Jul 18 02:12:12.031042 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 122/256] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:11 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:12.054375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28bcb592-437b-4cad-9dd4-969ae1c9488f tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1419884674"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.059395 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:12.059395 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:12.060486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-28bcb592-437b-4cad-9dd4-969ae1c9488f tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid c9517e83-46a1-4569-919b-2c530343fc8e for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:12.109137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28bcb592-437b-4cad-9dd4-969ae1c9488f tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071425 Jul 18 02:12:12.111471 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 123/257] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:12.133757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Action: 'update', calling method: .version_select at 0x7fab055c11f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.142661 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:12.142661 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:12.146578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.hosts [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Enabling host nonexistent_hostname. Jul 18 02:12:12.176278 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Request method failure captured: Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 50 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF1boli9bUClGHRoBoS7Y0LyPHD9yQu7eoJljF34M9a_YeITYq9GzXyeTbtRgmDHArxKpw3P6u939Zd-4ji2DEu13lpFHktYLAGIDN9VaQOITjVaKq-JgKjD42h5oLlrwKqCXrevforveFabRtO7tkFPhvKTWZECx4T39SArSPx_Is Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:12.196370 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38151f48f7594e7189e95eac4d6e8c86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 38151f48f7594e7189e95eac4d6e8c86 Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-566512835 Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 49d4dcc970e742efb50bd347c1f43f83 Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HostsAdminNegativeTestJSON-566512835-project-admin Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: {"status": "enable", "maintenance_mode": "enable"} Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:12.199567 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:12.202560 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:12.207237 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 18 02:12:12.213775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.222192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:12.223834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb338c2a-b49f-4877-ab05-6533b3e78f98 tempest-HostsAdminNegativeTestJSON-566512835 tempest-HostsAdminNegativeTestJSON-566512835-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.106479 Jul 18 02:12:12.224485 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 124/258] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:12:12 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:12.243539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-161e07a5-ed04-4ea2-adff-becf8668546e tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 204 len: 0 microversion: 2.1 time: 0.955830 Jul 18 02:12:12.259855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 135/259] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:11 2022] DELETE /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:12:12.264410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef7da8d1-00ff-4677-91d2-dc0163576fe2 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:12.272560 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:12.272560 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:12.295785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ef7da8d1-00ff-4677-91d2-dc0163576fe2 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 18 02:12:12.296654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0ed3b34e-5f6e-4065-a324-2499c232bd2b req-18c2bf85-fd7f-4455-8f99-a37077161751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa628e8-e79b-4680-a7ab-ccf7ab9031ac", "name": "network-vif-plugged", "status": "completed", "tag": "1430593b-230c-4072-8775-d099fb6d7a72"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef7da8d1-00ff-4677-91d2-dc0163576fe2 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Request method failure captured: Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEzQf23nDG7eLBSgzkmOOzY_7--GF-wSHlKdfzZK91WKiCAQHkb_W5pPRm060DCuuJ-rEwfLY1-pc_Jt3RoMOR6BFqjSDY6dybA-ufaRHHkSPZwZc2SkbdToQrX4PfQxDa67z8kSu5DFZq0-Solb_5Z18-9peDImVrl2iL9fY-ZmEs Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:12.299908 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 48a4d373f982416d90600e3ef828d3df Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: exception: Aggregate 8 could not be found. Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8'} Jul 18 02:12:12.301875 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.303261 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 18 02:12:12.305209 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.308548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef7da8d1-00ff-4677-91d2-dc0163576fe2 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:12.310147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef7da8d1-00ff-4677-91d2-dc0163576fe2 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.068645 Jul 18 02:12:12.313100 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 125/260] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:12:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:12.318476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ed3b34e-5f6e-4065-a324-2499c232bd2b req-18c2bf85-fd7f-4455-8f99-a37077161751 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.319237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ed3b34e-5f6e-4065-a324-2499c232bd2b req-18c2bf85-fd7f-4455-8f99-a37077161751 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.340006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0ed3b34e-5f6e-4065-a324-2499c232bd2b req-18c2bf85-fd7f-4455-8f99-a37077161751 service nova] Creating event network-vif-plugged:1430593b-230c-4072-8775-d099fb6d7a72 for instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac on n-h1-849796-1 Jul 18 02:12:12.350189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0ed3b34e-5f6e-4065-a324-2499c232bd2b req-18c2bf85-fd7f-4455-8f99-a37077161751 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077548 Jul 18 02:12:12.351286 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 136/261] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:12.389696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:12.395264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:12.413662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.414643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.415811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.417284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.616022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d059f22a-c9ca-49d2-a00c-7eb3c8ce0ba8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:12.617420 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:12.617420 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:12.619980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d059f22a-c9ca-49d2-a00c-7eb3c8ce0ba8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d059f22a-c9ca-49d2-a00c-7eb3c8ce0ba8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 39 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:12:12.622783 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: {"add_host": {"host": "n-h1-849796-1"}} Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:12.624396 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-849796-1'}}} Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:12.625245 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 18 02:12:12.626277 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:12.634074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d059f22a-c9ca-49d2-a00c-7eb3c8ce0ba8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:12.638170 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d059f22a-c9ca-49d2-a00c-7eb3c8ce0ba8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.323866 Jul 18 02:12:12.650997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 126/262] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Jul 18 02:12:12 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:12.661111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:12.670034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:12.678095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:12.696069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.699075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:12.718603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:12.721627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.105019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:13.120218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:13.125103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e206fcd-1223-477f-8ed9-349f3a9c620c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1475 microversion: 2.1 time: 0.472633 Jul 18 02:12:13.127165 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 127/263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:12 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1475 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:13.133607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:13.136712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5eb0bd35-3efc-4279-8712-1bc4206ca6dc tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:13.138760 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:13.138760 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:13.151382 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7528cdd-e231-45b9-ab79-e5911169bd07 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1318 microversion: 2.1 time: 0.798390 Jul 18 02:12:13.158480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5eb0bd35-3efc-4279-8712-1bc4206ca6dc tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 18 02:12:13.173256 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 137/264] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:12 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:13.173256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e19adb9-8777-4a6a-9896-f4bc2a29accd tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:13.174727 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:13.174727 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5eb0bd35-3efc-4279-8712-1bc4206ca6dc tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Request method failure captured: Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEzQf23nDG7eLBSgzkmOOzY_7--GF-wSHlKdfzZK91WKiCAQHkb_W5pPRm060DCuuJ-rEwfLY1-pc_Jt3RoMOR6BFqjSDY6dybA-ufaRHHkSPZwZc2SkbdToQrX4PfQxDa67z8kSu5DFZq0-Solb_5Z18-9peDImVrl2iL9fY-ZmEs Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:13.180653 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8dc0f6df3a914ae294be8cbc0f62a6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8dc0f6df3a914ae294be8cbc0f62a6cc Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079207630 Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 48a4d373f982416d90600e3ef828d3df Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1079207630-project-admin Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: exception: Aggregate 8 could not be found. Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8'} Jul 18 02:12:13.183959 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:13.186898 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:13.190400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5eb0bd35-3efc-4279-8712-1bc4206ca6dc tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5eb0bd35-3efc-4279-8712-1bc4206ca6dc tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.059754 Jul 18 02:12:13.195303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 128/265] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:13.249920 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e19adb9-8777-4a6a-9896-f4bc2a29accd tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.084918 Jul 18 02:12:13.261850 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 138/266] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:13 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:13.287965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:13.289182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:13.308306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.308306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.309651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:13.310450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:13.707022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1638262681", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:13.714711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:13.735050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67cdd541-96ec-4641-ba61-b82b04d2f9cb tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.462406 Jul 18 02:12:13.738102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 139/267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:13 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:13.755787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c6bc4a9a-de24-48ac-b73a-2604ca295554 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-489452842"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:13.761371 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:13.761371 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:13.762765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-c6bc4a9a-de24-48ac-b73a-2604ca295554 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid d8768087-e473-43ce-8ec6-cbf8be49ccd8 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:13.814835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c6bc4a9a-de24-48ac-b73a-2604ca295554 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072196 Jul 18 02:12:13.816910 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 140/268] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:13.833321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-daa89a2f-150e-40b7-9749-b824caf5de36 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-18769890"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:13.836789 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:13.836789 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:13.839725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-daa89a2f-150e-40b7-9749-b824caf5de36 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid 80b7a472-02fc-46f3-86eb-87e1ccd23f1a for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:13.840800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] validate_networks() for [('25bdf20f-59b8-445d-bd9f-eed3ee63ed1a', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:13.866083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:13.927227 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-daa89a2f-150e-40b7-9749-b824caf5de36 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.106492 Jul 18 02:12:13.941032 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 141/269] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:14.183431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-642051281", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "289de125-f75a-44e5-b795-181da195dbd2"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:14.444858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] validate_networks() for [('289de125-f75a-44e5-b795-181da195dbd2', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:14.996722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:14.997682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:15.001553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:15.003279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:15.006655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:15.072107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.073848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.074349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.074808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.129558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Getting quotas for project 8f679ff678064a09a1566c9f58f9344b. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:15.140531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Getting quotas for user c036dd17b7b04f0581ac388e18dfb347 and project 8f679ff678064a09a1566c9f58f9344b. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:15.200529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:15.206694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:15.303610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c6ee818-2f00-4b81-93a9-4b8240bc02db tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107867 Jul 18 02:12:15.310791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 129/270] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:15.323567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2833aea5-9b6f-46fd-9174-8f16961e16bd tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:15.324069 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:15.324069 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:15.352434 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2833aea5-9b6f-46fd-9174-8f16961e16bd tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.040354 Jul 18 02:12:15.354194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 130/271] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:15 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:15.373053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1506583666"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:15.375008 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:15.375008 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:15.403383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.403917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.421648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.422113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.442412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1506583666 could not be found. Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 58 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:15.444971 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: {"add_host": {"host": "tempest-nonexist_host-1506583666"}} Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:15.446151 n-d-849796-1 devstack@n-api.service[119440]: exception: Compute host tempest-nonexist_host-1506583666 could not be found. Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1506583666'}}} Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1506583666' is not mapped to any cell Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:15.446849 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 18 02:12:15.448764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1506583666 could not be found. Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1506583666 could not be found. Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:15.449994 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1506583666 could not be found. Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1506583666 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:15.451332 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-515259ca-9e42-4704-8d15-a32281bba553 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.086843 Jul 18 02:12:15.451961 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 131/272] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:15 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:15.462416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:15.463166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:15.480512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.481047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.481886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:15.486915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:15.944964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:15.968521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae2dce30-3cc8-4e79-8a56-979757179347 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 200 len: 1475 microversion: 2.1 time: 0.515138 Jul 18 02:12:15.970194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 132/273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:15 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:15.997525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:15.998528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:16.017159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.021011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.022512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.024798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.391908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:16.484484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:16.514762 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4578b9f3-4174-4b45-bf10-eb61dc0fa469 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1467 microversion: 2.1 time: 0.541626 Jul 18 02:12:16.516603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 133/274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:15 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1467 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:16.526582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:16.527722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:16.557332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.575060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.577528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.583810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.831126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:16.873463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfb05e06-65c9-478a-b267-881f0153cd19 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.343937 Jul 18 02:12:16.886330 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 134/275] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:16 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:16.886330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:16.886893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:16.895280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.896081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:16.897124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:16.897827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.135140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.177983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-31c4c018-933a-4d6f-aaa1-bcad6c6fa01d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1228 microversion: 2.1 time: 0.295176 Jul 18 02:12:17.179274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 135/276] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:16 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1228 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:17.206262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f69bc47-a3d6-496c-bb70-fdd3f432674c tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:17.219056 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:17.219056 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:17.334988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:17.335784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:17.336721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:17.337198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f69bc47-a3d6-496c-bb70-fdd3f432674c tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.152171 Jul 18 02:12:17.337656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:17.338799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:17.341451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 136/277] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:17 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:17.355400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b26b155-6e97-46a5-9957-e6a282a8ed4d tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.362510 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:17.362510 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:17.409982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.410683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.411509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.411977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.488402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:17.501557 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b26b155-6e97-46a5-9957-e6a282a8ed4d tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.157697 Jul 18 02:12:17.502693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for user 2affc29a14f847a099dad6deaf668842 and project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:17.505160 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 137/278] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:17 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:17.537614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-af7581fd-d81c-4d2a-89df-05cfa12f5a82 req-b1812c13-40de-419f-b272-3fe5bd680b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6cf10e-b489-4d5d-9c45-808a207bfd79", "name": "network-vif-deleted", "tag": "bfde49fa-1a76-47b7-b6e0-4057ecdbf45a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:17.545513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:17.548109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:17.555169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-af7581fd-d81c-4d2a-89df-05cfa12f5a82 req-b1812c13-40de-419f-b272-3fe5bd680b9e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.556400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-af7581fd-d81c-4d2a-89df-05cfa12f5a82 req-b1812c13-40de-419f-b272-3fe5bd680b9e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.595609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-af7581fd-d81c-4d2a-89df-05cfa12f5a82 req-b1812c13-40de-419f-b272-3fe5bd680b9e service nova] Creating event network-vif-deleted:bfde49fa-1a76-47b7-b6e0-4057ecdbf45a for instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 on n-h2-849796-1 Jul 18 02:12:17.610077 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-af7581fd-d81c-4d2a-89df-05cfa12f5a82 req-b1812c13-40de-419f-b272-3fe5bd680b9e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100618 Jul 18 02:12:17.612796 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 138/279] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:17.685182 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-157577d9-0220-4ce9-849d-8673b78956c7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.742069 Jul 18 02:12:17.691780 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 142/280] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:12:17.698482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.699358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:17.707600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.708067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.723778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:17.724436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:17.756582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 HTTP/1.1 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:17.761782 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:17.763171 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1d6cf10e-b489-4d5d-9c45-808a207bfd79'} Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:17.763955 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:17.765514 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.767900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:17.769008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1ce7d68-1cf1-41bd-bca7-54efefe94c5f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 404 len: 111 microversion: 2.1 time: 0.075958 Jul 18 02:12:17.783412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 143/281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:17 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:17.789102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-072007bc-a134-4d13-b990-2f28d8e9cf59 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.790576 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:17.790576 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:17.802026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-072007bc-a134-4d13-b990-2f28d8e9cf59 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.016975 Jul 18 02:12:17.803325 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 144/282] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:17 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:17.810406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9d49f46-7d0b-4c82-a31e-70fdd89247bc tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9d49f46-7d0b-4c82-a31e-70fdd89247bc tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 283 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:17.825284 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:17.826695 n-d-849796-1 devstack@n-api.service[119439]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:12:17.827478 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:17.828342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:17.829895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:17.831557 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:12:17.831557 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:17.832864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9d49f46-7d0b-4c82-a31e-70fdd89247bc tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:17.834314 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9d49f46-7d0b-4c82-a31e-70fdd89247bc tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029178 Jul 18 02:12:17.841584 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 145/283] 10.222.0.67 () {60 vars in 1164 bytes} [Mon Jul 18 02:12:17 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:17.847880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.848845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:17.934094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.945409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.958620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:17.960300 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f85af974-e46c-41d4-ac16-a3a90696822b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1261 microversion: 2.25 time: 0.117088 Jul 18 02:12:17.972655 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 146/284] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:17 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:17.980398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77df2f22-0f2c-4bff-aa37-9fd737612673 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:17.982583 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:17.982583 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:18.035662 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-77df2f22-0f2c-4bff-aa37-9fd737612673 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.065370 Jul 18 02:12:18.038086 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 147/285] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:17 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:18.057418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ff99d10d-deec-433e-aefd-45fc30534908 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ff99d10d-deec-433e-aefd-45fc30534908 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 27 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:18.062446 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: {"aggregate": {"name": ""}} Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:18.065217 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '' Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:18.067361 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:12:18.070668 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.076703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ff99d10d-deec-433e-aefd-45fc30534908 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:18.078967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ff99d10d-deec-433e-aefd-45fc30534908 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.038901 Jul 18 02:12:18.080143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 148/286] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:18 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:18.093180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:18.095877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:18.109005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.109970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.111516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.112458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.603006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:18.678873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-604028536", "block_migration": true, "disk_over_commit": false}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:18.683504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:18.687858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7fb3181b-090d-40ac-9106-6cf656b816a3 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.604938 Jul 18 02:12:18.695141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 149/287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:18 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:18.711274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43af80ff-d810-47b5-9f09-fb1ab9e1c2c6 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-288098086", "availability_zone": "tempest-test_az-1092337543"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:18.715703 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:18.715703 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:18.718722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-43af80ff-d810-47b5-9f09-fb1ab9e1c2c6 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid 8aaedf39-cb2e-4acd-8dc0-4b160c1a3144 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:18.768205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.770924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.774463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.777228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.784654 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43af80ff-d810-47b5-9f09-fb1ab9e1c2c6 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.087620 Jul 18 02:12:18.788432 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 150/288] 10.222.0.67 () {60 vars in 1164 bytes} [Mon Jul 18 02:12:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:18.805764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f276048-ac8e-48c2-b804-bc5c3be8e0c6 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1753905119"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:18.828548 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:18.828548 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:18.833936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3f276048-ac8e-48c2-b804-bc5c3be8e0c6 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f276048-ac8e-48c2-b804-bc5c3be8e0c6 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 60 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:18.848291 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: {"aggregate": {"name": "tempest-test_aggregate-1753905119"}} Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:18.851524 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1753905119'}}} Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:18.854018 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:18.858572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 18 02:12:18.860655 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:18.860655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f276048-ac8e-48c2-b804-bc5c3be8e0c6 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:18.860655 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f276048-ac8e-48c2-b804-bc5c3be8e0c6 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.062052 Jul 18 02:12:18.860655 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 151/289] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:18 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:18.909771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:18.911274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:18.943621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.946212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:18.959134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:18.959920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.186134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lazy-loading 'flavor' on Instance uuid 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:19.218345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:19.235756 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e2d2cbc-bd08-498e-829f-890fcde2ebb3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1294 microversion: 2.1 time: 0.369116 Jul 18 02:12:19.241141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 152/290] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:18 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1294 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:19.257681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1915727227", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:19.392034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:19.418906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Going to try to live migrate instance to tempest-host-604028536 {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:12:19.429061 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] HTTP exception thrown: Compute host tempest-host-604028536 could not be found. Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Request method failure captured: Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac/action HTTP/1.1 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 106 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MFhlGWOtojJg9wJM6xRlfflxvn4bYiIxBe_pZx5Al3c9VZGTaJ0cTn1bpxmBaOg5gYyFSyI4mk26wuXfSbDCfK6XN8p_nl7dGo_1vwaxaMD35-nTqR8eIkE9t6ZmjIefXJ3klvpbSa5ItGOCRQJCGmlTeC5LurDVOWPXBJN-hg5uak Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dfdb1b6667804f369faf477c18704663 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:19.438497 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dfdb1b6667804f369faf477c18704663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dfdb1b6667804f369faf477c18704663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dfdb1b6667804f369faf477c18704663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dfdb1b6667804f369faf477c18704663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dfdb1b6667804f369faf477c18704663 Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-LiveMigrationNegativeTest-182102092-project-admin Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: f5178a0346ad4c109ed500a88a90ac8c Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-LiveMigrationNegativeTest-182102092-project-admin Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: {"os-migrateLive": {"host": "tempest-host-604028536", "block_migration": true, "disk_over_commit": false}} Jul 18 02:12:19.440651 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: exception: Compute host tempest-host-604028536 could not be found. Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1aa628e8-e79b-4680-a7ab-ccf7ab9031ac', 'body': {'os-migrateLive': {'host': 'tempest-host-604028536', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:12:19.441781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-604028536 could not be found. Jul 18 02:12:19.443905 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-604028536 could not be found. Jul 18 02:12:19.446636 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-604028536 could not be found. Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Returning 400 to user: Compute host tempest-host-604028536 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ca543f2-0d57-4efb-9766-abf84a20f83d tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac/action" status: 400 len: 99 microversion: 2.1 time: 1.823134 Jul 18 02:12:19.451599 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 139/291] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Jul 18 02:12:17 2022] POST /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac/action => generated 99 bytes in 1827 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:12:19.455551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33bd892d-58f8-4f30-a970-8c4cc5947b82 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-288098086_new", "availability_zone": "tempest-test_az-1092337543_new"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:19.460398 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:19.460398 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:19.547628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bd892d-58f8-4f30-a970-8c4cc5947b82 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.548671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bd892d-58f8-4f30-a970-8c4cc5947b82 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.635541 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33bd892d-58f8-4f30-a970-8c4cc5947b82 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 336 microversion: 2.1 time: 0.192045 Jul 18 02:12:19.645503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 140/292] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:12:19 2022] PUT /compute/v2.1/os-aggregates/12 => generated 336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:19.645503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-89eda699-fae5-4d12-9a22-959499755115 req-e9796107-0545-46f5-958f-5f50886d3874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9eaca4-4373-41ba-9017-7cb68dca58fb", "name": "network-vif-plugged", "status": "completed", "tag": "ffc606bf-c733-45cf-ad7c-3e7bbec54391"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:19.662588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-89eda699-fae5-4d12-9a22-959499755115 req-e9796107-0545-46f5-958f-5f50886d3874 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.663400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-89eda699-fae5-4d12-9a22-959499755115 req-e9796107-0545-46f5-958f-5f50886d3874 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.698728 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-89eda699-fae5-4d12-9a22-959499755115 req-e9796107-0545-46f5-958f-5f50886d3874 service nova] Creating event network-vif-plugged:ffc606bf-c733-45cf-ad7c-3e7bbec54391 for instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb on n-h1-849796-1 Jul 18 02:12:19.715483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-89eda699-fae5-4d12-9a22-959499755115 req-e9796107-0545-46f5-958f-5f50886d3874 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073483 Jul 18 02:12:19.716739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 141/293] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:19.730011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae3c7989-deff-4f21-bd4a-c47ba6778b95 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-437278338"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:19.733963 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:19.733963 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:19.736242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-ae3c7989-deff-4f21-bd4a-c47ba6778b95 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid 65faabaf-2e74-4cae-bd54-3e7210dde700 for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:19.810656 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae3c7989-deff-4f21-bd4a-c47ba6778b95 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091481 Jul 18 02:12:19.812645 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 142/294] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:19.821890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:19.823789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:19.849196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.850026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:19.851452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:19.852201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.166414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:20.208295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:20.217678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:20.227495 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51643462-df2d-4932-a125-5eea407dc11c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1257 microversion: 2.25 time: 0.405222 Jul 18 02:12:20.230712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 143/295] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:19 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1257 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:20.247834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:20.252371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:20.269133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.269598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.270427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.271621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.342351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:20.344464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:20.346994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:20.348045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:20.350223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:20.391058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.396837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.402682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.411440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.499954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Getting quotas for project 0855591e3a664a5d8110f637a3172a00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:20.522007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Getting quotas for user 0c7dfafed8804a84b705d3f685f5916d and project 0855591e3a664a5d8110f637a3172a00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:20.566054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:20.579223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:20.667036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:20.715562 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27565ee2-e667-4ce1-8a1c-ae6649d4fcd3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1467 microversion: 2.1 time: 0.480277 Jul 18 02:12:20.730513 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 144/296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:20 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1467 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:20.746365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49644abb-9625-4042-94f3-74dc0cd4f938 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:20.753902 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:20.753902 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:20.812709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49644abb-9625-4042-94f3-74dc0cd4f938 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 553 microversion: 2.1 time: 0.079709 Jul 18 02:12:20.814220 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 145/297] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:12:20 2022] GET /compute/v2.1/os-aggregates => generated 553 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:20.844618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:20.847377 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fcbcad93-7eb9-49e7-8d0f-56b913de2fff tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598521 Jul 18 02:12:20.848906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 153/298] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:20.855492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:20.885831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-437278338"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:20.894903 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:20.894903 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:20.921341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid 3f473f03-dcc4-4c1a-bdc1-18758364a101 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:20.931011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.931929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.942225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:20.943252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:20.959576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-437278338 already exists. Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 59 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:20.968797 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: {"aggregate": {"name": "tempest-test_aggregate-437278338"}} Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:20.971175 n-d-849796-1 devstack@n-api.service[119439]: exception: Aggregate tempest-test_aggregate-437278338 already exists. Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-437278338'}}} Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 18 02:12:20.972605 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-437278338 already exists. Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:20.974639 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-437278338 already exists. Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-437278338 already exists. Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:20.980971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-437278338 already exists. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:20.990798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-229f8234-e3a4-4f87-b699-4cd682aacf8a tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.118386 Jul 18 02:12:20.990798 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 154/299] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:20 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:21.009186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.013548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:21.047017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.051235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.059956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.060751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.334244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:21.355147 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-657c6aa5-00ad-4c2e-b555-cf68d200d8ce tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1282 microversion: 2.1 time: 0.367477 Jul 18 02:12:21.370515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 155/300] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:20 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:21.383365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ebca970-485f-43d5-9114-d092d1dcdbfb tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.385134 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:21.385134 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:21.450827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ebca970-485f-43d5-9114-d092d1dcdbfb tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.075151 Jul 18 02:12:21.454593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 156/301] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:21 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:21.474414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df636cd7-c6ec-4d48-a8c2-42cb9a312039 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.476271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df636cd7-c6ec-4d48-a8c2-42cb9a312039 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:21.701160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:21.717559 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3716dd6a-181d-494d-b338-6c288666f95b tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1388 microversion: 2.1 time: 0.901119 Jul 18 02:12:21.719057 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 146/302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:20 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1388 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:21.727360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9f8c529-b0f2-4c60-a233-42fb4ccfba99 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.732732 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:21.732732 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:21.801101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9f8c529-b0f2-4c60-a233-42fb4ccfba99 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.079875 Jul 18 02:12:21.801990 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 147/303] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:21 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:21.812675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-421905653", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:21.826762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-df636cd7-c6ec-4d48-a8c2-42cb9a312039 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:21.862387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df636cd7-c6ec-4d48-a8c2-42cb9a312039 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1220 microversion: 2.1 time: 0.403778 Jul 18 02:12:21.866239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 157/304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:21 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1220 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:21.892367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:21.894051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:21.905553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.908042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.909784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:21.910824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:21.979048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:22.110015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:22.133991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:22.147634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:22.162882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8bfb3edb-3dda-4a3a-9257-c118f832d653 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1319 microversion: 2.25 time: 0.280292 Jul 18 02:12:22.164825 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 158/305] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:21 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:22.198753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a8d540c-de38-4a39-a4ff-ef8de7fde294 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-436119004"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:22.202750 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:22.202750 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:22.206900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-8a8d540c-de38-4a39-a4ff-ef8de7fde294 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Generated uuid 2ec360b3-e97a-437c-bbc0-0a6b844d44e4 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:22.286540 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a8d540c-de38-4a39-a4ff-ef8de7fde294 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103195 Jul 18 02:12:22.288395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 159/306] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:22.629731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:22.630283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:22.630918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:22.631746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:22.632315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:22.660062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.660894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.663931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.666330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.705165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Getting quotas for project 9bd68bb21b5342f79e7b7791f86bed46. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:22.711089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Getting quotas for user 0ea8026d405a4803b54b77de93cb9d01 and project 9bd68bb21b5342f79e7b7791f86bed46. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:22.745922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:22.751143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:22.751774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Calling method '.version_select at 0x7fab05da8ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:22.754538 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:22.754538 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:22.757634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.758688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.804007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.805568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.868019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ac670ef-41eb-4222-a738-22ff4b487c35 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062133 Jul 18 02:12:22.873875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 148/307] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:22.887873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a122cfa7-d9f8-4242-a79f-bc29f616e948 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675110258"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:22.891700 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:22.891700 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:22.894586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-a122cfa7-d9f8-4242-a79f-bc29f616e948 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid 0217d369-265d-403d-8eaf-98a52203c016 for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:22.907308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:22.923264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.924658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.968707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:22.971085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:22.972839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a122cfa7-d9f8-4242-a79f-bc29f616e948 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091430 Jul 18 02:12:22.974524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 149/308] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:23.005125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed5a1ce7-948b-4b51-add6-aebb144b8de9 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.006958 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:23.006958 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:23.015484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:23.036086 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed5a1ce7-948b-4b51-add6-aebb144b8de9 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 444 microversion: 2.1 time: 0.054528 Jul 18 02:12:23.037233 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 150/309] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:12:22 2022] GET /compute/v2.1/os-aggregates => generated 444 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:23.061282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.063973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.068221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.069958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:23.084113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.085268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.087294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.088452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.099259 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5bd41d0-4721-4c66-b87c-6d87c6759d25 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.807534 Jul 18 02:12:23.117160 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 160/310] 10.222.0.67 () {60 vars in 1242 bytes} [Mon Jul 18 02:12:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:23.127158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.128676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:23.156293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.157382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.158976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.168992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.910286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:23.924508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3137535a-d485-42d6-9db1-7ed6bb2cdb2d tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1588 microversion: 2.1 time: 0.805249 Jul 18 02:12:23.926310 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 161/311] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1588 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:23.936145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:23.938823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:23.952346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.952835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:23.956744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:23.957601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.158673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:24.199188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2a053c2-3cfd-4c1d-b548-a73f497dcd3b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1222 microversion: 2.1 time: 0.271636 Jul 18 02:12:24.203169 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 162/312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:24.215665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.219867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:24.228889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.229423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.230474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.231086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.292240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:24.309912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b63033d3-a6b2-4b8d-b8c7-f0fc8eeac34e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 1.262875 Jul 18 02:12:24.311526 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 151/313] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:23 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:24.327169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb5865e9-aee1-494f-8d17-824502b98b92 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.331502 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:24.331502 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:24.334848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb5865e9-aee1-494f-8d17-824502b98b92 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb5865e9-aee1-494f-8d17-824502b98b92 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:12:24.342789 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:12:24.344548 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '15'} Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:24.345448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 18 02:12:24.346514 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:24.354438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb5865e9-aee1-494f-8d17-824502b98b92 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:24.356380 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb5865e9-aee1-494f-8d17-824502b98b92 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.042526 Jul 18 02:12:24.365846 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 152/314] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:24 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:24.388301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a67ddc7-77ab-478e-93b9-3eb771cdbf72 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.463820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a67ddc7-77ab-478e-93b9-3eb771cdbf72 tempest-AggregatesAdminTestJSON-1079207630 tempest-AggregatesAdminTestJSON-1079207630-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.086493 Jul 18 02:12:24.464862 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 153/315] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:24 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:24.474034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Calling method '.version_select at 0x7fab05976c10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.478389 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:24.478389 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:24.481792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.484108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.504325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:24.538913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4554ff1f-cb0c-46d0-84e0-008f787fb0be tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1278 microversion: 2.1 time: 0.331165 Jul 18 02:12:24.540084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 163/316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:24.540296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.541541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.550324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.565785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:24.592500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.595547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.597165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.606143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.654282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.658564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.685760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.686439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.717303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.717946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.732421 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a3f93ce-b17e-4494-9503-97d85cbd5737 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.266421 Jul 18 02:12:24.733421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 154/317] 10.222.0.67 () {60 vars in 1221 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:24.740600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:24.741346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:24.755367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.756171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:24.768135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:24.768135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.188311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:25.219616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:25.222923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:25.227496 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bd7de9a-1f9a-47c3-8c67-7eea8e859fa6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.681035 Jul 18 02:12:25.235725 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 164/318] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:25.253788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-509f086b-fd27-48af-a1aa-a6aa407805b1 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.258852 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:25.258852 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:25.296964 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52194f22-eb28-4ad2-bcf9-480e0138fcc2 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.561774 Jul 18 02:12:25.301849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:25.309773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 155/319] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:12:24 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb/os-interface => generated 285 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:25.348212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-509f086b-fd27-48af-a1aa-a6aa407805b1 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.106364 Jul 18 02:12:25.349509 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 165/320] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:25.364266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Calling method '.version_select at 0x7fab05dd65e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.376273 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:25.376273 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:25.377885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.388045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:25.390560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.391882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.421008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.421870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.427252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.428715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.464718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.465626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.483206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5883046d-be03-4b52-b273-e75fb3234149 tempest-HypervisorAdminV253TestBase-101268779 tempest-HypervisorAdminV253TestBase-101268779-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/5abbb3b4-0d4e-49b4-acbb-d568d81448b1" status: 200 len: 792 microversion: 2.53 time: 0.131356 Jul 18 02:12:25.485549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 166/321] 10.222.0.67 () {60 vars in 1297 bytes} [Mon Jul 18 02:12:25 2022] GET /compute/v2.1/os-hypervisors/5abbb3b4-0d4e-49b4-acbb-d568d81448b1 => generated 792 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:25.498327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.499475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:25.527463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] HTTP exception thrown: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:25.533424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Request method failure captured: Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 HTTP/1.1 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEv0Zvdj17ccKAKaJy_cZwoUQ5wt80XrgzSwsSKcXxI-vykVANudjYqBeTUBTZlNqBriAVYLA3HBfvb8KdipfI6BANus-o671bogEHL5Z6RycAp3dBC0t9Tg8s9C1aCDBGaUgHA2ettsvmrJ0uK2F5-JipCDRbmLZXJn-cz5QY2h34 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:12:25.534952 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee88fcbd94749b68e23000827f35029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 27d5ded9f0eb4664852708afafa14395 Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:25.537476 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3013623f-faf9-4857-ada5-e328601bbbb9'} Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:25.538883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:25.542015 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:25.546325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.554191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.554191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.555472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Returning 404 to user: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:25.555970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72105850-f2fa-41d0-8c52-bc850796dd52 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 404 len: 111 microversion: 2.1 time: 0.244198 Jul 18 02:12:25.569350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 156/322] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:25 2022] DELETE /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:25.595977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:25.596885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:25.610634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.611380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:25.612879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:25.624103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.215710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:26.225876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90e3e9df-1979-4d18-8175-9f1bcf4b42e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1276 microversion: 2.1 time: 0.739249 Jul 18 02:12:26.227637 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 167/323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:25 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1276 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:26.252519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68f417e4-fbf6-4612-a4f1-96a59d94e0e2 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.253958 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:26.253958 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:26.276541 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-68f417e4-fbf6-4612-a4f1-96a59d94e0e2 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68f417e4-fbf6-4612-a4f1-96a59d94e0e2 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:26.278643 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: exception: Aggregate -1 could not be found. Jul 18 02:12:26.279834 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '-1'} Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:26.280489 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.281566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 02:12:26.282689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.285438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68f417e4-fbf6-4612-a4f1-96a59d94e0e2 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:26.286798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68f417e4-fbf6-4612-a4f1-96a59d94e0e2 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045205 Jul 18 02:12:26.287966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 168/324] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:26 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:26.293602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.294592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:26.307283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.310849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.313648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.319037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.552966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:26.589141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cec5521d-f180-4b2f-9239-50cf81c98256 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 1.005726 Jul 18 02:12:26.591845 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 157/325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:25 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:26.608006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.617171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] [instance: 3013623f-faf9-4857-ada5-e328601bbbb9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:26.683678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.686665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.688452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.689979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.735699 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] HTTP exception thrown: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Request method failure captured: Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 HTTP/1.1 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MEv0Zvdj17ccKAKaJy_cZwoUQ5wt80XrgzSwsSKcXxI-vykVANudjYqBeTUBTZlNqBriAVYLA3HBfvb8KdipfI6BANus-o671bogEHL5Z6RycAp3dBC0t9Tg8s9C1aCDBGaUgHA2ettsvmrJ0uK2F5-JipCDRbmLZXJn-cz5QY2h34 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:12:26.741899 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1ee88fcbd94749b68e23000827f35029"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1ee88fcbd94749b68e23000827f35029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1ee88fcbd94749b68e23000827f35029 Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890451959 Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 27d5ded9f0eb4664852708afafa14395 Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AggregatesAdminTestJSON-1890451959-project Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:26.744736 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3013623f-faf9-4857-ada5-e328601bbbb9'} Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:26.747777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. Jul 18 02:12:26.751699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:26.753937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] Returning 404 to user: Instance 3013623f-faf9-4857-ada5-e328601bbbb9 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:26.753937 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c37f102b-5956-4464-a913-338afdba2a75 tempest-AggregatesAdminTestJSON-1890451959 tempest-AggregatesAdminTestJSON-1890451959-project] 10.222.0.67 "GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9" status: 404 len: 111 microversion: 2.1 time: 0.155025 Jul 18 02:12:26.756425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 158/326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:26 2022] GET /compute/v2.1/servers/3013623f-faf9-4857-ada5-e328601bbbb9 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:26.762873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-831fc571-91f8-42ea-b264-c5a3e062ef60 req-921970d0-a6f5-42f4-a75a-5d833ea37613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:26.835403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-831fc571-91f8-42ea-b264-c5a3e062ef60 req-921970d0-a6f5-42f4-a75a-5d833ea37613 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.841711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-831fc571-91f8-42ea-b264-c5a3e062ef60 req-921970d0-a6f5-42f4-a75a-5d833ea37613 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.872842 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-831fc571-91f8-42ea-b264-c5a3e062ef60 req-921970d0-a6f5-42f4-a75a-5d833ea37613 service nova] Creating event network-changed:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:12:26.891054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-831fc571-91f8-42ea-b264-c5a3e062ef60 req-921970d0-a6f5-42f4-a75a-5d833ea37613 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128983 Jul 18 02:12:26.893352 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 159/327] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:26.933458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:26.951086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:26.977597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.985761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.986646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:26.987106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:26.993544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:27.537381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.549599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e9640a8-02ac-43a8-81e9-8bf8cfa8a8e7 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 1.260247 Jul 18 02:12:27.550207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 169/328] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:26 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:27.563070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26dbed31-295c-4c4b-89f6-1833cc96c8a8 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609002058"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:27.567761 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:27.567761 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:27.571778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-26dbed31-295c-4c4b-89f6-1833cc96c8a8 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid be7ec1f8-ceae-4652-8512-8c8d10603fbf for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:27.621978 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26dbed31-295c-4c4b-89f6-1833cc96c8a8 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070644 Jul 18 02:12:27.624046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 170/329] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:27.635701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:27.637153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:27.653227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:27.655586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:27.658292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:27.660478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:27.675818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.698497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.700805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.706647 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b81c266-895a-4366-955b-d63b0c34ebab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.808107 Jul 18 02:12:27.707438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 160/330] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:26 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:27.729739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:27.733434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:27.754623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:27.755937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:27.760886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:27.764549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:27.922550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.936726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df4a5ba6-4c14-4081-9d10-0bf35d7427be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1276 microversion: 2.1 time: 0.311082 Jul 18 02:12:27.941137 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 171/331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:27 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:27.946183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4591c76-fdb2-49ad-abec-c80688a817b8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:27.957620 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:27.957620 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:27.958932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4591c76-fdb2-49ad-abec-c80688a817b8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4591c76-fdb2-49ad-abec-c80688a817b8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:27.960626 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:12:27.963661 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '16'} Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:27.965049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:27.968631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4591c76-fdb2-49ad-abec-c80688a817b8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:27.970730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4591c76-fdb2-49ad-abec-c80688a817b8 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.019907 Jul 18 02:12:27.970730 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 172/332] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:27 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:27.974450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08c0f211-4a25-4ce2-8479-25b0dec68822 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:27.977134 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:27.977134 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.035074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08c0f211-4a25-4ce2-8479-25b0dec68822 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.060544 Jul 18 02:12:28.038088 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 173/333] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:27 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 18 02:12:28.064613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-536cacb7-fb90-435f-a314-adbf96342ff9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.069100 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:28.069100 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.098273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-536cacb7-fb90-435f-a314-adbf96342ff9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-536cacb7-fb90-435f-a314-adbf96342ff9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:28.104803 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: exception: Aggregate -1 could not be found. Jul 18 02:12:28.106193 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '-1'} Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.106872 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 18 02:12:28.107957 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.113378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-536cacb7-fb90-435f-a314-adbf96342ff9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:28.115493 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-536cacb7-fb90-435f-a314-adbf96342ff9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.065586 Jul 18 02:12:28.117249 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 174/334] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:28.146316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8de6f78-a765-4fbe-ae5e-de3b0abf3c87 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.147384 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:28.147384 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.148334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e8de6f78-a765-4fbe-ae5e-de3b0abf3c87 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8de6f78-a765-4fbe-ae5e-de3b0abf3c87 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:28.150031 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:12:28.151705 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:28.152529 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.153966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8de6f78-a765-4fbe-ae5e-de3b0abf3c87 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:28.155205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8de6f78-a765-4fbe-ae5e-de3b0abf3c87 tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024622 Jul 18 02:12:28.155205 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 175/335] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:28.166373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b7fd3f8-ebf1-49f4-996a-5b886dc1c52c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-464801224"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:28.167794 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:28.167794 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.168754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-2b7fd3f8-ebf1-49f4-996a-5b886dc1c52c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid 53cd2ae7-9554-4526-9df9-9a7257ff4061 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:28.217142 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b7fd3f8-ebf1-49f4-996a-5b886dc1c52c tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056238 Jul 18 02:12:28.217764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 176/336] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:12:28.233275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-173620f6-f5d3-413c-bb9f-899b1e3bea11 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:28.234650 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:28.234650 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.249953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173620f6-f5d3-413c-bb9f-899b1e3bea11 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.250347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173620f6-f5d3-413c-bb9f-899b1e3bea11 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:28.561860 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-173620f6-f5d3-413c-bb9f-899b1e3bea11 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.334072 Jul 18 02:12:28.562906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 177/337] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:12:28.578252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02335200-26be-4db5-b0ba-c62fadd19b6f tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:28.580296 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:28.580296 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:28.581926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-02335200-26be-4db5-b0ba-c62fadd19b6f tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2daa040dc60e4a228b05665be5f3f55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b56e423004863a54bd80cd02eaa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02335200-26be-4db5-b0ba-c62fadd19b6f tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Request method failure captured: Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 42 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MEx4MuTgP4ujuxjrxfTIrXmADMAuS-TKsxSeILT9DewSq1Iy2iWW-77SHocL39s4NFcBqpvfTPLAmaSVm0es_hzUaIw0ygkjwuqNHsOxwYznGDETv65tV70KsBsd8QRXp9xDtLndEw0IsM-TCJw9pPSaT9V88HTkqiH6P1_3I5--Ng Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:28.583797 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_409b56e423004863a54bd80cd02eaa31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/409b56e423004863a54bd80cd02eaa31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 409b56e423004863a54bd80cd02eaa31 Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815 Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2daa040dc60e4a228b05665be5f3f55f Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1536140815-project Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: {"remove_host": {"host": "n-h1-849796-1"}} Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:28.585066 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-849796-1'}}} Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:28.585797 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 18 02:12:28.586831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:28.591267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02335200-26be-4db5-b0ba-c62fadd19b6f tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:28.592146 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02335200-26be-4db5-b0ba-c62fadd19b6f tempest-AggregatesAdminNegativeTestJSON-1536140815 tempest-AggregatesAdminNegativeTestJSON-1536140815-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018061 Jul 18 02:12:28.592827 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 178/338] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:28.605149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:28.610580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:28.628608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.630092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:28.631168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:28.631833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.059121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:29.072567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60160387-ba7d-485b-afea-d6310233d09d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 1.357699 Jul 18 02:12:29.091516 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 161/339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:27 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:29.103839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50ac3ae3-9fac-4cc0-af00-49ca5585e3ea tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:29.105628 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:29.105628 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:29.117622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:29.129594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ac3ae3-9fac-4cc0-af00-49ca5585e3ea tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.137276 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-253a8e6e-261f-4d51-ac01-df60368cf264 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.534164 Jul 18 02:12:29.139512 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 179/340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:28 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:29.153903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ac3ae3-9fac-4cc0-af00-49ca5585e3ea tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.170622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:29.175273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:29.192040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.192542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.193426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.193886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.436972 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50ac3ae3-9fac-4cc0-af00-49ca5585e3ea tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.343498 Jul 18 02:12:29.438545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 162/341] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:29.449453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:29.450585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:29.469675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.473756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.475108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:29.475771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:29.920536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:29.942980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:29.961202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:29.970213 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5eb6eccc-f4e8-4ee4-9317-f3a0a0e90175 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.828027 Jul 18 02:12:29.974562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 180/342] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:29 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:29.986913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-33b82190-d896-4c07-82fd-4b1ed2d150da req-f34852a4-23de-4d47-84f4-e4a45a0faf32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:30.019023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33b82190-d896-4c07-82fd-4b1ed2d150da req-f34852a4-23de-4d47-84f4-e4a45a0faf32 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.021158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33b82190-d896-4c07-82fd-4b1ed2d150da req-f34852a4-23de-4d47-84f4-e4a45a0faf32 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.048134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:30.065411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97d6dd42-fa12-491c-8d35-ed2693e2eef9 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.624171 Jul 18 02:12:30.083102 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 163/343] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:29 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:30.086344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-33b82190-d896-4c07-82fd-4b1ed2d150da req-f34852a4-23de-4d47-84f4-e4a45a0faf32 service nova] Creating event network-changed:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h2-849796-1 Jul 18 02:12:30.096488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fee7121f-a028-4cd9-824c-1403d4c65e6b tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.108540 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:30.108540 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:30.114639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-33b82190-d896-4c07-82fd-4b1ed2d150da req-f34852a4-23de-4d47-84f4-e4a45a0faf32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135398 Jul 18 02:12:30.120195 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 181/344] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:30.153884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.155985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:30.172372 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fee7121f-a028-4cd9-824c-1403d4c65e6b tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.088005 Jul 18 02:12:30.173335 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 164/345] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:30.183804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.186687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:30.196710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.209016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.210063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.210537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.211582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.212037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.213932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.215164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.450664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:30.602707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:30.614869 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d2992a4-bff6-4bb1-a435-bd530d85ed86 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.489086 Jul 18 02:12:30.616535 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 182/346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:30 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:30.635686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-678c1727-e2f0-483d-a4c0-80d2a848eae9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1226608589"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:30.644953 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:30.644953 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:30.646650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.aggregate [None req-678c1727-e2f0-483d-a4c0-80d2a848eae9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Generated uuid a0f1f7c4-ad95-4b6b-91f2-1a5cb9846542 for aggregate {{(pid=119439) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:12:30.704883 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-678c1727-e2f0-483d-a4c0-80d2a848eae9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.086883 Jul 18 02:12:30.708029 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 183/347] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:12:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:30.738105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:30.746911 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:30.746911 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:30.786694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.795099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.809857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:30.812819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:30.827371 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.compute.aggregates [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 02:12:30.829796 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Request method failure captured: Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 42 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME1vpoLfBmBVJSMfDXGNm7aAV1jOKq4-5OOiEilqN2uRm31OXjz4W3VMpTWu7B1bb5aEtwQE8XUFyhPywO08T1rR6irBl07tAk5EgmLcFKfk94-bzzAPnmksxUPAzogKw-9_JMP7Nw74aJPEUnukpWvxk_3d_GOj9TkQos50gKhrW0 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:30.832341 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f805095d721a41569015dc4081e54363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f805095d721a41569015dc4081e54363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f805095d721a41569015dc4081e54363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f805095d721a41569015dc4081e54363 Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-293136296 Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ef577a53a978459cb924869e8e15ce92 Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: {"remove_host": {"host": "nonexist_host"}} Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:30.836235 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 18 02:12:30.837809 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 18 02:12:30.842492 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.846422 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64a21def-f743-40c5-81cf-2814f5fd29c9 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.115548 Jul 18 02:12:30.851736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 184/348] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:12:30 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:12:30.862595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e01d8ac-f507-493d-9dcf-7f6ca9c7c5a3 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.865542 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:30.865542 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:30.908158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:30.923819 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7be57fa-9f1e-4356-b32e-9fc50ed6403c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.749330 Jul 18 02:12:30.944174 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 165/349] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:30 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:30.949428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e01d8ac-f507-493d-9dcf-7f6ca9c7c5a3 tempest-AggregatesAdminNegativeTestJSON-293136296 tempest-AggregatesAdminNegativeTestJSON-293136296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.103033 Jul 18 02:12:30.954621 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 185/350] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:12:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:12:30.994715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:30.995037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.006966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.010801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.012086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.012952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.094371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:31.102507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.129965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.131263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.134248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.138944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.464435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:31.482403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2969b3d-5f72-4985-b111-626ce73fe097 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.396924 Jul 18 02:12:31.496559 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 186/351] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:31 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:31.507247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:31.511226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.528464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.537060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.541836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.542662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.758180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:31.789966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:31.799259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:31.804061 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e1dcdf5-4644-4914-9c6d-b0bd652a7d74 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.813725 Jul 18 02:12:31.808863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 166/352] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:30 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:31.826316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a9eecf67-eee0-4a58-84e6-5efacf454840 req-7f5294d9-4a8b-4570-843a-987fd82cac05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9eaca4-4373-41ba-9017-7cb68dca58fb", "tag": "ffc606bf-c733-45cf-ad7c-3e7bbec54391"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:31.841063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=16 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:31.860299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a9eecf67-eee0-4a58-84e6-5efacf454840 req-7f5294d9-4a8b-4570-843a-987fd82cac05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.861511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a9eecf67-eee0-4a58-84e6-5efacf454840 req-7f5294d9-4a8b-4570-843a-987fd82cac05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.888420 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a9eecf67-eee0-4a58-84e6-5efacf454840 req-7f5294d9-4a8b-4570-843a-987fd82cac05 service nova] Creating event network-changed:ffc606bf-c733-45cf-ad7c-3e7bbec54391 for instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb on n-h1-849796-1 Jul 18 02:12:31.897807 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a9eecf67-eee0-4a58-84e6-5efacf454840 req-7f5294d9-4a8b-4570-843a-987fd82cac05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086303 Jul 18 02:12:31.899692 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 167/353] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:31.933969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:31.937701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:31.958311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.959573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:31.961386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:31.962576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:32.337180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:32.346922 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0182770-939a-4762-b387-61a16312273e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 200 len: 1588 microversion: 2.1 time: 0.846676 Jul 18 02:12:32.349217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 187/354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:31 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 1588 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:32.361604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:32.362737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:32.373577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:32.378741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:32.380272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:32.381021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:32.686245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:32.730826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:32.794541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:32.825531 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32ccd972-6a5e-42fe-b771-a7c776b4e787 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.919506 Jul 18 02:12:32.827302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 168/355] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:31 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:32.839041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:32.840600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:32.875103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:32.875854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:32.877072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:32.878782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:33.591377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:33.630212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7099bbd0-d6c2-43f6-ab40-e508fa5a9611 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 1.274173 Jul 18 02:12:33.631735 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 188/356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:32 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:33.641803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:33.642944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:33.654679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.656325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:33.657860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.658576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:33.686949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:33.714204 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90131081-0f41-4058-8617-adbd1b81fa59 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.885087 Jul 18 02:12:33.715717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 169/357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:32 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:33.862275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:33.863450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:33.897899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.898749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:33.900765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:33.902091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.152169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:34.187633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71905c7b-bc79-499b-bc93-b4e843052467 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.334569 Jul 18 02:12:34.197234 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 170/358] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:33 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:34.199864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4c472201-4bdd-4984-82dd-2ee925f66c1b req-2336c58f-5bf7-4044-b9bc-fb3e2cd1f2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02951cf8-9abb-4df5-bbf5-975313171c4f", "tag": "97f51c96-75d9-41aa-9280-c1a16c34bfba"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:34.224116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c472201-4bdd-4984-82dd-2ee925f66c1b req-2336c58f-5bf7-4044-b9bc-fb3e2cd1f2b5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.224886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c472201-4bdd-4984-82dd-2ee925f66c1b req-2336c58f-5bf7-4044-b9bc-fb3e2cd1f2b5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.268616 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4c472201-4bdd-4984-82dd-2ee925f66c1b req-2336c58f-5bf7-4044-b9bc-fb3e2cd1f2b5 service nova] Creating event network-changed:97f51c96-75d9-41aa-9280-c1a16c34bfba for instance 02951cf8-9abb-4df5-bbf5-975313171c4f on n-h1-849796-1 Jul 18 02:12:34.286241 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4c472201-4bdd-4984-82dd-2ee925f66c1b req-2336c58f-5bf7-4044-b9bc-fb3e2cd1f2b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093838 Jul 18 02:12:34.297957 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 171/359] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:34.663569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:34.664795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:34.682830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.685540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.686661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.687704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.886145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:34.927015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:34.940208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:34.950723 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0bc55321-b06e-4696-b714-3b401ad0027f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 1.317136 Jul 18 02:12:34.951335 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 189/360] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:33 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:34.957463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:34.962183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:34.982302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.984421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:34.988667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:34.989649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.006445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:35.018257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:35.058615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-822394e1-9157-4470-880b-f7072c7aa1ea tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.407073 Jul 18 02:12:35.081829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 172/361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:34 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:35.213800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:35.215534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:35.244286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.245296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.265535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.267152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.529485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:35.544305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b4d5291-6cad-4ae8-b8c9-fe90b92845e1 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.591584 Jul 18 02:12:35.547817 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 190/362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:34 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:35.566095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-867e7b10-b7bd-4fee-9ef7-568ee261b78b req-24e96aa6-45bf-454b-b3bc-06efed748ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "name": "network-vif-plugged", "status": "completed", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:35.597089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-867e7b10-b7bd-4fee-9ef7-568ee261b78b req-24e96aa6-45bf-454b-b3bc-06efed748ec6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.597988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-867e7b10-b7bd-4fee-9ef7-568ee261b78b req-24e96aa6-45bf-454b-b3bc-06efed748ec6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.677650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-867e7b10-b7bd-4fee-9ef7-568ee261b78b req-24e96aa6-45bf-454b-b3bc-06efed748ec6 service nova] Creating event network-vif-plugged:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:12:35.702112 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-867e7b10-b7bd-4fee-9ef7-568ee261b78b req-24e96aa6-45bf-454b-b3bc-06efed748ec6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151820 Jul 18 02:12:35.703081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 191/363] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:35.717720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:35.735069 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d195309-ad7d-4ae1-b459-66a543fd988f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.526602 Jul 18 02:12:35.736557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 173/364] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:35 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:35.802034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a99ec910-6253-47e0-9da6-0236f431e877 req-e9051555-6c07-458a-8004-0124e1b905be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c13ed6-e774-4728-a355-c29cbde243d5", "tag": "e541268c-ab4e-466c-9198-74b59aa5bd01"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:35.829166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a99ec910-6253-47e0-9da6-0236f431e877 req-e9051555-6c07-458a-8004-0124e1b905be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.829807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a99ec910-6253-47e0-9da6-0236f431e877 req-e9051555-6c07-458a-8004-0124e1b905be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.851027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a99ec910-6253-47e0-9da6-0236f431e877 req-e9051555-6c07-458a-8004-0124e1b905be service nova] Creating event network-changed:e541268c-ab4e-466c-9198-74b59aa5bd01 for instance c1c13ed6-e774-4728-a355-c29cbde243d5 on n-h2-849796-1 Jul 18 02:12:35.860051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a99ec910-6253-47e0-9da6-0236f431e877 req-e9051555-6c07-458a-8004-0124e1b905be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072744 Jul 18 02:12:35.862497 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 192/365] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:35.983215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:35.983848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:35.996882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.997555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:35.999002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:35.999951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.092134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:36.093488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:36.123661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.127018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.133625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.139068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.420780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:36.436840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:36.437662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:36.438865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7590ce92-3bb7-4650-a068-2ba0d42f88c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.461365 Jul 18 02:12:36.439438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 174/366] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:35 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:12:36.471481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:36.484777 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f28a2b1-cbb3-4400-bcb8-e8995e4ffd78 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.398055 Jul 18 02:12:36.490624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 193/367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:36 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:36.572094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:36.572734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:36.581436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.582072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.582906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.589692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.779348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:36.782716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:36.802030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.802493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.803335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:36.803781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:36.997948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.006532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d6bb9393-8d70-445c-a20c-784a753d54d9 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.250567 Jul 18 02:12:37.008432 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 194/368] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:36 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:37.042347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.057181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1dae2d9-54c2-43f3-887a-6d58f668ca74 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.488232 Jul 18 02:12:37.058840 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 175/369] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:36 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:37.425252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2509d7c1-58e9-41f7-acd5-6a414de5b7a6 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1418686074", "id": 817146684, "os-flavor-access:is_public": "False"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:37.428803 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:37.428803 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:37.483858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:37.488589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:37.513962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:37.515711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:37.517838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:37.520125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:37.529427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2509d7c1-58e9-41f7-acd5-6a414de5b7a6 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.514414 Jul 18 02:12:37.531955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 195/370] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:37.552336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:37.553331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:37.561422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:37.562662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:37.564002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:37.564724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:37.761667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.775455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.776505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.780021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:37.782133 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ff057036-0631-48fc-a944-1d035ffb7a13 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.315113 Jul 18 02:12:37.783371 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 176/371] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:37 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:37.792687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d151b6f2-4288-47e9-bb6e-7f088d42e704 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a22d1469cc844942ac40c5e2c978601e"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:37.795749 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:37.795749 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:37.797093 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61ffcce0-d1b1-4f5f-949c-a8998114e89f tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.260463 Jul 18 02:12:37.798091 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 196/372] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:37 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:38.075930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Calling method '.version_select at 0x7fab05c84c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.076876 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:38.076876 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:38.078399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.078860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.129336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.130265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.150602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.152223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.161755 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49133b9a-4aa8-452f-b805-fc0b618d0609 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.360950 Jul 18 02:12:38.163020 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 197/373] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:38.170181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.171176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:38.179409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.179879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.181211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.181891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.239997 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d151b6f2-4288-47e9-bb6e-7f088d42e704 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/817146684/action" status: 200 len: 96 microversion: 2.1 time: 0.454785 Jul 18 02:12:38.247867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 177/374] 10.222.0.67 () {60 vars in 1196 bytes} [Mon Jul 18 02:12:37 2022] POST /compute/v2.1/flavors/817146684/action => generated 96 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:38.257150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.257150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:38.265124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.266154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.267488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.268155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.464716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:38.474515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52b668bb-8f97-43c9-98c4-5e77a5f1aa0d tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1324 microversion: 2.1 time: 0.309962 Jul 18 02:12:38.475846 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 198/375] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:38.719068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:38.731048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-47443a5c-6c23-4fa3-8535-9139b31e27be tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.489037 Jul 18 02:12:38.732088 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 178/376] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:38.920515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3248f516-f9db-4738-8a40-2c5c7d2ce270 tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Calling method '.version_select at 0x7fab06034430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.921562 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:38.921562 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:38.922856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3248f516-f9db-4738-8a40-2c5c7d2ce270 tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8af540ae610d4dd884ca23c0b0083b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bca70433d724146a74c4878f24aae4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3248f516-f9db-4738-8a40-2c5c7d2ce270 tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Request method failure captured: Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hypervisors/n-h1-849796-1/search HTTP/1.1 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGT_Xd1AkJ3Q91qS3txlzdyHqsdqT-dCEEFZzgccCDL0J6Y4-YYqmZry65IVIRE6WSqVf5eO73YS8SS5uUM8-nE9PiLsSOlhn7sW_7JtaCXNysUxe6P6EVcMlhppooR_WGBKYs31JIHh6hJQ4hGxpwRhGAMckwnULeGHRaBjGaNFZ8 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0bca70433d724146a74c4878f24aae4e Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:38.932494 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0bca70433d724146a74c4878f24aae4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0bca70433d724146a74c4878f24aae4e Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8af540ae610d4dd884ca23c0b0083b19 Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:12:38.934473 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'n-h1-849796-1'} Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:38.935394 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 18 02:12:38.936853 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:38.941599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3248f516-f9db-4738-8a40-2c5c7d2ce270 tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:38.942592 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3248f516-f9db-4738-8a40-2c5c7d2ce270 tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-849796-1/search" status: 403 len: 117 microversion: 2.1 time: 0.465385 Jul 18 02:12:38.943175 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 199/377] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-849796-1/search => generated 117 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:38.955576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:38.956197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:38.970309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.970770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:38.973314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:38.973787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.220133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-245895bc-2922-443b-a112-8cf03c8030e0 tempest-FlavorsAccessTestJSON-82203992 tempest-FlavorsAccessTestJSON-82203992-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.254400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-245895bc-2922-443b-a112-8cf03c8030e0 tempest-FlavorsAccessTestJSON-82203992 tempest-FlavorsAccessTestJSON-82203992-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.520623 Jul 18 02:12:39.255014 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 179/378] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:39.261293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.262236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:39.270352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.271088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.272090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.272711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.325151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:39.359402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:39.363566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:39.374542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2436af1-08aa-49cd-acc6-72ed98b18096 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.420785 Jul 18 02:12:39.377708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 200/379] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:38 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:39.402390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Calling method '.version_select at 0x7fab05dd6790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.406103 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:39.406103 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:39.408602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.409128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.420503 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Request method failure captured: Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGVTyfQ6dqbqXjRSvhQkkoI4QYWX4ysZ17o4GQoSiUCZy5VtcKj1evhsNyryQ6FKNITycgttEbBHH1YvsQBaI79fU4tsoOUEspcOMu_XjTI9xJZHN_jRuxN7PJ9jLeHVj796QEiQ5KIs4wEuGGcfbWYxKv2aYgS6Vg25nTHUKVGLsU Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: a800e2d1d52d483290b8df23a05c3a90 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:39.421980 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: a800e2d1d52d483290b8df23a05c3a90 Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 9d7bc15766494c3ababd1ac259b79801 Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:12:39.424332 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:39.426207 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-160db2a2-d12d-48d4-9a32-9195aba50fe8 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043252 Jul 18 02:12:39.430626 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 201/380] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 02:12:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:39.433767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2c056ecf-c0be-4f85-8eb4-cae56d38fb62 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a22d1469cc844942ac40c5e2c978601e"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:39.433767 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:39.433767 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:39.694614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:39.722359 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a769f9b6-1236-4a4b-829a-928b788f2b7e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.462809 Jul 18 02:12:39.743997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 180/381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:39 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:39.765566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Calling method '.version_select at 0x7fab05969b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.767545 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:39.767545 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:39.771068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.774488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.813531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.814818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.819634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:39.839764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.840854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.856780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-248d09ae-6fda-4145-abdc-642041919d39 tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110400 Jul 18 02:12:39.866186 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 181/382] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:39.879364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.880518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:39.891266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.892012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.893389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.894131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.947384 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2c056ecf-c0be-4f85-8eb4-cae56d38fb62 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/817146684/action" status: 200 len: 21 microversion: 2.1 time: 0.520423 Jul 18 02:12:39.948787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 202/383] 10.222.0.67 () {60 vars in 1196 bytes} [Mon Jul 18 02:12:39 2022] POST /compute/v2.1/flavors/817146684/action => generated 21 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:39.965401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:39.966965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:39.978494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.979463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:39.980477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:39.981146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.120342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.135623 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2fb838c2-257e-4f03-b44f-353c0b3fd86c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1520 microversion: 2.1 time: 0.267506 Jul 18 02:12:40.136472 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 182/384] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:39 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:40.204063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.213115 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-892d488d-d9d3-40a3-bf06-e6b826a92fe6 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.262789 Jul 18 02:12:40.214035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 203/385] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:39 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:40.219086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd117afd-6e6b-4d94-80c1-1976aa72715f tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Calling method '.version_select at 0x7fab05c840d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.219921 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:40.219921 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:40.221059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd117afd-6e6b-4d94-80c1-1976aa72715f tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8af540ae610d4dd884ca23c0b0083b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bca70433d724146a74c4878f24aae4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd117afd-6e6b-4d94-80c1-1976aa72715f tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Request method failure captured: Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGT_Xd1AkJ3Q91qS3txlzdyHqsdqT-dCEEFZzgccCDL0J6Y4-YYqmZry65IVIRE6WSqVf5eO73YS8SS5uUM8-nE9PiLsSOlhn7sW_7JtaCXNysUxe6P6EVcMlhppooR_WGBKYs31JIHh6hJQ4hGxpwRhGAMckwnULeGHRaBjGaNFZ8 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0bca70433d724146a74c4878f24aae4e Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:40.222918 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0bca70433d724146a74c4878f24aae4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0bca70433d724146a74c4878f24aae4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0bca70433d724146a74c4878f24aae4e Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864 Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8af540ae610d4dd884ca23c0b0083b19 Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:12:40.224275 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1'} Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:40.225103 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 18 02:12:40.226238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.228882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd117afd-6e6b-4d94-80c1-1976aa72715f tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:40.229785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd117afd-6e6b-4d94-80c1-1976aa72715f tempest-HypervisorAdminNegativeUnderV252Test-1306415864 tempest-HypervisorAdminNegativeUnderV252Test-1306415864-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014618 Jul 18 02:12:40.230356 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 204/386] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:40.238672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59b45920-3214-406c-8335-9a2f81e7c905 tempest-FlavorsAccessTestJSON-82203992 tempest-FlavorsAccessTestJSON-82203992-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.247087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:40.263049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59b45920-3214-406c-8335-9a2f81e7c905 tempest-FlavorsAccessTestJSON-82203992 tempest-FlavorsAccessTestJSON-82203992-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031575 Jul 18 02:12:40.264078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 205/387] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:40.269489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd61f76-cc30-465f-8afb-4ce2b2059cc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'create', calling method: .version_select at 0x7fab05cb2e50>, body: {"pool": null} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:40.346899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.349833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.350420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.351421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.352546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.394609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51de1aec-c10b-4d52-88f0-1229cd192d3f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.256300 Jul 18 02:12:40.396336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 183/388] 10.222.0.67 () {58 vars in 1163 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:40.407900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Calling method '.version_select at 0x7fab064bfa60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.409977 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:40.409977 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:40.412734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.413906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.442634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] HTTP exception thrown: No hypervisor matching '8000ee35-d42d-46b9-bd60-cd96831b2abb' could be found. Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Request method failure captured: Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/8000ee35-d42d-46b9-bd60-cd96831b2abb/servers HTTP/1.1 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MGVTyfQ6dqbqXjRSvhQkkoI4QYWX4ysZ17o4GQoSiUCZy5VtcKj1evhsNyryQ6FKNITycgttEbBHH1YvsQBaI79fU4tsoOUEspcOMu_XjTI9xJZHN_jRuxN7PJ9jLeHVj796QEiQ5KIs4wEuGGcfbWYxKv2aYgS6Vg25nTHUKVGLsU Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a800e2d1d52d483290b8df23a05c3a90 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:12:40.446351 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a800e2d1d52d483290b8df23a05c3a90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a800e2d1d52d483290b8df23a05c3a90 Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948 Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 9d7bc15766494c3ababd1ac259b79801 Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: exception: No hypervisor matching '8000ee35-d42d-46b9-bd60-cd96831b2abb' could be found. Jul 18 02:12:40.449207 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8000ee35-d42d-46b9-bd60-cd96831b2abb'} Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8000ee35-d42d-46b9-bd60-cd96831b2abb' could be found. Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.450500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8000ee35-d42d-46b9-bd60-cd96831b2abb' could be found. Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] Returning 404 to user: No hypervisor matching '8000ee35-d42d-46b9-bd60-cd96831b2abb' could be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4626fcc-629b-47dc-99f9-987acb8e9d1b tempest-HypervisorAdminNegativeUnderV252Test-1083278948 tempest-HypervisorAdminNegativeUnderV252Test-1083278948-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/8000ee35-d42d-46b9-bd60-cd96831b2abb/servers" status: 404 len: 123 microversion: 2.1 time: 0.052516 Jul 18 02:12:40.453608 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 184/389] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/os-hypervisors/8000ee35-d42d-46b9-bd60-cd96831b2abb/servers => generated 123 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:40.462282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ca7bb5b-15cf-4f2c-a086-329ecf3f8dae tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.463945 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:40.463945 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:40.488977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=7 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:40.500374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ca7bb5b-15cf-4f2c-a086-329ecf3f8dae tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/817146684" status: 202 len: 0 microversion: 2.1 time: 0.045433 Jul 18 02:12:40.501660 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 185/390] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:12:40 2022] DELETE /compute/v2.1/flavors/817146684 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:40.512054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.513165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:40.528688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.529538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.530975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.533456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.810180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:40.949764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.966643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.969627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:40.972281 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42e12d37-04d5-46ed-bdc8-8d887dfe381a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.468767 Jul 18 02:12:40.973902 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 186/391] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:40.981277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:40.983890 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:40.983890 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:40.986922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.988214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:40.990789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:40.992134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.066535 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba35e822-4462-4b33-bebe-3424980ab33f tempest-AZAdminV2TestJSON-1975887164 tempest-AZAdminV2TestJSON-1975887164-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.090852 Jul 18 02:12:41.067616 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 187/392] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:12:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:41.088252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0c086f2-a516-45d5-8c22-65ad9b1e6650 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.131792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0c086f2-a516-45d5-8c22-65ad9b1e6650 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.062192 Jul 18 02:12:41.133055 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 188/393] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:41.171335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.172575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:41.184857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.185702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.187074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.187862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.553919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:41.600648 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-305ddb0f-89de-4725-bba2-c22107726364 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.450092 Jul 18 02:12:41.619406 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 189/394] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:41.619406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cf0013b7-10b6-45cb-81ec-80e115f99cb8 req-ccd871ad-f71d-4858-bd16-ace3614e7efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02951cf8-9abb-4df5-bbf5-975313171c4f", "name": "network-vif-plugged", "status": "completed", "tag": "97f51c96-75d9-41aa-9280-c1a16c34bfba"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:41.632193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cf0013b7-10b6-45cb-81ec-80e115f99cb8 req-ccd871ad-f71d-4858-bd16-ace3614e7efe service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.633189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cf0013b7-10b6-45cb-81ec-80e115f99cb8 req-ccd871ad-f71d-4858-bd16-ace3614e7efe service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.693298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cf0013b7-10b6-45cb-81ec-80e115f99cb8 req-ccd871ad-f71d-4858-bd16-ace3614e7efe service nova] Creating event network-vif-plugged:97f51c96-75d9-41aa-9280-c1a16c34bfba for instance 02951cf8-9abb-4df5-bbf5-975313171c4f on n-h1-849796-1 Jul 18 02:12:41.720009 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cf0013b7-10b6-45cb-81ec-80e115f99cb8 req-ccd871ad-f71d-4858-bd16-ace3614e7efe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113695 Jul 18 02:12:41.729748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 190/395] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:41.740068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4dd7bcf8-a885-4d37-8adf-1af3c8d4b199 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-95925862", "id": 1563120969, "os-flavor-access:is_public": "False"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:41.742621 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:41.742621 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:41.769440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4dd7bcf8-a885-4d37-8adf-1af3c8d4b199 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.037380 Jul 18 02:12:41.779716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 191/396] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:41 2022] POST /compute/v2.1/flavors => generated 429 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:41.779716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:41.779716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:41.784627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.785417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:41.786593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:41.787059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.231477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:42.246992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56f377fd-fe0b-4823-8c8a-ee87561f0b37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.473346 Jul 18 02:12:42.269574 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 192/397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:41 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:42.280601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc87ad55-435f-42a3-aa75-5fc408a50172 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.282315 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:42.282315 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:42.308556 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc87ad55-435f-42a3-aa75-5fc408a50172 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1563120969/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036669 Jul 18 02:12:42.317348 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 193/398] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/flavors/1563120969/os-flavor-access => generated 21 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:42.324403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.325158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:42.333738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.334842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.335828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.336357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.624846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:42.651318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:42.657092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bd61f76-cc30-465f-8afb-4ce2b2059cc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.391621 Jul 18 02:12:42.658496 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 206/399] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:12:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:42.661079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:42.664130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc155071-c161-4684-a086-177d0fe437e3 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.665010 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2bc7118f-f9fd-4cd3-a38a-fc2375015791 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.345066 Jul 18 02:12:42.666685 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:42.666685 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:42.683700 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 194/400] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:42.693024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.694303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:42.722297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc155071-c161-4684-a086-177d0fe437e3 tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1563120969" status: 202 len: 0 microversion: 2.1 time: 0.062138 Jul 18 02:12:42.723263 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 207/401] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:12:42 2022] DELETE /compute/v2.1/flavors/1563120969 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:42.727334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.728803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.730647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:42.734951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2f9b6d9-0ae9-4a0f-ad27-b59b0076048c tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:42.743353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:42.759258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2f9b6d9-0ae9-4a0f-ad27-b59b0076048c tempest-FlavorsAccessTestJSON-1091612917 tempest-FlavorsAccessTestJSON-1091612917-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.029711 Jul 18 02:12:42.760693 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 208/402] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:42.933490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1187999381", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:43.002685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] validate_networks() for [('25bdf20f-59b8-445d-bd9f-eed3ee63ed1a', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:12:43.049805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:43.078610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b40be5a-4dc6-4332-992c-53ed334af83b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1320 microversion: 2.1 time: 0.392628 Jul 18 02:12:43.083099 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 195/403] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:42 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:43.279180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:43.280402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:43.293627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.294539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.296700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.297667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.528856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:43.544894 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-401c70e1-ca69-40c0-8657-589532ff5b98 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.281133 Jul 18 02:12:43.545521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 196/404] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:43 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:12:43.717405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:43.720587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:43.782723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.783983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.790159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.795654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.840706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:12:43.842987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:12:43.844336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:12:43.846027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:12:43.848603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:12:43.896650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.897563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.899436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:43.901214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:43.980811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Getting quotas for project 8f679ff678064a09a1566c9f58f9344b. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:43.986734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Getting quotas for user c036dd17b7b04f0581ac388e18dfb347 and project 8f679ff678064a09a1566c9f58f9344b. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:44.023085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:12:44.027820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:12:44.117229 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bcda4f34-9d9a-411e-8613-3f1d640af4d2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188159 Jul 18 02:12:44.118575 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 209/405] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:12:44.124114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7ba3261d-56b2-4b4f-aad0-49050fa7ad75 req-1a0ba05a-f5be-4fed-b709-d4f11591f8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "name": "network-vif-plugged", "status": "completed", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:44.135757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7ba3261d-56b2-4b4f-aad0-49050fa7ad75 req-1a0ba05a-f5be-4fed-b709-d4f11591f8a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.136507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7ba3261d-56b2-4b4f-aad0-49050fa7ad75 req-1a0ba05a-f5be-4fed-b709-d4f11591f8a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.150666 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7ba3261d-56b2-4b4f-aad0-49050fa7ad75 req-1a0ba05a-f5be-4fed-b709-d4f11591f8a0 service nova] Creating event network-vif-plugged:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h2-849796-1 Jul 18 02:12:44.159281 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7ba3261d-56b2-4b4f-aad0-49050fa7ad75 req-1a0ba05a-f5be-4fed-b709-d4f11591f8a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039098 Jul 18 02:12:44.161866 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 210/406] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:44.169348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.170381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.177505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.178301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.179791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.180565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.440387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.474232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.482762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.485042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc5d5cdd-cde9-4a52-a176-d91d25b832e8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.793545 Jul 18 02:12:44.515214 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 197/407] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:43 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:44.534900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c8498bb-d194-4431-8bf7-454f3d30f475 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.536061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c8498bb-d194-4431-8bf7-454f3d30f475 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.653693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c8498bb-d194-4431-8bf7-454f3d30f475 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.690440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c8498bb-d194-4431-8bf7-454f3d30f475 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1224 microversion: 2.1 time: 0.168834 Jul 18 02:12:44.694698 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 198/408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.718977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:44.721772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.741306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.746226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.748344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.752385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.816408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:44.848306 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f92889ee-09ae-4153-a5fc-ec4e6383898d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1469 microversion: 2.1 time: 0.683430 Jul 18 02:12:44.852858 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 211/409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1469 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:44.890201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:44.895240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:44.922675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.926336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:44.932141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:44.942115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.188215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc69b309-ff6c-4590-b2c3-22226ae156e0 tempest-DeleteServersAdminTestJSON-1303917557 tempest-DeleteServersAdminTestJSON-1303917557-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.322327 Jul 18 02:12:45.189369 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 212/410] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:12:44 2022] POST /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:45.199866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.200825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.211315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.213880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.216578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.217342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.223504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.243931 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52ea550c-bb23-4b4f-96d1-fc11cb8939c3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.544856 Jul 18 02:12:45.262223 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 199/411] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:44 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:45.270130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.270579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.271347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lazy-loading 'fault' on Instance uuid 02951cf8-9abb-4df5-bbf5-975313171c4f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:45.506312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.516389 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-761cdfe1-7f25-473c-b5f6-f6244a99ae91 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1452 microversion: 2.1 time: 0.322303 Jul 18 02:12:45.518484 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 213/412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1452 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:45.519910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.520798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.536131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.536642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.538702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.540060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.543539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.543880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.544403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.544706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.545555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.546157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.578193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:12:45.653140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:45.728725 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4041569c-713e-460f-b6be-1ebc2de8b63b tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 204 len: 0 microversion: 2.1 time: 0.196321 Jul 18 02:12:45.731266 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 214/413] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:45 2022] DELETE /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:12:45.739633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.744705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.758575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.759995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.761510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.762270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.810480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.821168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.822984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.824703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d07bc867-48c7-462b-884d-ddf03a292b0f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1361 microversion: 2.25 time: 0.311445 Jul 18 02:12:45.825770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 200/414] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:12:45.831404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:45.832028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:45.839638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.840585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.841745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.842193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.899261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:45.901666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:45.902026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:45.902498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lazy-loading 'fault' on Instance uuid 02951cf8-9abb-4df5-bbf5-975313171c4f {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:45.913033 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b735759b-4adf-4f68-b9d1-696c87edd203 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1220 microversion: 2.1 time: 0.180112 Jul 18 02:12:45.914797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 215/415] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.152288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:46.174472 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fdf15f00-4820-476f-88c2-e7a35999867d tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1458 microversion: 2.1 time: 0.346103 Jul 18 02:12:46.177388 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 201/416] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:45 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1458 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.272895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.273832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:46.283017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.283850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.285153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.286189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.504689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:46.519765 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d52a9129-8363-4b2b-9d93-3227a8548845 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.253124 Jul 18 02:12:46.521635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 216/417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:46.855803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.857537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:46.869427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.878141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.881750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.884566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.934094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:46.935376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:46.961675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.963547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:46.968227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:46.968906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.179532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.192437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a89df96-6f4a-4a73-b539-f1fc355e18ae tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1276 microversion: 2.1 time: 0.263093 Jul 18 02:12:47.205714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 217/418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:47.213723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:47.215753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:47.232914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.236685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.239893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.240394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.259874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.281775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.284509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.286512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36782d79-d386-4efa-9be1-281b0290a63e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1556 microversion: 2.25 time: 0.435588 Jul 18 02:12:47.289785 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 202/419] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:46 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1556 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:47.330970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.333430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.338814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lazy-loading 'fault' on Instance uuid 02951cf8-9abb-4df5-bbf5-975313171c4f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:47.554729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.571212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7bc43e7-66aa-4fdc-b38e-dabf92fd0640 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1458 microversion: 2.1 time: 0.362786 Jul 18 02:12:47.573410 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 218/420] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1458 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:47.579918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:47.581054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:47.590512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.591440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.592585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.593360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.872995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:47.886279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9962623f-3a3f-4f1f-8df8-10207dfc0ad8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.311140 Jul 18 02:12:47.887696 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 219/421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:47.894475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0ce49d54-d913-442c-9c9b-b92d4dc63d96 req-63c6984e-5e8e-4747-b6d1-23112ea59408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c13ed6-e774-4728-a355-c29cbde243d5", "name": "network-vif-plugged", "status": "completed", "tag": "e541268c-ab4e-466c-9198-74b59aa5bd01"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:47.906978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ce49d54-d913-442c-9c9b-b92d4dc63d96 req-63c6984e-5e8e-4747-b6d1-23112ea59408 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:47.907703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ce49d54-d913-442c-9c9b-b92d4dc63d96 req-63c6984e-5e8e-4747-b6d1-23112ea59408 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:47.930551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0ce49d54-d913-442c-9c9b-b92d4dc63d96 req-63c6984e-5e8e-4747-b6d1-23112ea59408 service nova] Creating event network-vif-plugged:e541268c-ab4e-466c-9198-74b59aa5bd01 for instance c1c13ed6-e774-4728-a355-c29cbde243d5 on n-h2-849796-1 Jul 18 02:12:47.941628 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0ce49d54-d913-442c-9c9b-b92d4dc63d96 req-63c6984e-5e8e-4747-b6d1-23112ea59408 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052060 Jul 18 02:12:47.945992 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 220/422] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:48.000328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:48.001070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:48.015603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:48.016360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:48.018797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:48.021543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:48.215581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:48.216886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:48.224916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:48.225761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:48.226823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:48.227479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:48.351188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:48.363960 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d6c1c29-2703-4c91-a432-7d0c848eec5e tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1282 microversion: 2.1 time: 0.155043 Jul 18 02:12:48.364701 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 221/423] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:48 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:48.907052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 81553898-c387-4d5e-b539-effed146abfd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:48.940579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Calling method '.version_select at 0x7fab05bb0c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:48.943362 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:48.943362 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:48.946548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:48.947567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:48.989093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-beb3004b-88a1-47ab-950a-699f769df1ba tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 2048 microversion: 2.25 time: 1.687690 Jul 18 02:12:48.990339 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 203/424] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:47 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 2048 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:48.996081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:48.997186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.004028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.005344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.006396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.007067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.010570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.011360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.044143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.044984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.045654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lazy-loading 'fault' on Instance uuid 02951cf8-9abb-4df5-bbf5-975313171c4f {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:49.066275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.069009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.080430 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3759778-f896-49d9-bd67-6f8ddfe09b5e tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.515746 Jul 18 02:12:49.089515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 222/425] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:49.097499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.099515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.127792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.132501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.137377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.137976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.405732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:49.412941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:49.418093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-63b96814-86e5-4427-8823-bf4a0a0a816c tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1458 microversion: 2.1 time: 0.426443 Jul 18 02:12:49.419683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:49.421720 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 204/426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:48 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1458 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.427116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.434313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.447043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a02599a0-b4eb-41ae-88d5-96418921ece2 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1318 microversion: 2.1 time: 0.354548 Jul 18 02:12:49.449961 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 223/427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.451720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.452184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.453024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.465397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Calling method '.version_select at 0x7fab05c849d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.467612 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:49.467612 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:49.471025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.473361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.474861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.501586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.502079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.547894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.548306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.563055 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5fd39b5-6593-472a-b635-82dce5ebc5b2 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-849796-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.107989 Jul 18 02:12:49.564031 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 224/428] 10.222.0.67 () {58 vars in 1211 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/os-hypervisors/n-h1-849796-1/servers => generated 433 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:49.577263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.578021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:49.587639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.588759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.589842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.590511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.831726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:49.848598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e02abe87-9f6a-47ae-99af-ba24299d6535 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1282 microversion: 2.1 time: 0.272718 Jul 18 02:12:49.862095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 225/429] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:49.876243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Calling method '.version_select at 0x7fab05bb0a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:49.878843 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:49.878843 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:49.884495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.885280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.934552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.935374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.970889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:49.971714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:49.997453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8036d108-8f25-452f-af58-cca154bf68fe tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.130615 Jul 18 02:12:50.000290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 226/430] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:50.180572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 81553898-c387-4d5e-b539-effed146abfd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:50.279612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ce17b69-e273-451d-8fde-a26923107600 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 2048 microversion: 2.25 time: 0.856076 Jul 18 02:12:50.286170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 205/431] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:12:49 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 2048 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:12:50.303437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Calling method '.version_select at 0x7fab0533c0d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:50.309531 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:50.309531 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:50.315559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.316362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.354871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.363767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.394215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37403492-556f-4f8f-aba9-cee441616ae0 tempest-HypervisorAdminUnderV252Test-653144519 tempest-HypervisorAdminUnderV252Test-653144519-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-849796-1/search" status: 200 len: 104 microversion: 2.1 time: 0.105814 Jul 18 02:12:50.396034 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 206/432] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:12:50 2022] GET /compute/v2.1/os-hypervisors/n-h1-849796-1/search => generated 104 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:50.423135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-299fa914-f673-4e22-9d36-717b3b7b463e req-34c59d96-e0a6-4a94-a5df-f66023ad2405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02951cf8-9abb-4df5-bbf5-975313171c4f", "name": "network-vif-deleted", "tag": "97f51c96-75d9-41aa-9280-c1a16c34bfba"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:50.455739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-299fa914-f673-4e22-9d36-717b3b7b463e req-34c59d96-e0a6-4a94-a5df-f66023ad2405 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.456192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-299fa914-f673-4e22-9d36-717b3b7b463e req-34c59d96-e0a6-4a94-a5df-f66023ad2405 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.477259 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-299fa914-f673-4e22-9d36-717b3b7b463e req-34c59d96-e0a6-4a94-a5df-f66023ad2405 service nova] Creating event network-vif-deleted:97f51c96-75d9-41aa-9280-c1a16c34bfba for instance 02951cf8-9abb-4df5-bbf5-975313171c4f on n-h1-849796-1 Jul 18 02:12:50.488193 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-299fa914-f673-4e22-9d36-717b3b7b463e req-34c59d96-e0a6-4a94-a5df-f66023ad2405 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090221 Jul 18 02:12:50.488827 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 207/433] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:50.496740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-805f2b25-b022-45bf-8977-fc010fb7d804 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1724230379", "ram": 512, "vcpus": 1, "disk": 10, "id": 1119205614, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:50.498813 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:50.498813 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:50.500203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:50.507815 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:50.507815 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:12:50.510296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.510941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.511940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.514702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.537759 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-805f2b25-b022-45bf-8977-fc010fb7d804 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.535774 Jul 18 02:12:50.549505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 227/434] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:12:50 2022] POST /compute/v2.1/flavors => generated 416 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:50.565454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:50.566217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:50.587431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.592038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.592883 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7933c644-e7ec-4bde-ba2c-1879a2379f5a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.098534 Jul 18 02:12:50.594150 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 208/435] 10.222.0.67 () {60 vars in 1216 bytes} [Mon Jul 18 02:12:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:12:50.605388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:50.605645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.606349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.606739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:50.623098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.623821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.625000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.625692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.791758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:50.799529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:50.802020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lazy-loading 'fault' on Instance uuid 02951cf8-9abb-4df5-bbf5-975313171c4f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:50.978554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7dfafed8804a84b705d3f685f5916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855591e3a664a5d8110f637a3172a00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:51.006543 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04fb8d8e-8c7e-4fe0-853d-b3ba9359cb70 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 200 len: 1310 microversion: 2.1 time: 0.455409 Jul 18 02:12:51.023107 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 228/436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:50 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 1310 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:51.299536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:51.313851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70b31ae4-4349-4186-b414-8ba63e677a37 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1468 microversion: 2.1 time: 0.718290 Jul 18 02:12:51.318381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 209/437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:50 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1468 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:51.332914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": "auto"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:51.339954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:51.358154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.359027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.362981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.363683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.445996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'flavor' on Instance uuid 81553898-c387-4d5e-b539-effed146abfd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:51.493524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 81553898-c387-4d5e-b539-effed146abfd] Going to try to live migrate instance to n-h1-849796-1 {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:12:51.688280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-200bece7-5c4f-41f0-a7d7-738d1913ba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:51.746360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-200bece7-5c4f-41f0-a7d7-738d1913ba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] HTTP exception thrown: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-200bece7-5c4f-41f0-a7d7-738d1913ba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Request method failure captured: Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGgYROOe-ELyfZAAfS_2_Qwgs3nNEy-HyJ3x44Yvockf6PXo2-4cuERxIFBZfochUqWHGDq3qS_rcxy4fevoXvO2diU02d2bRSxhJVj1blBS6nRIzbGz-AFW_hjACQPjLt1m4eEPcR5LelkvAhjCpJoJvQP2KgntrB0NPJIcoRmrxU Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:51.758386 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8de400d3fd4642aabf75eceb00220e16 Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:51.761397 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:cpu_thread_policy'} Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:51.762746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:51.765434 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:51.767627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-200bece7-5c4f-41f0-a7d7-738d1913ba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Returning 404 to user: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:51.771075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-200bece7-5c4f-41f0-a7d7-738d1913ba51 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] 10.222.0.67 "GET /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.746235 Jul 18 02:12:51.784246 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 229/438] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:12:51 2022] GET /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 761 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:51.799331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:51.801360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:51.825615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.826827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:51.828548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:51.829642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.644098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:53.677979 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e48be0f-4b01-4a44-b76e-5d6fb2ca334f tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 1.884240 Jul 18 02:12:53.678844 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 230/439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:51 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:53.697704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:53.702054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:53.730238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:53.731150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.733831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:53.736844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:53.799748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lazy-loading 'flavor' on Instance uuid c1c13ed6-e774-4728-a355-c29cbde243d5 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:12:53.967073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.018387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.028181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.144135 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1395cc0b-adcc-4201-9764-cc6af85fc3ba tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5/action" status: 202 len: 0 microversion: 2.1 time: 0.462856 Jul 18 02:12:54.148332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 231/440] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:12:53 2022] POST /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:54.186032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3a2ab21-f5ff-496f-925a-cb198c96b31f tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:54.189908 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:54.189908 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:54.192200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3a2ab21-f5ff-496f-925a-cb198c96b31f tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8de400d3fd4642aabf75eceb00220e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4ac06072d49f599781391d26dfc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3a2ab21-f5ff-496f-925a-cb198c96b31f tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Request method failure captured: Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/flavors/1119205614/os-extra_specs HTTP/1.1 Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 66 Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGgYROOe-ELyfZAAfS_2_Qwgs3nNEy-HyJ3x44Yvockf6PXo2-4cuERxIFBZfochUqWHGDq3qS_rcxy4fevoXvO2diU02d2bRSxhJVj1blBS6nRIzbGz-AFW_hjACQPjLt1m4eEPcR5LelkvAhjCpJoJvQP2KgntrB0NPJIcoRmrxU Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:54.202143 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8de400d3fd4642aabf75eceb00220e16 Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 18 02:12:54.204652 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:54.206021 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 18 02:12:54.208062 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.213385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3a2ab21-f5ff-496f-925a-cb198c96b31f tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:54.215700 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3a2ab21-f5ff-496f-925a-cb198c96b31f tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] 10.222.0.67 "POST /compute/v2.1/flavors/1119205614/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.064389 Jul 18 02:12:54.218022 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 232/441] 10.222.0.67 () {60 vars in 1223 bytes} [Mon Jul 18 02:12:54 2022] POST /compute/v2.1/flavors/1119205614/os-extra_specs => generated 124 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:54.235340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:54.240864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:54.279629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:54.281422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:54.283868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:54.285367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:54.307056 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f HTTP/1.1 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:54.310538 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:54.312045 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '02951cf8-9abb-4df5-bbf5-975313171c4f'} Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:54.312741 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:54.313991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:54.320648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:54.322899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-380caf58-59f0-4341-9fae-af358b0d0722 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 404 len: 111 microversion: 2.1 time: 0.102615 Jul 18 02:12:54.324620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 233/442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:54 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:54.331426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4b67c300-368e-421b-a30c-ce0784a8f35d req-4d0f28e8-0dd5-47ff-82f7-21c9a2380684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf524c-67ea-4cee-a327-ce274d11c894", "tag": "76355fd5-8182-4940-8061-ef759ae2d520"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:54.344640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4b67c300-368e-421b-a30c-ce0784a8f35d req-4d0f28e8-0dd5-47ff-82f7-21c9a2380684 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:54.345564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4b67c300-368e-421b-a30c-ce0784a8f35d req-4d0f28e8-0dd5-47ff-82f7-21c9a2380684 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:54.363177 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4b67c300-368e-421b-a30c-ce0784a8f35d req-4d0f28e8-0dd5-47ff-82f7-21c9a2380684 service nova] Creating event network-changed:76355fd5-8182-4940-8061-ef759ae2d520 for instance 84cf524c-67ea-4cee-a327-ce274d11c894 on n-h1-849796-1 Jul 18 02:12:54.372876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4b67c300-368e-421b-a30c-ce0784a8f35d req-4d0f28e8-0dd5-47ff-82f7-21c9a2380684 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046349 Jul 18 02:12:54.374243 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 234/443] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:54.383668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:54.384879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:54.393467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:54.394055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:54.395000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:54.395538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:54.666550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.897842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:54.913858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bddc85a-6e98-4160-81d8-9f5cb3ec26ca tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1476 microversion: 2.1 time: 0.537298 Jul 18 02:12:54.915788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 235/444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:54 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:54.925280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8cae4c7-b632-4bd1-b653-324c3f68b913 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:54.928570 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:54.928570 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:54.950462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:SAVEPOINT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:12:54.996226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8cae4c7-b632-4bd1-b653-324c3f68b913 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1119205614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078801 Jul 18 02:12:54.997328 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 236/445] 10.222.0.67 () {60 vars in 1223 bytes} [Mon Jul 18 02:12:54 2022] POST /compute/v2.1/flavors/1119205614/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:55.010444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.011004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.025366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.025366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.027458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.028232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.053693 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f HTTP/1.1 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.057080 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.059893 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '02951cf8-9abb-4df5-bbf5-975313171c4f'} Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.061312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.063703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.066261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.066261 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a617b30-4afb-454c-8c80-16e6727d958e tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 404 len: 111 microversion: 2.1 time: 0.060638 Jul 18 02:12:55.066261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 237/446] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:54 2022] DELETE /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.071551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.072507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.089344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.090158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.091638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.092423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.653969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:55.679770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-707cf9d6-9852-4e66-af85-d3c984b87723 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 0.612593 Jul 18 02:12:55.685103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 238/447] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:55 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:55.697746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-768397fa-4860-4a0a-a21b-e5dc0c07f004 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.702876 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:55.702876 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:55.705761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-768397fa-4860-4a0a-a21b-e5dc0c07f004 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8de400d3fd4642aabf75eceb00220e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4ac06072d49f599781391d26dfc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-768397fa-4860-4a0a-a21b-e5dc0c07f004 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Request method failure captured: Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGgYROOe-ELyfZAAfS_2_Qwgs3nNEy-HyJ3x44Yvockf6PXo2-4cuERxIFBZfochUqWHGDq3qS_rcxy4fevoXvO2diU02d2bRSxhJVj1blBS6nRIzbGz-AFW_hjACQPjLt1m4eEPcR5LelkvAhjCpJoJvQP2KgntrB0NPJIcoRmrxU Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.711286 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8de400d3fd4642aabf75eceb00220e16 Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.714829 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:numa_nodes'} Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:55.723119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.727481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-768397fa-4860-4a0a-a21b-e5dc0c07f004 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.732439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-768397fa-4860-4a0a-a21b-e5dc0c07f004 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] 10.222.0.67 "DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027761 Jul 18 02:12:55.732439 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 239/448] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:12:55 2022] DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.732439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.732439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 02951cf8-9abb-4df5-bbf5-975313171c4f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.747035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.747844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.749416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.750162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.787749 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f HTTP/1.1 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.791943 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.793292 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '02951cf8-9abb-4df5-bbf5-975313171c4f'} Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.793936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. Jul 18 02:12:55.795007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.797217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 02951cf8-9abb-4df5-bbf5-975313171c4f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.797217 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cfea70c9-7515-4e08-8242-59fb606beab1 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f" status: 404 len: 111 microversion: 2.1 time: 0.075992 Jul 18 02:12:55.800707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 240/449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:55 2022] GET /compute/v2.1/servers/02951cf8-9abb-4df5-bbf5-975313171c4f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.814484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa06fdb4-a43a-4b78-84e2-97d08d34ea7d tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:55.816086 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:55.816086 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:55.843423 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa06fdb4-a43a-4b78-84e2-97d08d34ea7d tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1119205614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041107 Jul 18 02:12:55.844732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 241/450] 10.222.0.67 () {60 vars in 1223 bytes} [Mon Jul 18 02:12:55 2022] POST /compute/v2.1/flavors/1119205614/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:12:55.850066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.850846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.860513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.861257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.862373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.863015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.880913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 HTTP/1.1 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.883045 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.884695 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1d6cf10e-b489-4d5d-9c45-808a207bfd79'} Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.885400 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.886465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.889306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.890431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea4f8f55-4dbf-4de0-8696-9a4960e0e773 tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 404 len: 111 microversion: 2.1 time: 0.044419 Jul 18 02:12:55.891257 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 242/451] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:12:55 2022] DELETE /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.900175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9029e99d-42f0-480b-a503-e983869711c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:55.902470 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:55.902470 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:55.904007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9029e99d-42f0-480b-a503-e983869711c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8de400d3fd4642aabf75eceb00220e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4ac06072d49f599781391d26dfc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9029e99d-42f0-480b-a503-e983869711c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Request method failure captured: Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 22 Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGgYROOe-ELyfZAAfS_2_Qwgs3nNEy-HyJ3x44Yvockf6PXo2-4cuERxIFBZfochUqWHGDq3qS_rcxy4fevoXvO2diU02d2bRSxhJVj1blBS6nRIzbGz-AFW_hjACQPjLt1m4eEPcR5LelkvAhjCpJoJvQP2KgntrB0NPJIcoRmrxU Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.906167 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e2d4ac06072d49f599781391d26dfc9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e2d4ac06072d49f599781391d26dfc9c Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8de400d3fd4642aabf75eceb00220e16 Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: {"hw:numa_nodes": "1"} Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.907429 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:12:55.908158 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 18 02:12:55.909925 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.912027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9029e99d-42f0-480b-a503-e983869711c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.913279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9029e99d-42f0-480b-a503-e983869711c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383 tempest-FlavorsExtraSpecsNegativeTestJSON-1893740383-project] 10.222.0.67 "PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020779 Jul 18 02:12:55.914191 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 243/452] 10.222.0.67 () {60 vars in 1264 bytes} [Mon Jul 18 02:12:55 2022] PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.920681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.921691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] [instance: 1d6cf10e-b489-4d5d-9c45-808a207bfd79] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:55.929582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.930026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.931443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:55.931443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:55.959011 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] HTTP exception thrown: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Request method failure captured: Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 HTTP/1.1 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFPkzP37_IY-OndlIa_hBMWbZ1OaA8ellWrQTBuSu6wzI4zwgqJ2p1jTbw7cwrWCzA9baeozPc5ebuR377SZ4gtRUc2PCHQKxlhyoSjdV47Gj2I7Xst3bQXH8VdpysQgAgUiIG1rVkEYuWBIJksRxUIhBgFT8ahhK-Ra73pPGIM0yo Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:12:55.962976 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0855591e3a664a5d8110f637a3172a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0855591e3a664a5d8110f637a3172a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0855591e3a664a5d8110f637a3172a00 Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525203244 Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0c7dfafed8804a84b705d3f685f5916d Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525203244-project Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.965995 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1d6cf10e-b489-4d5d-9c45-808a207bfd79'} Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:55.967302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. Jul 18 02:12:55.969526 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:55.971507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] Returning 404 to user: Instance 1d6cf10e-b489-4d5d-9c45-808a207bfd79 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:55.971507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d6c570b3-25bf-45c7-9aa2-69c7336b43fb tempest-DeleteServersAdminTestJSON-1525203244 tempest-DeleteServersAdminTestJSON-1525203244-project] 10.222.0.67 "GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79" status: 404 len: 111 microversion: 2.1 time: 0.049190 Jul 18 02:12:55.971507 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 244/453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:55 2022] GET /compute/v2.1/servers/1d6cf10e-b489-4d5d-9c45-808a207bfd79 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:55.984256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47bb9d85-0fbb-4dad-8a18-9871dcfa38a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:55.986072 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:55.986072 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:56.000752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-47bb9d85-0fbb-4dad-8a18-9871dcfa38a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] HTTP exception thrown: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47bb9d85-0fbb-4dad-8a18-9871dcfa38a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Request method failure captured: Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGhA56mYMkkVM9h5iNhfEdGYM3fOhJG4vZVO4_zFKUm-ww4pi8cluxX3vrBQjlczZvUZwWvkoCxOzdyWrtjNfG67St_xPBKcZUAUk-mP0zdtSxiAeCmGy9GHG2b24OZ5bfaZsbjskcx4ferWQ-qLUAA_GAUOyMlYW1WLfq05zjqJE4 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:56.003573 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_921838e305d14644b3fb74679e69204a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/921838e305d14644b3fb74679e69204a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: bba1d1b2d72647dcb819aabf40bc9c0e Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:56.006080 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:cpu_thread_policy'} Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:56.007300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47bb9d85-0fbb-4dad-8a18-9871dcfa38a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Returning 404 to user: Flavor 1119205614 has no extra specs with key hw:cpu_thread_policy. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:56.012795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47bb9d85-0fbb-4dad-8a18-9871dcfa38a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.036995 Jul 18 02:12:56.014763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 245/454] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:12:55 2022] DELETE /compute/v2.1/flavors/1119205614/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:12:56.022767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:56.023829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:56.036825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:56.037641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:56.038878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:56.039641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:56.422331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:56.438131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90fbef5c-b32f-4abe-8d34-7b382070c05f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1459 microversion: 2.1 time: 0.421894 Jul 18 02:12:56.439922 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 246/455] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:56 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1459 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:56.455530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28c64a85-babd-4b59-ba95-43d801462f57 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:56.456986 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:56.456986 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:56.457919 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-28c64a85-babd-4b59-ba95-43d801462f57 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28c64a85-babd-4b59-ba95-43d801462f57 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Request method failure captured: Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 27 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGhA56mYMkkVM9h5iNhfEdGYM3fOhJG4vZVO4_zFKUm-ww4pi8cluxX3vrBQjlczZvUZwWvkoCxOzdyWrtjNfG67St_xPBKcZUAUk-mP0zdtSxiAeCmGy9GHG2b24OZ5bfaZsbjskcx4ferWQ-qLUAA_GAUOyMlYW1WLfq05zjqJE4 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:56.459328 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_921838e305d14644b3fb74679e69204a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/921838e305d14644b3fb74679e69204a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: bba1d1b2d72647dcb819aabf40bc9c0e Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: {"hw:cpu_policy": "shared"} Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:56.462626 n-d-849796-1 devstack@n-api.service[119439]: exception: Request body and URI mismatch Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:56.464886 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28c64a85-babd-4b59-ba95-43d801462f57 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28c64a85-babd-4b59-ba95-43d801462f57 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009110 Jul 18 02:12:56.468498 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 247/456] 10.222.0.67 () {60 vars in 1264 bytes} [Mon Jul 18 02:12:56 2022] PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:12:56.473547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:56.474159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:56.482858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:56.483327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:56.484379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:56.484828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:57.745432 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11355573-a76d-441c-b435-000762e01a2f tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1610 microversion: 2.1 time: 1.275296 Jul 18 02:12:57.748009 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 248/457] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:56 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1610 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:57.761938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3701b368-6239-4d80-b9cb-10d9ad3baf54 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3701b368-6239-4d80-b9cb-10d9ad3baf54 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Request method failure captured: Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 49 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MGhA56mYMkkVM9h5iNhfEdGYM3fOhJG4vZVO4_zFKUm-ww4pi8cluxX3vrBQjlczZvUZwWvkoCxOzdyWrtjNfG67St_xPBKcZUAUk-mP0zdtSxiAeCmGy9GHG2b24OZ5bfaZsbjskcx4ferWQ-qLUAA_GAUOyMlYW1WLfq05zjqJE4 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:12:57.769857 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_921838e305d14644b3fb74679e69204a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/921838e305d14644b3fb74679e69204a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/921838e305d14644b3fb74679e69204a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 921838e305d14644b3fb74679e69204a Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: bba1d1b2d72647dcb819aabf40bc9c0e Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 18 02:12:57.772582 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'flavor_id': '1119205614', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance: Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 18 02:12:57.775911 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.778723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 18 02:12:57.784025 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:12:57.786859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3701b368-6239-4d80-b9cb-10d9ad3baf54 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:12:57.788912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3701b368-6239-4d80-b9cb-10d9ad3baf54 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.038666 Jul 18 02:12:57.791300 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 249/458] 10.222.0.67 () {60 vars in 1264 bytes} [Mon Jul 18 02:12:57 2022] PUT /compute/v2.1/flavors/1119205614/os-extra_specs/hw:numa_nodes => generated 117 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:12:57.802458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:57.803583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:57.836606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:57.839482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:57.845334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:57.849700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:58.637865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:12:58.697946 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74295a5e-4183-4e4b-a649-1b80ea46d9cf tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 0.903564 Jul 18 02:12:58.699869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 250/459] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:12:57 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:12:59.408041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fc9c4a4-0191-4bb4-b4cd-3a82eb33e926 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Action: 'create', calling method: .version_select at 0x7fab05bb8820>, body: {"keypair": {"name": "tempest-keypair-2123564796", "type": "ssh", "user_id": "1c1421441997491c82475f785c7db21e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE34VXi/olgSVH249oL6m7yFKsVvNjpGh2DiYQXfQt2Jnts+F7nhxerYvrJpPwqV+W+wdZJ/8RlExEinyWMf3oEsXAKGltLajOH+T2pdNY1xXq1pbQCC6RCqd2I8AmuJmw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:59.426863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1fc9c4a4-0191-4bb4-b4cd-3a82eb33e926 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:59.433643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1fc9c4a4-0191-4bb4-b4cd-3a82eb33e926 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for user b76816dfabbe4182a1a4c3044de0656c and project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:59.513129 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fc9c4a4-0191-4bb4-b4cd-3a82eb33e926 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.811242 Jul 18 02:12:59.514139 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 251/460] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:12:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 813 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:12:59.520442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:59.522638 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:59.522638 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:59.524674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.525531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.527044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.528044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.598843 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce2d7de5-1398-43f5-88cd-2f0db8c3f1a5 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082590 Jul 18 02:12:59.605030 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 252/461] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:12:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:12:59.622961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caf4bd0b-c553-492c-ae64-beb04d24e488 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:12:59.632747 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:12:59.632747 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:12:59.671372 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-caf4bd0b-c553-492c-ae64-beb04d24e488 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1119205614" status: 202 len: 0 microversion: 2.1 time: 0.067434 Jul 18 02:12:59.672505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 253/462] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:12:59 2022] DELETE /compute/v2.1/flavors/1119205614 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:12:59.684030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bbae96f9-77f4-45eb-aa32-7b290fc7a715 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Action: 'create', calling method: .version_select at 0x7fab05bdc310>, body: {"keypair": {"name": "tempest-keypair-749522373", "type": "ssh", "user_id": "1c1421441997491c82475f785c7db21e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvkbllQj7UJl9D8lVSpLizYmVB47Vz84jLXm7wQijIsE5qaUPNyuizvospIMOa4Ow1ZTW+EKpSQUVzhqx9xeA7YzPT2BKn+DS3y/kTBad9lV65oHJ6WAvCPrCyTt51zHA=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:59.734911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-bbae96f9-77f4-45eb-aa32-7b290fc7a715 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:12:59.747232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-bbae96f9-77f4-45eb-aa32-7b290fc7a715 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for user b76816dfabbe4182a1a4c3044de0656c and project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:12:59.820064 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bbae96f9-77f4-45eb-aa32-7b290fc7a715 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.144858 Jul 18 02:12:59.823078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 254/463] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:12:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:12:59.834075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:12:59.837671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:12:59.853970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.855501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.859139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:12:59.860569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:12:59.991008 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f04a280d-b1e8-4b82-b4a6-7fa212304e35 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd/action" status: 202 len: 0 microversion: 2.25 time: 8.670518 Jul 18 02:12:59.999759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 210/464] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:12:51 2022] POST /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd/action => generated 0 bytes in 8680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:00.035246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6082b2f7-e2e3-4848-99cc-f39f937e7bc9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.173293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6082b2f7-e2e3-4848-99cc-f39f937e7bc9 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818 tempest-FlavorsExtraSpecsNegativeTestJSON-1787089818-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.157766 Jul 18 02:13:00.198638 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 211/465] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:12:59 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:00.216062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Lazy-loading 'flavor' on Instance uuid c1c13ed6-e774-4728-a355-c29cbde243d5 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:13:00.222999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.226893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:00.244233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.245561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.248040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.249673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.254048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c1c13ed6-e774-4728-a355-c29cbde243d5 while it is in vm_state suspended Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Request method failure captured: Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5/action HTTP/1.1 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 97 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFhlGWOtojJg9wJM6xRlfflxvn4bYiIxBe_pZx5Al3c9VZGTaJ0cTn1bpxmBaOg5gYyFSyI4mk26wuXfSbDCfK6XN8p_nl7dGo_1vwaxaMD35-nTqR8eIkE9t6ZmjIefXJ3klvpbSa5ItGOCRQJCGmlTeC5LurDVOWPXBJN-hg5uak Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dfdb1b6667804f369faf477c18704663 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:13:00.258310 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dfdb1b6667804f369faf477c18704663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dfdb1b6667804f369faf477c18704663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dfdb1b6667804f369faf477c18704663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dfdb1b6667804f369faf477c18704663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dfdb1b6667804f369faf477c18704663 Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-182102092 Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveMigrationNegativeTest-182102092-project-admin Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f5178a0346ad4c109ed500a88a90ac8c Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveMigrationNegativeTest-182102092-project-admin Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": true, "disk_over_commit": false}} Jul 18 02:13:00.262775 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'os-migrateLive' instance c1c13ed6-e774-4728-a355-c29cbde243d5 while it is in vm_state suspended Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'c1c13ed6-e774-4728-a355-c29cbde243d5', 'body': {'os-migrateLive': {'host': 'n-h1-849796-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 02:13:00.265691 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:00.268602 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c1c13ed6-e774-4728-a355-c29cbde243d5 while it is in vm_state suspended Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c1c13ed6-e774-4728-a355-c29cbde243d5 while it is in vm_state suspended Jul 18 02:13:00.273682 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:00.276910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c1c13ed6-e774-4728-a355-c29cbde243d5 while it is in vm_state suspended {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:00.276910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a7b62fb-7d02-449e-9582-6d72e59f55e1 tempest-LiveMigrationNegativeTest-182102092 tempest-LiveMigrationNegativeTest-182102092-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5/action" status: 409 len: 155 microversion: 2.1 time: 0.439564 Jul 18 02:13:00.280603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 255/466] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:12:59 2022] POST /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5/action => generated 155 bytes in 456 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:13:00.303650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-401d443f-eb77-488b-8907-3be56028bf8c tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Calling method '.version_select at 0x7fab05bdc940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.357500 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-401d443f-eb77-488b-8907-3be56028bf8c tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-2123564796?user_id=1c1421441997491c82475f785c7db21e" status: 200 len: 512 microversion: 2.10 time: 0.073977 Jul 18 02:13:00.358801 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 256/467] 10.222.0.67 () {60 vars in 1339 bytes} [Mon Jul 18 02:13:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2123564796?user_id=1c1421441997491c82475f785c7db21e => generated 512 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:00.369442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.373431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:00.407427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.409119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.410082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.412304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.542301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:00.853692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:00.853988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:00.881434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:00.883377 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c111f3c-47d5-4def-8ce0-f1da8cf7c2e3 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 0.682756 Jul 18 02:13:00.887448 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 212/468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:00 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:00.897273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:00.898678 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abf73d0d-f15e-49c9-afcd-a98b81a738ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.538159 Jul 18 02:13:00.899933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:00.901119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:00.902814 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 257/469] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:00 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:00.911342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97cf05ca-1969-4d90-b46e-2e4be23676fc tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Action: 'create', calling method: .version_select at 0x7fab05bdcb80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-474879233", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzpsA+BJUoJjxlHFd0agGizq8H9/+ahG3cybHIQrWh5IUrIvQghJh4gboNOZfaLGi8mTLhR5JmR+j6jMfCEAdJknJqbz1inMSQ+wF8rAio/7qBlOcY4HP+90o1R0cOxyw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:00.924660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.928008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.932800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:00.936776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:00.965518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-97cf05ca-1969-4d90-b46e-2e4be23676fc tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:00.972572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-97cf05ca-1969-4d90-b46e-2e4be23676fc tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Getting quotas for user b76816dfabbe4182a1a4c3044de0656c and project de57f45350af432ba2ca527b44ad7550. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:01.038863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:13:01.050937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97cf05ca-1969-4d90-b46e-2e4be23676fc tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.146182 Jul 18 02:13:01.052995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 258/470] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:13:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:13:01.088304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-898f6b19-9d17-4d98-a876-e71ed3456350 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Calling method '.version_select at 0x7fab05ec1940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.097222 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-898f6b19-9d17-4d98-a876-e71ed3456350 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:13:01.124957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-898f6b19-9d17-4d98-a876-e71ed3456350 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs?user_id=1c1421441997491c82475f785c7db21e" status: 200 len: 725 microversion: 2.10 time: 0.051427 Jul 18 02:13:01.126167 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 259/471] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Jul 18 02:13:01 2022] GET /compute/v2.1/os-keypairs?user_id=1c1421441997491c82475f785c7db21e => generated 725 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:13:01.140519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c665abf-4841-4c4c-91d6-d7546e7da7c2 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Calling method '.version_select at 0x7fab05bb8280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.199242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c665abf-4841-4c4c-91d6-d7546e7da7c2 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-474879233" status: 204 len: 0 microversion: 2.10 time: 0.068152 Jul 18 02:13:01.201071 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 260/472] 10.222.0.67 () {60 vars in 1321 bytes} [Mon Jul 18 02:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-474879233 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:13:01.232181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2f15787-14e9-4cfb-a371-d4eacca95506 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Calling method '.version_select at 0x7fab05bb89d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.322323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d2f15787-14e9-4cfb-a371-d4eacca95506 tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749522373?user_id=1c1421441997491c82475f785c7db21e" status: 204 len: 0 microversion: 2.10 time: 0.107253 Jul 18 02:13:01.327102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 261/473] 10.222.0.67 () {60 vars in 1339 bytes} [Mon Jul 18 02:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749522373?user_id=1c1421441997491c82475f785c7db21e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:13:01.378112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2031878c-0314-4384-aa8b-e16a50c3909e tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] Calling method '.version_select at 0x7fab05cb20d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.397690 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a16f209-3bce-43b4-b73d-995e60b9e898 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 204 len: 0 microversion: 2.1 time: 0.507534 Jul 18 02:13:01.399981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 213/474] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:13:00 2022] DELETE /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:01.410492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:SAVEPOINT=3,nova_api:SELECT=83,nova_api:DELETE=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:01.426404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.443988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:01.455043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2031878c-0314-4384-aa8b-e16a50c3909e tempest-KeyPairsV210TestJSON-549114734 tempest-KeyPairsV210TestJSON-549114734-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123564796?user_id=1c1421441997491c82475f785c7db21e" status: 204 len: 0 microversion: 2.10 time: 0.120036 Jul 18 02:13:01.456396 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 262/475] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123564796?user_id=1c1421441997491c82475f785c7db21e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:13:01.483402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.484216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.485693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.486485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.904916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:01.905641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:01.918605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.919064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:01.923331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:01.926898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:02.285342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.297196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-525497be-ce48-4b25-9439-d1642f04d920 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 0.396859 Jul 18 02:13:02.311931 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 263/476] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:01 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:13:02.318325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3a07440d-4696-4f48-81a3-d222f3ef16ee req-6186e324-9f84-4547-a9bd-7b328a045027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf524c-67ea-4cee-a327-ce274d11c894", "name": "network-vif-plugged", "status": "completed", "tag": "76355fd5-8182-4940-8061-ef759ae2d520"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:02.350235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3a07440d-4696-4f48-81a3-d222f3ef16ee req-6186e324-9f84-4547-a9bd-7b328a045027 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:02.356104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3a07440d-4696-4f48-81a3-d222f3ef16ee req-6186e324-9f84-4547-a9bd-7b328a045027 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:02.370469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3a07440d-4696-4f48-81a3-d222f3ef16ee req-6186e324-9f84-4547-a9bd-7b328a045027 service nova] Creating event network-vif-plugged:76355fd5-8182-4940-8061-ef759ae2d520 for instance 84cf524c-67ea-4cee-a327-ce274d11c894 on n-h1-849796-1 Jul 18 02:13:02.376599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3a07440d-4696-4f48-81a3-d222f3ef16ee req-6186e324-9f84-4547-a9bd-7b328a045027 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061899 Jul 18 02:13:02.377688 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 264/477] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:02.384967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:02.396086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:02.421506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:02.422451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:02.422786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:02.423238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:02.427069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.467826 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-884f4c8e-e997-4b7f-963b-a03fbecfc0b3 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1465 microversion: 2.1 time: 1.059213 Jul 18 02:13:02.471100 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 214/478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:01 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1465 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:02.673847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.690332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.692227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:02.699450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0017971e-2462-47d7-9a06-8b13d0649577 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.317164 Jul 18 02:13:02.701808 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 265/479] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:02 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:03.320173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:03.323845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:03.356578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.359431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.365422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.366604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.491191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:03.492291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:03.512243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.513156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:03.514359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:03.514911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.088366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:04.119972 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59133f93-18e0-4d39-84ad-31e6e6dbb49d tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1465 microversion: 2.1 time: 0.629121 Jul 18 02:13:04.122950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 266/480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:03 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1465 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:13:04.165268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:04.178615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:04.210327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.213746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.217290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:04.217756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:04.929201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:04.982349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:04.986702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:04.989524 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5eb4cde-b2b2-4423-a6e4-a0aaa8065c5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.863151 Jul 18 02:13:04.990999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 267/481] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:04 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:05.026846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:05.067633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c4a2aa0-779a-4dde-a7b0-cc978490a79b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1324 microversion: 2.1 time: 1.755047 Jul 18 02:13:05.069448 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 215/482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:03 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1324 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:05.154410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:05.155534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:05.184109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:05.190280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:05.192186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:05.199323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:05.896129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-53270789-46ba-4c04-8d42-583e7cca9175 req-f0643a39-f26d-4254-adb4-5c672f9e81f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "name": "network-vif-unplugged", "status": "completed", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:05.959521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-53270789-46ba-4c04-8d42-583e7cca9175 req-f0643a39-f26d-4254-adb4-5c672f9e81f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:05.960499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-53270789-46ba-4c04-8d42-583e7cca9175 req-f0643a39-f26d-4254-adb4-5c672f9e81f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.016123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-53270789-46ba-4c04-8d42-583e7cca9175 req-f0643a39-f26d-4254-adb4-5c672f9e81f8 service nova] Creating event network-vif-unplugged:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h2-849796-1 Jul 18 02:13:06.043280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-53270789-46ba-4c04-8d42-583e7cca9175 req-f0643a39-f26d-4254-adb4-5c672f9e81f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153363 Jul 18 02:13:06.044797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 216/483] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:06.060861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:06.062467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:06.073287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:06.088758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:06.089807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66d27f8e-dd78-4f9c-8c71-62d0e1262893 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1423 microversion: 2.1 time: 0.941887 Jul 18 02:13:06.090863 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 268/484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:05 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1423 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:06.099761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.099761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:06.099761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.115765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:06.122738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:06.140748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:06.142708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.145511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:06.146220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.644184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:06.676213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:06.679750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:06.694724 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de959786-555b-40a6-95ac-a9cfd4438ec9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.647717 Jul 18 02:13:06.695717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 217/485] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:06 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:06.714767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6b88e015-af18-49cb-a5f1-08364fdb9fab req-52c2d145-c2c9-4ed3-b307-3dc1c6a71f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c13ed6-e774-4728-a355-c29cbde243d5", "name": "network-vif-deleted", "tag": "e541268c-ab4e-466c-9198-74b59aa5bd01"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:06.742536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6b88e015-af18-49cb-a5f1-08364fdb9fab req-52c2d145-c2c9-4ed3-b307-3dc1c6a71f22 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:06.751742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6b88e015-af18-49cb-a5f1-08364fdb9fab req-52c2d145-c2c9-4ed3-b307-3dc1c6a71f22 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:06.797263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6b88e015-af18-49cb-a5f1-08364fdb9fab req-52c2d145-c2c9-4ed3-b307-3dc1c6a71f22 service nova] Creating event network-vif-deleted:e541268c-ab4e-466c-9198-74b59aa5bd01 for instance c1c13ed6-e774-4728-a355-c29cbde243d5 on n-h2-849796-1 Jul 18 02:13:06.810011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6b88e015-af18-49cb-a5f1-08364fdb9fab req-52c2d145-c2c9-4ed3-b307-3dc1c6a71f22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110676 Jul 18 02:13:06.813635 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 218/486] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:07.351395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:07.376520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5102c06f-23f8-4086-90a4-a2acddff3084 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 200 len: 1521 microversion: 2.1 time: 1.274157 Jul 18 02:13:07.382987 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 269/487] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:06 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 1521 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:07.417677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:07.424646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:07.456887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.460423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:07.465258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.465979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:07.537178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81f3bc7b-bd6e-4475-94da-5dbf1f2cc9f3 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1152405308", "id": 1771737062, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:07.545436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:07.552347 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:07.552347 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:07.565444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.565918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:07.566533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lazy-loading 'fault' on Instance uuid c1c13ed6-e774-4728-a355-c29cbde243d5 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:13:07.678251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81f3bc7b-bd6e-4475-94da-5dbf1f2cc9f3 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.859673 Jul 18 02:13:07.679438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 219/488] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:13:06 2022] POST /compute/v2.1/flavors => generated 468 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:07.710232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: .version_select at 0x7fab08146e50>, body: {"addFloatingIp": {"address": "172.25.0.62"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:07.713502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:07.714373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:07.739913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-41156b4b-8c24-434d-be84-cfaeeee9480f tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 200 len: 1308 microversion: 2.1 time: 0.335840 Jul 18 02:13:07.739913 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 270/489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:07 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:07.748012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.749140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:07.751481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:07.753441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:08.035017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Acquired lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:08.979766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65ae5162-c96c-476d-9ec5-31bdf5a7cbcd tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:09.007385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65ae5162-c96c-476d-9ec5-31bdf5a7cbcd tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] 10.222.0.67 "GET /compute/v2.1/flavors/1771737062" status: 200 len: 468 microversion: 2.61 time: 1.258070 Jul 18 02:13:09.018689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 271/490] 10.222.0.67 () {60 vars in 1198 bytes} [Mon Jul 18 02:13:07 2022] GET /compute/v2.1/flavors/1771737062 => generated 468 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:09.029926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:09.031871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:09.089241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:09.094418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:09.098487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:09.102812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:09.539872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:09.882730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:09.914316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:09.921936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:09.923608 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a3125cc-51da-446b-a24e-39b7309f622e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.903758 Jul 18 02:13:09.931762 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 272/491] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:09 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:09.948635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5e719582-a04f-4e73-9e12-d49de34d85df req-90ed9af6-f657-4a2f-a801-a7fa9faaac21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:09.965211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5e719582-a04f-4e73-9e12-d49de34d85df req-90ed9af6-f657-4a2f-a801-a7fa9faaac21 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:09.986795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5e719582-a04f-4e73-9e12-d49de34d85df req-90ed9af6-f657-4a2f-a801-a7fa9faaac21 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.047708 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5e719582-a04f-4e73-9e12-d49de34d85df req-90ed9af6-f657-4a2f-a801-a7fa9faaac21 service nova] Creating event network-changed:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h2-849796-1 Jul 18 02:13:10.067298 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5e719582-a04f-4e73-9e12-d49de34d85df req-90ed9af6-f657-4a2f-a801-a7fa9faaac21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133837 Jul 18 02:13:10.072580 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 273/492] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:10.084002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:10.087330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: c1c13ed6-e774-4728-a355-c29cbde243d5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:10.114856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.115777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.116864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.117559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.153370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] HTTP exception thrown: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Request method failure captured: Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 HTTP/1.1 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFf9DJ5EBOD0UcZwYdjC4aWT6yQ4vAP6a4thhGxFMrRwSN6S4M8qOu0DbTQU5F9sXh2oBxOgMlMUUqKQWYKN5DjooP6GooNI41KdafcK3v1MX4WUAERFUr8Y2js1qvQWDzWXQjLCMyYukIfIJucfCcvminiEiIt46XsyCH4HINkevk Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9bd68bb21b5342f79e7b7791f86bed46 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:13:10.157935 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9bd68bb21b5342f79e7b7791f86bed46 Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveMigrationNegativeTest-170126233-project Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0ea8026d405a4803b54b77de93cb9d01 Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveMigrationNegativeTest-170126233-project Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. Jul 18 02:13:10.159430 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'c1c13ed6-e774-4728-a355-c29cbde243d5'} Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:10.160179 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. Jul 18 02:13:10.161546 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:10.166006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Returning 404 to user: Instance c1c13ed6-e774-4728-a355-c29cbde243d5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:10.167219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20816891-a756-4287-b8a6-f47c49892532 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5" status: 404 len: 111 microversion: 2.1 time: 0.093211 Jul 18 02:13:10.173248 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 274/493] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:10 2022] GET /compute/v2.1/servers/c1c13ed6-e774-4728-a355-c29cbde243d5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:10.182109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af1a89b1-18d2-4acf-ba14-a3f4481b65b5 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:10.192347 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:10.192347 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:10.259253 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af1a89b1-18d2-4acf-ba14-a3f4481b65b5 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1771737062" status: 200 len: 469 microversion: 2.61 time: 0.083742 Jul 18 02:13:10.261533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 275/494] 10.222.0.67 () {62 vars in 1218 bytes} [Mon Jul 18 02:13:10 2022] PUT /compute/v2.1/flavors/1771737062 => generated 469 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:10.279068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:10.279935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:10.295393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.298422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.302571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.303388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.382739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:13:10.754912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-914797d4-33b1-464b-ac60-39e57cef7d75 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 204 len: 0 microversion: 2.1 time: 0.490387 Jul 18 02:13:10.762307 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 276/495] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:13:10 2022] DELETE /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:10.782432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da67200f-b03b-46d7-9598-ca1a93ce98fe tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:10.841528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da67200f-b03b-46d7-9598-ca1a93ce98fe tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.076925 Jul 18 02:13:10.855722 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 277/496] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:13:10 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:10.861445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:10.862466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:10.873101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.877039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:10.878786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:10.890023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:11.003787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:11.653552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Building network info cache for instance {{(pid=119440) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:11.705073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:11.735891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be19981a-f286-4454-9d1b-35b065f6e303 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1473 microversion: 2.1 time: 0.878305 Jul 18 02:13:11.738293 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 278/497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:10 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1473 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:11.772267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cdbcc98-46f1-496b-9e63-82d6290bb7c6 tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:11.854042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2cdbcc98-46f1-496b-9e63-82d6290bb7c6 tempest-FlavorsV261TestJSON-2106656784 tempest-FlavorsV261TestJSON-2106656784-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.113497 Jul 18 02:13:11.892672 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 279/498] 10.222.0.67 () {60 vars in 1165 bytes} [Mon Jul 18 02:13:11 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:11.914220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:11.916347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:11.955389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:11.957627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:11.959406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:11.960217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.038982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:13.071223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:13.076379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:13.079719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ca86bba-0b7c-4118-9a19-c418c8db046f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 1.184712 Jul 18 02:13:13.082143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 280/499] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:11 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:13.093554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3650421f-04c7-49e2-9141-e1a0e2622f08 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:13.095650 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:13.095650 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:13.182904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3650421f-04c7-49e2-9141-e1a0e2622f08 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1771737062" status: 202 len: 0 microversion: 2.61 time: 0.098166 Jul 18 02:13:13.184587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 281/500] 10.222.0.67 () {60 vars in 1201 bytes} [Mon Jul 18 02:13:13 2022] DELETE /compute/v2.1/flavors/1771737062 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:13.669912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05dc59d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:13.685860 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:13.685860 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:13.689490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:13.691280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.692176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:13.693289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.762236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe8d8c24-b4b9-48ba-9b1c-b578b1a2b31b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.575467 Jul 18 02:13:13.763046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 282/501] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:13:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:13.790367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-bd2041bb-cc4b-459d-97f2-16542d4b824e req-4a3938c7-6a66-43d3-98e9-5e18fbd2c2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:13.830720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bd2041bb-cc4b-459d-97f2-16542d4b824e req-4a3938c7-6a66-43d3-98e9-5e18fbd2c2f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:13.834574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bd2041bb-cc4b-459d-97f2-16542d4b824e req-4a3938c7-6a66-43d3-98e9-5e18fbd2c2f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:13.855385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-bd2041bb-cc4b-459d-97f2-16542d4b824e req-4a3938c7-6a66-43d3-98e9-5e18fbd2c2f6 service nova] Creating event network-changed:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:13:13.863246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-bd2041bb-cc4b-459d-97f2-16542d4b824e req-4a3938c7-6a66-43d3-98e9-5e18fbd2c2f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094876 Jul 18 02:13:13.865147 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 283/502] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:14.034857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1505081899", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:14.124738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:14.364700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Updating instance_info_cache with network_info: [{"id": "31df94e4-34c7-4448-bd8a-45c120eca8d8", "address": "fa:16:3e:fa:b1:b5", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31df94e4-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:14.407427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Releasing lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:14.409096 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c2cabd2-cc6b-491e-9cdb-f957614335e2 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action" status: 202 len: 0 microversion: 2.1 time: 6.711485 Jul 18 02:13:14.411543 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 220/503] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:07 2022] POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action => generated 0 bytes in 6715 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:13:14.421290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:14.422239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:14.434184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:14.441325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.441772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.446495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.447262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.557336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:14.728163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea8026d405a4803b54b77de93cb9d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd68bb21b5342f79e7b7791f86bed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:14.753706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bcfa4609-7807-4a6d-92cb-c78faaee02d8 tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 200 len: 1431 microversion: 2.1 time: 0.340330 Jul 18 02:13:14.764678 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 221/504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:14 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 1431 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:14.780024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d99afe7-2af7-41b8-b44e-c8c857a8b684 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:14.892486 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d99afe7-2af7-41b8-b44e-c8c857a8b684 tempest-FlavorsV261TestJSON-1280150067 tempest-FlavorsV261TestJSON-1280150067-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.124164 Jul 18 02:13:14.894469 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 222/505] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:13:14 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:14.927266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab051f3940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:14.934353 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:14.934353 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:14.946959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.948468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:14.951398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:14.955407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.064697 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c576ea2-9dea-44aa-badb-8b76ccf73536 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.167016 Jul 18 02:13:15.065586 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 223/506] 10.222.0.67 () {58 vars in 1138 bytes} [Mon Jul 18 02:13:14 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:15.099724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:15.101007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:15.124914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.136188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.137975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.138755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.513140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:15.514352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:15.515000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:15.515536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:15.516684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:15.536547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.538548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.540866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.543841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.653222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Getting quotas for project bd273272d4f44b6287b9b6e97bbb4bd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:15.666844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Getting quotas for user 355895d2b59745c8857999a3b2b82ade and project bd273272d4f44b6287b9b6e97bbb4bd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:15.681282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:15.707791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:15.711745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:15.721889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:15.726741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:15.737216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da0f24ce-abdb-49f1-8e36-82562ecfbc0b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.650492 Jul 18 02:13:15.738717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 224/507] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:15 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:15.765307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.62"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:15.768616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:15.794727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.801921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.802972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:15.809230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:15.933428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dd299db-7074-4063-bc17-67a9f8870fa1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.065592 Jul 18 02:13:15.944660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Acquired lock "refresh_cache-84cf524c-67ea-4cee-a327-ce274d11c894" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:15.950652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 284/508] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:15.983532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05ab0ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:15.994409 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:15.994409 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:15.998822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.006221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.009687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.012672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.100882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d38baa14-fa96-47e1-bb5f-f5d39dbd9b37 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.146054 Jul 18 02:13:16.106756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 285/509] 10.222.0.67 () {58 vars in 1144 bytes} [Mon Jul 18 02:13:15 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:13:16.136540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:16.142865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] [instance: 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:16.168161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.170086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.173965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.178807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.251925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] HTTP exception thrown: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Request method failure captured: Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac HTTP/1.1 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFf9DJ5EBOD0UcZwYdjC4aWT6yQ4vAP6a4thhGxFMrRwSN6S4M8qOu0DbTQU5F9sXh2oBxOgMlMUUqKQWYKN5DjooP6GooNI41KdafcK3v1MX4WUAERFUr8Y2js1qvQWDzWXQjLCMyYukIfIJucfCcvminiEiIt46XsyCH4HINkevk Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9bd68bb21b5342f79e7b7791f86bed46 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:13:16.263035 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9bd68bb21b5342f79e7b7791f86bed46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9bd68bb21b5342f79e7b7791f86bed46 Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-170126233 Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveMigrationNegativeTest-170126233-project Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0ea8026d405a4803b54b77de93cb9d01 Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveMigrationNegativeTest-170126233-project Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. Jul 18 02:13:16.265627 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1aa628e8-e79b-4680-a7ab-ccf7ab9031ac'} Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:16.267024 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. Jul 18 02:13:16.269350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:16.290336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] Returning 404 to user: Instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:16.297995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dc66b8c-3418-4176-b335-639acd1f347b tempest-LiveMigrationNegativeTest-170126233 tempest-LiveMigrationNegativeTest-170126233-project] 10.222.0.67 "GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac" status: 404 len: 111 microversion: 2.1 time: 0.182873 Jul 18 02:13:16.302542 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 286/510] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:16 2022] GET /compute/v2.1/servers/1aa628e8-e79b-4680-a7ab-ccf7ab9031ac => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:16.316742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8551da96-e3ba-4c6e-bdc7-9b7efa2796e7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:16.321639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8551da96-e3ba-4c6e-bdc7-9b7efa2796e7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:16.743630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8551da96-e3ba-4c6e-bdc7-9b7efa2796e7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:16.767559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8551da96-e3ba-4c6e-bdc7-9b7efa2796e7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1222 microversion: 2.1 time: 0.465527 Jul 18 02:13:16.773128 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 287/511] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:16 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1222 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:16.791581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05bb8e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:16.800315 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:16.800315 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:16.804620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.806826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.810962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.811603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:16.911263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-827b4b36-6181-4ab5-a5f1-743b89605bd2 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.135468 Jul 18 02:13:16.918539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 288/512] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:13:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:16.936980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-acccd230-a488-4d27-8f52-505aa863e0b6 req-17760f64-f173-4add-93ed-058062f43517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa628e8-e79b-4680-a7ab-ccf7ab9031ac", "name": "network-vif-deleted", "tag": "1430593b-230c-4072-8775-d099fb6d7a72"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:16.986250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-acccd230-a488-4d27-8f52-505aa863e0b6 req-17760f64-f173-4add-93ed-058062f43517 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:16.987036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-acccd230-a488-4d27-8f52-505aa863e0b6 req-17760f64-f173-4add-93ed-058062f43517 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:17.046927 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-acccd230-a488-4d27-8f52-505aa863e0b6 req-17760f64-f173-4add-93ed-058062f43517 service nova] Creating event network-vif-deleted:1430593b-230c-4072-8775-d099fb6d7a72 for instance 1aa628e8-e79b-4680-a7ab-ccf7ab9031ac on n-h1-849796-1 Jul 18 02:13:17.062036 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-acccd230-a488-4d27-8f52-505aa863e0b6 req-17760f64-f173-4add-93ed-058062f43517 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138577 Jul 18 02:13:17.062720 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 289/513] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:17.085497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:17.087357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:17.092630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:17.097968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:17.098769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:17.100068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:17.100885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:17.863413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:17.880220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:17.882704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:17.891007 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a54198e-ce61-4ca5-bd32-bb6dfc9e949c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.826264 Jul 18 02:13:17.893756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 290/514] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:17 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:17.911268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05ab0790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:17.913603 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:17.913603 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:17.923555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:17.950749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:17.956069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:17.958362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:18.037600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07d99d3e-c114-46cd-9fdd-dcc77e7d1e8b tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.141944 Jul 18 02:13:18.047460 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 291/515] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:13:17 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:18.056808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:18.058952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:18.070430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:18.071332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:18.072701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:18.073510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.004581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:19.018639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dfb7fbbd-b0de-43be-8e8a-9a8b22fda36f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1274 microversion: 2.1 time: 0.969466 Jul 18 02:13:19.021531 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 292/516] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:18 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1274 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:19.036176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-13b7c6ba-9d77-4895-8040-fbe32741a037 req-63e46512-91ee-49a4-92fd-5b94fa9b9a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "name": "network-vif-unplugged", "status": "completed", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:19.059080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-13b7c6ba-9d77-4895-8040-fbe32741a037 req-63e46512-91ee-49a4-92fd-5b94fa9b9a14 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.061186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-13b7c6ba-9d77-4895-8040-fbe32741a037 req-63e46512-91ee-49a4-92fd-5b94fa9b9a14 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.090425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-13b7c6ba-9d77-4895-8040-fbe32741a037 req-63e46512-91ee-49a4-92fd-5b94fa9b9a14 service nova] Creating event network-vif-unplugged:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h2-849796-1 Jul 18 02:13:19.110175 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-13b7c6ba-9d77-4895-8040-fbe32741a037 req-63e46512-91ee-49a4-92fd-5b94fa9b9a14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086335 Jul 18 02:13:19.110795 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 293/517] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:19.133728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05bb8550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:19.136063 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:19.136063 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:19.137455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.137949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.138814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.139263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.259896 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52f63487-ef4e-4875-bde2-afae58ff12dc tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.147792 Jul 18 02:13:19.265950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 294/518] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:13:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:19.274685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:19.275456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:19.295701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.296164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:19.297417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:19.297877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.121190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:20.146821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:20.155317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:20.157688 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3646d56b-c799-42ce-9747-0683e013e519 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.889798 Jul 18 02:13:20.173422 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 295/519] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:19 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:20.173422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05bb0940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.173422 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:20.173422 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:20.197996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.199914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.224803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.229160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.273262 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c6bdace-7dbe-408a-b1e6-9716e967ec81 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h1-849796-1" status: 200 len: 598 microversion: 2.1 time: 0.108900 Jul 18 02:13:20.277746 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 296/520] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/os-hosts/n-h1-849796-1 => generated 598 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:20.301646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.303457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:20.325002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.326380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.328882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.333566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.526124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:20.559336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dc6db3a-7ee9-46d7-8c5b-02c80f8b2ca5 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1280 microversion: 2.1 time: 0.279600 Jul 18 02:13:20.562403 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 297/521] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:20.582673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Calling method '.version_select at 0x7fab05bb8a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:20.585688 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:20.585688 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:20.635793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.636708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.687630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:20.688422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:20.738644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:20.749137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29ac6105-be68-4e2a-b672-289359ddb882 tempest-HostsAdminTestJSON-998813125 tempest-HostsAdminTestJSON-998813125-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h2-849796-1" status: 200 len: 729 microversion: 2.1 time: 0.181576 Jul 18 02:13:20.750930 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 298/522] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:13:20 2022] GET /compute/v2.1/os-hosts/n-h2-849796-1 => generated 729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:21.191327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:21.192081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:21.204541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:21.208824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:21.210969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:21.213722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.047134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:22.057114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:22.069784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:22.071580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c643edd6-a76d-487e-b9f8-01e95fb3f9d8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 0.884910 Jul 18 02:13:22.072533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 299/523] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:21 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:13:22.088306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:22.089032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:22.108596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.109104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.109954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:22.110418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:22.959416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:22.968553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3181098-c401-400f-99f3-61040f1a2892 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.894851 Jul 18 02:13:22.969256 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 300/524] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:22 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:23.025917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b98c2d9b-699e-4d35-908e-e40f711522e2 req-9f4287d5-9ec9-4024-8fd3-8aa683cb2d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:23.048327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b98c2d9b-699e-4d35-908e-e40f711522e2 req-9f4287d5-9ec9-4024-8fd3-8aa683cb2d73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:23.049019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b98c2d9b-699e-4d35-908e-e40f711522e2 req-9f4287d5-9ec9-4024-8fd3-8aa683cb2d73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:23.079818 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b98c2d9b-699e-4d35-908e-e40f711522e2 req-9f4287d5-9ec9-4024-8fd3-8aa683cb2d73 service nova] Creating event network-changed:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:13:23.090189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b98c2d9b-699e-4d35-908e-e40f711522e2 req-9f4287d5-9ec9-4024-8fd3-8aa683cb2d73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068861 Jul 18 02:13:23.091141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 301/525] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:23.097026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:23.097776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:23.120047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:23.121287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:23.124481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:23.138567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:23.362797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.neutron [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] re-assign floating IP 172.25.0.62 from instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c Jul 18 02:13:23.621226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Building network info cache for instance {{(pid=119440) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:24.524536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:24.541608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:24.548215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:24.553028 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-815e75f0-d0c7-400f-b4f6-e3ad4038af19 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1566 microversion: 2.25 time: 1.457906 Jul 18 02:13:24.553766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 302/526] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:23 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1566 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:24.565572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:24.566534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:24.580610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:24.585458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:24.586765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:24.588947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:24.983673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:25.082920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:25.104189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-679dd979-07a4-4553-9b0c-2d2be2563bb0 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.548992 Jul 18 02:13:25.110644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 303/527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:24 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:25.169804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Updating instance_info_cache with network_info: [{"id": "31df94e4-34c7-4448-bd8a-45c120eca8d8", "address": "fa:16:3e:fa:b1:b5", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31df94e4-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:25.175113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5da77001-e6a4-46fc-bd59-26dea5f5bc05 req-f28c7c6b-7900-42e8-ad2e-a7ad7e1c6b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf524c-67ea-4cee-a327-ce274d11c894", "tag": "76355fd5-8182-4940-8061-ef759ae2d520"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:25.200908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Building network info cache for instance {{(pid=119440) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:25.213681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5da77001-e6a4-46fc-bd59-26dea5f5bc05 req-f28c7c6b-7900-42e8-ad2e-a7ad7e1c6b32 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.218867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5da77001-e6a4-46fc-bd59-26dea5f5bc05 req-f28c7c6b-7900-42e8-ad2e-a7ad7e1c6b32 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.272270 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5da77001-e6a4-46fc-bd59-26dea5f5bc05 req-f28c7c6b-7900-42e8-ad2e-a7ad7e1c6b32 service nova] Creating event network-changed:76355fd5-8182-4940-8061-ef759ae2d520 for instance 84cf524c-67ea-4cee-a327-ce274d11c894 on n-h1-849796-1 Jul 18 02:13:25.301388 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5da77001-e6a4-46fc-bd59-26dea5f5bc05 req-f28c7c6b-7900-42e8-ad2e-a7ad7e1c6b32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137999 Jul 18 02:13:25.320025 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 304/528] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:25.579471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:25.580745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:25.623812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.625007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.626730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:25.627797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:25.787682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=13 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:26.440101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:26.450381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:26.474104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:26.475786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63461a25-3f3a-4688-98d4-9b4572f75b44 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1556 microversion: 2.25 time: 0.905494 Jul 18 02:13:26.479200 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 305/529] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:25 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1556 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:13:26.768040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:27.387902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Calling method '.version_select at 0x7fab05c4dca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:27.389010 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:27.389010 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:27.395919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:27.396840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:27.428422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:27.429342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:27.443974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:27.444805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:27.454373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d8c25a4-3c89-4bdd-86d6-2080a4920975 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.973736 Jul 18 02:13:27.455766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 306/530] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:13:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:27.463514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:27.464670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:27.475594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:27.481347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:27.482832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:27.484509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:27.972491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:28.000175 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-642d9378-5240-40d9-bdf1-19268db8690f tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.542209 Jul 18 02:13:28.001611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 307/531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:27 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:28.012680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-14daa5ff-7ca8-48e7-b183-05094c6b39b5 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '.version_select at 0x7fab05ab0f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:28.021816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14daa5ff-7ca8-48e7-b183-05094c6b39b5 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.028396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14daa5ff-7ca8-48e7-b183-05094c6b39b5 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.071184 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-14daa5ff-7ca8-48e7-b183-05094c6b39b5 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.064172 Jul 18 02:13:28.072639 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 308/532] 10.222.0.67 () {60 vars in 1183 bytes} [Mon Jul 18 02:13:28 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:28.103847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-03972d64-34d4-4dfb-b6ee-2f63835eb4d3 req-e331c70e-7268-4226-a7b0-170ae9fc66b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b504f18-4faa-4c8f-9b5a-e017643a85d0", "tag": "88cf6efd-6956-4c44-8a1f-b5701bc6a82d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:28.144057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-03972d64-34d4-4dfb-b6ee-2f63835eb4d3 req-e331c70e-7268-4226-a7b0-170ae9fc66b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.144617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-03972d64-34d4-4dfb-b6ee-2f63835eb4d3 req-e331c70e-7268-4226-a7b0-170ae9fc66b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.159749 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-03972d64-34d4-4dfb-b6ee-2f63835eb4d3 req-e331c70e-7268-4226-a7b0-170ae9fc66b6 service nova] Creating event network-changed:88cf6efd-6956-4c44-8a1f-b5701bc6a82d for instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 on n-h2-849796-1 Jul 18 02:13:28.170374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-03972d64-34d4-4dfb-b6ee-2f63835eb4d3 req-e331c70e-7268-4226-a7b0-170ae9fc66b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094546 Jul 18 02:13:28.181120 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 309/533] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:28.187612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Calling method '.version_select at 0x7fab05bdcdc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:28.188987 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:28.188987 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:28.191055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.191817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.209176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.210717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.221397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c5fc2507-e5cd-42e4-92db-99814f572db3 tempest-HypervisorAdminV228Test-1500850121 tempest-HypervisorAdminV228Test-1500850121-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.038322 Jul 18 02:13:28.232782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 310/534] 10.222.0.67 () {60 vars in 1192 bytes} [Mon Jul 18 02:13:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:28.239334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:28.240671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:28.251525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.252550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.254191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:28.255025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:28.576043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 81553898-c387-4d5e-b539-effed146abfd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:13:28.646447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ba5747e-c03c-44a4-af1f-ac1595d25881 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 2048 microversion: 2.25 time: 0.411917 Jul 18 02:13:28.661769 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 311/535] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:28 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 2048 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:29.033497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:29.034813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:29.059867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:29.060606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:29.061628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:29.062921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:29.176042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:29.409087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Updating instance_info_cache with network_info: [{"id": "76355fd5-8182-4940-8061-ef759ae2d520", "address": "fa:16:3e:93:f0:fc", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76355fd5-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:29.430262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Releasing lock "refresh_cache-84cf524c-67ea-4cee-a327-ce274d11c894" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:29.431856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ea7a246-2e3b-46cb-b170-da33b848a90b tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894/action" status: 202 len: 0 microversion: 2.1 time: 13.688588 Jul 18 02:13:29.433624 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 225/536] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:15 2022] POST /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894/action => generated 0 bytes in 13694 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:13:29.440786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1846910818", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "289de125-f75a-44e5-b795-181da195dbd2"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:29.553495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:29.556291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] validate_networks() for [('289de125-f75a-44e5-b795-181da195dbd2', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:29.575218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e17c195-4244-4c1b-875a-62bac300d75e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.541096 Jul 18 02:13:29.591471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 312/537] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:29 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:13:29.593431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: .version_select at 0x7fab0815c040>, body: {"removeFloatingIp": {"address": "172.25.0.62"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:30.053129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:30.067901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:30.068363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:30.069207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:30.072532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:31.046024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:31.046839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:31.047753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:31.048510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:31.049549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:31.085550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:31.086884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:31.088748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:31.089509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:31.149266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:31.155156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for user 2affc29a14f847a099dad6deaf668842 and project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:31.172136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:31.174870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:31.270615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-693909c1-058b-48db-943c-8ab3f7be83e2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.835433 Jul 18 02:13:31.276974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 226/538] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:13:31.291926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:31.292966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:31.302054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:31.302798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:31.304051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:31.304757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:31.457050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] HTTP exception thrown: Floating IP 172.25.0.62 is not associated with instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c. Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Request method failure captured: Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action HTTP/1.1 Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 48 Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MF8AuJrC32EF0aHPolpAhpDFyzGDHo-d4l_ODSr3zQVbJEcU49PBaT7Ru_xxkbC9v64mwLm8m01waxAtXkHdPFOLvWxEHV8Zbiz6_hixSQrtF8_mKgTvKSY2RMabTjymfMjD7fJiTSNxFdIXxtb-Yq6RfxijTiaVogiKKjQC7OAr2A Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:13:31.469951 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: c036dd17b7b04f0581ac388e18dfb347 Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: {"removeFloatingIp": {"address": "172.25.0.62"}} Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:13:31.472081 n-d-849796-1 devstack@n-api.service[119439]: exception: Floating IP 172.25.0.62 is not associated with instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c. Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2420df5b-ef67-4dd7-b566-785ac92bbb3c', 'body': {'removeFloatingIp': {'address': '172.25.0.62'}}} Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.62 is not associated with instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c. Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:31.473079 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.62 is not associated with instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c. Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Returning 409 to user: Floating IP 172.25.0.62 is not associated with instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c87e600d-b58a-465f-893f-258b421820a8 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action" status: 409 len: 145 microversion: 2.1 time: 1.893670 Jul 18 02:13:31.474894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 313/539] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:29 2022] POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action => generated 145 bytes in 1897 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:13:31.497510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:31.498464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:31.762603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:31.772057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:31.773881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:31.775763 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d028fba-cf5e-4736-a828-e74794a701e6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1262 microversion: 2.25 time: 0.299660 Jul 18 02:13:31.784990 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 314/540] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:31 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1262 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:31.806609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.62"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:32.075241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:32.094516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.099089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.106936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.108227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.825322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:32.854805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-088677ec-bba4-4461-b63c-929061ae4893 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 1.562970 Jul 18 02:13:32.855855 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 227/541] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:31 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:32.883467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:32.896687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:32.928445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.933910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.946514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:32.947677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:32.964012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Acquired lock "refresh_cache-84cf524c-67ea-4cee-a327-ce274d11c894" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:33.250701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:33.291027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:33.298154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:33.306358 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aabb2fd2-22c1-4027-bb7d-1265672f9724 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1258 microversion: 2.25 time: 0.444774 Jul 18 02:13:33.310532 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 228/542] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:32 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1258 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:33.888831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:33.894010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:33.921880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:33.926885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:33.929173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:33.934311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:34.675292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:34.709185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80d0cc6c-35bb-45c3-803c-bdb58372f708 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.827921 Jul 18 02:13:34.717365 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 229/543] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:33 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:34.728905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:34.730437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:34.779726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:34.781022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:34.783588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:34.784875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:35.082632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:35.096748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:35.101949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:35.104189 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d66f5229-3c5b-45aa-8659-256d7aff74ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1320 microversion: 2.25 time: 0.384210 Jul 18 02:13:35.105384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 230/544] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:34 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1320 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:35.437097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-629363161", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:35.561502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:35.983764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:35.984252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:35.984740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:35.985196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:35.985591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:36.003222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:36.003705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:36.004513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:36.005549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:36.034002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:36.039631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for user 8d162823ac51401ba0d2fb537f76af60 and project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:36.055049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:36.057709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:36.125329 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ddbed99b-b76c-4655-be2e-c3ebdda0c3af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017986 Jul 18 02:13:36.127130 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 231/545] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:36.344465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-636117722", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:36.467947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:36.627532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:36.907543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:36.908087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:36.908578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:36.909064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:36.909778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:36.923635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:36.927850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:36.928801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:36.934213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:36.972754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Getting quotas for project d2d83c872c1b4c519da771f056db7305. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:36.990837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Getting quotas for user 319eb3a1c3144985860c780d307b85ee and project d2d83c872c1b4c519da771f056db7305. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:37.010984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:37.014009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:37.250260 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5bbf8208-e084-4a7d-b66f-1e2a1eb32624 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120669 Jul 18 02:13:37.262748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 232/546] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:37.311742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:37.313659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:37.346237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.347096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.348582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.349844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.682726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:37.694032 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35c5bc1f-74a8-451d-be48-2a3c4362b5d1 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.428486 Jul 18 02:13:37.694865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 233/547] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:37 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:37.701932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:37.702758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:37.712753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.713665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.714756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:37.715544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:37.974116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:38.017780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:38.022932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:38.030978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07846e9c-9dbb-46b2-9abb-915f61844960 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 0.331526 Jul 18 02:13:38.049545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 234/548] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:37 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:38.065011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-780315863", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:38.223161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:38.776781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:38.777476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:38.777938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:38.778381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:38.778805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:38.803705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:38.804257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:38.807613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:38.808944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:38.872835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:38.878645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for user 8d162823ac51401ba0d2fb537f76af60 and project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:38.908698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:38.916973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:39.034940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b60955d6-a2cf-4128-b2a8-418ef3cd7be0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982894 Jul 18 02:13:39.049821 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 235/549] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:39.065180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ec773b0e-a215-462d-baa8-b055e39bdb35 req-c9945064-c6db-4f70-944d-56dbd9dcab06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b504f18-4faa-4c8f-9b5a-e017643a85d0", "name": "network-vif-plugged", "status": "completed", "tag": "88cf6efd-6956-4c44-8a1f-b5701bc6a82d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:39.100740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ec773b0e-a215-462d-baa8-b055e39bdb35 req-c9945064-c6db-4f70-944d-56dbd9dcab06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.102118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ec773b0e-a215-462d-baa8-b055e39bdb35 req-c9945064-c6db-4f70-944d-56dbd9dcab06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.135694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ec773b0e-a215-462d-baa8-b055e39bdb35 req-c9945064-c6db-4f70-944d-56dbd9dcab06 service nova] Creating event network-vif-plugged:88cf6efd-6956-4c44-8a1f-b5701bc6a82d for instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 on n-h2-849796-1 Jul 18 02:13:39.157237 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ec773b0e-a215-462d-baa8-b055e39bdb35 req-c9945064-c6db-4f70-944d-56dbd9dcab06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105530 Jul 18 02:13:39.161067 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 236/550] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:39.171433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dfad9980-821e-4791-b60e-b463dfb2f2fa req-f304be0e-4146-429e-a2e4-32b8e6e77267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cf524c-67ea-4cee-a327-ce274d11c894", "tag": "76355fd5-8182-4940-8061-ef759ae2d520"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:39.191460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dfad9980-821e-4791-b60e-b463dfb2f2fa req-f304be0e-4146-429e-a2e4-32b8e6e77267 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.192282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dfad9980-821e-4791-b60e-b463dfb2f2fa req-f304be0e-4146-429e-a2e4-32b8e6e77267 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.219000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dfad9980-821e-4791-b60e-b463dfb2f2fa req-f304be0e-4146-429e-a2e4-32b8e6e77267 service nova] Creating event network-changed:76355fd5-8182-4940-8061-ef759ae2d520 for instance 84cf524c-67ea-4cee-a327-ce274d11c894 on n-h1-849796-1 Jul 18 02:13:39.226010 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dfad9980-821e-4791-b60e-b463dfb2f2fa req-f304be0e-4146-429e-a2e4-32b8e6e77267 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062274 Jul 18 02:13:39.228354 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 237/551] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:39.235530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:39.236214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:39.246325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.247206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.249169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.251332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.417267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:39.478977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b9b57416-fd8c-4264-8cf2-bd4fe178c623 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1274 microversion: 2.1 time: 0.244123 Jul 18 02:13:39.507092 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 238/552] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:39 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:39.536215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:39.537875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:39.558653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.559624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:39.560797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:39.561592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.219066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:40.231505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04a60839-e901-4e74-85ff-11402bcb6789 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.721180 Jul 18 02:13:40.242253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 239/553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:39 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:40.248096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:40.249208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:40.259165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.259991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.261080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.262294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.318984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Updating instance_info_cache with network_info: [{"id": "76355fd5-8182-4940-8061-ef759ae2d520", "address": "fa:16:3e:93:f0:fc", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76355fd5-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:40.366592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Releasing lock "refresh_cache-84cf524c-67ea-4cee-a327-ce274d11c894" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:40.372373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ed316ca-fa7d-4d35-a8c5-e4295c48065a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894/action" status: 202 len: 0 microversion: 2.1 time: 8.574841 Jul 18 02:13:40.373954 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 315/554] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:31 2022] POST /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894/action => generated 0 bytes in 8597 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:13:40.381144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:40.382247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:40.392255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.392792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.393838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.394505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.563967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:40.578388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a701c330-64b0-4a82-b62a-df424ae6fe6c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1217 microversion: 2.1 time: 0.334152 Jul 18 02:13:40.580048 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 240/555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:40 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1217 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:40.591637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:40.593019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:40.604685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.605807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.607470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.608355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.645165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:40.669500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:13:40.731776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:40.750956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:40.753375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:40.754700 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00fcc40a-aa7b-48e4-9da5-58168c01e809 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 0.379407 Jul 18 02:13:40.768959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 316/556] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:40 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:40.875912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68e5b063-2dfc-4f04-b706-786024d58104 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 204 len: 0 microversion: 2.1 time: 0.293543 Jul 18 02:13:40.889094 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 241/557] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:13:40 2022] DELETE /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:40.906042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:40.909874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:40.923675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.925797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:40.928105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:40.931462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.097585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b54b1ea-e224-497f-8769-445189f6c278 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Calling method '.version_select at 0x7fab05ab0550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.098983 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:41.098983 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:41.100639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b54b1ea-e224-497f-8769-445189f6c278 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b3c0e840bf2540d9b66e1071e3eb22f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd83275f89fd4611a9e456b92bc0bdc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b54b1ea-e224-497f-8769-445189f6c278 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Request method failure captured: Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHSE5BjMvlMbX4kGO55vQmJDZ5l_VTuLGFEkxG58FaIjP6Vy-w2dzeKjAR3SOfkhVfkN2Boyy4iwbr4ocqgc48siDlUkG6d0qQnb8aqMSny8sfa8vpwwemR8UMPIT64hXVQFw5hH4mxm68DsPK8aAgLyy9m9iYex7yAT8PdzddGRAg Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:13:41.105729 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: b3c0e840bf2540d9b66e1071e3eb22f8 Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:13:41.107137 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:13:41.108012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 18 02:13:41.109300 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.118718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b54b1ea-e224-497f-8769-445189f6c278 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:41.125015 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b54b1ea-e224-497f-8769-445189f6c278 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.365772 Jul 18 02:13:41.137705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 317/558] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:13:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:41.160184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: .version_select at 0x7fab0815c700>, body: {"addFloatingIp": {"address": "172.25.0.62"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:41.162584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:41.199336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.201267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.203547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.204260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.228987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.252043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Acquired lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:41.255034 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7c85460-e9fa-4ec3-8891-21769ba69618 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1280 microversion: 2.1 time: 0.364128 Jul 18 02:13:41.256801 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 242/559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:40 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:41.268110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-039bd89b-03d8-4e47-a1a8-859102a06c30 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Calling method '.version_select at 0x7fab05294040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.271483 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:41.271483 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:41.277026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-039bd89b-03d8-4e47-a1a8-859102a06c30 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b3c0e840bf2540d9b66e1071e3eb22f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd83275f89fd4611a9e456b92bc0bdc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-039bd89b-03d8-4e47-a1a8-859102a06c30 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Request method failure captured: Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHSE5BjMvlMbX4kGO55vQmJDZ5l_VTuLGFEkxG58FaIjP6Vy-w2dzeKjAR3SOfkhVfkN2Boyy4iwbr4ocqgc48siDlUkG6d0qQnb8aqMSny8sfa8vpwwemR8UMPIT64hXVQFw5hH4mxm68DsPK8aAgLyy9m9iYex7yAT8PdzddGRAg Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:13:41.280145 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b3c0e840bf2540d9b66e1071e3eb22f8 Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: action_args: {} Jul 18 02:13:41.281565 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:13:41.282352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 18 02:13:41.283507 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.287325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-039bd89b-03d8-4e47-a1a8-859102a06c30 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:41.290796 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-039bd89b-03d8-4e47-a1a8-859102a06c30 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.031104 Jul 18 02:13:41.292226 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 243/560] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:41.298805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.300542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:41.310862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.311928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.313194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.313965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.765447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:41.873498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.888075 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19553b1a-c324-4c87-b2ae-40cf64995a08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1322 microversion: 2.1 time: 0.592703 Jul 18 02:13:41.895575 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 244/561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:41.927204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21e6b50d-b4bc-448e-ab19-635b7dc3c85f tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Calling method '.version_select at 0x7fab0513c5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.930618 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:41.930618 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:41.932371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21e6b50d-b4bc-448e-ab19-635b7dc3c85f tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b3c0e840bf2540d9b66e1071e3eb22f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd83275f89fd4611a9e456b92bc0bdc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21e6b50d-b4bc-448e-ab19-635b7dc3c85f tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Request method failure captured: Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHSE5BjMvlMbX4kGO55vQmJDZ5l_VTuLGFEkxG58FaIjP6Vy-w2dzeKjAR3SOfkhVfkN2Boyy4iwbr4ocqgc48siDlUkG6d0qQnb8aqMSny8sfa8vpwwemR8UMPIT64hXVQFw5hH4mxm68DsPK8aAgLyy9m9iYex7yAT8PdzddGRAg Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:13:41.941415 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b3c0e840bf2540d9b66e1071e3eb22f8 Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: action_args: {} Jul 18 02:13:41.942808 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:13:41.943585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 18 02:13:41.944692 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:41.949893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21e6b50d-b4bc-448e-ab19-635b7dc3c85f tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:41.951141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21e6b50d-b4bc-448e-ab19-635b7dc3c85f tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.054097 Jul 18 02:13:41.953678 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 245/562] 10.222.0.67 () {58 vars in 1178 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:41.967092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:41.968102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:41.972472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:41.986672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.992663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:41.994293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:41.995403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:42.230914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:42.263399 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5ad5e18-0aff-4632-9365-c3242f5bdc96 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1273 microversion: 2.1 time: 0.307835 Jul 18 02:13:42.278533 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 246/563] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:41 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:42.293233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:42.299370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:42.319480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:42.321557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:42.325522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:42.326657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.061024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.084077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.089107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.091927 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-590325b4-b537-4d75-af59-d8552b8f96ec tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 0.810975 Jul 18 02:13:43.092992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 247/564] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:42 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:43.245719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Calling method '.version_select at 0x7fab0513c790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:43.246801 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:43.246801 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:43.249264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.249264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.296104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.296993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.329286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.329960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.347237 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36601632-e090-4e77-9597-3f966315b8f1 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.251888 Jul 18 02:13:43.349915 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 248/565] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:13:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:43.368711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:43.370682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:43.385530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.386631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.388448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.389812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.561879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:43.585041 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfaf0ea5-4215-446d-9d47-6de22ce5c2ca tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1280 microversion: 2.1 time: 0.224599 Jul 18 02:13:43.590381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 249/566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:43 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:43.611737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-392f15c6-20cc-4c5e-821e-306d686c1eb0 req-bc5ebf45-8d3d-4e86-9037-62f77014a716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:43.629545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-392f15c6-20cc-4c5e-821e-306d686c1eb0 req-bc5ebf45-8d3d-4e86-9037-62f77014a716 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.630754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-392f15c6-20cc-4c5e-821e-306d686c1eb0 req-bc5ebf45-8d3d-4e86-9037-62f77014a716 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.658585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-392f15c6-20cc-4c5e-821e-306d686c1eb0 req-bc5ebf45-8d3d-4e86-9037-62f77014a716 service nova] Creating event network-changed:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h2-849796-1 Jul 18 02:13:43.677216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-392f15c6-20cc-4c5e-821e-306d686c1eb0 req-bc5ebf45-8d3d-4e86-9037-62f77014a716 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076829 Jul 18 02:13:43.679822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 250/567] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:43.694616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:43.697000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:43.717600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.721068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:43.727246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:43.728450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.178962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.200175 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-18eeb6d7-8392-44b2-a430-4f930c7e7f9c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1472 microversion: 2.1 time: 0.517897 Jul 18 02:13:44.222001 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 251/568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:43 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.238369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.240089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.283742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.292297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.294486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.295683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.542202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.582463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60539237-e861-4143-975f-952f35bd8464 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1271 microversion: 2.1 time: 0.358609 Jul 18 02:13:44.590521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 252/569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:44.618880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faa1db78-52a4-47b3-b3f3-040dd51dd91c tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Calling method '.version_select at 0x7fab05155430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.627448 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:44.627448 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:44.635605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-faa1db78-52a4-47b3-b3f3-040dd51dd91c tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b3c0e840bf2540d9b66e1071e3eb22f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd83275f89fd4611a9e456b92bc0bdc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faa1db78-52a4-47b3-b3f3-040dd51dd91c tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Request method failure captured: Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHSE5BjMvlMbX4kGO55vQmJDZ5l_VTuLGFEkxG58FaIjP6Vy-w2dzeKjAR3SOfkhVfkN2Boyy4iwbr4ocqgc48siDlUkG6d0qQnb8aqMSny8sfa8vpwwemR8UMPIT64hXVQFw5hH4mxm68DsPK8aAgLyy9m9iYex7yAT8PdzddGRAg Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:13:44.645353 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b3c0e840bf2540d9b66e1071e3eb22f8 Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1'} Jul 18 02:13:44.647417 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:13:44.648382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 18 02:13:44.650125 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:44.651137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faa1db78-52a4-47b3-b3f3-040dd51dd91c tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:44.651137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-faa1db78-52a4-47b3-b3f3-040dd51dd91c tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.057663 Jul 18 02:13:44.651137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 253/570] 10.222.0.67 () {58 vars in 1172 bytes} [Mon Jul 18 02:13:44 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:44.668012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:44.669355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:44.684955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.686920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.688235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:44.691227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:44.753489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:13:45.079151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1abb5d2-392d-4d15-8de6-2589bf3687c8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 204 len: 0 microversion: 2.1 time: 0.424805 Jul 18 02:13:45.080058 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 254/571] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:13:44 2022] DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:13:45.088669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:45.089833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:45.120487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.121198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.122509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.129421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.593151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.612877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.614451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:45.615610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bd33107e-90d3-49fb-8eb2-c1862fec266d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 0.532847 Jul 18 02:13:45.626495 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 255/572] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:45 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:45.805982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:45.806770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] [instance: 2df319a2-43cf-420c-a141-690b697c7d1e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:45.815043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] HTTP exception thrown: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Request method failure captured: Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/2df319a2-43cf-420c-a141-690b697c7d1e/action HTTP/1.1 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MG4iBtmDtPHdihZPwJzqMH2kecwyg_ZgvBG1K39fKKGFa-htoMUyIPd7Y6imXePZxWlpyQnXpnfJiDUJuC-AezwaAEP-0PvhMmCMRh3oAOKm8j3J4zqg2_-V4LnV5SsRIj43E1dSh7fmrz41RdKi8858NVz9kodF8Q97XofjrZGle8 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:13:45.817620 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4b096c37abd84364b664f0c9cb3ff1f3 Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: {"migrate": {}} Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:13:45.819207 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2df319a2-43cf-420c-a141-690b697c7d1e', 'body': {'migrate': {}}} Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:45.820823 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. Jul 18 02:13:45.822035 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:45.823085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Returning 404 to user: Instance 2df319a2-43cf-420c-a141-690b697c7d1e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:45.823085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f34e098-d525-414b-8109-703e82c67a27 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/2df319a2-43cf-420c-a141-690b697c7d1e/action" status: 404 len: 111 microversion: 2.1 time: 0.192234 Jul 18 02:13:45.823085 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 256/573] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:45 2022] POST /compute/v2.1/servers/2df319a2-43cf-420c-a141-690b697c7d1e/action => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:45.833093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c1e214dc-ec7f-4001-ad69-a34ef3a60b74 req-c287d204-1cac-4a73-88c5-a22bbb00ec22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cf524c-67ea-4cee-a327-ce274d11c894", "name": "network-vif-deleted", "tag": "76355fd5-8182-4940-8061-ef759ae2d520"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:45.851467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c1e214dc-ec7f-4001-ad69-a34ef3a60b74 req-c287d204-1cac-4a73-88c5-a22bbb00ec22 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.852577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c1e214dc-ec7f-4001-ad69-a34ef3a60b74 req-c287d204-1cac-4a73-88c5-a22bbb00ec22 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.880701 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c1e214dc-ec7f-4001-ad69-a34ef3a60b74 req-c287d204-1cac-4a73-88c5-a22bbb00ec22 service nova] Creating event network-vif-deleted:76355fd5-8182-4940-8061-ef759ae2d520 for instance 84cf524c-67ea-4cee-a327-ce274d11c894 on n-h1-849796-1 Jul 18 02:13:45.888897 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c1e214dc-ec7f-4001-ad69-a34ef3a60b74 req-c287d204-1cac-4a73-88c5-a22bbb00ec22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065035 Jul 18 02:13:45.890769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 257/574] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:45.897671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:45.899983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:45.908048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.908876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:45.910397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:45.911201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:46.275776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:46.292123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b383216d-3715-4642-9303-d41979e15a05 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.399606 Jul 18 02:13:46.293717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 258/575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:45 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:46.315806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78e39ffa-cdd7-4aad-89d2-ef89d9cce1f3 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Calling method '.version_select at 0x7fab0538f5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:46.318719 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:46.318719 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:46.321380 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-78e39ffa-cdd7-4aad-89d2-ef89d9cce1f3 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] HTTP exception thrown: Hypervisor with ID '0a994ca8-357a-493d-bd0f-a5e49300d54c' could not be found. Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78e39ffa-cdd7-4aad-89d2-ef89d9cce1f3 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Request method failure captured: Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/0a994ca8-357a-493d-bd0f-a5e49300d54c/uptime HTTP/1.1 Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHUQYrh_sK6L9t7TLzGZSWw1Ih0cEQxqkREbl_SD-0nI08TXCix1MflcUuD8-Vyir3Z0uhNrBs1CQsbrvsMTmcXh3JYVbQ8xddqY7Xtg9PXEO5nSuTa3b_0u2ZSQcH93-_0OoIOpFrylSilisHjCVrVDVrTwi7dgYUOcSJRGbLybJA Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ca89491775be42409f0e355ba031fb6f Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:13:46.334077 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ca89491775be42409f0e355ba031fb6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ca89491775be42409f0e355ba031fb6f Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 52d02ae45ccc4ccdaca4eadcd2aef946 Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: exception: Hypervisor with ID '0a994ca8-357a-493d-bd0f-a5e49300d54c' could not be found. Jul 18 02:13:46.338360 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '0a994ca8-357a-493d-bd0f-a5e49300d54c'} Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0a994ca8-357a-493d-bd0f-a5e49300d54c' Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 02:13:46.340041 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0a994ca8-357a-493d-bd0f-a5e49300d54c' could not be found. Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:46.343272 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0a994ca8-357a-493d-bd0f-a5e49300d54c' could not be found. Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78e39ffa-cdd7-4aad-89d2-ef89d9cce1f3 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Returning 404 to user: Hypervisor with ID '0a994ca8-357a-493d-bd0f-a5e49300d54c' could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:46.352782 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78e39ffa-cdd7-4aad-89d2-ef89d9cce1f3 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/0a994ca8-357a-493d-bd0f-a5e49300d54c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043904 Jul 18 02:13:46.354838 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 259/576] 10.222.0.67 () {58 vars in 1277 bytes} [Mon Jul 18 02:13:46 2022] GET /compute/v2.1/os-hypervisors/0a994ca8-357a-493d-bd0f-a5e49300d54c/uptime => generated 123 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:46.370898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1864767289", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "875054882", "adminPass": "***", "networks": [{"uuid": "984b8d18-5204-49d0-bf99-739f2ee61cd3"}], "security_groups": [{"name": "tempest-securitygroup--558784529"}], "key_name": "tempest-keypair-660151589", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:46.534892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:46.646605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] validate_networks() for [('984b8d18-5204-49d0-bf99-739f2ee61cd3', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:47.912777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:47.914474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:47.915243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:47.915843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:47.916445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:47.927682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.928453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:47.929846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:47.930602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:47.954017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for project 26519510f3bf4d98814641c3f445ee9f. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:47.959253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Getting quotas for user d8f728feedf3481e9495821fbd27813a and project 26519510f3bf4d98814641c3f445ee9f. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:47.991003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:47.996994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:48.109006 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d3c4167-8c6e-41b2-b6b9-018fa138c770 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.748109 Jul 18 02:13:48.110066 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 260/577] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:48.142281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:48.145644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:48.190587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.191328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.202646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:48.203445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:48.472108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Updating instance_info_cache with network_info: [{"id": "31df94e4-34c7-4448-bd8a-45c120eca8d8", "address": "fa:16:3e:fa:b1:b5", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31df94e4-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:13:48.491612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:48.504197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Releasing lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:13:48.512448 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3db07c0b-981e-4ac1-8060-0120cb2b8838 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action" status: 202 len: 0 microversion: 2.1 time: 7.365299 Jul 18 02:13:48.522484 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 318/578] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:41 2022] POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action => generated 0 bytes in 7381 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:13:48.537331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1114962178", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:48.557289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=65 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:48.640061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:13:49.122993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:49.146816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:49.152498 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-690f8346-f876-421e-89ca-b318d0f77f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 1.037405 Jul 18 02:13:49.153882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 261/579] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:48 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:49.168070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Calling method '.version_select at 0x7fab052854c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:49.169801 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:49.169801 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:49.173063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.173977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.209788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.211496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.227830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.228547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.238473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-852e4ff7-565d-42d2-926a-1eb0b84b6765 tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082713 Jul 18 02:13:49.239120 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 262/580] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:13:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:49.248857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e0bc445e-4691-4276-809c-a742368aaf91 req-687f9825-a58a-4f2f-ac49-95e38b922173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:49.267772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0bc445e-4691-4276-809c-a742368aaf91 req-687f9825-a58a-4f2f-ac49-95e38b922173 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.269188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0bc445e-4691-4276-809c-a742368aaf91 req-687f9825-a58a-4f2f-ac49-95e38b922173 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.289911 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e0bc445e-4691-4276-809c-a742368aaf91 req-687f9825-a58a-4f2f-ac49-95e38b922173 service nova] Creating event network-changed:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:13:49.295630 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e0bc445e-4691-4276-809c-a742368aaf91 req-687f9825-a58a-4f2f-ac49-95e38b922173 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052590 Jul 18 02:13:49.297231 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 263/581] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:49.303110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:49.303823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:49.315409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.316157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:49.317216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:49.318284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.053945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:13:50.055634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:13:50.056300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:13:50.056914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:13:50.057549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:13:50.088577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.091463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.094247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.095900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.157478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Getting quotas for project bd273272d4f44b6287b9b6e97bbb4bd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:13:50.169726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Getting quotas for user 355895d2b59745c8857999a3b2b82ade and project bd273272d4f44b6287b9b6e97bbb4bd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:13:50.205484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:13:50.214363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:13:50.299010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.314856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.317294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:50.319900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9cb2b0e-e458-455e-8bbf-3d65a4364d6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 1.020963 Jul 18 02:13:50.321375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 264/582] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:49 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:50.327077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:50.328071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.331246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d11503a-e1a0-458a-b02c-077bd70a8f3c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796431 Jul 18 02:13:50.344302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.344709 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 319/583] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:13:50.345489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.346683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.347502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.368698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-dc9fd56b-6cd8-4359-a46b-c4a5a7ba8dfa req-0b89f08e-fda6-4ea9-b212-ceec0dfe0705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:50.388912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dc9fd56b-6cd8-4359-a46b-c4a5a7ba8dfa req-0b89f08e-fda6-4ea9-b212-ceec0dfe0705 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.389756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dc9fd56b-6cd8-4359-a46b-c4a5a7ba8dfa req-0b89f08e-fda6-4ea9-b212-ceec0dfe0705 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.417576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-dc9fd56b-6cd8-4359-a46b-c4a5a7ba8dfa req-0b89f08e-fda6-4ea9-b212-ceec0dfe0705 service nova] Creating event network-changed:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:13:50.427523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-dc9fd56b-6cd8-4359-a46b-c4a5a7ba8dfa req-0b89f08e-fda6-4ea9-b212-ceec0dfe0705 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080546 Jul 18 02:13:50.430078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 320/584] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:50.441753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:50.444288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:50.459294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.464064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:50.467187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:50.468204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.140612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.155380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f19dcb26-5876-451f-a36c-4e39d06da80e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1258 microversion: 2.1 time: 0.722656 Jul 18 02:13:51.157105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 321/585] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:50 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1258 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:51.162339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abe19597-1f44-44ad-ae48-ef7fd34174aa tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '.version_select at 0x7fab059a69d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.772529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.786102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dfea1718-e148-437e-a528-6ab0f29b953d tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 1.463088 Jul 18 02:13:51.802887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 265/586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:50 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:51.811903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12c010e6-6ed0-41a9-84cf-f3dfdba34237 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Calling method '.version_select at 0x7fab075550d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.813921 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:51.813921 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:51.816055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12c010e6-6ed0-41a9-84cf-f3dfdba34237 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b3c0e840bf2540d9b66e1071e3eb22f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd83275f89fd4611a9e456b92bc0bdc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12c010e6-6ed0-41a9-84cf-f3dfdba34237 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Request method failure captured: Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHSE5BjMvlMbX4kGO55vQmJDZ5l_VTuLGFEkxG58FaIjP6Vy-w2dzeKjAR3SOfkhVfkN2Boyy4iwbr4ocqgc48siDlUkG6d0qQnb8aqMSny8sfa8vpwwemR8UMPIT64hXVQFw5hH4mxm68DsPK8aAgLyy9m9iYex7yAT8PdzddGRAg Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:13:51.819295 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd83275f89fd4611a9e456b92bc0bdc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: bd83275f89fd4611a9e456b92bc0bdc3 Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-307388535 Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b3c0e840bf2540d9b66e1071e3eb22f8 Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-307388535-project Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1'} Jul 18 02:13:51.823183 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:13:51.824811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 18 02:13:51.827423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:51.833787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12c010e6-6ed0-41a9-84cf-f3dfdba34237 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:51.833787 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12c010e6-6ed0-41a9-84cf-f3dfdba34237 tempest-HypervisorAdminNegativeTestJSON-307388535 tempest-HypervisorAdminNegativeTestJSON-307388535-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.027547 Jul 18 02:13:51.839836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 266/587] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:51.845161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2c1618a1-2e88-4e8d-9e5d-2abcf58b4e11 req-8b17a074-5622-4622-a903-24883f7023ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "name": "network-vif-plugged", "status": "completed", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:51.857611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2c1618a1-2e88-4e8d-9e5d-2abcf58b4e11 req-8b17a074-5622-4622-a903-24883f7023ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.858419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2c1618a1-2e88-4e8d-9e5d-2abcf58b4e11 req-8b17a074-5622-4622-a903-24883f7023ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.871621 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2c1618a1-2e88-4e8d-9e5d-2abcf58b4e11 req-8b17a074-5622-4622-a903-24883f7023ee service nova] Creating event network-vif-plugged:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h2-849796-1 Jul 18 02:13:51.882211 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2c1618a1-2e88-4e8d-9e5d-2abcf58b4e11 req-8b17a074-5622-4622-a903-24883f7023ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Jul 18 02:13:51.889181 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 267/588] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:51.896571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:51.899713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:51.909573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.910662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:51.911590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:51.912129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.051585 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abe19597-1f44-44ad-ae48-ef7fd34174aa tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/c1216b5a-515a-4f91-8f97-1dfacbf33b21" status: 200 len: 183 microversion: 2.1 time: 0.893159 Jul 18 02:13:52.052908 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 322/589] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/os-floating-ips/c1216b5a-515a-4f91-8f97-1dfacbf33b21 => generated 183 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:52.062440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:52.063607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:52.080106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.081852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.082947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.083613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.697603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:52.753681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-684de433-2e43-4c34-b7e9-e388164e9bed tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1274 microversion: 2.1 time: 0.697016 Jul 18 02:13:52.759572 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 323/590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:52 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1274 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:52.770181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:52.772568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:52.811912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.812374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.815939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.817055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.826394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:52.836403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f88f5788-cb5d-4ae0-ad6c-150459cc4441 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.944417 Jul 18 02:13:52.844533 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 268/591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:51 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:52.849864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2180475d-d41f-4ed6-9d97-a280d8282d4b req-85ef745f-e942-4213-96fe-8dddcfa0dd44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484d114e-1a33-4866-b88d-0ce5a961e88a", "tag": "abbe5ab8-060c-45d2-96a3-21bffbd68008"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:52.872444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2180475d-d41f-4ed6-9d97-a280d8282d4b req-85ef745f-e942-4213-96fe-8dddcfa0dd44 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:52.873276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2180475d-d41f-4ed6-9d97-a280d8282d4b req-85ef745f-e942-4213-96fe-8dddcfa0dd44 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:52.887830 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2180475d-d41f-4ed6-9d97-a280d8282d4b req-85ef745f-e942-4213-96fe-8dddcfa0dd44 service nova] Creating event network-changed:abbe5ab8-060c-45d2-96a3-21bffbd68008 for instance 484d114e-1a33-4866-b88d-0ce5a961e88a on n-h1-849796-1 Jul 18 02:13:52.895676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2180475d-d41f-4ed6-9d97-a280d8282d4b req-85ef745f-e942-4213-96fe-8dddcfa0dd44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049602 Jul 18 02:13:52.896693 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 269/592] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:52.907109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae82a86e-c8e0-4ba8-94a5-d499586f6afa tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Calling method '.version_select at 0x7fab05285f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:52.909533 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:52.909533 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:13:52.910762 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ae82a86e-c8e0-4ba8-94a5-d499586f6afa tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] HTTP exception thrown: Hypervisor with ID '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' could not be found. Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae82a86e-c8e0-4ba8-94a5-d499586f6afa tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Request method failure captured: Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-hypervisors/8129ef8b-3567-46fa-ac9c-07bdcae6b8de HTTP/1.1 Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHUQYrh_sK6L9t7TLzGZSWw1Ih0cEQxqkREbl_SD-0nI08TXCix1MflcUuD8-Vyir3Z0uhNrBs1CQsbrvsMTmcXh3JYVbQ8xddqY7Xtg9PXEO5nSuTa3b_0u2ZSQcH93-_0OoIOpFrylSilisHjCVrVDVrTwi7dgYUOcSJRGbLybJA Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ca89491775be42409f0e355ba031fb6f Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:13:52.912908 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ca89491775be42409f0e355ba031fb6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ca89491775be42409f0e355ba031fb6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ca89491775be42409f0e355ba031fb6f Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163 Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 52d02ae45ccc4ccdaca4eadcd2aef946 Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: exception: Hypervisor with ID '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' could not be found. Jul 18 02:13:52.914835 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8129ef8b-3567-46fa-ac9c-07bdcae6b8de'} Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 18 02:13:52.915563 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:13:52.917082 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' could not be found. Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' could not be found. Jul 18 02:13:52.918400 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:13:52.920091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae82a86e-c8e0-4ba8-94a5-d499586f6afa tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] Returning 404 to user: Hypervisor with ID '8129ef8b-3567-46fa-ac9c-07bdcae6b8de' could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:13:52.921240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae82a86e-c8e0-4ba8-94a5-d499586f6afa tempest-HypervisorAdminNegativeTestJSON-1603302163 tempest-HypervisorAdminNegativeTestJSON-1603302163-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/8129ef8b-3567-46fa-ac9c-07bdcae6b8de" status: 404 len: 123 microversion: 2.1 time: 0.023087 Jul 18 02:13:52.932067 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 270/593] 10.222.0.67 () {58 vars in 1256 bytes} [Mon Jul 18 02:13:52 2022] GET /compute/v2.1/os-hypervisors/8129ef8b-3567-46fa-ac9c-07bdcae6b8de => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:13:52.944056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Action: 'action', calling method: .version_select at 0x7fab08146160>, body: {"removeFloatingIp": {"address": "172.25.0.62"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:53.386778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.398384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.406119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.412116 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9e843ec-a3f9-4be4-8d2e-7474d77fa9b9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1362 microversion: 2.25 time: 0.650916 Jul 18 02:13:53.418144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 324/594] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:52 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1362 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:53.430093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:53.431966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:53.447887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.451893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.453070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.453686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.643238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:53.658800 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-332dbb67-0ba4-48f7-874c-394f30a9f2ed tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1320 microversion: 2.1 time: 0.237992 Jul 18 02:13:53.659871 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 325/595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:53 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:53.667809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-59d674b8-6395-4090-9b93-695aa03845ef req-26eb5298-e61e-406d-8861-8d9fe6ba8549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9eaca4-4373-41ba-9017-7cb68dca58fb", "name": "network-vif-deleted", "tag": "ffc606bf-c733-45cf-ad7c-3e7bbec54391"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:53.678092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-59d674b8-6395-4090-9b93-695aa03845ef req-26eb5298-e61e-406d-8861-8d9fe6ba8549 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.678798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-59d674b8-6395-4090-9b93-695aa03845ef req-26eb5298-e61e-406d-8861-8d9fe6ba8549 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.693446 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-59d674b8-6395-4090-9b93-695aa03845ef req-26eb5298-e61e-406d-8861-8d9fe6ba8549 service nova] Creating event network-vif-deleted:ffc606bf-c733-45cf-ad7c-3e7bbec54391 for instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb on n-h1-849796-1 Jul 18 02:13:53.701770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-59d674b8-6395-4090-9b93-695aa03845ef req-26eb5298-e61e-406d-8861-8d9fe6ba8549 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039953 Jul 18 02:13:53.703446 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 326/596] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:53.710744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:53.711772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:53.719068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.719778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.720851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.721515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.859816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:53.874650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.875278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:53.884813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:53.884813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.096333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.120305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-337efbb1-07e3-4f56-ac62-f18e90c24f5f tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.415043 Jul 18 02:13:54.126213 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 327/597] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:53 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.150901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.152202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.164720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.166009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.167695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.168834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.320325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.337123 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07dccf55-1f2f-467d-b450-3a9588297de4 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1280 microversion: 2.1 time: 0.206300 Jul 18 02:13:54.338089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 328/598] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.345702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.347095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.357098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.361098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.362915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.363580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.724674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:54.751866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8ff320e-8dd5-4aec-ab97-7f078b55c66c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.410828 Jul 18 02:13:54.765940 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 329/599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:54.771878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:54.772505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:54.798856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.799878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:54.800713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:54.801190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.096293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Acquired lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:13:55.169745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.182046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.184857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.186162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b6acf8d-a875-446e-af1b-2fac1ac275ea tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1557 microversion: 2.25 time: 0.419062 Jul 18 02:13:55.186926 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 330/600] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:54 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1557 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:55.192118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:55.193526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:55.206616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.208218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.209928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.211842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.348682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.364827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f9b8e2f-e3d1-471e-b386-8b98fb3ef145 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1320 microversion: 2.1 time: 0.176361 Jul 18 02:13:55.366186 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 331/601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:55 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:55.373613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a2780af3-cc10-4def-b168-7369def3b110 req-ba9be2ff-45fe-45da-8fb4-0852189d35fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddeee982-0343-4f11-a4a1-13eab45fbbe2", "tag": "7204817d-cf9e-4e65-bb24-6369404e1fff"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:55.385190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a2780af3-cc10-4def-b168-7369def3b110 req-ba9be2ff-45fe-45da-8fb4-0852189d35fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.386155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a2780af3-cc10-4def-b168-7369def3b110 req-ba9be2ff-45fe-45da-8fb4-0852189d35fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.404811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a2780af3-cc10-4def-b168-7369def3b110 req-ba9be2ff-45fe-45da-8fb4-0852189d35fc service nova] Creating event network-changed:7204817d-cf9e-4e65-bb24-6369404e1fff for instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 on n-h2-849796-1 Jul 18 02:13:55.413289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a2780af3-cc10-4def-b168-7369def3b110 req-ba9be2ff-45fe-45da-8fb4-0852189d35fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043357 Jul 18 02:13:55.415665 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 332/602] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:55.429579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:55.431705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:55.447042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.449320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.451598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:55.453218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:55.931787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:55.957939 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-866d9aa7-bd9b-4540-8345-062d9e43c465 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.539665 Jul 18 02:13:55.978004 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 333/603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:55 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:55.988100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:55.989270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:56.001102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.001821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.003331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.004139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.475094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:13:56.498096 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0153a9c-4af1-4423-b199-940077abed5d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 2050 microversion: 2.25 time: 0.518988 Jul 18 02:13:56.499171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 334/604] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:55 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 2050 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:56.511456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:56.512206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:56.520301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.521278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.522558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.524183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.841129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:56.860423 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65bfd884-1ccf-44b3-a4e2-ffa65b4b60ef tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.358599 Jul 18 02:13:56.861148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 335/605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:56 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:56.867463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:56.868274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:56.878988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.883516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:56.885155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:56.886382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.239419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:57.255304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7acbe11-d94f-4247-b8a9-aad16480dce7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.392098 Jul 18 02:13:57.271084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 336/606] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:56 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:57.276132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:57.282383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:57.315613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.316376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.317804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.318344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.528772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:57.547858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c48d5004-6341-46b3-a232-28b8b49de78e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.283651 Jul 18 02:13:57.564409 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 337/607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:57 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:57.575425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:57.576452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:57.596382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.598072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.602008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:57.603250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:57.943835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:57.981135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=30 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:58.146797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:13:58.164553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:13:58.211464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4a189e5-d308-436e-a410-84056e520958 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 2050 microversion: 2.25 time: 0.644670 Jul 18 02:13:58.212718 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 338/608] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:13:57 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 2050 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:13:58.224646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.237176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:58.282750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.293840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.295592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.296501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.670498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:58.688774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd510bb6-90c1-4a92-8718-b40abd051fd9 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.471745 Jul 18 02:13:58.708378 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 339/609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:58.719394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-441a69c6-26f1-4d44-a1fb-fbc986dc1cd3 req-25a135e8-5d99-4584-a936-c367bcff054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-plugged", "status": "completed", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:58.744775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-441a69c6-26f1-4d44-a1fb-fbc986dc1cd3 req-25a135e8-5d99-4584-a936-c367bcff054e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.745777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-441a69c6-26f1-4d44-a1fb-fbc986dc1cd3 req-25a135e8-5d99-4584-a936-c367bcff054e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.765344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-441a69c6-26f1-4d44-a1fb-fbc986dc1cd3 req-25a135e8-5d99-4584-a936-c367bcff054e service nova] Creating event network-vif-plugged:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:13:58.773870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-441a69c6-26f1-4d44-a1fb-fbc986dc1cd3 req-25a135e8-5d99-4584-a936-c367bcff054e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062739 Jul 18 02:13:58.776389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 340/610] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:13:58.790285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:58.791149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:58.799024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.800572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:58.801516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:58.802137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.193796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.210003 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-968b511c-8cc1-4248-9b7f-905af86a1c02 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.426686 Jul 18 02:13:59.211129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 341/611] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:58 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:59.223788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.237359 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:13:59.237359 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:13:59.239200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.239746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.240547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.241028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.273359 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2676dc79-42c7-4e2e-be50-568b5de795d6 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059655 Jul 18 02:13:59.274169 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 342/612] 10.222.0.67 () {60 vars in 1216 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:13:59.279387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.280439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.289437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.291469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.293328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.294450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.418758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Building network info cache for instance {{(pid=119440) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:13:59.496597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.506672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8b9f6f4-ee82-4422-a0b9-78636963aba6 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.231167 Jul 18 02:13:59.508726 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 343/613] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:59.514928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:13:59.515868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.524829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.525793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.526951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.527753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.745621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:13:59.762506 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1117bb35-238b-4cf8-a809-9f1aceab27c7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.251636 Jul 18 02:13:59.767502 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 344/614] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:13:59 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:13:59.792220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:13:59.796233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:13:59.811872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.814138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:13:59.815891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:13:59.817022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.026030 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73b0e0b8-5eed-4c88-bec2-873bc8b41894 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1/action" status: 202 len: 0 microversion: 2.25 time: 0.253192 Jul 18 02:14:00.026490 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 345/615] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:13:59 2022] POST /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:00.039543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b6e4d9fd-053a-4da5-b4d4-68e345ec2d83 req-5c1e5290-53b6-4aed-9eb6-a1653bc3c78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:00.066563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b6e4d9fd-053a-4da5-b4d4-68e345ec2d83 req-5c1e5290-53b6-4aed-9eb6-a1653bc3c78d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.068391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b6e4d9fd-053a-4da5-b4d4-68e345ec2d83 req-5c1e5290-53b6-4aed-9eb6-a1653bc3c78d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.099203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b6e4d9fd-053a-4da5-b4d4-68e345ec2d83 req-5c1e5290-53b6-4aed-9eb6-a1653bc3c78d service nova] Creating event network-changed:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:14:00.135785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b6e4d9fd-053a-4da5-b4d4-68e345ec2d83 req-5c1e5290-53b6-4aed-9eb6-a1653bc3c78d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101488 Jul 18 02:14:00.143072 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 346/616] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:00.157436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:00.163919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:00.225169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:00.241409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.242480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.246763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.254700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.903639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:00.927571 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5990701-c370-4272-a11a-15c3396ee679 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.781361 Jul 18 02:14:00.942319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 347/617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:00 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:00.967482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:00.968994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:00.979688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.980184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:00.984191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:00.984687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.293080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:01.324132 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0d64ff1a-3770-42c3-b8f7-fecc00672b82 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 2035 microversion: 2.25 time: 0.377635 Jul 18 02:14:01.325355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 348/618] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:00 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 2035 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:01.343631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:01.344697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:01.361682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.362901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.366938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.369325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.755135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:01.763704 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a0bdef5-36b6-4c03-ad98-0c436e82db08 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.436982 Jul 18 02:14:01.764302 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 349/619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:01 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:01.777183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:01.779731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:01.832322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.833766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:01.836131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:01.837574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.222640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:02.241619 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16ff8507-1f89-416a-90bf-67a9974ac406 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.475455 Jul 18 02:14:02.242937 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 350/620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:01 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:02.254724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:02.255789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:02.272542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.277299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.279204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.280747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.713255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:02.734886 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48d31398-955c-4554-ae67-b20575f26b34 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.489910 Jul 18 02:14:02.736294 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 351/621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:02 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:02.750521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": "auto"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:02.755550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:02.774549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.776117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.778939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:02.781103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:02.851868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'flavor' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:02.892082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Going to try to live migrate instance to n-h1-849796-1 {{(pid=119439) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:14:03.690205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Updating instance_info_cache with network_info: [{"id": "31df94e4-34c7-4448-bd8a-45c120eca8d8", "address": "fa:16:3e:fa:b1:b5", "network": {"id": "25bdf20f-59b8-445d-bd9f-eed3ee63ed1a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1676565698-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8f679ff678064a09a1566c9f58f9344b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31df94e4-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:14:03.717167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Releasing lock "refresh_cache-2420df5b-ef67-4dd7-b566-785ac92bbb3c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:14:03.719856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-891397ef-de70-46b3-94ad-13072abb6223 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action" status: 202 len: 0 microversion: 2.1 time: 10.784422 Jul 18 02:14:03.722694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 271/622] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:13:52 2022] POST /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c/action => generated 0 bytes in 10788 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:14:03.745235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:03.746645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:03.763120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.764277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:03.765950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:03.767340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.312376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:04.339118 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a497fe0-8ad6-4344-90a1-51b24b0b7802 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.602306 Jul 18 02:14:04.340647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 272/623] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:03 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:04.367661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-78f4c893-3d47-46cd-b792-447f484969dd req-c2beacdd-6717-4181-9175-056200a7d134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeee982-0343-4f11-a4a1-13eab45fbbe2", "name": "network-vif-plugged", "status": "completed", "tag": "7204817d-cf9e-4e65-bb24-6369404e1fff"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.384730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-78f4c893-3d47-46cd-b792-447f484969dd req-c2beacdd-6717-4181-9175-056200a7d134 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.386156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-78f4c893-3d47-46cd-b792-447f484969dd req-c2beacdd-6717-4181-9175-056200a7d134 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.410233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-78f4c893-3d47-46cd-b792-447f484969dd req-c2beacdd-6717-4181-9175-056200a7d134 service nova] Creating event network-vif-plugged:7204817d-cf9e-4e65-bb24-6369404e1fff for instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 on n-h2-849796-1 Jul 18 02:14:04.421714 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-78f4c893-3d47-46cd-b792-447f484969dd req-c2beacdd-6717-4181-9175-056200a7d134 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068260 Jul 18 02:14:04.423811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 273/624] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:04.437813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-074be2bb-c1c8-444d-b80d-5df22f4b2192 req-4b3ef53e-f4fa-4ee8-a839-94bb13ec583f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93532a39-fba4-486b-aa2f-3f18982ced7b", "tag": "1ebcb07e-7fb3-42df-86e9-7497e0127b3d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.467657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-074be2bb-c1c8-444d-b80d-5df22f4b2192 req-4b3ef53e-f4fa-4ee8-a839-94bb13ec583f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:04.468119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-074be2bb-c1c8-444d-b80d-5df22f4b2192 req-4b3ef53e-f4fa-4ee8-a839-94bb13ec583f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:04.485706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-074be2bb-c1c8-444d-b80d-5df22f4b2192 req-4b3ef53e-f4fa-4ee8-a839-94bb13ec583f service nova] Creating event network-changed:1ebcb07e-7fb3-42df-86e9-7497e0127b3d for instance 93532a39-fba4-486b-aa2f-3f18982ced7b on n-h1-849796-1 Jul 18 02:14:04.492044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-074be2bb-c1c8-444d-b80d-5df22f4b2192 req-4b3ef53e-f4fa-4ee8-a839-94bb13ec583f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065375 Jul 18 02:14:04.493538 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 274/625] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:04.752195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-668647304", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:04.833996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:05.139676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:05.140477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:05.141448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:05.142187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:05.142933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:05.169279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.170494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.172355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.173451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.213157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:05.221100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:05.242720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:05.245428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:05.317076 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e7d27d5-8d56-48f8-919c-c532980eb097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822170 Jul 18 02:14:05.325508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 275/626] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:05.325508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:05.325918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:05.333672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.334440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.336654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.337319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.517573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:05.527060 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f4f8d96-34f4-4e7f-99bf-26e798ed710a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.207923 Jul 18 02:14:05.527799 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 276/627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:05 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:05.533608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:05.534676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:05.543082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.543878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.544831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.545569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.786973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:05.801471 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f92b085e-9401-46a8-befa-68b155693272 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1313 microversion: 2.1 time: 0.272394 Jul 18 02:14:05.802910 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 277/628] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:05 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:05.810395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:05.812198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:05.822180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.822929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.824336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.825273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.856582 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] HTTP exception thrown: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Request method failure captured: Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 HTTP/1.1 Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF8AuJrC32EF0aHPolpAhpDFyzGDHo-d4l_ODSr3zQVbJEcU49PBaT7Ru_xxkbC9v64mwLm8m01waxAtXkHdPFOLvWxEHV8Zbiz6_hixSQrtF8_mKgTvKSY2RMabTjymfMjD7fJiTSNxFdIXxtb-Yq6RfxijTiaVogiKKjQC7OAr2A Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:14:05.858721 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c036dd17b7b04f0581ac388e18dfb347 Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:05.863187 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '84cf524c-67ea-4cee-a327-ce274d11c894'} Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:05.864071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:05.865571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:05.867791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Returning 404 to user: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:05.867791 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85145569-6243-4133-b1fb-174aa3169746 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 404 len: 111 microversion: 2.1 time: 0.055601 Jul 18 02:14:05.867791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 278/629] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:05 2022] DELETE /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:05.872865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:05.873532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:05.889208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.890440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:05.892234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:05.893348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.207523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:06.220225 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4a3b8a1-f698-4119-9bd5-ae168f67c21a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.357694 Jul 18 02:14:06.221315 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 279/630] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:05 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:06.227847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:06.228476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:06.231750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:06.236667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.237463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.238533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.239191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.380566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:06.396221 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8dbcd6c7-4a04-4b62-9316-5e54e3cbaa25 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1216 microversion: 2.1 time: 0.172701 Jul 18 02:14:06.398133 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 280/631] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:06 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:06.408809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:06.411140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:06.427569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.428768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.431524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.432642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.769442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:06.790422 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-310c9c6d-5e8e-4346-b13c-4f160086c4c1 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.389455 Jul 18 02:14:06.791517 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 281/632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:06 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:06.802321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:06.805171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 84cf524c-67ea-4cee-a327-ce274d11c894] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:06.817770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.818395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.820637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.821487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.841199 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] HTTP exception thrown: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Request method failure captured: Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 HTTP/1.1 Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF8AuJrC32EF0aHPolpAhpDFyzGDHo-d4l_ODSr3zQVbJEcU49PBaT7Ru_xxkbC9v64mwLm8m01waxAtXkHdPFOLvWxEHV8Zbiz6_hixSQrtF8_mKgTvKSY2RMabTjymfMjD7fJiTSNxFdIXxtb-Yq6RfxijTiaVogiKKjQC7OAr2A Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:14:06.844177 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c036dd17b7b04f0581ac388e18dfb347 Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:06.845647 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '84cf524c-67ea-4cee-a327-ce274d11c894'} Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:06.846492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. Jul 18 02:14:06.847836 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:06.851045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Returning 404 to user: Instance 84cf524c-67ea-4cee-a327-ce274d11c894 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:06.853298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84f91917-9047-45b0-af8a-b44f1476fb75 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894" status: 404 len: 111 microversion: 2.1 time: 0.059329 Jul 18 02:14:06.858327 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 282/633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:06 2022] GET /compute/v2.1/servers/84cf524c-67ea-4cee-a327-ce274d11c894 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:06.867078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5398d694-000c-4bec-b6b9-475a25d0d253 req-3beda01d-7ce3-4168-8e6a-59feae73b4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155de58c-3391-416d-a1d0-70cfc48377c3", "tag": "7c86631e-2aba-4d90-8d44-e20b7ec615c8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:06.898182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5398d694-000c-4bec-b6b9-475a25d0d253 req-3beda01d-7ce3-4168-8e6a-59feae73b4a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.900718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5398d694-000c-4bec-b6b9-475a25d0d253 req-3beda01d-7ce3-4168-8e6a-59feae73b4a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.947798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5398d694-000c-4bec-b6b9-475a25d0d253 req-3beda01d-7ce3-4168-8e6a-59feae73b4a0 service nova] Creating event network-changed:7c86631e-2aba-4d90-8d44-e20b7ec615c8 for instance 155de58c-3391-416d-a1d0-70cfc48377c3 on n-h1-849796-1 Jul 18 02:14:06.959137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5398d694-000c-4bec-b6b9-475a25d0d253 req-3beda01d-7ce3-4168-8e6a-59feae73b4a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098640 Jul 18 02:14:06.963289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 283/634] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:06.975335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:06.976882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:06.989824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.990656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:06.992450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:06.993330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:07.564570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:07.619025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1d52407-c1c2-40ea-b4b7-7554a0812ced tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.647842 Jul 18 02:14:07.620583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 284/635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:06 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:07.649609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-78e011a7-0a8e-4d21-b62c-d4f810d45a8a req-28b3ceae-eb67-4068-93f4-ddecf2a23c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484d114e-1a33-4866-b88d-0ce5a961e88a", "name": "network-vif-plugged", "status": "completed", "tag": "abbe5ab8-060c-45d2-96a3-21bffbd68008"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:07.708313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-78e011a7-0a8e-4d21-b62c-d4f810d45a8a req-28b3ceae-eb67-4068-93f4-ddecf2a23c60 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:07.711250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-78e011a7-0a8e-4d21-b62c-d4f810d45a8a req-28b3ceae-eb67-4068-93f4-ddecf2a23c60 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:07.773969 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-78e011a7-0a8e-4d21-b62c-d4f810d45a8a req-28b3ceae-eb67-4068-93f4-ddecf2a23c60 service nova] Creating event network-vif-plugged:abbe5ab8-060c-45d2-96a3-21bffbd68008 for instance 484d114e-1a33-4866-b88d-0ce5a961e88a on n-h1-849796-1 Jul 18 02:14:07.809722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-78e011a7-0a8e-4d21-b62c-d4f810d45a8a req-28b3ceae-eb67-4068-93f4-ddecf2a23c60 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184212 Jul 18 02:14:07.811822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 285/636] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:07.837198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:07.844444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:07.867148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:07.868337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:07.869588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:07.870281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:07.934745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:08.209321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:08.229409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb483082-6b64-4698-992c-eb809bea4a46 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1463 microversion: 2.1 time: 0.412343 Jul 18 02:14:08.229409 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 286/637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:07 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1463 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:08.241029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4c3f23b-2aa9-4a80-b999-fe266bdad7ad tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '.version_select at 0x7fab050cb430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:09.252576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:10.137684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4c3f23b-2aa9-4a80-b999-fe266bdad7ad tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/c1216b5a-515a-4f91-8f97-1dfacbf33b21" status: 202 len: 0 microversion: 2.1 time: 1.907006 Jul 18 02:14:10.142019 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 287/638] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:14:08 2022] DELETE /compute/v2.1/os-floating-ips/c1216b5a-515a-4f91-8f97-1dfacbf33b21 => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:10.148801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:10.150455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:10.168776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.169426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.170390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.170958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.832311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:10.842740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56c1c171-eabc-46ef-acac-4fccc33c1b6c tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.699412 Jul 18 02:14:10.858803 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 288/639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:10 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:10.881858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:10.882149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:10.901674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.902351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:10.906084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:10.910090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.329538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:11.340232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f25632e6-fe66-4c11-bd27-008c39ec4b8e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.476583 Jul 18 02:14:11.348832 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 289/640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:10 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:11.355500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.356407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.364881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.366074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.367392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.368847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.393743 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0160f038-d561-405c-96b1-68c71be8914b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1/action" status: 202 len: 0 microversion: 2.25 time: 8.654681 Jul 18 02:14:11.403560 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 352/641] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:14:02 2022] POST /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1/action => generated 0 bytes in 8666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:11.437387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:11.442262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:11.462635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.464858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.469502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:11.471393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:11.967883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:11.981516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:11.988651 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc176faa-9182-4a92-bd9d-201b6dd7ecc4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1462 microversion: 2.1 time: 0.579309 Jul 18 02:14:11.989646 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 353/642] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:11 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1462 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:12.021412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:12.024039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:12.047074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:12.060187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-025e2001-a576-4ee8-bc7f-be17237aad41 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1322 microversion: 2.1 time: 0.709065 Jul 18 02:14:12.061826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.065489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.067101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.068588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.074069 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 290/643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:11 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:12.097759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:12.099233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:12.120180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.120953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.123919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.124988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.195606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:12.435661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e326a391-02c5-4860-ae2f-20f0f3c9829a tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 204 len: 0 microversion: 2.1 time: 0.356786 Jul 18 02:14:12.437537 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 291/644] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:12 2022] DELETE /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:12.446296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:12.449190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:12.461869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.462345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.463336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.463829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.724706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:12.774006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea91744d-eb91-46ee-903d-49655c81320a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.779893 Jul 18 02:14:12.777135 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 354/645] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:11 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:12.792008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:12.792683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:12.804057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.812844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:12.817666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:12.821746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.015774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.042157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.048227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.055662 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1e7f864-e423-434c-b6da-bb440eae54d2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.613299 Jul 18 02:14:13.058677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 292/646] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:12 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:13.089967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1666306002", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:13.215812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.220402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:13.228264 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1541093b-b0a1-4cb1-b2a3-7857c5458708 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.446303 Jul 18 02:14:13.229089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 355/647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:12 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:13.245962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:13.247085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:13.266281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.268169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.278941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.279745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.629876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:13.645642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f705d6a-559c-44f5-9c57-dbfeb2d06127 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.415473 Jul 18 02:14:13.649061 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 356/648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:13 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:13.662251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:13.666570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:13.687729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.688271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.689205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.689887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.713065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:13.713973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:13.713973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:13.714458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:13.714889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:13.730921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.731417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.732847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.733672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.778207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:13.784365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Getting quotas for user 8d162823ac51401ba0d2fb537f76af60 and project 952dae33267642bd982964e23ca1b231. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:13.821768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:13.832073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:13.905444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06832a38-8074-4e8a-a4a6-80aeb0c891cd tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832036 Jul 18 02:14:13.906718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 293/649] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:13.912568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-260035fd-c5c0-4168-b57e-26a2b6fcd9cd req-cd8a2666-f616-4d70-9b00-c40c99eed343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155de58c-3391-416d-a1d0-70cfc48377c3", "name": "network-vif-plugged", "status": "completed", "tag": "7c86631e-2aba-4d90-8d44-e20b7ec615c8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:13.926675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-260035fd-c5c0-4168-b57e-26a2b6fcd9cd req-cd8a2666-f616-4d70-9b00-c40c99eed343 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.927711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-260035fd-c5c0-4168-b57e-26a2b6fcd9cd req-cd8a2666-f616-4d70-9b00-c40c99eed343 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:13.949562 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-260035fd-c5c0-4168-b57e-26a2b6fcd9cd req-cd8a2666-f616-4d70-9b00-c40c99eed343 service nova] Creating event network-vif-plugged:7c86631e-2aba-4d90-8d44-e20b7ec615c8 for instance 155de58c-3391-416d-a1d0-70cfc48377c3 on n-h1-849796-1 Jul 18 02:14:13.956453 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-260035fd-c5c0-4168-b57e-26a2b6fcd9cd req-cd8a2666-f616-4d70-9b00-c40c99eed343 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047616 Jul 18 02:14:13.958402 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 294/650] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:13.966514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1bd2b435-80a0-4812-ab37-9a25abc051a6 req-fe4309e5-ae59-47a1-b98a-044560685528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:13.998003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1bd2b435-80a0-4812-ab37-9a25abc051a6 req-fe4309e5-ae59-47a1-b98a-044560685528 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:13.998754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1bd2b435-80a0-4812-ab37-9a25abc051a6 req-fe4309e5-ae59-47a1-b98a-044560685528 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.026480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1bd2b435-80a0-4812-ab37-9a25abc051a6 req-fe4309e5-ae59-47a1-b98a-044560685528 service nova] Creating event network-changed:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h2-849796-1 Jul 18 02:14:14.035381 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1bd2b435-80a0-4812-ab37-9a25abc051a6 req-fe4309e5-ae59-47a1-b98a-044560685528 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075490 Jul 18 02:14:14.036652 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 295/651] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:14.044700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.046286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.060728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.061656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.063045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.063740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.151628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.167857 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79654e02-3e23-41ab-8d79-e8f70a2f172c tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1526 microversion: 2.1 time: 0.516728 Jul 18 02:14:14.168821 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 357/652] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:13 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1526 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.174009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.182049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.193591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.194914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.195958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.196610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.597489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.607128 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-248b2cc4-68e4-48ec-8d57-e2b1cf8569e3 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1472 microversion: 2.1 time: 0.568049 Jul 18 02:14:14.608691 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 296/653] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.615750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-34c9fbfa-372b-4ef3-a8b9-c7309e82fcd0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.619836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-34c9fbfa-372b-4ef3-a8b9-c7309e82fcd0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.725154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.749563 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e871b19d-4e24-459f-80fb-e25d4b45397c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1322 microversion: 2.1 time: 0.578625 Jul 18 02:14:14.752352 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 358/654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1322 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.766517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.768001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.808405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-34c9fbfa-372b-4ef3-a8b9-c7309e82fcd0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:14.818176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.818666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.820162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.820612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.821480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-34c9fbfa-372b-4ef3-a8b9-c7309e82fcd0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1214 microversion: 2.1 time: 0.208272 Jul 18 02:14:14.826785 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 297/655] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:14.849741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:14.851284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:14.865008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.865739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:14.868087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:14.877863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.272547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.287239 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dabc24be-eb7b-4030-a666-42f7684ad67a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.458099 Jul 18 02:14:15.291213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 298/656] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:15.307368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d163c2d6-96c9-4612-9abc-581bc05d6975 req-fadc0cb7-9f2f-4d97-a528-611edcc19413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "name": "network-vif-unplugged", "status": "completed", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:15.331453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d163c2d6-96c9-4612-9abc-581bc05d6975 req-fadc0cb7-9f2f-4d97-a528-611edcc19413 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.332307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d163c2d6-96c9-4612-9abc-581bc05d6975 req-fadc0cb7-9f2f-4d97-a528-611edcc19413 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.359007 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d163c2d6-96c9-4612-9abc-581bc05d6975 req-fadc0cb7-9f2f-4d97-a528-611edcc19413 service nova] Creating event network-vif-unplugged:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h2-849796-1 Jul 18 02:14:15.374626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d163c2d6-96c9-4612-9abc-581bc05d6975 req-fadc0cb7-9f2f-4d97-a528-611edcc19413 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082007 Jul 18 02:14:15.375710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 299/657] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:15.389508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:15.393285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:15.416134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.417079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.419328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.420115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.500437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Request method failure captured: Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a/diagnostics HTTP/1.1 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHLtZfF80eTBG1_OaC5GTvWHaMVWiXtDwkgzhfy81nZ2kO78BttrETVdgKc4RYGqjB185Wm6U3e-ZlQBpP3_YeCYJeSz_24-NOPuww6HNWI76x91vlKEqIwW15rspjj-TpG7_HnS73C48o1TogEVS1IMGV1EYqTttHzZPwuXwhTHks Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d2d83c872c1b4c519da771f056db7305 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:14:15.510256 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d2d83c872c1b4c519da771f056db7305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d2d83c872c1b4c519da771f056db7305 Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiagnosticsNegativeTest-1224986530-project Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 319eb3a1c3144985860c780d307b85ee Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1224986530-project Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:15.511709 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': '484d114e-1a33-4866-b88d-0ce5a961e88a'} Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:14:15.512395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 18 02:14:15.514456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:15.516738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:15.518054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75ecc4ff-9479-4023-afab-6116f23cab6e tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.140882 Jul 18 02:14:15.520583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 300/658] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:14:15 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a/diagnostics => generated 117 bytes in 144 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:15.537245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:15.542042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:15.561332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.563471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.567774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.571412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.689115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.720217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.729872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:15.745437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87452dda-7780-4586-b5be-6b67ec7b8af9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.988069 Jul 18 02:14:15.746973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 359/659] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:14 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:15.760875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:15.762452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:15.776378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.777786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:15.779614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:15.780754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.077664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:16.118228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92d344ca-af05-4198-88d7-70b421eed4ec tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.591792 Jul 18 02:14:16.119111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 301/660] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:15 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:16.148622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.149794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:16.177571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.179626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.191276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.192550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.341167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:16.629413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10398210-718c-4c35-9887-efdf6aa97d49 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "DELETE /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 204 len: 0 microversion: 2.1 time: 0.502102 Jul 18 02:14:16.630690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:16.630979 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 302/661] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:16 2022] DELETE /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:16.643029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.643916 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f278b48b-91aa-4778-879d-fde2b50f6159 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1526 microversion: 2.1 time: 0.892891 Jul 18 02:14:16.644085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:16.657526 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 360/662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:15 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1526 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:16.657526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.657526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:16.667784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:16.676269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.677096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.677580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.678182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.679279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.679956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.680454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.683251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.798945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:16.812643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34cad74d-e67d-468f-bca8-cb214784894b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1266 microversion: 2.1 time: 0.163587 Jul 18 02:14:16.813690 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 361/663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:16 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:16.835156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7d27ab1e-a943-4df4-8d56-521c07be7780 req-b4bbc64a-c3be-4f59-b6c9-b66762cd2c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93532a39-fba4-486b-aa2f-3f18982ced7b", "name": "network-vif-plugged", "status": "completed", "tag": "1ebcb07e-7fb3-42df-86e9-7497e0127b3d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:16.852083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7d27ab1e-a943-4df4-8d56-521c07be7780 req-b4bbc64a-c3be-4f59-b6c9-b66762cd2c71 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.852802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7d27ab1e-a943-4df4-8d56-521c07be7780 req-b4bbc64a-c3be-4f59-b6c9-b66762cd2c71 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.892331 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7d27ab1e-a943-4df4-8d56-521c07be7780 req-b4bbc64a-c3be-4f59-b6c9-b66762cd2c71 service nova] Creating event network-vif-plugged:1ebcb07e-7fb3-42df-86e9-7497e0127b3d for instance 93532a39-fba4-486b-aa2f-3f18982ced7b on n-h1-849796-1 Jul 18 02:14:16.906894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7d27ab1e-a943-4df4-8d56-521c07be7780 req-b4bbc64a-c3be-4f59-b6c9-b66762cd2c71 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081416 Jul 18 02:14:16.908758 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 362/664] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:16.942712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:16.945709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:16.957115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.957812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:16.958830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:16.959397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.260327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.279394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d317f5d7-2d51-4256-ac83-8e48ca38fa99 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.367737 Jul 18 02:14:17.281096 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 363/665] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:16 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:17.288435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:17.292956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:17.304733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.305926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.307127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.307889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.508433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:17.518323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fad4935-ce6b-4247-b798-aae3e5a70d96 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1478 microversion: 2.1 time: 0.234689 Jul 18 02:14:17.518918 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 364/666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:17 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:17.526298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9ff88977-68b7-46f4-a008-8679e1084498 req-f81624be-bf21-44d0-bbad-d1920ad02073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2420df5b-ef67-4dd7-b566-785ac92bbb3c", "name": "network-vif-deleted", "tag": "31df94e4-34c7-4448-bd8a-45c120eca8d8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:17.539179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ff88977-68b7-46f4-a008-8679e1084498 req-f81624be-bf21-44d0-bbad-d1920ad02073 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.540059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ff88977-68b7-46f4-a008-8679e1084498 req-f81624be-bf21-44d0-bbad-d1920ad02073 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.557221 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9ff88977-68b7-46f4-a008-8679e1084498 req-f81624be-bf21-44d0-bbad-d1920ad02073 service nova] Creating event network-vif-deleted:31df94e4-34c7-4448-bd8a-45c120eca8d8 for instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c on n-h2-849796-1 Jul 18 02:14:17.564038 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9ff88977-68b7-46f4-a008-8679e1084498 req-f81624be-bf21-44d0-bbad-d1920ad02073 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043602 Jul 18 02:14:17.580515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 365/667] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:17.586603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:17.587333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:17.599550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.602819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:17.604083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:17.604644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.001603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.071123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca5aca73-041b-4197-8086-d969c4fdbcbc tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1471 microversion: 2.1 time: 1.434609 Jul 18 02:14:18.073285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 303/668] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:16 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1471 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:18.093454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.095172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.096796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:18.104363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.112493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.114165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a297f44-ed3c-46ec-a139-307bd7b95d4f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.532466 Jul 18 02:14:18.119224 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 366/669] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:17 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:18.129850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c21f0a3d-cf99-4031-b7c0-66ceef570c36 req-79c3ceba-73aa-48a2-a681-fee3f47cfc4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:18.137075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.137864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.138724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.139172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.156713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c21f0a3d-cf99-4031-b7c0-66ceef570c36 req-79c3ceba-73aa-48a2-a681-fee3f47cfc4f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.158158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c21f0a3d-cf99-4031-b7c0-66ceef570c36 req-79c3ceba-73aa-48a2-a681-fee3f47cfc4f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.196431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c21f0a3d-cf99-4031-b7c0-66ceef570c36 req-79c3ceba-73aa-48a2-a681-fee3f47cfc4f service nova] Creating event network-changed:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h2-849796-1 Jul 18 02:14:18.208952 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c21f0a3d-cf99-4031-b7c0-66ceef570c36 req-79c3ceba-73aa-48a2-a681-fee3f47cfc4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088084 Jul 18 02:14:18.213858 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 367/670] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:18.226461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.230233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:18.257909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.258777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.259850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.260518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.443865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c036dd17b7b04f0581ac388e18dfb347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f679ff678064a09a1566c9f58f9344b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:18.462232 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86314195-ddde-48f2-ac8a-121594f20de1 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 200 len: 1309 microversion: 2.1 time: 0.246420 Jul 18 02:14:18.464215 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 368/671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:18.496317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:18.498794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:18.531235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.541518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:18.555727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:18.557196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.035982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.036973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.045506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:19.047840 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b82a901-3f27-4ef3-944a-6978141af54a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1272 microversion: 2.1 time: 0.581079 Jul 18 02:14:19.051415 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 369/672] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1272 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.052892 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38349c3c-5f44-49fe-8bab-9ce0406c9a70 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.976135 Jul 18 02:14:19.056304 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 304/673] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:18 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.063766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.068546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:19.068772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.069618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.079734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.083039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.086610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.087418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.092896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.093382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.098339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.099060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.149997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lazy-loading 'flavor' on Instance uuid 155de58c-3391-416d-a1d0-70cfc48377c3 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:19.313116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:19.345552 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93eae59c-d45a-491d-9574-895b29449514 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3/action" status: 202 len: 0 microversion: 2.1 time: 0.291974 Jul 18 02:14:19.349983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 370/674] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:19 2022] POST /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:19.358963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.359688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.377579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.378193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.379857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.381657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.672549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.690624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bef0d378-6fe9-4bbc-9a8e-0ef1b6149b26 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1387 microversion: 2.1 time: 0.632635 Jul 18 02:14:19.692023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 305/675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1387 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.702292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.704608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.716648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.717244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.718140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.718688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.765810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:19.801625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd909c44-fa59-47b5-8ea5-bb48724f6861 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1478 microversion: 2.1 time: 0.444924 Jul 18 02:14:19.812804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 371/676] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1478 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:19.860460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:19.862092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:19.880616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.883202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:19.889246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:19.889246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.245677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.264275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.266356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:20.276343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50388ed6-d8b5-4ab7-bcfc-7f10bdf45cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.582501 Jul 18 02:14:20.280118 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 306/677] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:20.294320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.294956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] [instance: 2420df5b-ef67-4dd7-b566-785ac92bbb3c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.313222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.313792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.320180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.321230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.372753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] HTTP exception thrown: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Request method failure captured: Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c HTTP/1.1 Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MF8AuJrC32EF0aHPolpAhpDFyzGDHo-d4l_ODSr3zQVbJEcU49PBaT7Ru_xxkbC9v64mwLm8m01waxAtXkHdPFOLvWxEHV8Zbiz6_hixSQrtF8_mKgTvKSY2RMabTjymfMjD7fJiTSNxFdIXxtb-Yq6RfxijTiaVogiKKjQC7OAr2A Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:14:20.374895 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f679ff678064a09a1566c9f58f9344b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8f679ff678064a09a1566c9f58f9344b Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-17931760 Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c036dd17b7b04f0581ac388e18dfb347 Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-17931760-project Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. Jul 18 02:14:20.376475 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2420df5b-ef67-4dd7-b566-785ac92bbb3c'} Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:20.377548 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. Jul 18 02:14:20.379250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:20.381830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] Returning 404 to user: Instance 2420df5b-ef67-4dd7-b566-785ac92bbb3c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:20.383490 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e1dd875-7929-4dc4-9489-d04c5e4a8bc6 tempest-FloatingIPsAssociationTestJSON-17931760 tempest-FloatingIPsAssociationTestJSON-17931760-project] 10.222.0.67 "GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c" status: 404 len: 111 microversion: 2.1 time: 0.102193 Jul 18 02:14:20.389421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 307/678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/2420df5b-ef67-4dd7-b566-785ac92bbb3c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:20.398719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.402015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.418171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.418644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.423053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.424019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.878416 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a08db161-e956-44e1-8950-7a083cdf0cc5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1630 microversion: 2.1 time: 1.047834 Jul 18 02:14:20.878416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 372/679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:19 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1630 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:20.891439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:20.892175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:20.906107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.906661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:20.907733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:20.908390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.008377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.019287 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3fa43a3-29a8-4efe-89cb-7c849b93b25e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1272 microversion: 2.1 time: 0.138947 Jul 18 02:14:21.019990 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 373/680] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.032599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-959751c2-dc1e-4d2a-bde9-76de8a7430a1 req-21e1161a-affb-4097-9645-597a083895f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484d114e-1a33-4866-b88d-0ce5a961e88a", "name": "network-vif-deleted", "tag": "abbe5ab8-060c-45d2-96a3-21bffbd68008"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:21.052825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-959751c2-dc1e-4d2a-bde9-76de8a7430a1 req-21e1161a-affb-4097-9645-597a083895f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.054845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-959751c2-dc1e-4d2a-bde9-76de8a7430a1 req-21e1161a-affb-4097-9645-597a083895f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.079224 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-959751c2-dc1e-4d2a-bde9-76de8a7430a1 req-21e1161a-affb-4097-9645-597a083895f6 service nova] Creating event network-vif-deleted:abbe5ab8-060c-45d2-96a3-21bffbd68008 for instance 484d114e-1a33-4866-b88d-0ce5a961e88a on n-h1-849796-1 Jul 18 02:14:21.087551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-959751c2-dc1e-4d2a-bde9-76de8a7430a1 req-21e1161a-affb-4097-9645-597a083895f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064356 Jul 18 02:14:21.088644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 374/681] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:21.095778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.097720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.106580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.107592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.109142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.109906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.488734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.501036 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c140c9ae-a859-4f44-ae04-d3c975ee70f0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1586 microversion: 2.1 time: 0.411042 Jul 18 02:14:21.502217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 375/682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1586 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.508469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.509591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.518750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.520207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.521488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.522820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.640754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.642670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.643852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lazy-loading 'fault' on Instance uuid 484d114e-1a33-4866-b88d-0ce5a961e88a {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:21.657538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.680658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-010ddbb4-8e35-480f-b995-ba4c68db35e8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 1.286087 Jul 18 02:14:21.682679 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 308/683] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:20 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.691941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.692982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.714222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.715292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.719222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.720165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.737813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319eb3a1c3144985860c780d307b85ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d83c872c1b4c519da771f056db7305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:21.755752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d88bc7bf-b553-490f-85b3-7e86de055741 tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 200 len: 1312 microversion: 2.1 time: 0.251858 Jul 18 02:14:21.757437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 376/684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:21.766936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.767759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.779921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.780689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.782651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.783787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.940463 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25995dac-62f5-4d20-8712-ad7fb275c358 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180420 Jul 18 02:14:21.940463 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 377/685] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:21.951093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:21.951676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:21.958289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.958751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:21.960473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:21.961012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.370113 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-269a189b-2fc8-496e-be87-120a7029f78d tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1613 microversion: 2.1 time: 0.422807 Jul 18 02:14:22.374567 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 378/686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1613 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:22.380544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.382077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.392751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.393779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.395175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.395808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.655053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.673234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.680215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.684598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d0995afc-8aae-410c-9f98-68b038e39de2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.997067 Jul 18 02:14:22.686730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 309/687] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:21 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:22.700726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:22.704562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:22.706225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.710208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60b009ba-326d-45b8-a949-dc9b1264a7ab tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.333560 Jul 18 02:14:22.721345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.722913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.723265 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 379/688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:22.725291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.726477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.735044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.735669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.764798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.765514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.766436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.766893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.922467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] HTTP exception thrown: Cannot 'migrate' instance 155de58c-3391-416d-a1d0-70cfc48377c3 while it is in vm_state suspended Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Request method failure captured: Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3/action HTTP/1.1 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MG4iBtmDtPHdihZPwJzqMH2kecwyg_ZgvBG1K39fKKGFa-htoMUyIPd7Y6imXePZxWlpyQnXpnfJiDUJuC-AezwaAEP-0PvhMmCMRh3oAOKm8j3J4zqg2_-V4LnV5SsRIj43E1dSh7fmrz41RdKi8858NVz9kodF8Q97XofjrZGle8 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:14:22.932903 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4b096c37abd84364b664f0c9cb3ff1f3 Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: {"migrate": {}} Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:22.936181 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'migrate' instance 155de58c-3391-416d-a1d0-70cfc48377c3 while it is in vm_state suspended Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '155de58c-3391-416d-a1d0-70cfc48377c3', 'body': {'migrate': {}}} Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 in vm_state suspended. Cannot resize while the instance is in this state. Jul 18 02:14:22.937845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 155de58c-3391-416d-a1d0-70cfc48377c3 while it is in vm_state suspended Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.941188 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 155de58c-3391-416d-a1d0-70cfc48377c3 while it is in vm_state suspended Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Returning 409 to user: Cannot 'migrate' instance 155de58c-3391-416d-a1d0-70cfc48377c3 while it is in vm_state suspended {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:22.945730 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14a13784-0338-4ecc-a876-310be62437f5 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3/action" status: 409 len: 148 microversion: 2.1 time: 0.247484 Jul 18 02:14:22.956375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 310/689] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:22 2022] POST /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3/action => generated 148 bytes in 268 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:22.971521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:22.971521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] [instance: 484d114e-1a33-4866-b88d-0ce5a961e88a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:22.989137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.992278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:22.994147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:22.995564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.050658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] HTTP exception thrown: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Request method failure captured: Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a HTTP/1.1 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHLtZfF80eTBG1_OaC5GTvWHaMVWiXtDwkgzhfy81nZ2kO78BttrETVdgKc4RYGqjB185Wm6U3e-ZlQBpP3_YeCYJeSz_24-NOPuww6HNWI76x91vlKEqIwW15rspjj-TpG7_HnS73C48o1TogEVS1IMGV1EYqTttHzZPwuXwhTHks Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d2d83c872c1b4c519da771f056db7305 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:14:23.056600 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d2d83c872c1b4c519da771f056db7305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d2d83c872c1b4c519da771f056db7305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d2d83c872c1b4c519da771f056db7305 Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1224986530 Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiagnosticsNegativeTest-1224986530-project Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 319eb3a1c3144985860c780d307b85ee Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1224986530-project Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. Jul 18 02:14:23.059781 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '484d114e-1a33-4866-b88d-0ce5a961e88a'} Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.062508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. Jul 18 02:14:23.064889 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.068217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] Returning 404 to user: Instance 484d114e-1a33-4866-b88d-0ce5a961e88a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.070801 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ebe9834b-4d8c-41b2-8997-70117957484a tempest-ServerDiagnosticsNegativeTest-1224986530 tempest-ServerDiagnosticsNegativeTest-1224986530-project] 10.222.0.67 "GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a" status: 404 len: 111 microversion: 2.1 time: 0.113482 Jul 18 02:14:23.078484 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 311/690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/484d114e-1a33-4866-b88d-0ce5a961e88a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:23.095483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a42549d-65e5-4c7d-bc0f-339d71096b60 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a42549d-65e5-4c7d-bc0f-339d71096b60 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Request method failure captured: Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action HTTP/1.1 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 39 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MG4iBtmDtPHdihZPwJzqMH2kecwyg_ZgvBG1K39fKKGFa-htoMUyIPd7Y6imXePZxWlpyQnXpnfJiDUJuC-AezwaAEP-0PvhMmCMRh3oAOKm8j3J4zqg2_-V4LnV5SsRIj43E1dSh7fmrz41RdKi8858NVz9kodF8Q97XofjrZGle8 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:14:23.109554 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4b096c37abd84364b664f0c9cb3ff1f3 Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: {"os-resetState": {"state": "invalid"}} Jul 18 02:14:23.112522 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8b504f18-4faa-4c8f-9b5a-e017643a85d0', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.114134 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:14:23.117364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 18 02:14:23.119709 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.125039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a42549d-65e5-4c7d-bc0f-339d71096b60 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.125039 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a42549d-65e5-4c7d-bc0f-339d71096b60 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action" status: 400 len: 144 microversion: 2.1 time: 0.041967 Jul 18 02:14:23.130874 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 312/691] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:23 2022] POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action => generated 144 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:14:23.149708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14ae18f7-4209-43c0-8f21-cb8539f72854 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14ae18f7-4209-43c0-8f21-cb8539f72854 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Request method failure captured: Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action HTTP/1.1 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 31 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MG4iBtmDtPHdihZPwJzqMH2kecwyg_ZgvBG1K39fKKGFa-htoMUyIPd7Y6imXePZxWlpyQnXpnfJiDUJuC-AezwaAEP-0PvhMmCMRh3oAOKm8j3J4zqg2_-V4LnV5SsRIj43E1dSh7fmrz41RdKi8858NVz9kodF8Q97XofjrZGle8 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:14:23.159441 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4b096c37abd84364b664f0c9cb3ff1f3 Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: {"os-resetState": {"state": 1}} Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:23.161978 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8b504f18-4faa-4c8f-9b5a-e017643a85d0', 'body': {'os-resetState': {'state': 1}}} Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 1 Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.163607 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 18 02:14:23.166128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.171767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14ae18f7-4209-43c0-8f21-cb8539f72854 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.173584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14ae18f7-4209-43c0-8f21-cb8539f72854 tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action" status: 400 len: 120 microversion: 2.1 time: 0.040103 Jul 18 02:14:23.174972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 313/692] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:23 2022] POST /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0/action => generated 120 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:14:23.213842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:23.215279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Failed to fetch instance by id 999 {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:14:23.218112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Request method failure captured: Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 37 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MG4iBtmDtPHdihZPwJzqMH2kecwyg_ZgvBG1K39fKKGFa-htoMUyIPd7Y6imXePZxWlpyQnXpnfJiDUJuC-AezwaAEP-0PvhMmCMRh3oAOKm8j3J4zqg2_-V4LnV5SsRIj43E1dSh7fmrz41RdKi8858NVz9kodF8Q97XofjrZGle8 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:14:23.234004 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f0b87cd73a8a4ab0b85ded5e54e88c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f0b87cd73a8a4ab0b85ded5e54e88c2a Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1984539356 Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4b096c37abd84364b664f0c9cb3ff1f3 Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1984539356-project-admin Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: {"os-resetState": {"state": "error"}} Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:14:23.236832 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 999 could not be found. Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:14:23.238592 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:23.242746 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9187966-9b2a-4716-b0bf-360101714a1e tempest-ServersAdminNegativeTestJSON-1984539356 tempest-ServersAdminNegativeTestJSON-1984539356-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.056232 Jul 18 02:14:23.246643 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 314/693] 10.222.0.67 () {60 vars in 1178 bytes} [Mon Jul 18 02:14:23 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:14:23.273914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.276331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.290181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.292462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.295112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.297123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.328556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:23.355665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc1c4982-f933-4e5b-983b-1675620d540f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.630791 Jul 18 02:14:23.356915 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 380/694] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:22 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:23.366238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:23.584134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c802047d-e0f9-4c5d-b725-2f81d7ef51e3 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "DELETE /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 204 len: 0 microversion: 2.1 time: 0.332458 Jul 18 02:14:23.591406 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 315/695] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:23 2022] DELETE /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:23.599531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.602447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.613467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.614546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.616458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.617625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.727927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:23.729734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:23.749640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.751264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.753354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:23.754396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:23.790418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:24.113276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:24.134181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7fc44856-321a-4a1b-a8b3-f9abffa3272a tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1468 microversion: 2.1 time: 0.540999 Jul 18 02:14:24.136157 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 381/696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:24.147678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:24.150368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:24.166274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.168252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.171404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.172828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.819314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:24.863877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:24.883387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:24.888372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:24.892687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-023db312-7208-4f9d-af3f-f4a946a61629 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 1.184048 Jul 18 02:14:24.894841 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 316/697] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:23 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:24.904361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2bab739d-097a-40be-8b84-39acc8d7b8a1 req-87fc7a45-dff1-449f-aab1-1dd3d3a047a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "name": "network-vif-plugged", "status": "completed", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:24.913850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:24.921851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2bab739d-097a-40be-8b84-39acc8d7b8a1 req-87fc7a45-dff1-449f-aab1-1dd3d3a047a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.922491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2bab739d-097a-40be-8b84-39acc8d7b8a1 req-87fc7a45-dff1-449f-aab1-1dd3d3a047a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.942616 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2bab739d-097a-40be-8b84-39acc8d7b8a1 req-87fc7a45-dff1-449f-aab1-1dd3d3a047a3 service nova] Creating event network-vif-plugged:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h2-849796-1 Jul 18 02:14:24.949365 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2bab739d-097a-40be-8b84-39acc8d7b8a1 req-87fc7a45-dff1-449f-aab1-1dd3d3a047a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052559 Jul 18 02:14:24.950011 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 317/698] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:24.956261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:24.957607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:24.966196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.967050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.967957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:24.968998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:24.972272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:24.995471 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0b0365b-b210-483b-8f1e-a39ed3926e68 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.857402 Jul 18 02:14:24.996086 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 382/699] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:24 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:25.089611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0bef2bcf-6f75-4afc-b02a-8d5ae82c9507 req-ca646b13-dfe5-46bf-a117-28cfc4eea7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "name": "network-vif-unplugged", "status": "completed", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:25.102223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0bef2bcf-6f75-4afc-b02a-8d5ae82c9507 req-ca646b13-dfe5-46bf-a117-28cfc4eea7c3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.103353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0bef2bcf-6f75-4afc-b02a-8d5ae82c9507 req-ca646b13-dfe5-46bf-a117-28cfc4eea7c3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.121935 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0bef2bcf-6f75-4afc-b02a-8d5ae82c9507 req-ca646b13-dfe5-46bf-a117-28cfc4eea7c3 service nova] Creating event network-vif-unplugged:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h2-849796-1 Jul 18 02:14:25.129302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0bef2bcf-6f75-4afc-b02a-8d5ae82c9507 req-ca646b13-dfe5-46bf-a117-28cfc4eea7c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044152 Jul 18 02:14:25.134688 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 383/700] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:14:25.160231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:25.161658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:25.176967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.177783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.180898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.181675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.556996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.575626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4903042b-34ab-4cf5-aa6a-e85496c44d1d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.624021 Jul 18 02:14:25.577556 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 318/701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:24 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:25.583902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:25.588833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:25.607357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.608766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.610376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.613070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:25.613913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.627539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00c1dbe8-34cd-459e-8513-d92e32447c1c tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1468 microversion: 2.1 time: 0.475144 Jul 18 02:14:25.633296 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 384/702] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:25 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:25.916060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:25.917488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:25.932598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.935748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:25.938245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:25.940734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.339942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:26.352315 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8abf7d6d-b3e4-48fa-b162-5121f020ddd9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1586 microversion: 2.1 time: 0.773423 Jul 18 02:14:26.354159 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 319/703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:25 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1586 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:26.367186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:26.373940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:26.387462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.388200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.389264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.389885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.399444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:26.415349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:26.421709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:26.424587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c64bae7d-8299-4e8c-a432-f2f3d25a91ed tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.516785 Jul 18 02:14:26.426380 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 385/704] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:25 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:26.596546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:26.597356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:26.609262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.613035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:26.618351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:26.620195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.040008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.051427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-99b26a29-ae45-49a1-9571-2dae75fc07b7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1312 microversion: 2.1 time: 0.460092 Jul 18 02:14:27.053985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 386/705] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:26 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:27.069352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:27.077893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:27.102060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.105655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.106795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.107450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.261720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.274280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92d2dccb-b05a-47b5-849e-64886cbd1520 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.916526 Jul 18 02:14:27.275238 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 320/706] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:26 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:27.288767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3e18971c-d78a-4e89-bb56-007b7e64244f req-11942f44-6c5e-42b9-a680-7689fc20acf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1517eb7b-29f3-42ca-810e-901023e82b1f", "tag": "c58c17d6-6128-45b1-b4f7-fe002ea8177e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:27.304220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3e18971c-d78a-4e89-bb56-007b7e64244f req-11942f44-6c5e-42b9-a680-7689fc20acf3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.304688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3e18971c-d78a-4e89-bb56-007b7e64244f req-11942f44-6c5e-42b9-a680-7689fc20acf3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.342195 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3e18971c-d78a-4e89-bb56-007b7e64244f req-11942f44-6c5e-42b9-a680-7689fc20acf3 service nova] Creating event network-changed:c58c17d6-6128-45b1-b4f7-fe002ea8177e for instance 1517eb7b-29f3-42ca-810e-901023e82b1f on n-h1-849796-1 Jul 18 02:14:27.354638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3e18971c-d78a-4e89-bb56-007b7e64244f req-11942f44-6c5e-42b9-a680-7689fc20acf3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077848 Jul 18 02:14:27.355277 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 321/707] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:27.370498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e6427a5a-855f-4f49-a244-eeb197b5a7bf req-61f66ccc-bd29-4a35-9fd7-4605fd6348d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93532a39-fba4-486b-aa2f-3f18982ced7b", "tag": "1ebcb07e-7fb3-42df-86e9-7497e0127b3d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:27.391693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e6427a5a-855f-4f49-a244-eeb197b5a7bf req-61f66ccc-bd29-4a35-9fd7-4605fd6348d3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.399319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e6427a5a-855f-4f49-a244-eeb197b5a7bf req-61f66ccc-bd29-4a35-9fd7-4605fd6348d3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.434667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e6427a5a-855f-4f49-a244-eeb197b5a7bf req-61f66ccc-bd29-4a35-9fd7-4605fd6348d3 service nova] Creating event network-changed:1ebcb07e-7fb3-42df-86e9-7497e0127b3d for instance 93532a39-fba4-486b-aa2f-3f18982ced7b on n-h1-849796-1 Jul 18 02:14:27.441027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e6427a5a-855f-4f49-a244-eeb197b5a7bf req-61f66ccc-bd29-4a35-9fd7-4605fd6348d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084321 Jul 18 02:14:27.442287 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 322/708] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:27.472142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:27.474648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:27.477175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:27.488983 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f7a86ef-0963-4efb-b322-06549371bcba tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1468 microversion: 2.1 time: 0.429418 Jul 18 02:14:27.491977 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 387/709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:27 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1468 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:27.500250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.504550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:27.505478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:27.505945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.074392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:28.074964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:28.085838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.086298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:28.087123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:28.087579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.159197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.185835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:29.227311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9757a922-a94c-42b9-805e-c670bc262b52 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1461 microversion: 2.1 time: 1.159483 Jul 18 02:14:29.241388 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 388/710] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:28 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1461 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:29.250705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:29.254919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:29.274598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.275664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.276763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.280566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.319761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.375622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.394444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.409113 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb3ab04c-917b-49cf-9ab4-0f9d65d93c52 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 1.942904 Jul 18 02:14:29.435469 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 323/711] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:27 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:29.470266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:29.471390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:29.503225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.506823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.516726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:29.519503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:29.841620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.859611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48b56556-b40e-405e-a1df-b2112798787c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.608566 Jul 18 02:14:29.860306 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 389/712] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:29.905915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:29.926854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-df4a00fb-873f-4492-8336-22ff64fbc20e tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1298 microversion: 2.1 time: 0.479662 Jul 18 02:14:29.929249 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 324/713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1298 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:29.986047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-33cfec37-b5bf-4efb-969e-36dbdcb2c1c9 req-1e253fdc-8322-463b-bfbf-9a0d36aba4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155de58c-3391-416d-a1d0-70cfc48377c3", "name": "network-vif-deleted", "tag": "7c86631e-2aba-4d90-8d44-e20b7ec615c8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:30.023853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-33cfec37-b5bf-4efb-969e-36dbdcb2c1c9 req-1e253fdc-8322-463b-bfbf-9a0d36aba4d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.026782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-33cfec37-b5bf-4efb-969e-36dbdcb2c1c9 req-1e253fdc-8322-463b-bfbf-9a0d36aba4d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.058399 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-33cfec37-b5bf-4efb-969e-36dbdcb2c1c9 req-1e253fdc-8322-463b-bfbf-9a0d36aba4d2 service nova] Creating event network-vif-deleted:7c86631e-2aba-4d90-8d44-e20b7ec615c8 for instance 155de58c-3391-416d-a1d0-70cfc48377c3 on n-h1-849796-1 Jul 18 02:14:30.072667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-33cfec37-b5bf-4efb-969e-36dbdcb2c1c9 req-1e253fdc-8322-463b-bfbf-9a0d36aba4d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100669 Jul 18 02:14:30.075414 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 325/714] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:30.378745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:30.382560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:30.414121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.415368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.417700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.421391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.452446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:30.454552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:30.470000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.470485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:30.471326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:30.478296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.103399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.139067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.142912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.145290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07c5ef2d-516a-4444-baa8-df6a51bd968f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1567 microversion: 2.25 time: 0.701711 Jul 18 02:14:31.165717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 326/715] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:30 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1567 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:14:31.185984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:31.187719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:31.202094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.203128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.204961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.205936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.217203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:31.643270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:31.668890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4a8c336-dc18-4f74-9c57-91cb0900604a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.500344 Jul 18 02:14:31.670360 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 327/716] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:31 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:31.683225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:31.685579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:31.706796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.707951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.712149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:31.719092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:31.774567 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef731874-f8a9-426d-9fc6-ad786f22abb1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1612 microversion: 2.1 time: 1.912368 Jul 18 02:14:31.786829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 390/717] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:29 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1612 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:31.999892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:32.044480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b440765e-fe7b-4d7e-abb3-5dc6ecc6dbd7 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 200 len: 1298 microversion: 2.1 time: 0.369517 Jul 18 02:14:32.046938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 328/718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:31 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:32.078294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:32.079674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:32.139067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.141222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.143075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:32.148090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:32.245881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '048399aedda54b55b75892105ef78f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13458fa338ea4d77a4df1b8c59d0e86a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:32.248734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] flavor_id is None. Assuming migration. {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:14:32.252363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:14:32.333653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-588925262", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:32.499031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:33.156687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:33.158039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:33.158916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:33.159602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:33.160495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:33.176527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.182528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.183989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.190235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.229761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Getting quotas for project a37e3150bd9a4fa9b200ab8465a05b24. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:33.236798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Getting quotas for user 63f52482b2c04420af9511ee80d847ac and project a37e3150bd9a4fa9b200ab8465a05b24. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:33.260552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:33.266171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:33.366086 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ab450d9-6613-4dee-997a-d5e79fc4ccae tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad/action" status: 202 len: 0 microversion: 2.1 time: 1.316091 Jul 18 02:14:33.367974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 329/719] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:32 2022] POST /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad/action => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:33.376386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.376960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:33.386205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.386673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.387508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.387962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.403453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12c2dc7a-7765-406b-a351-d053d0013447 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614528 Jul 18 02:14:33.407514 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 391/720] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:33.419399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.421251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:33.455920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.458314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.469456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.470835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.826666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:33.842475 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90439f0b-c549-4fbe-a846-c12466bb5ba2 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.433493 Jul 18 02:14:33.844001 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 392/721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:33.853144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.854975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 155de58c-3391-416d-a1d0-70cfc48377c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:33.862706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.863303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.864245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.864811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.883890 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] HTTP exception thrown: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Request method failure captured: Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 HTTP/1.1 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MG1F1J1YTLQssDMGW9JF1y7FUtk2wZkD6hvofsNzfp3zXpilw2ojFNjN-zokycJgrIzWgyg9Gb2MoGh8q1BrV-veqxD9kpJaw4g8m3yQqqSsTwYz1-2-M-zI7joI-tqTpdmnM-CgsjASiR9gmkHPbBTIxJQ1KgWkp5KAXWoQ7OHw4c Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: bd273272d4f44b6287b9b6e97bbb4bd8 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:14:33.885978 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: bd273272d4f44b6287b9b6e97bbb4bd8 Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersAdminNegativeTestJSON-770031297-project Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 355895d2b59745c8857999a3b2b82ade Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersAdminNegativeTestJSON-770031297-project Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. Jul 18 02:14:33.889203 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '155de58c-3391-416d-a1d0-70cfc48377c3'} Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:33.891032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. Jul 18 02:14:33.893708 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:33.901948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Returning 404 to user: Instance 155de58c-3391-416d-a1d0-70cfc48377c3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:33.901948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5c31cd6-f95a-432a-810c-2950c010e650 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3" status: 404 len: 111 microversion: 2.1 time: 0.055817 Jul 18 02:14:33.901948 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 393/722] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/servers/155de58c-3391-416d-a1d0-70cfc48377c3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:33.908350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:33.909032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:33.937477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.938980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:33.941272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:33.943285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:34.374008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:34.406341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:34.425170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:34.428622 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45be4d5a-35bc-4bfb-b343-c1e5ce1e1b1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1542 microversion: 2.25 time: 1.058200 Jul 18 02:14:34.437038 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 330/723] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1542 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:34.450726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fbc0d28-50e0-4cc4-bf6c-8b2d04268879 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:34.451932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3fbc0d28-50e0-4cc4-bf6c-8b2d04268879 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:34.520794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3fbc0d28-50e0-4cc4-bf6c-8b2d04268879 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:34.531170 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3fbc0d28-50e0-4cc4-bf6c-8b2d04268879 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1213 microversion: 2.1 time: 0.090376 Jul 18 02:14:34.532451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 331/724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:34 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:34.567716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:34.582168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71c71b71-8b76-4800-9a2f-c9adb11ecd93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1470 microversion: 2.1 time: 0.678344 Jul 18 02:14:34.586394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 394/725] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:33 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1470 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:34.591705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:34.597885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:34.608380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:34.618606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:34.619881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:34.621506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:34.722189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:14:34.777094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-124519267", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "02468610-b7a9-4f9f-b82b-fcd8322cd0c8"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:34.848165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] validate_networks() for [('02468610-b7a9-4f9f-b82b-fcd8322cd0c8', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:35.115149 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bad6a087-09fa-4374-bfc4-7b8fbb9ccc26 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 204 len: 0 microversion: 2.1 time: 0.526187 Jul 18 02:14:35.119627 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 395/726] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:14:34 2022] DELETE /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:14:35.132451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-754ef358-482f-47f0-8cfc-769ecc3d4572 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '.version_select at 0x7fab059a6310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:35.138519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754ef358-482f-47f0-8cfc-769ecc3d4572 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:35.139306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754ef358-482f-47f0-8cfc-769ecc3d4572 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:35.162305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-754ef358-482f-47f0-8cfc-769ecc3d4572 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1473 microversion: 2.25 time: 0.039993 Jul 18 02:14:35.165261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 396/727] 10.222.0.67 () {60 vars in 1183 bytes} [Mon Jul 18 02:14:35 2022] GET /compute/v2.1/os-migrations => generated 1473 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:35.178584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:35.180214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:35.194385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:35.196288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:35.200713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:35.201817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:35.851456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:35.862161 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1716ea53-0b9d-4709-b17a-f6bb915e2197 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.694197 Jul 18 02:14:35.872982 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 397/728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:35 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:35.884441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:35.884441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:35.892203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:35.892907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:35.894046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:35.894697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.130138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:36.131023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:36.136124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:36.137686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:36.138200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:36.173428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.174277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.175932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.180386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.270162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:36.298043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for user d2b97e560fcf4750b2aad92d6d37e611 and project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:36.357786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:36.360711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:36.489401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.489723 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2d04a4e1-b47f-4fa6-a1d2-74d62a5cd2b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955119 Jul 18 02:14:36.492391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 332/729] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:36.498437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.499484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:36.508612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.509516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.510663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.511673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.520751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1dca542-7051-4fd0-8d4f-4197f120c026 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1478 microversion: 2.1 time: 0.655526 Jul 18 02:14:36.541189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 398/730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:35 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1478 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:36.553551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.560679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:36.581318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.582765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.586725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.588448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.766725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:36.785246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d39d34d7-8f3e-4234-84fa-effd3df3e368 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1265 microversion: 2.1 time: 0.242708 Jul 18 02:14:36.803521 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 399/731] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:36.810622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:36.830439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:36.878722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.893599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.895149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:36.895969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:36.981790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:37.032343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ce341c5-124b-4ec0-bb2f-8915d09931e7 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 2035 microversion: 2.25 time: 0.538410 Jul 18 02:14:37.045570 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 333/732] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 2035 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:37.063966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16744aec-673a-4ba2-8d41-4db291517b8e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:37.073742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-16744aec-673a-4ba2-8d41-4db291517b8e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:37.278446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-16744aec-673a-4ba2-8d41-4db291517b8e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:37.299004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16744aec-673a-4ba2-8d41-4db291517b8e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1210 microversion: 2.1 time: 0.250813 Jul 18 02:14:37.302121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 334/733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:37 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1210 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:37.328942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:37.330896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:37.349072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.370511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.372520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.373659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.634460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:37.679032 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7abd144e-d0bd-4282-8101-5cca2ce66a3f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1470 microversion: 2.1 time: 0.868161 Jul 18 02:14:37.684489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 400/734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:36 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1470 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:37.725294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-752abfc0-55f2-445e-b0ea-66ed03ec1ed4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: .version_select at 0x7fab05cb20d0>, body: {"keypair": {"name": "tempest-keypair-407514903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzw8aCJsbNaFVOafzSiEIJTSC7d14tuh/5v3dKJ+ZRLfzuNEDS6lvyzYRvsmcweBoQyL3XOCoHnas84UmZlOSrYKZCNcaMiiQ9T0uq1Ker4kqK4YeViXUr+6d94iOOR0A=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:37.777293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:37.850462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-752abfc0-55f2-445e-b0ea-66ed03ec1ed4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:37.859359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-752abfc0-55f2-445e-b0ea-66ed03ec1ed4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for user 2affc29a14f847a099dad6deaf668842 and project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:37.927879 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-752abfc0-55f2-445e-b0ea-66ed03ec1ed4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.236859 Jul 18 02:14:37.930102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 401/735] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:14:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:14:37.949229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5187be66-6663-4eb1-90ef-40fb245925f3 req-8754d8c2-2395-4745-a7b5-efe308eaa10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1517eb7b-29f3-42ca-810e-901023e82b1f", "name": "network-vif-plugged", "status": "completed", "tag": "c58c17d6-6128-45b1-b4f7-fe002ea8177e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:37.985790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5187be66-6663-4eb1-90ef-40fb245925f3 req-8754d8c2-2395-4745-a7b5-efe308eaa10c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:37.988523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5187be66-6663-4eb1-90ef-40fb245925f3 req-8754d8c2-2395-4745-a7b5-efe308eaa10c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:37.988874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.001385 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-63574cec-aaf0-49a5-9472-d05a9256375c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.697528 Jul 18 02:14:38.004717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 335/736] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:37 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:38.015172 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5187be66-6663-4eb1-90ef-40fb245925f3 req-8754d8c2-2395-4745-a7b5-efe308eaa10c service nova] Creating event network-vif-plugged:c58c17d6-6128-45b1-b4f7-fe002ea8177e for instance 1517eb7b-29f3-42ca-810e-901023e82b1f on n-h1-849796-1 Jul 18 02:14:38.025394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5187be66-6663-4eb1-90ef-40fb245925f3 req-8754d8c2-2395-4745-a7b5-efe308eaa10c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087526 Jul 18 02:14:38.026833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 402/737] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:38.033635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:38.034288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:38.035687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:38.036721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:38.051613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.053696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.056497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.057730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.061426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.062056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.062941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.063401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.708014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.759177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:38.775178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12b1d7d6-cd08-43b3-87f7-9ef4557605e2 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1478 microversion: 2.1 time: 0.754921 Jul 18 02:14:38.784350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d9ad851-547e-4e0e-aa3a-7293dd71043b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1283 microversion: 2.1 time: 0.745552 Jul 18 02:14:38.797283 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 403/738] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1283 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:38.800355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 336/739] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1478 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:38.812309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:38.814355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:38.830489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.831352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.832394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.836810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.854636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:38.861922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:38.942249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.944152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:38.949190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:38.950017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.233790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:39.247855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da5cd32a-6347-4531-ac90-1b21bbb10768 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1470 microversion: 2.1 time: 0.441044 Jul 18 02:14:39.261386 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 337/740] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:39.274466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:39.275989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:39.289935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.293096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.294257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.298868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.565153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:39.575000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12e64ba9-4731-4938-8e38-6e131979a1c0 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1314 microversion: 2.1 time: 0.320624 Jul 18 02:14:39.575919 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 338/741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:39 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:39.726530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:39.735914 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c372931f-fa78-4679-9ef8-83ba94b17c71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1206 microversion: 2.1 time: 0.932620 Jul 18 02:14:39.752226 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 404/742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:38 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1206 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:39.796897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:39.797713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:39.808312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.811288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.814193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.821176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.825681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:39.826410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:39.842889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.845390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:39.846368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:39.846836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.090681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.105333 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f859b27b-d955-4dd6-a511-1c0bd6d3d4f1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1271 microversion: 2.1 time: 0.283983 Jul 18 02:14:40.106837 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 405/743] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:39 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:40.299813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:40.307792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:40.337259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.337727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.346303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.347111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.441978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:40.469149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eccfb11a-79e0-4159-8eaf-875f5ebe4095 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1478 microversion: 2.1 time: 0.676672 Jul 18 02:14:40.491305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 339/744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:39 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1478 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:40.594838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:40.595480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:40.620855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.621657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:40.623055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:40.623822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.149088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.166611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.185901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e17ea27-ac58-4ea1-8e5d-358a237dec2e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1464 microversion: 2.1 time: 0.592034 Jul 18 02:14:41.189353 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 340/745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:40 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1464 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:41.201139 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-872787f9-fdd4-4313-8e37-8c7e4a74e763 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1470 microversion: 2.1 time: 0.925160 Jul 18 02:14:41.209122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.211899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:41.223233 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 406/746] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:40 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1470 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:41.245445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.247492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.250568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.252199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:41.255441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.268619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.269209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.270104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.271812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.272902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.341850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:41.560325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.595949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9e704de-b3a9-4218-8497-7d50d9e7cabf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1268 microversion: 2.1 time: 0.403414 Jul 18 02:14:41.597081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 341/747] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1268 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:41.725696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:41.750728 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8b64ccc-cc0b-4cae-af1d-a5d77601c0ea tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1271 microversion: 2.1 time: 0.525251 Jul 18 02:14:41.775923 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 407/748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1271 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:41.786894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:41.789273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:41.802403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.804197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.806241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.807354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.929944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:41.932600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:41.934531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lazy-loading 'fault' on Instance uuid 8b504f18-4faa-4c8f-9b5a-e017643a85d0 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:14:42.180771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355895d2b59745c8857999a3b2b82ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd273272d4f44b6287b9b6e97bbb4bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.226403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89cf2bc6-13ab-445a-a22f-7f0ea4722f97 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 200 len: 1312 microversion: 2.1 time: 0.431845 Jul 18 02:14:42.227427 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 408/749] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 1312 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:42.255641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c03ba123-0dc2-4eee-97aa-80a8ed3e89e8 req-f75bf412-4234-4db2-9a47-841765b9f652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b504f18-4faa-4c8f-9b5a-e017643a85d0", "name": "network-vif-deleted", "tag": "88cf6efd-6956-4c44-8a1f-b5701bc6a82d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:42.298376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c03ba123-0dc2-4eee-97aa-80a8ed3e89e8 req-f75bf412-4234-4db2-9a47-841765b9f652 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.302056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c03ba123-0dc2-4eee-97aa-80a8ed3e89e8 req-f75bf412-4234-4db2-9a47-841765b9f652 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.326693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.335954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'deleted': False, 'project_id': '2d1d0574313c4249a2a542b05878e866'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:42.350403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c03ba123-0dc2-4eee-97aa-80a8ed3e89e8 req-f75bf412-4234-4db2-9a47-841765b9f652 service nova] Creating event network-vif-deleted:88cf6efd-6956-4c44-8a1f-b5701bc6a82d for instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 on n-h2-849796-1 Jul 18 02:14:42.358830 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c03ba123-0dc2-4eee-97aa-80a8ed3e89e8 req-f75bf412-4234-4db2-9a47-841765b9f652 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123728 Jul 18 02:14:42.360083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 409/750] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:42.363478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.364508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.366900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.367829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.369297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.370375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:42.389790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.399657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.400799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.401504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.583348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4bc9f056-4a0a-4ca0-98cc-c1357ba7af3a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.981443 Jul 18 02:14:42.583852 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 342/751] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:14:41 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:14:42.613594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.624788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'deleted': False} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:42.634687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.635480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.636911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.637741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.806587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:42.835463 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85578f42-e3ed-456c-b4dd-55fb023ae21d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.468633 Jul 18 02:14:42.836740 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 410/752] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:42 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:42.861914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:42.863428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:42.884455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.885273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.888707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:42.889529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:42.893982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:14:43.215248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:43.238408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:43.242999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:43.503925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:43.521260 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d31a68a4-4544-4fc2-90bd-44db3577b0ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.682886 Jul 18 02:14:43.546823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 411/753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:42 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:43.559443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:43.566572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:43.590100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:43.591470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:43.594981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:43.597440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.230710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:44.245578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e3b868e-3681-4681-8a2d-e3f32ecc96b0 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.697033 Jul 18 02:14:44.247044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 412/754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:43 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:44.255469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:44.257637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] [instance: 8b504f18-4faa-4c8f-9b5a-e017643a85d0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:44.271308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.272736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.274870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.276010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.311010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] HTTP exception thrown: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Request method failure captured: Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 HTTP/1.1 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MG1F1J1YTLQssDMGW9JF1y7FUtk2wZkD6hvofsNzfp3zXpilw2ojFNjN-zokycJgrIzWgyg9Gb2MoGh8q1BrV-veqxD9kpJaw4g8m3yQqqSsTwYz1-2-M-zI7joI-tqTpdmnM-CgsjASiR9gmkHPbBTIxJQ1KgWkp5KAXWoQ7OHw4c Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: bd273272d4f44b6287b9b6e97bbb4bd8 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:14:44.315083 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd273272d4f44b6287b9b6e97bbb4bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: bd273272d4f44b6287b9b6e97bbb4bd8 Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-770031297 Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersAdminNegativeTestJSON-770031297-project Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 355895d2b59745c8857999a3b2b82ade Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersAdminNegativeTestJSON-770031297-project Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. Jul 18 02:14:44.317663 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '8b504f18-4faa-4c8f-9b5a-e017643a85d0'} Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:14:44.319171 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. Jul 18 02:14:44.323046 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:14:44.329745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] Returning 404 to user: Instance 8b504f18-4faa-4c8f-9b5a-e017643a85d0 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:14:44.332279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc6a4985-e345-4a26-8143-26fbfa73f089 tempest-ServersAdminNegativeTestJSON-770031297 tempest-ServersAdminNegativeTestJSON-770031297-project] 10.222.0.67 "GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0" status: 404 len: 111 microversion: 2.1 time: 0.082631 Jul 18 02:14:44.334792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 413/755] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:44 2022] GET /compute/v2.1/servers/8b504f18-4faa-4c8f-9b5a-e017643a85d0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:14:44.347887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:44.349885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:44.370225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.372664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.374811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.376025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.813400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:44.827376 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-99bb0eb7-7d6f-4ba9-a031-73ff7899aa58 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.490225 Jul 18 02:14:44.836332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 414/756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:44 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:44.845843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:44.846482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:44.860824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.862274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:44.864165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:44.865754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:45.434533 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b92a272a-7966-4cb7-980e-087e5d43a1f4 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14495 microversion: 2.1 time: 2.827192 Jul 18 02:14:45.436502 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 343/757] 10.222.0.67 () {58 vars in 1170 bytes} [Mon Jul 18 02:14:42 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14495 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:14:45.489753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:45.491014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:45.504127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:45.505357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:45.508968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:45.510387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:45.548325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:45.668076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:45.700550 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eab188f5-de6f-4237-8e1e-839e66de6835 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.858466 Jul 18 02:14:45.702142 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 415/758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:44 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:45.720974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:45.748505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'deleted': False, 'project_id': '2d1d0574313c4249a2a542b05878e866'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:45.781180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:45.784279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:45.785755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:45.786524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:45.984194 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01d71459-2593-4f95-80af-ad22d6eb7365 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?tenant_id=952dae33267642bd982964e23ca1b231" status: 200 len: 15 microversion: 2.1 time: 0.277276 Jul 18 02:14:45.997029 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 416/759] 10.222.0.67 () {58 vars in 1230 bytes} [Mon Jul 18 02:14:45 2022] GET /compute/v2.1/servers/detail?tenant_id=952dae33267642bd982964e23ca1b231 => generated 15 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:14:46.002550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:46.004254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:46.016749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.017968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.019081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.019734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.080245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:46.103799 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4b47837-a3a0-43a9-805e-d2db3733dc51 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.648857 Jul 18 02:14:46.115391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 344/760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:45 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:46.122707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:46.139367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'tenant_id': '952dae33267642bd982964e23ca1b231', 'deleted': False} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:46.151651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.153993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.157478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:46.159342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:46.235939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:14:46.999628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.001908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.349126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:47.369306 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b75f15c-e0d7-4ec8-bef5-47c244147e88 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 1.365762 Jul 18 02:14:47.394101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 417/761] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:45 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:47.421582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-103498130", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "289de125-f75a-44e5-b795-181da195dbd2"}], "security_groups": [{"name": "tempest-securitygroup--1052635693"}], "key_name": "tempest-keypair-407514903", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:47.427298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c819e5e6-da13-4b10-917f-8976bb7bda0e tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=952dae33267642bd982964e23ca1b231" status: 200 len: 4825 microversion: 2.1 time: 1.316879 Jul 18 02:14:47.429824 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 345/762] 10.222.0.67 () {58 vars in 1256 bytes} [Mon Jul 18 02:14:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=952dae33267642bd982964e23ca1b231 => generated 4825 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:47.450583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-433ddab4-e01a-495d-882f-ddde4bea1116 req-978ad3d1-2903-488a-b41c-ed71fcd45f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:47.496710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-433ddab4-e01a-495d-882f-ddde4bea1116 req-978ad3d1-2903-488a-b41c-ed71fcd45f16 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.498019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-433ddab4-e01a-495d-882f-ddde4bea1116 req-978ad3d1-2903-488a-b41c-ed71fcd45f16 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.546893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-433ddab4-e01a-495d-882f-ddde4bea1116 req-978ad3d1-2903-488a-b41c-ed71fcd45f16 service nova] Creating event network-changed:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h2-849796-1 Jul 18 02:14:47.577456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-433ddab4-e01a-495d-882f-ddde4bea1116 req-978ad3d1-2903-488a-b41c-ed71fcd45f16 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135514 Jul 18 02:14:47.585364 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 346/763] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:47.606690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:47.614641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:47.652611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.653549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.655032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:47.655830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:47.886293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:47.999467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:48.014469 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0586f3a-a8d4-431f-8d14-71d7ebbe707c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.426723 Jul 18 02:14:48.017081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 347/764] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:47 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:48.032584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] validate_networks() for [('289de125-f75a-44e5-b795-181da195dbd2', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:48.032866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:48.033256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:48.047043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.047589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.048786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.049647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.384877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:48.402546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12bac238-8c96-4873-adc5-c5c33d54e2ae tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.373507 Jul 18 02:14:48.406765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 348/765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:48 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:48.420739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-28ea844a-298b-4892-b1c6-14de5d967e15 req-b559f744-d898-4fd0-8904-7f243d396be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f872eccd-f3df-47d0-954a-ba2be5d03b34", "tag": "cb92e3be-ca4f-4c5d-a2c4-fa17627be525"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:48.434258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-28ea844a-298b-4892-b1c6-14de5d967e15 req-b559f744-d898-4fd0-8904-7f243d396be7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.435174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-28ea844a-298b-4892-b1c6-14de5d967e15 req-b559f744-d898-4fd0-8904-7f243d396be7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.457274 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-28ea844a-298b-4892-b1c6-14de5d967e15 req-b559f744-d898-4fd0-8904-7f243d396be7 service nova] Creating event network-changed:cb92e3be-ca4f-4c5d-a2c4-fa17627be525 for instance f872eccd-f3df-47d0-954a-ba2be5d03b34 on n-h2-849796-1 Jul 18 02:14:48.466564 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-28ea844a-298b-4892-b1c6-14de5d967e15 req-b559f744-d898-4fd0-8904-7f243d396be7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055358 Jul 18 02:14:48.469869 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 349/766] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:48.489498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:48.506606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'tenant_id': '2d1d0574313c4249a2a542b05878e866', 'deleted': False} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:48.521991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.522972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.525042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.526382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.594055 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a1cff7b-22e8-48b3-a496-c217e559ee4f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2d1d0574313c4249a2a542b05878e866" status: 200 len: 15 microversion: 2.1 time: 0.120680 Jul 18 02:14:48.596312 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 350/767] 10.222.0.67 () {58 vars in 1256 bytes} [Mon Jul 18 02:14:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2d1d0574313c4249a2a542b05878e866 => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:14:48.609685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:48.611638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:48.625373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.626385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:48.627975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:48.629179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.106694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.135652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-193a17d9-b17e-43e7-8a54-29b07fa9d552 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.536005 Jul 18 02:14:49.148266 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 351/768] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:48 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:49.167798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2cf0f1dc-f3f2-4788-941f-a8e4eea4db89 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.179011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2cf0f1dc-f3f2-4788-941f-a8e4eea4db89 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.028744 Jul 18 02:14:49.182080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 352/769] 10.222.0.67 () {58 vars in 1188 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:14:49.187842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.188735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:49.196970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.197729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.198757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.199380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.214968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:49.215743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:49.216357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:49.217409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:49.218105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:49.249406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.249983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.274319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.274993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.301445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:49.306962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for user 2affc29a14f847a099dad6deaf668842 and project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:49.323409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:49.327576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:49.431595 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17fe7ae2-3c0e-493a-9bc3-f52361d2fa37 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.035815 Jul 18 02:14:49.432615 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 418/770] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:14:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:14:49.447161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:49.455253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:49.571330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:49.604396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6741c6b7-66e2-45c6-85f3-7a062ea0e106 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.420593 Jul 18 02:14:49.610992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 353/771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:49.627488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:49.628538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:49.653695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:49.656684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.663501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.664890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.665598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.914208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.914996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:49.916467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:49.917772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.144246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f2219a51-07a8-4342-a93d-b893b7632d34 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 0 microversion: 2.1 time: 0.705009 Jul 18 02:14:50.145437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 419/772] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:49 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:50.150381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:50.161891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:50.163246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:50.166779 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22182daf-c02a-43dc-80b6-cae3ddfc967b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.553058 Jul 18 02:14:50.168558 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 354/773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:49 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:50.177340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:50.183126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:50.184865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '952dae33267642bd982964e23ca1b231'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:50.200909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.202218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.204009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.204952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.374196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:14:50.402211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:50.430811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:50.441669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:50.445063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43f2ccc6-1440-49e5-a8c0-5b98919a6cc3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1284 microversion: 2.25 time: 0.296897 Jul 18 02:14:50.473844 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 420/774] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:50 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:50.486667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:50.488561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:50.503039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.504457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.506732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.508140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.534955 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd1cfa45-68a1-4a82-9cf1-c5c76c57cad4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.364734 Jul 18 02:14:50.536258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 355/775] 10.222.0.67 () {58 vars in 1149 bytes} [Mon Jul 18 02:14:50 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:50.551478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:50.565768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:50.579368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.579885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.581021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.581687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.764322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efbe76dd-e9e2-4133-98e5-f73685103220 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 0 microversion: 2.1 time: 0.216992 Jul 18 02:14:50.767289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 356/776] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:50 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:50.815758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:50.817803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:50.831150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.832683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:50.834575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:50.835326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.018725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.038987 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-899f0080-34a8-4efa-ae3b-bcf69e4d3d0e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.562534 Jul 18 02:14:51.041154 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 421/777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:50 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:51.051805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:51.054042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:51.074373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.075658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.077681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.079243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.419024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.461461 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-269658f4-b596-48fa-a521-2bcb3670175d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.686999 Jul 18 02:14:51.464122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 357/778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:50 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:51.489213 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70013036-d285-4f18-9e0e-c0247cd76cdb tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1613 microversion: 2.1 time: 0.445256 Jul 18 02:14:51.490471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 422/779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1613 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:51.494659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:51.500013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:51.500245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:51.505097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:51.517471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.518925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.520498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.521535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.524185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.525068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.527057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.528134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.735064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.762500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.785807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:51.792884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd8352c3-f23f-40b7-84fa-6afe5e64621c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1336 microversion: 2.25 time: 0.300525 Jul 18 02:14:51.794000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 423/780] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1336 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:51.820869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:51.822122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:51.833396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.835097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:51.836682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:51.837504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.105056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:52.121895 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ccb9e4a2-f6d0-4b11-a6e4-6fa87fbe01a1 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.655743 Jul 18 02:14:52.122491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 358/781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.136228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.136862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:52.139358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2eea5cd-573e-48a8-ba8f-ec038d32e641 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1613 microversion: 2.1 time: 0.343490 Jul 18 02:14:52.140843 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 424/782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:51 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1613 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.158607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.159074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.159878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.160325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.162464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.175105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'host': 'n-h1-849796-1', 'deleted': False} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:52.184905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.186122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.188044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.189171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.353452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:14:52.435929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:52.512151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42bfe96b-de0f-4cf7-ba0c-c7a5554f9cad tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=n-h1-849796-1&all_tenants=1" status: 200 len: 2009 microversion: 2.1 time: 0.358249 Jul 18 02:14:52.513885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 425/783] 10.222.0.67 () {58 vars in 1189 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers?host=n-h1-849796-1&all_tenants=1 => generated 2009 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.526930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.528425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:52.546006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.546484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.550127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.550648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.806464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:52.822092 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b6f3495-6a21-41b4-a5d3-3d4bc161056d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.698442 Jul 18 02:14:52.822710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 359/784] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.823244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:52.832075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-880c4c20-9bed-4daf-b4bc-ad0bc51aa452 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.317745 Jul 18 02:14:52.837458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.847597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 426/785] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:52.853648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:14:52.857770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:52.858371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:52.860507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.861195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.862404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.862866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.867884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.868662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.869771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:52.870496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:52.987612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba305c74-effb-4cce-a83b-6ed9f35aed8a tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.163365 Jul 18 02:14:52.988909 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 360/786] 10.222.0.67 () {58 vars in 1195 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:14:53.009680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:53.010962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.023716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.024643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.026251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.027717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.039758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:53.056264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:53.060173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:53.062600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c60a38bd-8d28-4889-8877-536d1106a2e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1342 microversion: 2.25 time: 0.213184 Jul 18 02:14:53.078918 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 427/787] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:52 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:53.123366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:53.156082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:53.161656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.177530 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d5b2ae9-5f87-4e8c-9a3c-307e15f7fd51 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 0 microversion: 2.1 time: 0.179049 Jul 18 02:14:53.182587 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 361/788] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:52 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:14:53.190817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:53.191897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.192818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.194537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.194753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.195432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.213872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.214501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.215513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.215985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.367025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:53.367375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:53.367875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:53.368342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:53.368717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:53.503094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:53.516374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-185421fb-25d6-44e5-8c48-8551eb1209b5 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.368575 Jul 18 02:14:53.518411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 428/789] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:53 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:53.533071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.535119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.535852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.537181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.538269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.593792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e93f8cea-26f0-47ab-a873-a3ffdd055fb9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 1066 microversion: 2.1 time: 0.406641 Jul 18 02:14:53.601131 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 362/790] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:14:53 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 1066 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:14:53.653432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:53.654153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:53.675011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.676772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.681202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:53.682602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:53.950198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1387319638", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:54.073624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:54.340258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.354456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01e1d186-ec07-4e08-926c-5a82f6799a28 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.737431 Jul 18 02:14:54.358540 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 363/791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:53 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:14:54.363774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:54.364388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:54.386707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.387076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.387969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.391694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.817635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:54.887319 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b4f5f72-8710-4b22-86ee-bcd504ea97fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.515437 Jul 18 02:14:54.890971 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 364/792] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:54 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:54.946332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:54.949203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:54.963644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.964582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:54.966179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:54.967103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.426549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:14:55.427454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:14:55.427639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:14:55.428233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:14:55.428663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:14:55.461707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.462167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.463006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.463661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.512913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:14:55.532602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:14:55.585247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:14:55.599072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:14:55.635828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:55.753178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-814c42d8-5dac-4a8e-ba4c-c288170e5915 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201728 Jul 18 02:14:55.768804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 429/793] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:14:55.781517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:55.785395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:55.816064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.817713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:55.819668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:55.820833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.114913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:56.137144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d8ec187-9fa6-4046-b1cf-30cc0979c8ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 1.213135 Jul 18 02:14:56.140834 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 365/794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:54 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:56.174099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:56.175054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:56.186868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.187411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.189427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.190654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.232758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:56.250259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:56.258053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:56.258053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9eaaf5a3-7f06-4411-8f3c-28bc39b6d382 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.484197 Jul 18 02:14:56.279697 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 430/795] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:55 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:56.289303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-db6cc124-9863-4c6f-9a5e-493f38e086a3 req-11ffd216-1480-424c-8447-8c11bdfa2259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "name": "network-vif-plugged", "status": "completed", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:56.305899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db6cc124-9863-4c6f-9a5e-493f38e086a3 req-11ffd216-1480-424c-8447-8c11bdfa2259 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.306382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db6cc124-9863-4c6f-9a5e-493f38e086a3 req-11ffd216-1480-424c-8447-8c11bdfa2259 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.333089 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-db6cc124-9863-4c6f-9a5e-493f38e086a3 req-11ffd216-1480-424c-8447-8c11bdfa2259 service nova] Creating event network-vif-plugged:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h2-849796-1 Jul 18 02:14:56.346442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-db6cc124-9863-4c6f-9a5e-493f38e086a3 req-11ffd216-1480-424c-8447-8c11bdfa2259 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064609 Jul 18 02:14:56.347503 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 431/796] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:56.358853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:56.360262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:56.374386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.375539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.377299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:56.378391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:56.946833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:14:57.106538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.135299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da644568-2cd6-422d-b0b5-be031484db9a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.786039 Jul 18 02:14:57.151351 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 432/797] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:56 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.159739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.161406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.170275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.171609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.172774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.176908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.335744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.348407 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc2f50fb-466d-429f-94a1-28dd75d8913e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1269 microversion: 2.1 time: 0.195127 Jul 18 02:14:57.348649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.351391 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 433/798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.367812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.368089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65e65a9e-1c2e-4780-a706-0ceac5e7fc4b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 1.223666 Jul 18 02:14:57.368677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.369001 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 366/799] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:56 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.374562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.375676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.382890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.383125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.383776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.384499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.384989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.385610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.389471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.392427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.700077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.721579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6410129b-54ca-4eb7-95a6-3c19bec99ac6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.365551 Jul 18 02:14:57.723885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 434/800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.736253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:57.737861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:57.750330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.751129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.752945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:57.753948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:57.806097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.815407 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43bcc7dc-a9df-4b05-852c-62866a22308a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.445099 Jul 18 02:14:57.816681 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 367/801] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:57.966571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.977077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.978747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:57.980005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9eac83b4-46b8-45ce-99a9-e7335b6b4104 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.253782 Jul 18 02:14:57.980607 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 435/802] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:57 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:58.155929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.156594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.165927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.166727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.168194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.169619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.369526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.372094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.387313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.388302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.389733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.390571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.525618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:58.541457 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4431d9ab-e9e8-4d71-9577-52c66eb033a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1275 microversion: 2.1 time: 0.176677 Jul 18 02:14:58.543816 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 436/803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:58.556368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.558863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.569703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.570402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.571425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.572036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.604328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:58.633715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-763a2f39-53ca-4d51-a61b-d8d296938ff4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.481408 Jul 18 02:14:58.641085 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 368/804] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:58.748410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.750126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.764662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.765411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.767276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.768568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.883228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:58.902362 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3267fd2c-eb3c-4b8d-8a08-4213db8d2297 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.355901 Jul 18 02:14:58.916982 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 437/805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:58.917859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:58.918745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:58.949217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.949635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:58.954483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:58.955996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.182514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.191377 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2dac4208-099b-4b5a-8c6c-e77f8c4dbee5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1310 microversion: 2.1 time: 0.279282 Jul 18 02:14:59.202462 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 438/806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1310 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.208018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.209795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.218424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.219161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.220167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.220801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.494182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.503851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e399ec4-7d2d-4d14-809e-2ec736534744 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.767015 Jul 18 02:14:59.518603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 369/807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:58 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.554628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b2f68ca0-cd0b-43d2-9f65-2cd483913e30 req-4b86697c-62df-4f7c-a0e9-bc4e2edae150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f872eccd-f3df-47d0-954a-ba2be5d03b34", "name": "network-vif-plugged", "status": "completed", "tag": "cb92e3be-ca4f-4c5d-a2c4-fa17627be525"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:59.562806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2f68ca0-cd0b-43d2-9f65-2cd483913e30 req-4b86697c-62df-4f7c-a0e9-bc4e2edae150 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.564999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2f68ca0-cd0b-43d2-9f65-2cd483913e30 req-4b86697c-62df-4f7c-a0e9-bc4e2edae150 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.567648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.579405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b2f68ca0-cd0b-43d2-9f65-2cd483913e30 req-4b86697c-62df-4f7c-a0e9-bc4e2edae150 service nova] Creating event network-vif-plugged:cb92e3be-ca4f-4c5d-a2c4-fa17627be525 for instance f872eccd-f3df-47d0-954a-ba2be5d03b34 on n-h2-849796-1 Jul 18 02:14:59.580467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.582120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.583428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e7858fb4-ca23-4ef2-88be-faf209df3626 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.379558 Jul 18 02:14:59.586674 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b2f68ca0-cd0b-43d2-9f65-2cd483913e30 req-4b86697c-62df-4f7c-a0e9-bc4e2edae150 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071021 Jul 18 02:14:59.587868 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 370/808] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:59.592912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 439/809] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:14:59.595017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0076e94f-0a51-4841-8ec2-bc5c157b05d1 req-1f370dfe-993f-412b-ad26-6837ae2c5b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:59.605297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0076e94f-0a51-4841-8ec2-bc5c157b05d1 req-1f370dfe-993f-412b-ad26-6837ae2c5b89 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.605998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0076e94f-0a51-4841-8ec2-bc5c157b05d1 req-1f370dfe-993f-412b-ad26-6837ae2c5b89 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.607134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.608052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.622046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.622861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.623908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.624585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.644540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0076e94f-0a51-4841-8ec2-bc5c157b05d1 req-1f370dfe-993f-412b-ad26-6837ae2c5b89 service nova] Creating event network-changed:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:14:59.651896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0076e94f-0a51-4841-8ec2-bc5c157b05d1 req-1f370dfe-993f-412b-ad26-6837ae2c5b89 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062284 Jul 18 02:14:59.652523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 371/810] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:14:59.715055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.723643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-697566e8-7a39-45a5-b272-708f547a03e3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1275 microversion: 2.1 time: 0.129197 Jul 18 02:14:59.726466 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 440/811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.732289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.733253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.742171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.743088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.744176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.744851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.750964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1063275804", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ba681847-f712-4432-8e9f-9928078c492f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:14:59.846398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] validate_networks() for [('ba681847-f712-4432-8e9f-9928078c492f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:14:59.954036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:14:59.963506 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1958f13-bdf1-487b-98c6-44872ec3212a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.235567 Jul 18 02:14:59.965034 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 441/812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:14:59.970347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:14:59.971357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:14:59.979299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.979892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:14:59.980781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:14:59.981462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.202529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:00.213213 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a25a7ea5-2cb2-4495-9187-871586da916b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.246712 Jul 18 02:15:00.214260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 442/813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:14:59 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:00.220970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:00.222117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:00.230235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.230791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.231696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.232338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.474810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:00.480387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:00.493407 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6f6ae60-437f-485d-9c50-e1112de1e8c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1492 microversion: 2.1 time: 0.276566 Jul 18 02:15:00.504870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 443/814] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:00 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1492 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:00.780163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:00.799587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:00.846561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.848067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:00.849834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:00.850885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.208786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8677263a-a119-4462-87fb-d6f735d4b701 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1643 microversion: 2.1 time: 0.692224 Jul 18 02:15:01.245621 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 444/815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:00 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1643 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:01.289609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.316643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:01.322706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:01.325881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:01.329414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:01.330749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:01.334728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.334728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.335332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.335737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.337791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:01.389113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.401441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.403533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.405102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.453303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Getting quotas for project 3f824f83a1cd4c5f961d7699eff4dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:01.461452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Getting quotas for user d1cc7dd6bef648b48ba02258c37d2eb7 and project 3f824f83a1cd4c5f961d7699eff4dfcd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:01.498615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:01.522472 n-d-849796-1 devstack@n-api.service[119440]: WARNING nova.utils [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1063275804 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-106327580 Jul 18 02:15:01.528305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:01.680311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9aadc785-322a-42e3-8f0a-93e77a6bd91b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.026467 Jul 18 02:15:01.681752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:01.682978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 372/816] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:01.697669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38fb6b84-67ac-4a41-81bf-9dfb88cdcf59 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1475 microversion: 2.1 time: 0.449007 Jul 18 02:15:01.698323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.699085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:01.700029 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 445/817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:01.706278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:01.707192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:01.718861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.719567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.721236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.722679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.736262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.737177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:01.738678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:01.739461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.124271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.151547 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd52f42c-b05c-417a-bce1-0df0626cc4b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.449280 Jul 18 02:15:02.154026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 446/818] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.178563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.180406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.198569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.199093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.199928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.200382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.222259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.239072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.242024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.248191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f997b60c-a00d-43e7-a52a-8bc86efbad6c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.562621 Jul 18 02:15:02.249368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 373/819] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:01 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:02.265573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.267902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.298305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.299168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.301261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.302012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.468678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.491790 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67b9b435-a620-4d58-b0dd-1bca6c5b64ce tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.333194 Jul 18 02:15:02.495620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 447/820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.506498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.506498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.516759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.516759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.516759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.517628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.733297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:02.804610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54980e80-5ea1-4315-8425-679affd3554f tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1313 microversion: 2.1 time: 0.543286 Jul 18 02:15:02.814343 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 374/821] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.839008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-25e88f29-7841-4451-b882-1589e4066b08 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.840123 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fd51098-c1a9-45cf-858a-d88a6b3cc33b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1643 microversion: 2.1 time: 0.343730 Jul 18 02:15:02.840313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-25e88f29-7841-4451-b882-1589e4066b08 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.840736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 448/822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1643 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:02.854041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:02.854674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:02.880042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.881624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:02.883566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:02.884247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.066379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-25e88f29-7841-4451-b882-1589e4066b08 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.110159 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-25e88f29-7841-4451-b882-1589e4066b08 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1232 microversion: 2.1 time: 0.286026 Jul 18 02:15:03.119117 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 375/823] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1232 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:03.136287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.143972 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:15:03.143972 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:15:03.147380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.148547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.153530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.155443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.229909 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da430d6f-89ae-4429-80ff-1c785ee1648b tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.105995 Jul 18 02:15:03.230816 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 376/824] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:03.242614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.252368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.254203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.279833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.281227 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e30b1b7-2bc0-4389-a063-ee673e919379 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1474 microversion: 2.1 time: 0.432127 Jul 18 02:15:03.296969 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 449/825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:02 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1474 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:03.298158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.298158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.298158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.305311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:03.310369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.331637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.333935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.337784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.339009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.403540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lazy-loading 'flavor' on Instance uuid 9848647e-8e1c-4e17-83a6-8c5877cad694 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:15:03.434101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Going to try to live migrate instance to n-h1-849796-1 {{(pid=119439) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:15:03.612614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.642898 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f75574f-75a0-4a08-8833-84216588dad3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.396797 Jul 18 02:15:03.656960 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 377/826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:03.662412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.663147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.670204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.670769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.671516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.671952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.918750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.937240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.939235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:03.940739 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ea27861-efd0-494e-baba-c67133ea72aa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.292617 Jul 18 02:15:03.941625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 378/827] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:03.962176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:03.963202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:03.977119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.977990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.979162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:03.979927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:03.985563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:04.795908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:04.807253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-186840e8-bd3a-4f4a-9e65-9ecd426ae866 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1470 microversion: 2.1 time: 0.849922 Jul 18 02:15:04.808198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 379/828] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:03 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1470 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:04.813913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:04.815024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:04.822306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:04.822855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:04.823767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:04.824290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.017277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:05.028970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ca52c4c-9d08-4de5-a77d-2f1449889d9a tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1463 microversion: 2.1 time: 0.218816 Jul 18 02:15:05.030091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 380/829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:04 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:05.043936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:05.045987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:05.059554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.060896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.063187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.064737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.197411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:05.223270 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e40e663-5922-497e-994a-893fd3a21afe tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1290 microversion: 2.1 time: 0.191211 Jul 18 02:15:05.224822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 381/830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:05 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1290 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:05.240738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:05.245129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:05.264851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.265348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.266158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.278435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.475564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:05.571683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=14 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:05.882808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:05.925834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b6f3a7b-c9af-4034-99d2-86c440a8b770 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1474 microversion: 2.1 time: 0.697575 Jul 18 02:15:05.943595 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 382/831] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:05 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1474 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:05.943595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:05.944199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:05.950755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.951891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:05.953282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:05.954162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.558550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:06.574634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8fcd32f-6fa6-467b-ae8b-9567980257cf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.635923 Jul 18 02:15:06.593265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 383/832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:05 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:06.602847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "name": "network-vif-unplugged", "status": "completed", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:06.619309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.620494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.649733 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] Creating event network-vif-unplugged:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h1-849796-1 Jul 18 02:15:06.677668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] Instance 5109dafc-983b-4078-b7a0-c80460f551ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:15:06.731439 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-acd191fc-7c8f-46d9-8a9c-f0056accdb61 req-32ce5ee5-0526-4685-9b57-ba4827747c13 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135716 Jul 18 02:15:06.734035 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 384/833] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:06.749717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:06.750463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:06.770396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.770946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:06.771958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:06.773144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.110633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.120971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.138068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.139747 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-506169b1-546c-401f-82b2-6e58de2b62a7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.404147 Jul 18 02:15:07.146923 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 385/834] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:06 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:07.270118 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce2eb3b7-d207-4aca-9090-461308395c6d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694/action" status: 202 len: 0 microversion: 2.1 time: 3.985804 Jul 18 02:15:07.275191 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 450/835] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:03 2022] POST /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694/action => generated 0 bytes in 3992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:07.280306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.280958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.298706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.303357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.306268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.307561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.344842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Calling method '.version_select at 0x7fab05096f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.361834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.362491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.376077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=19 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:07.383781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.384242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.405267 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ad8bc4a-bbb6-4477-8a3e-1a0dc34de43e tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/a37e3150bd9a4fa9b200ab8465a05b24?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964" status: 200 len: 690 microversion: 2.1 time: 0.256451 Jul 18 02:15:07.405544 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 386/836] 10.222.0.67 () {58 vars in 1411 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/os-simple-tenant-usage/a37e3150bd9a4fa9b200ab8465a05b24?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964 => generated 690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:07.417023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.417023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.420600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.420600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.421470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.423245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.617191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.635627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7fb6f760-88f8-4c79-9de0-7f9325ed2f31 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.359192 Jul 18 02:15:07.641986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.651508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-facf6647-fd10-4cbf-9650-d5d9cc1664df tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.244680 Jul 18 02:15:07.654129 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 387/838] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:07.654297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 451/838] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:07.660185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.661524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.669432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.670323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.671410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.672105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.685840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9a43dee1-1846-477c-ac8f-c530aa766cd1 req-f9582214-3e7d-44b4-8a64-2bb436c55e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6", "tag": "972750a5-4e56-4ee2-894b-cfb3b0c4ecec"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:07.704085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9a43dee1-1846-477c-ac8f-c530aa766cd1 req-f9582214-3e7d-44b4-8a64-2bb436c55e83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.704883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9a43dee1-1846-477c-ac8f-c530aa766cd1 req-f9582214-3e7d-44b4-8a64-2bb436c55e83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.728619 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9a43dee1-1846-477c-ac8f-c530aa766cd1 req-f9582214-3e7d-44b4-8a64-2bb436c55e83 service nova] Creating event network-changed:972750a5-4e56-4ee2-894b-cfb3b0c4ecec for instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 on n-h1-849796-1 Jul 18 02:15:07.738515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9a43dee1-1846-477c-ac8f-c530aa766cd1 req-f9582214-3e7d-44b4-8a64-2bb436c55e83 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082145 Jul 18 02:15:07.741749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 452/839] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:07.756681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-07536bb2-f8d8-4a0d-8ef8-11197072f30d req-a58385e4-5e6e-4b65-b13a-f1432d2b423d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "name": "network-vif-plugged", "status": "completed", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:07.776734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-07536bb2-f8d8-4a0d-8ef8-11197072f30d req-a58385e4-5e6e-4b65-b13a-f1432d2b423d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.778006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-07536bb2-f8d8-4a0d-8ef8-11197072f30d req-a58385e4-5e6e-4b65-b13a-f1432d2b423d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.826558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-07536bb2-f8d8-4a0d-8ef8-11197072f30d req-a58385e4-5e6e-4b65-b13a-f1432d2b423d service nova] Creating event network-vif-plugged:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:15:07.839977 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-07536bb2-f8d8-4a0d-8ef8-11197072f30d req-a58385e4-5e6e-4b65-b13a-f1432d2b423d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095403 Jul 18 02:15:07.841925 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 453/840] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:07.853748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.855990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.863130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:07.871121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.871909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.873340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.874113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.879861 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1dd36953-080d-4d22-9bdb-b030952b8f1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1474 microversion: 2.1 time: 0.224007 Jul 18 02:15:07.883277 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 388/841] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1474 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:07.891245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '.version_select at 0x7fab052dd310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.907237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.908087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.927939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.928717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.953306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ecf3c485-69d5-4aa7-b77e-3e93e9b8e784 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/a37e3150bd9a4fa9b200ab8465a05b24?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964" status: 200 len: 694 microversion: 2.1 time: 0.067968 Jul 18 02:15:07.954407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 389/842] 10.222.0.67 () {58 vars in 1411 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/os-simple-tenant-usage/a37e3150bd9a4fa9b200ab8465a05b24?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964 => generated 694 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:07.963767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:07.964995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:07.979529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.980237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:07.981844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:07.982788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.243276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.254025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85e1b6a5-b58c-4a40-9b2f-04bd685fa4ee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.297640 Jul 18 02:15:08.259619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.263710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 390/843] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.269298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Calling method '.version_select at 0x7fab05294ee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.284263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae0ddd73-91de-48cf-a65c-38bc6a462751 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.439778 Jul 18 02:15:08.285705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 454/844] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:07 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:08.293561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.294642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.297678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.298382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.308903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.309888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.311281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.312510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.322201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.323154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.376301 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd9fc4a4-6aaa-44a7-8d81-46aaa42274e9 tempest-TenantUsagesTestJSON-1827322394 tempest-TenantUsagesTestJSON-1827322394-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964&detailed=1" status: 200 len: 11309 microversion: 2.1 time: 0.111069 Jul 18 02:15:08.377638 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 391/845] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A15%3A05.051964&end=2022-07-19T02%3A15%3A05.051964&detailed=1 => generated 11309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:15:08.400888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.401433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.410360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.411471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.412954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.413630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.447505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:15:08.527905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:08.559311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5277da9-850a-4d92-a8a9-69563f0cadf4 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 204 len: 0 microversion: 2.1 time: 0.162350 Jul 18 02:15:08.560389 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 392/846] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:15:08 2022] DELETE /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:08.574568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.575994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.578465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.588497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.589357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.590267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.590774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.591587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.592051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.593602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b77e56e7-c2a0-4fac-b29d-cda0db09a74b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.306380 Jul 18 02:15:08.594785 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 455/847] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:08.680962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.681750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.695036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.695830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.697433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.698198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.840149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.855107 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aeb80e8a-d898-4dc6-9430-380a2532ba83 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1469 microversion: 2.1 time: 0.288819 Jul 18 02:15:08.856154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 393/848] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:08.870155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.871002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.881708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.882608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.884272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.885247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.902096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:08.910771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-517f6f58-e641-451c-b62d-177b6d8ef739 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.234566 Jul 18 02:15:08.912035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 456/849] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:08.917576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}, {"name": "network-changed", "server_uuid": "71702a75-38fe-4b13-8b34-9db58051c80c", "tag": "d8668635-730d-4538-8908-6957cdbe5067"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:08.929472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.930050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.946098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Creating event network-changed:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h1-849796-1 Jul 18 02:15:08.946710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Creating event network-changed:d8668635-730d-4538-8908-6957cdbe5067 for instance 71702a75-38fe-4b13-8b34-9db58051c80c on n-h2-849796-1 Jul 18 02:15:08.955847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] Instance 5109dafc-983b-4078-b7a0-c80460f551ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:15:08.970431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f88c3b75-25d0-493a-afc7-68933b2542fe req-211a3f60-3c13-44d7-a4cf-5c893df3500d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056388 Jul 18 02:15:08.971155 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 457/850] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:08.978298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:08.979095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:08.986328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.986846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:08.987747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:08.988276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.074317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.086101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a762780-e47a-4584-a0ef-aa6827655c07 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.221915 Jul 18 02:15:09.086902 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 394/851] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.159451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.171804 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10f92ed5-717d-41a2-b91f-766df205950a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1474 microversion: 2.1 time: 0.199273 Jul 18 02:15:09.172654 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 458/852] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:08 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.291250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.294108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.311611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.312869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.313987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.314770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.320184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.321597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.330392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.331387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.333130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.335000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.665446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.682601 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfedd505-2f60-4626-bab8-3391086044a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.382332 Jul 18 02:15:09.685041 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 459/853] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.697039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.700421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.709695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.710449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.711550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.712203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.718334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:09.768118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.787110 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55db8ac9-c0de-4ecc-a002-f9be0a525644 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.509651 Jul 18 02:15:09.788272 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 395/854] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:09.883713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:09.885346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:09.897316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.898087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.899130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:09.899815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:09.928090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:09.983863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.994211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.995783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:09.997071 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcb55282-f91d-4d75-a003-e2df4818d8cc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.310235 Jul 18 02:15:09.997671 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 460/855] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:10.002958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.003890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.013121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.014001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.015019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.015659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.191627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.200887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ecff655b-1dc7-4ce0-838a-734c15e7e69a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.201764 Jul 18 02:15:10.201870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 461/856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:10.216094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.216720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.223467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.224513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.225930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.226841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.381990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.390626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0386989c-a6b8-4b7a-ad91-256228474f97 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.178410 Jul 18 02:15:10.391334 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 462/857] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:10.397422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.398060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.404790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.405338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.406103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.406561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.497629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.510638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c80c44b-b378-4906-86a3-0aac0820480d tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1469 microversion: 2.1 time: 0.631906 Jul 18 02:15:10.511596 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 396/858] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:09 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1469 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:10.593647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.604474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59e01216-143b-42e2-a6a1-c1096dd80454 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1472 microversion: 2.1 time: 0.212014 Jul 18 02:15:10.605242 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 463/859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:10.711691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.713580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.721210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.721836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.723210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.723785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.774268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d831c9e4-d069-4385-89b2-3358f2cb15c7 req-0465eec9-f3d2-43c5-ac42-ca01882f4cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-unplugged", "status": "completed", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:10.791917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d831c9e4-d069-4385-89b2-3358f2cb15c7 req-0465eec9-f3d2-43c5-ac42-ca01882f4cd2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.792698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d831c9e4-d069-4385-89b2-3358f2cb15c7 req-0465eec9-f3d2-43c5-ac42-ca01882f4cd2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.817619 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d831c9e4-d069-4385-89b2-3358f2cb15c7 req-0465eec9-f3d2-43c5-ac42-ca01882f4cd2 service nova] Creating event network-vif-unplugged:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:15:10.828127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d831c9e4-d069-4385-89b2-3358f2cb15c7 req-0465eec9-f3d2-43c5-ac42-ca01882f4cd2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062693 Jul 18 02:15:10.829743 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 464/860] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:15:10.840096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:10.841502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:10.856531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.857494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.859038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:10.860068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:10.917169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:10.932681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9d3dcdc-aa50-47b3-9c18-15bdcb708921 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.226624 Jul 18 02:15:10.934257 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 397/861] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.031924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.033307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.046013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.046863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.048264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.049246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.075011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.087990 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca69fd69-fc9f-4861-b15e-68fddf444dd4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.256421 Jul 18 02:15:11.088603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 465/862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:10 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.218787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.219419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.226537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.226983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.227822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.228276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.264894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.274957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.276574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.277804 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c2b1bac-4af5-4b64-9451-59651e36259e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.253956 Jul 18 02:15:11.278393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 398/863] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:11.386008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.394371 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b440df5-19c6-4bb8-aba1-aed619b57df5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.179616 Jul 18 02:15:11.394978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 466/864] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:11.410516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.411143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.419254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.419710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.420521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.421006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.530617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.531396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.540125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.540724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.541668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.542214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.629423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.639018 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f68584d-2a86-4734-9943-5ab12527d586 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.232416 Jul 18 02:15:11.639623 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 399/865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.647043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.647985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.659937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.661824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.663032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.663567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.792400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.807923 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ace51a7e-a14b-4046-88d3-0d3f42ece02b tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1469 microversion: 2.1 time: 0.281712 Jul 18 02:15:11.809283 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 467/866] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:11.867493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:11.876116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5be72dfd-9c9e-4e79-b4bc-b6918d2b7f7a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1472 microversion: 2.1 time: 0.234321 Jul 18 02:15:11.876722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 400/867] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:11.959877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:11.960762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:11.967770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.968221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:11.969055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:11.969513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.110755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.112009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.123450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.124221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.125518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.126105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.128084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.139368 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e2ae114-a0ab-446e-8ccc-c05aaaa27cbf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.184275 Jul 18 02:15:12.145165 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 468/868] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:11 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:12.306964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.308008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.318953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.320020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.321481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.322201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.377637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.408581 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-849f0319-0a55-40c3-8e49-3410a9e4e762 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.304775 Jul 18 02:15:12.410077 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 401/869] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:12.426063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.428122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.444681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.446032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.447576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.448477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.615233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.626997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.628865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.631385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcbe5ad6-b796-47c3-8780-40fb8679ea8d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.331993 Jul 18 02:15:12.637394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 469/870] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:15:12.668404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.670476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.704546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.709123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.710880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.711682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.916187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:12.944323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4daa034-404e-4b61-84c4-76d2a321c585 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.526677 Jul 18 02:15:12.945563 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 402/871] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:12.964584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:12.965871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:12.990369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:12.997477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:12.999346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.000789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.107263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:13.146806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.157594 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45855098-e752-4b19-bb7f-f24c3b54d657 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.494761 Jul 18 02:15:13.158859 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 470/872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.166291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:13.167210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.186421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.187243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.188723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.189540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.467757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.480629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2211a8b6-5487-44f8-9408-8add7fb7dad1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1469 microversion: 2.1 time: 0.319294 Jul 18 02:15:13.481799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 471/873] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:13 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.487630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:13.488630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.496827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.497398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.498540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.498999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.630054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f52482b2c04420af9511ee80d847ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37e3150bd9a4fa9b200ab8465a05b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.654940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab133dab-d4e9-4683-b48b-8c95e7e16acb tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 200 len: 1469 microversion: 2.1 time: 0.702733 Jul 18 02:15:13.670105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 403/874] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:12 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 1469 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.676252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-49684ac5-9169-4faa-9dc3-fc637aac537e req-29d2f289-b256-43c5-aadd-46b12ceb97f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f872eccd-f3df-47d0-954a-ba2be5d03b34", "name": "network-vif-deleted", "tag": "cb92e3be-ca4f-4c5d-a2c4-fa17627be525"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:13.690351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49684ac5-9169-4faa-9dc3-fc637aac537e req-29d2f289-b256-43c5-aadd-46b12ceb97f0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.690809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49684ac5-9169-4faa-9dc3-fc637aac537e req-29d2f289-b256-43c5-aadd-46b12ceb97f0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.713241 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-49684ac5-9169-4faa-9dc3-fc637aac537e req-29d2f289-b256-43c5-aadd-46b12ceb97f0 service nova] Creating event network-vif-deleted:cb92e3be-ca4f-4c5d-a2c4-fa17627be525 for instance f872eccd-f3df-47d0-954a-ba2be5d03b34 on n-h2-849796-1 Jul 18 02:15:13.719525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-49684ac5-9169-4faa-9dc3-fc637aac537e req-29d2f289-b256-43c5-aadd-46b12ceb97f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047368 Jul 18 02:15:13.721341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 404/875] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:13.727753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:13.729193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.739157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.740563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.742870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.743870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.859606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:13.873909 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-099b7fbc-ff1e-4109-b6d3-6b457f83e2f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.390774 Jul 18 02:15:13.874963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 472/876] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:13 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:13.887781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:13.890685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:13.902885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.903553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:13.904701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:13.905313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.003792 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed13222e-e295-498c-9aaa-9c31738d7aba tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad/action" status: 204 len: 0 microversion: 2.1 time: 0.126970 Jul 18 02:15:14.004774 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 473/877] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:13 2022] POST /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad/action => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:14.011715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.012457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.019462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.021326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.021542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.022328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.236192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.273549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20a6470e-0054-4b8a-bb00-703e6375af10 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.528033 Jul 18 02:15:14.274401 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 405/878] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:13 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:14.282413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7255f712-ad46-4a55-ab62-cbc5d1a7b87b req-30ebee2a-eea4-45bf-a213-49ca7af9a8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-plugged", "status": "completed", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:14.304008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7255f712-ad46-4a55-ab62-cbc5d1a7b87b req-30ebee2a-eea4-45bf-a213-49ca7af9a8cd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.305128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7255f712-ad46-4a55-ab62-cbc5d1a7b87b req-30ebee2a-eea4-45bf-a213-49ca7af9a8cd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.335992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7255f712-ad46-4a55-ab62-cbc5d1a7b87b req-30ebee2a-eea4-45bf-a213-49ca7af9a8cd service nova] Creating event network-vif-plugged:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:15:14.343690 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7255f712-ad46-4a55-ab62-cbc5d1a7b87b req-30ebee2a-eea4-45bf-a213-49ca7af9a8cd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067840 Jul 18 02:15:14.345030 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 406/879] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:14.352375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.353513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.363665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.365186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.366596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.367654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.506842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.516681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.519593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.521573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b0354ab-6690-4317-ba89-398ce92b038e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1410 microversion: 2.25 time: 0.514333 Jul 18 02:15:14.533018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 474/880] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1410 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:15:14.533018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.533018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.538407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.538964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.539916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.540479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.788375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.797351 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9486098e-68a8-449b-bd0d-dcb9fd318167 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.450709 Jul 18 02:15:14.798070 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 407/881] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:14.803046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.804010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.812132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.813225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.814504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.815170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.944081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:14.959696 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c35624a3-a248-43b0-aa5f-66f010c7ca4e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1469 microversion: 2.1 time: 0.435866 Jul 18 02:15:14.970899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 475/882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:14.978521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:14.979344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] [instance: f872eccd-f3df-47d0-954a-ba2be5d03b34] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:14.990485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.992375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:14.993423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:14.995376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.015178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:15.018150 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] HTTP exception thrown: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Request method failure captured: Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 HTTP/1.1 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIFPIgmwqKgfqrBe6OYE-OtfpH-1BkHMGBR_M66ZW3Rll9FkYIBb6PtPy3Hop9zVfFz2dt608q6_okHlaWQV3so44r1DiuO-QuFg7UFFg__Oruep7X7uz2uXtY4rwJnQV-HdzHEJr84S1r_OSJclv5APavXxQfx44qrwthZDNjAiuA Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: a37e3150bd9a4fa9b200ab8465a05b24 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TenantUsagesTestJSON-308728606 Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:15:15.019960 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a37e3150bd9a4fa9b200ab8465a05b24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a37e3150bd9a4fa9b200ab8465a05b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a37e3150bd9a4fa9b200ab8465a05b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a37e3150bd9a4fa9b200ab8465a05b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TenantUsagesTestJSON-308728606 Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: a37e3150bd9a4fa9b200ab8465a05b24 Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TenantUsagesTestJSON-308728606 Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TenantUsagesTestJSON-308728606-project Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 63f52482b2c04420af9511ee80d847ac Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TenantUsagesTestJSON-308728606-project Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. Jul 18 02:15:15.022077 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f872eccd-f3df-47d0-954a-ba2be5d03b34'} Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:15.023032 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. Jul 18 02:15:15.024484 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:15.025875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] Returning 404 to user: Instance f872eccd-f3df-47d0-954a-ba2be5d03b34 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:15.026887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c1441878-a373-4705-aa96-5bc762c69b42 tempest-TenantUsagesTestJSON-308728606 tempest-TenantUsagesTestJSON-308728606-project] 10.222.0.67 "GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34" status: 404 len: 111 microversion: 2.1 time: 0.054496 Jul 18 02:15:15.031874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 476/883] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/f872eccd-f3df-47d0-954a-ba2be5d03b34 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:15.038628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.039525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.047354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:15.049549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.050537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.051774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.053438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.221672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.234696 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7178a6f-a4b2-4031-8947-4e1a9aac65ce tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.435374 Jul 18 02:15:15.239223 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 408/884] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:14 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:15.303038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.306248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.330477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.331266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.332649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.341065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.466217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.479398 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d6f7875-a5b3-4ed5-99b4-7a89d1fa1f71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.445272 Jul 18 02:15:15.491458 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 477/885] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:15.554684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.555866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.578610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.579066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.580153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.580810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.793121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.820269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.823021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.825339 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62db11c9-0bc2-47e3-8f4f-67f4872a5db7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1605 microversion: 2.25 time: 0.286960 Jul 18 02:15:15.826423 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 478/886] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1605 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:15:15.839036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:15.854585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.855236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.865620 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb42ccd0-bbed-4c1d-88fb-fadd1d7f43bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.576192 Jul 18 02:15:15.867001 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 409/887] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:15.878947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:15.879464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:15.885274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.886447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.887820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.888333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.888855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.889246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:15.889820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:15.890489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.021940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2767e7f2-ea6d-4946-a50a-5bc0b415e613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.150193 Jul 18 02:15:16.033456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 410/888] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:15:16.033456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.033880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.046333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.047137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.048839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.050179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.147229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.160820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e7d0225b-d527-4d3d-b9c9-7e6bc7e8537c tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.332691 Jul 18 02:15:16.163375 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 479/889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:15 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:16.263684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.265332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.279665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.279964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.281233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.282021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.514292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.525122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b595dfc4-6b17-465c-bf23-5c470b8c0668 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1469 microversion: 2.1 time: 0.500155 Jul 18 02:15:16.537425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 411/890] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1469 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:16.543667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8281e138-7120-4741-b5f2-9932b98695ea req-56e6ab6a-b1b8-4c9e-80b7-429a7c99b2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71702a75-38fe-4b13-8b34-9db58051c80c", "name": "network-vif-plugged", "status": "completed", "tag": "d8668635-730d-4538-8908-6957cdbe5067"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:16.565597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8281e138-7120-4741-b5f2-9932b98695ea req-56e6ab6a-b1b8-4c9e-80b7-429a7c99b2c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.567986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8281e138-7120-4741-b5f2-9932b98695ea req-56e6ab6a-b1b8-4c9e-80b7-429a7c99b2c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.602748 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8281e138-7120-4741-b5f2-9932b98695ea req-56e6ab6a-b1b8-4c9e-80b7-429a7c99b2c7 service nova] Creating event network-vif-plugged:d8668635-730d-4538-8908-6957cdbe5067 for instance 71702a75-38fe-4b13-8b34-9db58051c80c on n-h2-849796-1 Jul 18 02:15:16.610522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8281e138-7120-4741-b5f2-9932b98695ea req-56e6ab6a-b1b8-4c9e-80b7-429a7c99b2c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071270 Jul 18 02:15:16.611161 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 412/891] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:16.619254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.619963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.628062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.628794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.630233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:16.630652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.631392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.652995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcaae41c-4aba-4282-a83d-2b8eecc83a33 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.403810 Jul 18 02:15:16.656231 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 480/892] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:16.885227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:16.885839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:16.894345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.894797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:16.896375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:16.897278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.105658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:17.119006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a645320e-6025-48c2-8ec2-9c2f76050616 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.239491 Jul 18 02:15:17.132397 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 481/893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:17.185800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:17.187463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:17.200747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.201753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.202907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.203675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.514969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:17.528549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66c1f4eb-135c-4a63-9ab9-c6953ac62ef6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.915705 Jul 18 02:15:17.529765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 413/894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:16 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:17.548337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:17.549734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:17.563482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.566129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:17.568050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:17.569084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.029468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.038913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7975cfe3-8400-4d1a-a6eb-60cf2cebb52d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.859139 Jul 18 02:15:18.039789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 482/895] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:17 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:18.053465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.054367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.062122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.062697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.063813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.064317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.086727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.107570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e33f7f91-5e41-4a54-8e2d-af440af59452 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1461 microversion: 2.1 time: 0.564760 Jul 18 02:15:18.120012 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 414/896] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:17 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1461 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.135397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.136467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.147547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.148324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.150023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.150737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.187648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:18.312887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:18.368734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.377168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f793593a-5873-4a6d-abea-b5834cd8eba7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.328160 Jul 18 02:15:18.387469 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 483/897] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.393149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.394100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.401118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.401731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.402664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.403215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.561471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.570004 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03e7004e-6eca-4d95-8a20-2eb44b1cb3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.180747 Jul 18 02:15:18.570715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 484/898] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.575546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.576152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:18.583075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.584472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.585300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.585735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.604130 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c42a27e-caf0-49eb-8e0f-129e0fe0d7b8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1612 microversion: 2.1 time: 0.475353 Jul 18 02:15:18.609647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 415/899] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1612 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:18.637131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1889a08b-7c53-42d7-b31e-ce263f8ed591 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '.version_select at 0x7fab05969430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:18.640405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1889a08b-7c53-42d7-b31e-ce263f8ed591 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.641523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1889a08b-7c53-42d7-b31e-ce263f8ed591 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.658342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1889a08b-7c53-42d7-b31e-ce263f8ed591 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.030541 Jul 18 02:15:18.658969 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 416/900] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.664901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c7d4f775-607b-468d-8b37-70f484a4ee1c req-29306414-c871-4dd6-b671-decbe4f64b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "name": "network-vif-plugged", "status": "completed", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:18.673760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c7d4f775-607b-468d-8b37-70f484a4ee1c req-29306414-c871-4dd6-b671-decbe4f64b73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:18.674414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c7d4f775-607b-468d-8b37-70f484a4ee1c req-29306414-c871-4dd6-b671-decbe4f64b73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:18.699959 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c7d4f775-607b-468d-8b37-70f484a4ee1c req-29306414-c871-4dd6-b671-decbe4f64b73 service nova] Creating event network-vif-plugged:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h1-849796-1 Jul 18 02:15:18.711478 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c7d4f775-607b-468d-8b37-70f484a4ee1c req-29306414-c871-4dd6-b671-decbe4f64b73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050781 Jul 18 02:15:18.714387 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 417/901] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:18.791041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:18.805531 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-631a2f2d-fa32-4344-b5d8-ffce259dec4b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.233536 Jul 18 02:15:18.807813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 485/902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:18 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:18.876023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-32436555", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:18.944865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:19.056611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.057448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:19.064609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.065204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.066405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.067126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.266725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:19.282035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-82f88237-3ad5-45f8-857e-87aad80d5b34 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1476 microversion: 2.1 time: 0.228947 Jul 18 02:15:19.283553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 486/903] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:19.289674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-93442d06-1e9d-4271-81d2-6c41300b3d9b req-a07b0d5e-2c96-4a56-be07-df52210d104f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:19.300268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-93442d06-1e9d-4271-81d2-6c41300b3d9b req-a07b0d5e-2c96-4a56-be07-df52210d104f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.301297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-93442d06-1e9d-4271-81d2-6c41300b3d9b req-a07b0d5e-2c96-4a56-be07-df52210d104f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.320064 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-93442d06-1e9d-4271-81d2-6c41300b3d9b req-a07b0d5e-2c96-4a56-be07-df52210d104f service nova] Creating event network-changed:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:15:19.333084 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-93442d06-1e9d-4271-81d2-6c41300b3d9b req-a07b0d5e-2c96-4a56-be07-df52210d104f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Jul 18 02:15:19.334570 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 487/904] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:19.397733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.398762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:19.411813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.412274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.413117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.413563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.522088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:19.522676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:19.523173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:19.523594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:19.524124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:19.543269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.543984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.545048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:19.557297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:19.639401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:19.650531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:19.702983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:19.717590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:19.940398 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c35b2fcb-f565-4223-9d29-b1258317452a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069455 Jul 18 02:15:19.971320 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 418/905] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:15:19.982797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:19.984550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:20.034855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.043780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.048221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.049588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.216827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.237157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20b203a3-2cd0-4a4f-b62d-a0bee3907e79 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1332 microversion: 2.1 time: 0.840150 Jul 18 02:15:20.238207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 488/906] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1332 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:20.272487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:20.273205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:20.306557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.307035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.308274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.309375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.560511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.575833 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dbbfd556-c33e-4c57-9fbb-08a1be2ef71c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.602412 Jul 18 02:15:20.576440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 419/907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:19 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:20.588046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a51a526-0565-4e23-9375-83763c42c4a1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:20.588689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a51a526-0565-4e23-9375-83763c42c4a1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:20.684249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a51a526-0565-4e23-9375-83763c42c4a1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.696325 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a51a526-0565-4e23-9375-83763c42c4a1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1211 microversion: 2.1 time: 0.118488 Jul 18 02:15:20.710909 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 420/908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1211 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:20.716282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:20.729925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:20.737061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.737816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.738835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:20.739707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:20.923937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:20.950162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a9940a1-35b3-441c-a10d-ff545f19b66c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.710524 Jul 18 02:15:20.951176 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 489/909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:21.085015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:21.094769 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40e216fc-704a-49d6-8926-a59e4cf656b7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1462 microversion: 2.1 time: 0.382329 Jul 18 02:15:21.099846 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 421/910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1462 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:21.119401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.120824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.131675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.133040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.134507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.136204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.303559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50ec7b05-ce61-486e-a549-a71ae439497f tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.316632 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50ec7b05-ce61-486e-a549-a71ae439497f tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.363971 Jul 18 02:15:21.319087 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 490/911] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:21.329188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.349002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.363226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.367195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.368359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.371898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.517860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:21.528467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4add3884-4470-472c-8bad-b09ee1dee662 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1462 microversion: 2.1 time: 0.415054 Jul 18 02:15:21.531527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 422/912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:21 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1462 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:21.567372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "name": "network-vif-unplugged", "status": "completed", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}, {"name": "network-changed", "server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:21.594095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.594877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.615321 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] Creating event network-vif-unplugged:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h2-849796-1 Jul 18 02:15:21.616471 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] Creating event network-changed:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h2-849796-1 Jul 18 02:15:21.639230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d72158dc-c2d8-4e1a-8e7f-24ab6a6a41c2 req-fb36fbd1-c5ec-45af-978a-8fdbabd57da2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.092270 Jul 18 02:15:21.643905 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 423/913] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:21.652350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:21.652637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:21.655837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.672746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.677670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.681392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.682013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.690079 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76150717-be49-432a-b538-fa91392fafc7 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1535 microversion: 2.1 time: 0.369175 Jul 18 02:15:21.694359 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 491/914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:21 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1535 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:21.707770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:21.709241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:21.724099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.725185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.746439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:21.746910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:21.894090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:21.897948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:21.901553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:21.903121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:21.905598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:21.990444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:22.000292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb67e068-4aba-4cd0-86c9-706d55fd0dfb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.303975 Jul 18 02:15:22.001818 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 492/915] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:21 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:22.009013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc8c219e-bdff-41fe-913d-dbb0e8d682f3 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'create', calling method: .version_select at 0x7fab0597bee0>, body: {"pool": "004947f5-27ae-49b3-adb0-22d85e36f691"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:22.095220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.114810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.114810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.117127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.117970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.202895 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d72c937d-2347-4e6b-bd54-abbe23656e49 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 1066 microversion: 2.1 time: 0.557312 Jul 18 02:15:22.215028 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 424/916] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:21 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 1066 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:15:22.234035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.235229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.272851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.278111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.287868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.289156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.516409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:22.537867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20afefcd-bc07-46b0-9b79-2629e183d11f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1263 microversion: 2.1 time: 0.328996 Jul 18 02:15:22.539255 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 425/917] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1263 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:22.551142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.553512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.596658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.597477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.599875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.600710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.937238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:22.956615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e4f5cae-5516-4b05-9305-83349e06051c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.414904 Jul 18 02:15:22.958612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 426/918] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:22.968384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:22.969598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:22.983512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.984721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:22.986570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:22.987400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.211740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.221865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-953d9a35-809c-4744-b296-65f6b8c9177a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.260404 Jul 18 02:15:23.222512 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 427/919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:22 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:23.236625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2061705341", "imageRef": "67666c60-1d11-4d93-91af-81476bb7de26", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:23.298732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:23.642181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] Request method failure captured: Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 143 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MI44Tr_oUiN5gxksx2rzBM3Rx_IoqkC8XcpBTkL6BJXvrbDlA08-_fAJfHSQsr3H-xOn5xSpqHX6dEgWD2t0dgKPzOqqlC8nG3KwG6eAlKZK_T46__IfYtrnM0y89vfEDtYftfT7MgULa8fRhR8A8iBNfgJ5id_-EdP5pomNb8IeHQ Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8c8d8c5d6ad54f27bf11f636507d54a1 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FlavorsV2NegativeTest-161172736 Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:15:23.646144 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c8d8c5d6ad54f27bf11f636507d54a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c8d8c5d6ad54f27bf11f636507d54a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c8d8c5d6ad54f27bf11f636507d54a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c8d8c5d6ad54f27bf11f636507d54a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FlavorsV2NegativeTest-161172736 Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8c8d8c5d6ad54f27bf11f636507d54a1 Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-161172736 Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FlavorsV2NegativeTest-161172736-project Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c1aa87d2bdfc432bbd3946b2c7aefdd7 Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FlavorsV2NegativeTest-161172736-project Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2061705341", "imageRef": "67666c60-1d11-4d93-91af-81476bb7de26", "flavorRef": "452"}} Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:15:23.647900 n-d-849796-1 devstack@n-api.service[119440]: exception: Flavor's memory is too small for requested image. Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2061705341', 'imageRef': '67666c60-1d11-4d93-91af-81476bb7de26', 'flavorRef': '452'}}} Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:23.648908 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:23.650323 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:23.651920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52748582-2478-46b7-8856-3b390d3eb0bf tempest-FlavorsV2NegativeTest-161172736 tempest-FlavorsV2NegativeTest-161172736-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.424702 Jul 18 02:15:23.655938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 428/920] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:23 2022] POST /compute/v2.1/servers => generated 93 bytes in 433 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:15:23.668003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.669213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:23.681847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.682663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.684379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:23.685163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:23.940199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:23.966434 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fa75d14-c62f-425c-b8fa-9787bc4c6034 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.308812 Jul 18 02:15:23.981275 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 429/921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:23.992023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:23.996315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.009027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.009873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.013117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.014132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.220409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.228948 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8cf2952f-2bc2-4269-8e88-1a2c26263286 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.246105 Jul 18 02:15:24.229554 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 430/922] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:23 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:24.243328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-14a5876e-396b-4920-a867-f8169b983a6f req-1e508c26-56a6-4b71-8afb-8b6f224b1ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6", "name": "network-vif-plugged", "status": "completed", "tag": "972750a5-4e56-4ee2-894b-cfb3b0c4ecec"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:24.248634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:24.260314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-14a5876e-396b-4920-a867-f8169b983a6f req-1e508c26-56a6-4b71-8afb-8b6f224b1ab3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.261143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-14a5876e-396b-4920-a867-f8169b983a6f req-1e508c26-56a6-4b71-8afb-8b6f224b1ab3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.279377 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-14a5876e-396b-4920-a867-f8169b983a6f req-1e508c26-56a6-4b71-8afb-8b6f224b1ab3 service nova] Creating event network-vif-plugged:972750a5-4e56-4ee2-894b-cfb3b0c4ecec for instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 on n-h1-849796-1 Jul 18 02:15:24.286251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-14a5876e-396b-4920-a867-f8169b983a6f req-1e508c26-56a6-4b71-8afb-8b6f224b1ab3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054385 Jul 18 02:15:24.287671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 431/923] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:24.295140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.297489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.305865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.306588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.307768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.308610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.586152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.597706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b916e69-d708-4672-9cd2-fd97e04bd9f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.308338 Jul 18 02:15:24.599345 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 432/924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:24.612131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.613363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.625690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.626463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.628462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.629303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.873295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:24.882792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e332f7d-0a4a-4721-b88d-98185fe8b791 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.281879 Jul 18 02:15:24.884138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 433/925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:24.987210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:24.989637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:24.997069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.997807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:24.999218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:24.999835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.243067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:25.258703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db29023c-6364-493c-949b-1b6b6704098e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.276639 Jul 18 02:15:25.260491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 434/926] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:24 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:25.271404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.272566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.286644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.287486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.289044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.290082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.293290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc8c219e-bdff-41fe-913d-dbb0e8d682f3 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.290324 Jul 18 02:15:25.295081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 493/927] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:25.309925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.135"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:25.312057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.331384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.332229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.334136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:25.338100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.340352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.387265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Acquired lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:15:25.570679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:25.584222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdd6da6a-b7cc-427f-8f9a-550e7d658bb8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.321697 Jul 18 02:15:25.585359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 435/928] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:25.629145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.630715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.645822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.646377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.647272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.647792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.945101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:25.961099 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b866883b-2135-49f3-977d-132a0ee90b93 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.340627 Jul 18 02:15:25.962951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 436/929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:25.975633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:25.977553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:25.991531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.993541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:25.995451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:25.996530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.248861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.260172 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85e2347d-a725-4dc0-8164-191f4aadf6af tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.294830 Jul 18 02:15:26.263189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 437/930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:25 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:26.281139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:26.282384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:26.291216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.291698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.292748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.293538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.527575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:26.546311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ec0d9e6-6274-4627-9133-63737c924b12 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1317 microversion: 2.1 time: 0.271772 Jul 18 02:15:26.584876 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 438/931] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:26 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:26.604736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ee828929-f978-4e0e-87a0-49aa32827788 req-7a0dc405-614b-46f7-bbb5-722eb0e2a518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f707dce1-8fe2-4c49-be3a-a3d720a37bc4", "tag": "a8142dee-d890-46f0-973d-029eece75a69"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:26.626532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ee828929-f978-4e0e-87a0-49aa32827788 req-7a0dc405-614b-46f7-bbb5-722eb0e2a518 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.627443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ee828929-f978-4e0e-87a0-49aa32827788 req-7a0dc405-614b-46f7-bbb5-722eb0e2a518 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.656348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ee828929-f978-4e0e-87a0-49aa32827788 req-7a0dc405-614b-46f7-bbb5-722eb0e2a518 service nova] Creating event network-changed:a8142dee-d890-46f0-973d-029eece75a69 for instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 on n-h2-849796-1 Jul 18 02:15:26.671539 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ee828929-f978-4e0e-87a0-49aa32827788 req-7a0dc405-614b-46f7-bbb5-722eb0e2a518 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084197 Jul 18 02:15:26.674218 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 439/932] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:26.686245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:26.687901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:26.701937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.702747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:26.704808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:26.706220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:27.032039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:27.046053 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33e57a2e-7b85-46d4-bdc6-002a5fd918eb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.369051 Jul 18 02:15:27.060613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 440/933] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:26 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:27.066455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:27.067080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:27.079048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:27.080130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:27.081300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:27.081979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:27.323841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:27.335405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db5cf62e-6407-4f4f-8bbb-9d294ff8104c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.273252 Jul 18 02:15:27.336414 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 441/934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:27 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:27.345940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:27.347092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:27.362266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:27.363120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:27.365885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:27.366682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.022841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:28.045901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-067dd589-8222-4945-89f8-bc666b5d3149 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.706748 Jul 18 02:15:28.047418 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 442/935] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:27 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:28.057398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:28.059123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:28.071731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.072529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.074007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.074793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.137427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:15:28.374806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:28.401085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26c14e8d-8d76-4726-a40a-393286bd9501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1466 microversion: 2.1 time: 0.351249 Jul 18 02:15:28.402766 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 443/936] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:28 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:28.415085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:28.416798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:28.434360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.435570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.437448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.438568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.752422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:28.765177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb10239d-c8e9-4420-b360-8569087938c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.360389 Jul 18 02:15:28.766917 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 444/937] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:28 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:28.773823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:28.774825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:28.783114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.784130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:28.785328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:28.787794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.045557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:29.094326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37b21de5-76dc-4fad-80e6-b49cb3b7183d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.325459 Jul 18 02:15:29.096339 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 445/938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:28 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:29.581490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:29.654704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:29.656743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:29.671214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.681695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.684103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:29.685379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:29.938293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Updating instance_info_cache with network_info: [{"id": "d8668635-730d-4538-8908-6957cdbe5067", "address": "fa:16:3e:ab:1c:cc", "network": {"id": "ba681847-f712-4432-8e9f-9928078c492f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-904604943-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3f824f83a1cd4c5f961d7699eff4dfcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8668635-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:15:29.967389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Releasing lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:15:29.968680 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a81c9c3-638d-4311-9c57-3fbc651c0265 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 202 len: 0 microversion: 2.1 time: 4.665867 Jul 18 02:15:29.969662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 494/939] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:25 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 0 bytes in 4668 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 18 02:15:29.990605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-99d48117-4873-4a73-9eab-e76c882b2eda req-d1e329a0-20ea-4d0a-8aee-2ae2c301cd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71702a75-38fe-4b13-8b34-9db58051c80c", "tag": "d8668635-730d-4538-8908-6957cdbe5067"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:30.010415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-99d48117-4873-4a73-9eab-e76c882b2eda req-d1e329a0-20ea-4d0a-8aee-2ae2c301cd77 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.011213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-99d48117-4873-4a73-9eab-e76c882b2eda req-d1e329a0-20ea-4d0a-8aee-2ae2c301cd77 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.049705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-99d48117-4873-4a73-9eab-e76c882b2eda req-d1e329a0-20ea-4d0a-8aee-2ae2c301cd77 service nova] Creating event network-changed:d8668635-730d-4538-8908-6957cdbe5067 for instance 71702a75-38fe-4b13-8b34-9db58051c80c on n-h2-849796-1 Jul 18 02:15:30.068052 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-99d48117-4873-4a73-9eab-e76c882b2eda req-d1e329a0-20ea-4d0a-8aee-2ae2c301cd77 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093359 Jul 18 02:15:30.075612 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 495/940] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:30.087311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:30.088559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:30.102084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.102966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.104706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.105458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.117822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:30.343448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:30.365108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-454d4e30-5cd9-4f48-9540-a87dca70ed8d tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.287006 Jul 18 02:15:30.379542 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 496/941] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:30 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:30.379542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:30.381191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:30.396368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.397401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.399125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:30.400070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:30.691123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:30.854568 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66bf6d97-890f-4793-a112-ba17cdea71e3 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1617 microversion: 2.1 time: 1.755265 Jul 18 02:15:30.867653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 446/942] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:29 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1617 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:30.878348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c12780b2-ff21-482b-9c9d-e1ca3baa92a6 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'create', calling method: .version_select at 0x7fab050ed9d0>, body: {"pool": "004947f5-27ae-49b3-adb0-22d85e36f691"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:31.134941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:31.165257 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65c91181-37b9-40fc-939b-f6a576306889 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.792519 Jul 18 02:15:31.167733 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 497/943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:30 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:31.217742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:31.220629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:31.241374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:31.247977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:31.250364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:31.251457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:31.721856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:31.731082 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ada5aceb-63ed-40d3-acba-4aa926a3a968 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.561427 Jul 18 02:15:31.736106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 498/944] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:31 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:31.754518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: .version_select at 0x7fab05dad670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-961573640", "policies": ["affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:31.813734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:31.823550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:31.961656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:31.978200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:32.026480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a3c28a6-935f-4114-871f-23fb40990a4d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.287081 Jul 18 02:15:32.034410 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 499/945] 10.222.0.67 () {60 vars in 1173 bytes} [Mon Jul 18 02:15:31 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:32.041483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-71177636-cfa6-4762-aed2-60bb85a42619 req-6a0834a1-2ed7-47c5-a35d-436fe1d36ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "name": "network-vif-unplugged", "status": "completed", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:32.092336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-71177636-cfa6-4762-aed2-60bb85a42619 req-6a0834a1-2ed7-47c5-a35d-436fe1d36ee1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:32.093530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-71177636-cfa6-4762-aed2-60bb85a42619 req-6a0834a1-2ed7-47c5-a35d-436fe1d36ee1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:32.141073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-71177636-cfa6-4762-aed2-60bb85a42619 req-6a0834a1-2ed7-47c5-a35d-436fe1d36ee1 service nova] Creating event network-vif-unplugged:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h2-849796-1 Jul 18 02:15:32.160718 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-71177636-cfa6-4762-aed2-60bb85a42619 req-6a0834a1-2ed7-47c5-a35d-436fe1d36ee1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123497 Jul 18 02:15:32.164656 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 500/946] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:32.189378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:32.191409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:32.215697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:32.249307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:32.261625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:32.264115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:32.624800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:32.640842 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbe26da3-addc-45a0-88af-cb6fb2970219 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.473900 Jul 18 02:15:32.642886 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 501/947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:32 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:32.653486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:32.654936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:32.672352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:32.677041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:32.681048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:32.682404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:32.974309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:32.992051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bd4e2b0-417f-437f-a3a4-f1994f34fccd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.346997 Jul 18 02:15:33.012975 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 502/948] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:32 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:33.053520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1640735102", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fdab30e6-449f-4e7b-a55a-b1470654f76f"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:33.293683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:34.070559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:34.071511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:34.072318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:34.072892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:34.073582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:34.113157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.115218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.116799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.117643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.156727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:34.167193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:34.196201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 2 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:34.201493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:34.279896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119439) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 02:15:34.315118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:34.321677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:34.326018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:34.384470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:34.389817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:34.406301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=76977d61-442a-4ecb-8f99-2573009eda60,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:34.507948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:34.515793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:34.594014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:34.603712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:34.644649 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d8896364-0d97-4b3a-bec7-e556cb4fdff0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.629466 Jul 18 02:15:34.646171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 503/949] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 1632 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:15:34.655826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:34.656515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:34.664496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.665030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.665859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:34.666302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:34.949005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:34.971124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-375df8f4-14d0-49ed-b2b4-7cb811006be5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1502 microversion: 2.1 time: 0.323271 Jul 18 02:15:34.982046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 504/950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:34 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:34.998702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:34.999539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:35.021409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.026361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.028465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.032621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.163412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c12780b2-ff21-482b-9c9d-e1ca3baa92a6 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.304380 Jul 18 02:15:35.164419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 447/951] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:35.169425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:35.170040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:35.183455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.184182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.185406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.197118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.540764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:35.579880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93fdd86b-1908-4729-9816-f3fedeb42b41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.407413 Jul 18 02:15:35.585222 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 448/952] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:35 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:35.595979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:35.606490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:35.607801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Searching by: {'deleted': False, 'project_id': '46ba6d7afda14ac8a41818afb217ab40'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:15:35.670164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.674239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.675676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:35.677641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:35.961252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:15:36.126191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2188d745-d5ca-4c08-85aa-84e5e2c29871 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.538864 Jul 18 02:15:36.128207 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 449/953] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:15:35 2022] GET /compute/v2.1/servers => generated 1004 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.130856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:36.142464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72e6c504-8f65-45c7-87e1-772d8a2a4d4e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 1.158683 Jul 18 02:15:36.144869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.52"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:36.149542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.150533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 505/954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:34 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.160447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5c8d6765-b9f3-431b-b0b1-1325d11a5703 req-dd75045d-8672-4101-a429-709cfbcd96c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f707dce1-8fe2-4c49-be3a-a3d720a37bc4", "name": "network-vif-plugged", "status": "completed", "tag": "a8142dee-d890-46f0-973d-029eece75a69"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:36.180395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.181494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.183369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.184688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.192491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5c8d6765-b9f3-431b-b0b1-1325d11a5703 req-dd75045d-8672-4101-a429-709cfbcd96c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.193093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5c8d6765-b9f3-431b-b0b1-1325d11a5703 req-dd75045d-8672-4101-a429-709cfbcd96c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.211950 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5c8d6765-b9f3-431b-b0b1-1325d11a5703 req-dd75045d-8672-4101-a429-709cfbcd96c0 service nova] Creating event network-vif-plugged:a8142dee-d890-46f0-973d-029eece75a69 for instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 on n-h2-849796-1 Jul 18 02:15:36.218905 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5c8d6765-b9f3-431b-b0b1-1325d11a5703 req-dd75045d-8672-4101-a429-709cfbcd96c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066521 Jul 18 02:15:36.219845 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 506/955] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:36.227975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.229042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.236858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.237742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.239044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.240066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.317101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Acquired lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:15:36.759336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:36.773219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5fb65651-eff6-4b6d-b368-e10876136f31 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1492 microversion: 2.1 time: 0.551205 Jul 18 02:15:36.775149 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 507/956] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1492 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.790792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.791413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.806542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.807663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.808706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.809654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.942285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:36.952690 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dee7fc9d-32d5-4596-922c-89587ddb06a7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1271 microversion: 2.1 time: 0.176188 Jul 18 02:15:36.953679 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 508/957] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:36.969050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:36.970044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:36.977584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.978462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:36.979504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:36.980223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.213229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:37.246571 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b00841c-136a-4d51-891e-6e51ade21f07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1311 microversion: 2.1 time: 0.280946 Jul 18 02:15:37.248044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 509/958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:36 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1311 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:37.256829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de07e4de-3bac-4e33-a31c-13fe970cbfb2 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '.version_select at 0x7fab059a6040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.262354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de07e4de-3bac-4e33-a31c-13fe970cbfb2 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.263610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de07e4de-3bac-4e33-a31c-13fe970cbfb2 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.287218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de07e4de-3bac-4e33-a31c-13fe970cbfb2 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.036364 Jul 18 02:15:37.290045 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 510/959] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:15:37 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:37.302519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.304381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:37.319352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.321149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.323936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.325925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.347710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691.", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:15:37.349556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Releasing lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:15:37.350403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.350403 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Request method failure captured: Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action HTTP/1.1 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 45 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIj7HTDJS02sGro8IRc6N9hNZyz5z34bwOfpWKn9S1bM7GdhLtJssdFMPC4BmHhyGJz6QnTFDdC0wXFPpv8l1MzLde2tVZS51V5QxZ6KHS50FkgoZ9hnFkaQ99L8eu2ewGgyD09ZQJrd99El62VNmOYuxV6x_UIPMjSTRhgIHRIZ48 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:15:37.369130 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d1cc7dd6bef648b48ba02258c37d2eb7 Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: {"addFloatingIp": {"address": "172.25.0.52"}} Jul 18 02:15:37.370796 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '71702a75-38fe-4b13-8b34-9db58051c80c', 'body': {'addFloatingIp': {'address': '172.25.0.52'}}} Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.371683 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:15:37.372949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.374113 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.375239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] Jul 18 02:15:37.376522 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:37.378263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Returning 400 to user: Cannot associate floating IP 172.25.0.52 (8ca9adbf-18e6-487c-a71a-4af2afd44e6d) with port d8668635-730d-4538-8908-6957cdbe5067 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 004947f5-27ae-49b3-adb0-22d85e36f691. Jul 18 02:15:37.378263 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6f61289f-681b-42c8-a45f-a1e6b01a4263'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:37.379589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93d97a50-8f79-4459-a1e7-edd2320e2032 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 400 len: 380 microversion: 2.1 time: 1.248478 Jul 18 02:15:37.380755 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 450/960] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:36 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 380 bytes in 1252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:15:37.385804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.386723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:37.393957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.394410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.395697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:37.396287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:37.568186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32009191-2ac3-4947-b6e4-214b7fc757c5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1643 microversion: 2.1 time: 0.184959 Jul 18 02:15:37.568907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 451/961] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:37 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1643 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:37.575351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7f14f15-4a14-4087-86a5-e3141a301b00 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '.version_select at 0x7fab04a7e310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:37.826250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:37.852583 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01904bf6-6a57-4e68-b3a8-c1971246449e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.557745 Jul 18 02:15:37.865125 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 511/962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:37 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:37.899261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-84123866", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "02468610-b7a9-4f9f-b82b-fcd8322cd0c8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:38.080769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] validate_networks() for [('02468610-b7a9-4f9f-b82b-fcd8322cd0c8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:15:39.523912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7f14f15-4a14-4087-86a5-e3141a301b00 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/8ca9adbf-18e6-487c-a71a-4af2afd44e6d" status: 202 len: 0 microversion: 2.1 time: 1.953397 Jul 18 02:15:39.526246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 452/963] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:15:37 2022] DELETE /compute/v2.1/os-floating-ips/8ca9adbf-18e6-487c-a71a-4af2afd44e6d => generated 0 bytes in 1956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:39.531917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:39.533637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:39.544179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.545534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.546582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.547714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.638473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:39.650392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7dc2d6a8-84be-4673-8c5f-3d3dd1ae6846 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1277 microversion: 2.1 time: 0.122883 Jul 18 02:15:39.651587 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 453/964] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:39 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:39.657167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:39.658059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:39.683123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.683626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:39.684838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:39.685331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.017662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.021677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:40.031576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09ccbd2e-7c5e-435a-b890-3af0a8dc3d78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1461 microversion: 2.1 time: 0.378581 Jul 18 02:15:40.046312 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 454/965] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:39 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1461 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:40.062530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.066654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.090376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.091984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.095360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.097357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.375359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:40.378432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:40.379035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:40.380138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:40.381045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:40.393615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.394259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.395564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.396534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.421114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:15:40.427433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for user d2b97e560fcf4750b2aad92d6d37e611 and project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:15:40.442874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:15:40.445660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:15:40.515370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7f63753-eaea-4b83-aeea-d4e617366ba1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.624993 Jul 18 02:15:40.516464 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 512/966] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:15:40.522374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.135"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:40.544553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.560501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d60901fd-31c7-43e8-8cec-b926c7ecd94a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.520388 Jul 18 02:15:40.561047 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 455/967] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:40.569387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:40.571011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:40.579845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.580875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.582070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:40.583524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:40.700044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:40.710638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:15:40.736016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:15:40.736503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:15:40.736956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:15:40.737378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:15:40.737935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:15:40.982795 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e6d1086-df9e-4c28-b4aa-4f0c787a7ab6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4/action" status: 202 len: 0 microversion: 2.1 time: 0.420067 Jul 18 02:15:40.983754 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 456/968] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:40 2022] POST /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:40.992894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1fadf58-c343-417e-a6ea-86f4071c0e37 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:40.993893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1fadf58-c343-417e-a6ea-86f4071c0e37 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.131488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1fadf58-c343-417e-a6ea-86f4071c0e37 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.147280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1fadf58-c343-417e-a6ea-86f4071c0e37 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1209 microversion: 2.1 time: 0.162135 Jul 18 02:15:41.148252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 457/969] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:40 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.154975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.156196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.166449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.167271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.168384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.169453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.379746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.393538 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9c50ad4-3a86-48cd-babc-a4c08c0c84bb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.243395 Jul 18 02:15:41.397985 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 458/970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.405915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.406256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.420970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.421766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.423607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.424140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.487056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.502767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.505195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.506453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.507025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.725956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:41.755490 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1325c99c-f616-4a82-98ea-c4a532d879b3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1470 microversion: 2.1 time: 0.358425 Jul 18 02:15:41.756650 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 459/971] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:41.762052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:41.763070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:41.770833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.771651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:41.772807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:41.773582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.159480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:42.191421 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b67e8f5-8b57-4a4d-b006-0a2534d20239 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.433165 Jul 18 02:15:42.196292 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 460/972] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:41 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:42.201988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.206211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:42.227121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.227740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.228941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.246754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.538618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Acquired lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:15:42.554852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:42.571455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f0d0aec-f8ce-4375-96ff-5f9d18fc322d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1269 microversion: 2.1 time: 0.372591 Jul 18 02:15:42.584889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 461/973] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1269 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:42.590279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:42.591119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:42.606179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.606745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:42.607820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:42.608457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:43.937385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:43.948177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c623e7c-741c-4dab-9574-3ce59231c77d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 1.361729 Jul 18 02:15:43.949442 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 462/974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:42 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:43.958913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:43.963285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:43.970773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:43.971540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:43.972554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:43.973784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:44.550307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:15:44.947539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:44.963191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48fe80e7-ded5-4492-a7f8-2a00e7e1b7fd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1470 microversion: 2.1 time: 1.012421 Jul 18 02:15:44.963822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 463/975] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:43 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1470 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:45.126200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99d363eb-ba0f-427f-a99f-655abbd01584 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Action: 'create', calling method: .version_select at 0x7fab05297310>, body: {"pool": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:45.778918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:47.292690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Updating instance_info_cache with network_info: [{"id": "d8668635-730d-4538-8908-6957cdbe5067", "address": "fa:16:3e:ab:1c:cc", "network": {"id": "ba681847-f712-4432-8e9f-9928078c492f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-904604943-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3f824f83a1cd4c5f961d7699eff4dfcd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd8668635-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:15:47.321918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Releasing lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:15:47.323439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66d8c369-b054-4808-b848-db796bb46289 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 202 len: 0 microversion: 2.1 time: 6.805746 Jul 18 02:15:47.324831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 513/976] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:40 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 0 bytes in 6807 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:15:47.334184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:47.335135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:47.346711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.348569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.350186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.350834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.597282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:47.609121 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1224d9cc-d121-438f-9e93-c6157ba7896a tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.282195 Jul 18 02:15:47.610564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 514/977] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:47 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:47.617413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:47.618414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:47.633417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.634335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.635549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.636274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.831828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:47.851108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc40cdad-c16e-408e-9abc-de945b22981e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.238695 Jul 18 02:15:47.856184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 515/978] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:47 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:47.860481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-12d3a1c0-eccf-4181-b55e-2e0e906e5004 req-cb9da410-8504-4dd1-a214-9ad3ecf30851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71702a75-38fe-4b13-8b34-9db58051c80c", "tag": "d8668635-730d-4538-8908-6957cdbe5067"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:47.874836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-12d3a1c0-eccf-4181-b55e-2e0e906e5004 req-cb9da410-8504-4dd1-a214-9ad3ecf30851 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.875637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-12d3a1c0-eccf-4181-b55e-2e0e906e5004 req-cb9da410-8504-4dd1-a214-9ad3ecf30851 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.882592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:47.892593 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-12d3a1c0-eccf-4181-b55e-2e0e906e5004 req-cb9da410-8504-4dd1-a214-9ad3ecf30851 service nova] Creating event network-changed:d8668635-730d-4538-8908-6957cdbe5067 for instance 71702a75-38fe-4b13-8b34-9db58051c80c on n-h2-849796-1 Jul 18 02:15:47.907610 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-12d3a1c0-eccf-4181-b55e-2e0e906e5004 req-cb9da410-8504-4dd1-a214-9ad3ecf30851 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050621 Jul 18 02:15:47.908254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 516/979] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:47.916944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:47.918261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:47.927526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.929194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:47.931828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:47.933143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.298277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:48.312675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd3939db-2291-4b33-ab51-b89557f946e8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.402733 Jul 18 02:15:48.323678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 517/980] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:47 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:48.328683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-de9ff6d3-461c-4982-8a1c-baae46325cb3 req-b515f33b-3c4b-4a47-acf2-1a808ba08686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7", "tag": "a1982c76-1f9d-4c92-94d1-0477894aed63"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:48.340439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de9ff6d3-461c-4982-8a1c-baae46325cb3 req-b515f33b-3c4b-4a47-acf2-1a808ba08686 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:48.341144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de9ff6d3-461c-4982-8a1c-baae46325cb3 req-b515f33b-3c4b-4a47-acf2-1a808ba08686 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.359271 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-de9ff6d3-461c-4982-8a1c-baae46325cb3 req-b515f33b-3c4b-4a47-acf2-1a808ba08686 service nova] Creating event network-changed:a1982c76-1f9d-4c92-94d1-0477894aed63 for instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 on n-h1-849796-1 Jul 18 02:15:48.369517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-de9ff6d3-461c-4982-8a1c-baae46325cb3 req-b515f33b-3c4b-4a47-acf2-1a808ba08686 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047195 Jul 18 02:15:48.370685 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 518/981] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:48.377655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:48.381998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:48.400317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:48.401521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.403208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:48.403985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:48.803055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:48.812330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f701433f-f8e0-4f0a-b5b6-40d358de9732 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.440149 Jul 18 02:15:48.823899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 519/982] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:48 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:48.829233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-967d8e0d-4f19-4ac4-aeed-08929cb9ced2 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '.version_select at 0x7fab05767160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.038757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-967d8e0d-4f19-4ac4-aeed-08929cb9ced2 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/ad47f8bf-e7ab-4e9c-8c80-a8587e6a4478" status: 202 len: 0 microversion: 2.1 time: 1.213312 Jul 18 02:15:50.044697 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 520/983] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:15:48 2022] DELETE /compute/v2.1/os-floating-ips/ad47f8bf-e7ab-4e9c-8c80-a8587e6a4478 => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:15:50.049955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.050836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.068398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.069596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.070660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.071264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.293312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:50.299057 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99d363eb-ba0f-427f-a99f-655abbd01584 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.317576 Jul 18 02:15:50.300201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 464/984] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:50.309374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.310288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.315085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f475bf8e-7344-4d7d-b14c-b70e2ba80b41 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.268768 Jul 18 02:15:50.317018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 521/985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:50 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.330431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.330431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.330431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.330431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.342224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.343954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.358447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.359210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.360590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.361368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.408575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.436600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=36 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.523766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:50.524616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:50.536772 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5695a5ae-56c8-451e-8e83-bff0d282bab0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.234588 Jul 18 02:15:50.537965 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 465/986] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:50 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.540643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b967aa1f-83a4-4d11-9475-24152f80aa35 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.206097 Jul 18 02:15:50.548743 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 522/987] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:50 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.549015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:50.549015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.549977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-722acaf5-1611-4904-a138-c846d2d32cb9 req-fa79969d-adaf-4722-b590-695a5a8bb51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76977d61-442a-4ecb-8f99-2573009eda60", "tag": "0e59e343-155c-4163-8a05-e4bd96c2f454"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:50.558271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.559305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.560677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.561475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.568871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-722acaf5-1611-4904-a138-c846d2d32cb9 req-fa79969d-adaf-4722-b590-695a5a8bb51d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.569442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-722acaf5-1611-4904-a138-c846d2d32cb9 req-fa79969d-adaf-4722-b590-695a5a8bb51d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.582748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-722acaf5-1611-4904-a138-c846d2d32cb9 req-fa79969d-adaf-4722-b590-695a5a8bb51d service nova] Creating event network-changed:0e59e343-155c-4163-8a05-e4bd96c2f454 for instance 76977d61-442a-4ecb-8f99-2573009eda60 on n-h1-849796-1 Jul 18 02:15:50.588835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-722acaf5-1611-4904-a138-c846d2d32cb9 req-fa79969d-adaf-4722-b590-695a5a8bb51d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045587 Jul 18 02:15:50.589822 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 523/988] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:50.595009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86311749-5384-4dc7-a37d-dc804849a038 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86311749-5384-4dc7-a37d-dc804849a038 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Request method failure captured: Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action HTTP/1.1 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 34 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIj7HTDJS02sGro8IRc6N9hNZyz5z34bwOfpWKn9S1bM7GdhLtJssdFMPC4BmHhyGJz6QnTFDdC0wXFPpv8l1MzLde2tVZS51V5QxZ6KHS50FkgoZ9hnFkaQ99L8eu2ewGgyD09ZQJrd99El62VNmOYuxV6x_UIPMjSTRhgIHRIZ48 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:15:50.597549 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d1cc7dd6bef648b48ba02258c37d2eb7 Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: {"addFloatingIp": {"address": ""}} Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:15:50.600459 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '71702a75-38fe-4b13-8b34-9db58051c80c', 'body': {'addFloatingIp': {'address': ''}}} Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '' Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:50.602385 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:15:50.607661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86311749-5384-4dc7-a37d-dc804849a038 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86311749-5384-4dc7-a37d-dc804849a038 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 400 len: 142 microversion: 2.1 time: 0.008983 Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 524/989] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:50 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 142 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:15:50.611000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-116d9aa1-2b4b-4e79-a66b-221b60045999 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Action: 'create', calling method: .version_select at 0x7fab057e0dc0>, body: {"pool": null} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:50.744191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:50.753746 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-588a923d-aaef-47d8-b30c-60e88a8ece38 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.214149 Jul 18 02:15:50.757179 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 466/990] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:50 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.765818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1fdaa408-898f-4153-9ca4-eaa2e90134c7 req-5810660c-0f0d-4688-8770-da3b013ea149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:50.780422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1fdaa408-898f-4153-9ca4-eaa2e90134c7 req-5810660c-0f0d-4688-8770-da3b013ea149 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.781353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1fdaa408-898f-4153-9ca4-eaa2e90134c7 req-5810660c-0f0d-4688-8770-da3b013ea149 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.804661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1fdaa408-898f-4153-9ca4-eaa2e90134c7 req-5810660c-0f0d-4688-8770-da3b013ea149 service nova] Creating event network-changed:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h2-849796-1 Jul 18 02:15:50.814268 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1fdaa408-898f-4153-9ca4-eaa2e90134c7 req-5810660c-0f0d-4688-8770-da3b013ea149 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054803 Jul 18 02:15:50.815228 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 467/991] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:50.825861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:50.828203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:50.841104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.841936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.843378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:50.844125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:50.894486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Acquired lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:15:51.049549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Releasing lock "refresh_cache-71702a75-38fe-4b13-8b34-9db58051c80c" {{(pid=119440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:15:51.050628 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] HTTP exception thrown: floating IP not found Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Request method failure captured: Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action HTTP/1.1 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 41 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIj7HTDJS02sGro8IRc6N9hNZyz5z34bwOfpWKn9S1bM7GdhLtJssdFMPC4BmHhyGJz6QnTFDdC0wXFPpv8l1MzLde2tVZS51V5QxZ6KHS50FkgoZ9hnFkaQ99L8eu2ewGgyD09ZQJrd99El62VNmOYuxV6x_UIPMjSTRhgIHRIZ48 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:15:51.053406 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d1cc7dd6bef648b48ba02258c37d2eb7 Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: exception: floating IP not found Jul 18 02:15:51.056114 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '71702a75-38fe-4b13-8b34-9db58051c80c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:51.061774 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 18 02:15:51.064633 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.069112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Returning 404 to user: floating IP not found {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:51.069112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-151fa282-1aa3-473c-a81e-abb40a741533 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 404 len: 67 microversion: 2.1 time: 0.238895 Jul 18 02:15:51.069112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 468/992] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:50 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 67 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:15:51.072671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f76a8185-802e-428b-88c5-f9cd986475c1 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:51.138399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.143867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f76a8185-802e-428b-88c5-f9cd986475c1 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f76a8185-802e-428b-88c5-f9cd986475c1 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Request method failure captured: Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action HTTP/1.1 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 44 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIj7HTDJS02sGro8IRc6N9hNZyz5z34bwOfpWKn9S1bM7GdhLtJssdFMPC4BmHhyGJz6QnTFDdC0wXFPpv8l1MzLde2tVZS51V5QxZ6KHS50FkgoZ9hnFkaQ99L8eu2ewGgyD09ZQJrd99El62VNmOYuxV6x_UIPMjSTRhgIHRIZ48 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:15:51.147740 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d1cc7dd6bef648b48ba02258c37d2eb7 Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:15:51.150096 n-d-849796-1 devstack@n-api.service[119440]: exception: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '71702a75-38fe-4b13-8b34-9db58051c80c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:51.152109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 18 02:15:51.155742 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:15:51.158806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f76a8185-802e-428b-88c5-f9cd986475c1 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:51.158806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f76a8185-802e-428b-88c5-f9cd986475c1 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action" status: 404 len: 88 microversion: 2.1 time: 0.085220 Jul 18 02:15:51.158806 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 469/993] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:15:51 2022] POST /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c/action => generated 88 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:15:51.166752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.167654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.182817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.183642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.185504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.186323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.236692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:15:51.368507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a315ee17-d7a0-4204-a370-b80da1737bbf tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "DELETE /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 204 len: 0 microversion: 2.1 time: 0.208787 Jul 18 02:15:51.375061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 470/994] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:15:51 2022] DELETE /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:51.378137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.380244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.387661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.388300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.389395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.389994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.642598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:51.658541 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60067844-10cb-4bc5-83a9-fb20181db404 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.286647 Jul 18 02:15:51.660774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 471/995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.671053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.672266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.685060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.686176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.687289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.688026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.717194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.899600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:51.915919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc4a455b-2b32-4844-a5b7-4839f0113871 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1541 microversion: 2.1 time: 0.252480 Jul 18 02:15:51.917017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 472/996] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.927901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:51.929833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:51.942630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.943542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:51.946075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:51.946924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.151830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:52.167815 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38152d15-94ab-430e-8701-d9dc3061da85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.248310 Jul 18 02:15:52.171463 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 473/997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:51 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.181606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.182767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.200169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.200872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.202332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.203124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.419917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:52.436891 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8e68578-0387-40e0-af5a-053ac41cafc3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.263256 Jul 18 02:15:52.437854 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 474/998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.447613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.449383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.462033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.462835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.464330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.465115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.716495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:52.728669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-116d9aa1-2b4b-4e79-a66b-221b60045999 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.126851 Jul 18 02:15:52.731584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0b87c9c-ff4c-466c-bce1-a319dad70f89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.291416 Jul 18 02:15:52.737933 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 475/999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.737933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.738812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.739155 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 525/1000] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:52.745966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.746478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.747273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.747713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.748359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.749799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.761902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.762858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.764436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.765387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.784774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:15:52.940111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:52.951608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94fdd2fd-722f-4977-b236-f99db2d6e4c9 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 204 len: 0 microversion: 2.1 time: 0.216858 Jul 18 02:15:52.952728 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 476/1001] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:15:52 2022] DELETE /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:52.963238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4aacbe95-336f-494e-8d96-6a7b8debde21 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Action: 'create', calling method: .version_select at 0x7fab04a84b80>, body: {"pool": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:52.964099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:52.972624 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef4fb4ec-6442-4a01-8c8a-05163f14d098 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.231931 Jul 18 02:15:52.973809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 526/1002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:52.978677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:52.979299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:52.982763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:52.987729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.988186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:52.989781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:52.990231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.206510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.217862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5865b3a1-7f77-4837-ae3f-c88d5796b12b tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1541 microversion: 2.1 time: 0.242717 Jul 18 02:15:53.219199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 527/1003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:52 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.249729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.253000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:53.268553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.271280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.273245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.275143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.532488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.548490 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c91db2a6-6309-4c14-92da-f710d0b72bdc tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1710 microversion: 2.1 time: 0.313362 Jul 18 02:15:53.549868 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 528/1004] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1710 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.559701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.561456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:53.576018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.578561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.580560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.582608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.791195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:53.803097 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49b86c80-74c3-4507-b4f4-039a5c671278 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.250750 Jul 18 02:15:53.804446 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 529/1005] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:53.814153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:53.815375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:53.826840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.827400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:53.828287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:53.828801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.154138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:54.173255 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce427225-6a84-41a1-94dd-dee36586e710 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.366659 Jul 18 02:15:54.175355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 530/1006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:53 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.186486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.188195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:54.199457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.200382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.201972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.203114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.580786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:54.609749 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d4ce9e9-eb54-49bb-93c6-1cbdd1373922 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.431783 Jul 18 02:15:54.610728 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 531/1007] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.615760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.628033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:54.646294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.647073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.648070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:54.648692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:54.961048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:54.976857 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7df4e5e1-862c-4cbb-beb4-3c6b8ad4a6b9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.364933 Jul 18 02:15:54.977952 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 532/1008] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.987230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:54.990978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:55.000764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.001416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.002379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.002978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.266397 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4aacbe95-336f-494e-8d96-6a7b8debde21 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.311213 Jul 18 02:15:55.274976 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 477/1009] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:55.278082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-da752987-bc08-48c5-9c99-cf195d17909d req-fe50de67-78b9-443c-b678-fc2a0afb207b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7", "name": "network-vif-plugged", "status": "completed", "tag": "a1982c76-1f9d-4c92-94d1-0477894aed63"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:55.310703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da752987-bc08-48c5-9c99-cf195d17909d req-fe50de67-78b9-443c-b678-fc2a0afb207b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.312109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da752987-bc08-48c5-9c99-cf195d17909d req-fe50de67-78b9-443c-b678-fc2a0afb207b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.336095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-da752987-bc08-48c5-9c99-cf195d17909d req-fe50de67-78b9-443c-b678-fc2a0afb207b service nova] Creating event network-vif-plugged:a1982c76-1f9d-4c92-94d1-0477894aed63 for instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 on n-h1-849796-1 Jul 18 02:15:55.346499 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-da752987-bc08-48c5-9c99-cf195d17909d req-fe50de67-78b9-443c-b678-fc2a0afb207b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076427 Jul 18 02:15:55.348618 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 478/1010] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:55.356709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:55.358501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:55.377018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.377780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.379625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.380366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.380652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cc7dd6bef648b48ba02258c37d2eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f824f83a1cd4c5f961d7699eff4dfcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:55.399732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e7e41879-883e-4dcd-8a66-aacdc89f16a8 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 200 len: 1541 microversion: 2.1 time: 0.419754 Jul 18 02:15:55.402299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 533/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:54 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 1541 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.413322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:55.414870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:55.449460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.451550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.452967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.453734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.898848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:55.915599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02f9e1e3-fb17-4d66-a132-88a4eb58c416 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.511428 Jul 18 02:15:55.916599 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 534/1012] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:55.926396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:55.928663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:55.939122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.940149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.941052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:55.942304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:55.971699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:56.005634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e229202-6232-41e4-949d-44e020d56aa7 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1710 microversion: 2.1 time: 0.653486 Jul 18 02:15:56.012701 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 479/1013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1710 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:56.021607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7527d55a-1e44-4111-919e-142b169e9603 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Action: 'create', calling method: .version_select at 0x7fab04996670>, body: {"pool": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:56.147576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:56.164322 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45080972-ed0f-4357-b40b-240ed396c2f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1319 microversion: 2.1 time: 0.245043 Jul 18 02:15:56.165102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 535/1014] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:55 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:56.173109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b86b2f35-6faf-407a-8047-381f2084b089 req-7c9a5887-b12b-4314-99f8-32ec56f5bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71702a75-38fe-4b13-8b34-9db58051c80c", "name": "network-vif-deleted", "tag": "d8668635-730d-4538-8908-6957cdbe5067"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:56.184144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b86b2f35-6faf-407a-8047-381f2084b089 req-7c9a5887-b12b-4314-99f8-32ec56f5bf67 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.184605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b86b2f35-6faf-407a-8047-381f2084b089 req-7c9a5887-b12b-4314-99f8-32ec56f5bf67 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.201324 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b86b2f35-6faf-407a-8047-381f2084b089 req-7c9a5887-b12b-4314-99f8-32ec56f5bf67 service nova] Creating event network-vif-deleted:d8668635-730d-4538-8908-6957cdbe5067 for instance 71702a75-38fe-4b13-8b34-9db58051c80c on n-h2-849796-1 Jul 18 02:15:56.208243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b86b2f35-6faf-407a-8047-381f2084b089 req-7c9a5887-b12b-4314-99f8-32ec56f5bf67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040968 Jul 18 02:15:56.209110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 536/1015] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:56.221264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.223475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.235814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.236742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.238279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.239083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.413056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:56.425059 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46d08cb7-f345-4814-9f26-a26bf77f5a99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.212130 Jul 18 02:15:56.437774 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 537/1016] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:56 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:56.444654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.445696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.454799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.455354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.456286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.456807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.501598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:56.744830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:56.753172 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e9193b8-d602-4112-8a9a-e6496475a522 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.312856 Jul 18 02:15:56.753884 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 538/1017] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:56 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:56.759530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.760159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] [instance: 71702a75-38fe-4b13-8b34-9db58051c80c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.767605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.768074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.768968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.770800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.789174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] HTTP exception thrown: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Request method failure captured: Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c HTTP/1.1 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIj7HTDJS02sGro8IRc6N9hNZyz5z34bwOfpWKn9S1bM7GdhLtJssdFMPC4BmHhyGJz6QnTFDdC0wXFPpv8l1MzLde2tVZS51V5QxZ6KHS50FkgoZ9hnFkaQ99L8eu2ewGgyD09ZQJrd99El62VNmOYuxV6x_UIPMjSTRhgIHRIZ48 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:15:56.790926 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3f824f83a1cd4c5f961d7699eff4dfcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 3f824f83a1cd4c5f961d7699eff4dfcd Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510 Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d1cc7dd6bef648b48ba02258c37d2eb7 Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. Jul 18 02:15:56.792580 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '71702a75-38fe-4b13-8b34-9db58051c80c'} Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:15:56.793480 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. Jul 18 02:15:56.795002 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:15:56.798573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] Returning 404 to user: Instance 71702a75-38fe-4b13-8b34-9db58051c80c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:15:56.800171 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9211a634-6827-4f15-b64a-1bbf84523641 tempest-FloatingIPsAssociationNegativeTestJSON-585574510 tempest-FloatingIPsAssociationNegativeTestJSON-585574510-project] 10.222.0.67 "GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c" status: 404 len: 111 microversion: 2.1 time: 0.044803 Jul 18 02:15:56.801642 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 539/1018] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:56 2022] GET /compute/v2.1/servers/71702a75-38fe-4b13-8b34-9db58051c80c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:56.943311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:56.943949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:56.952480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.953629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:56.956256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:56.960651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:57.374318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:57.389576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-56121349-1095-4752-9e59-0618161e3447 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.451342 Jul 18 02:15:57.391270 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 540/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:56 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:57.397902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:57.398930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:57.408990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.408990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:57.410932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.411985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:57.758538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:57.788185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-afb9b929-d804-4ab7-aff6-c028b99c86b0 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1710 microversion: 2.1 time: 0.395237 Jul 18 02:15:57.810699 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 541/1020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:57 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1710 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:57.824990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:57.827175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:57.837175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.837955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:57.838816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:57.839262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.088253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:58.104308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9061da7-d173-447f-9e3a-6caea0df2d7c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1468 microversion: 2.1 time: 0.286596 Jul 18 02:15:58.105782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 542/1021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:57 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:58.115719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.117203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.131942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.133314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.135168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.136050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.760471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:58.779169 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-120a51f9-5241-4a4e-a628-e6b15e54a31d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.671361 Jul 18 02:15:58.780333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 543/1022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:58.787721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-95d48efa-8fb6-43a7-be9c-35ab75ec6978 req-8d39003a-02d7-431f-8138-8ca461777625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "name": "network-vif-plugged", "status": "completed", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:58.805337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-95d48efa-8fb6-43a7-be9c-35ab75ec6978 req-8d39003a-02d7-431f-8138-8ca461777625 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.806239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-95d48efa-8fb6-43a7-be9c-35ab75ec6978 req-8d39003a-02d7-431f-8138-8ca461777625 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.821114 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-95d48efa-8fb6-43a7-be9c-35ab75ec6978 req-8d39003a-02d7-431f-8138-8ca461777625 service nova] Creating event network-vif-plugged:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h2-849796-1 Jul 18 02:15:58.827744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-95d48efa-8fb6-43a7-be9c-35ab75ec6978 req-8d39003a-02d7-431f-8138-8ca461777625 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045783 Jul 18 02:15:58.831237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 544/1023] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:58.837941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.838832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.851583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.852768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.854780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.855868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.892976 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7527d55a-1e44-4111-919e-142b169e9603 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.877293 Jul 18 02:15:58.903791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 480/1024] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:15:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:58.909728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:58.916395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:58.940782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.942584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:58.944289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:58.945761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.259501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.282107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.296277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-522019dd-21cd-4eed-b99a-a136ad3ba83c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1319 microversion: 2.1 time: 0.397655 Jul 18 02:15:59.298796 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 481/1025] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.311381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.313539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.326720 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a351d2ba-733f-4eb0-a95e-0e6a308959e5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.492813 Jul 18 02:15:59.328007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.329618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.337874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 545/1026] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:58 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.339468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.342106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.342814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.342979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.368645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.368645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.368645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.369357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.472405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f728feedf3481e9495821fbd27813a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26519510f3bf4d98814641c3f445ee9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.485588 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3eab8d3-efd7-44ec-bbad-074d962706ae tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 200 len: 1643 microversion: 2.1 time: 0.151346 Jul 18 02:15:59.496168 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 546/1027] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 1643 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.496168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9755a09-c606-4c07-a5de-703c6fa0d7f1 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab05767af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.729190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:15:59.739797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b361f148-2b92-4def-ba97-0ce88086c088 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1309 microversion: 2.1 time: 0.436115 Jul 18 02:15:59.750198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 482/1028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.756363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9fc792a3-3825-4b90-b7b8-4caffc9885a4 req-a950fa0a-ecf8-42d7-9600-b3ff9f922fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93532a39-fba4-486b-aa2f-3f18982ced7b", "name": "network-vif-deleted", "tag": "1ebcb07e-7fb3-42df-86e9-7497e0127b3d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:15:59.766186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9fc792a3-3825-4b90-b7b8-4caffc9885a4 req-a950fa0a-ecf8-42d7-9600-b3ff9f922fe7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.766937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9fc792a3-3825-4b90-b7b8-4caffc9885a4 req-a950fa0a-ecf8-42d7-9600-b3ff9f922fe7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.789258 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9fc792a3-3825-4b90-b7b8-4caffc9885a4 req-a950fa0a-ecf8-42d7-9600-b3ff9f922fe7 service nova] Creating event network-vif-deleted:1ebcb07e-7fb3-42df-86e9-7497e0127b3d for instance 93532a39-fba4-486b-aa2f-3f18982ced7b on n-h1-849796-1 Jul 18 02:15:59.803325 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9fc792a3-3825-4b90-b7b8-4caffc9885a4 req-a950fa0a-ecf8-42d7-9600-b3ff9f922fe7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051404 Jul 18 02:15:59.804421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 483/1029] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:59.815691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:15:59.816740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:15:59.829566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.830308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.833620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:15:59.834200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:15:59.835857 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f9755a09-c606-4c07-a5de-703c6fa0d7f1 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/1fd22947-fafd-40ba-9e31-6ff525ce99e8" status: 200 len: 141 microversion: 2.1 time: 0.347985 Jul 18 02:15:59.842421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 547/1030] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/os-floating-ips/1fd22947-fafd-40ba-9e31-6ff525ce99e8 => generated 141 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:15:59.851227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a20d2808-12a6-4719-bc73-6025f9fbb022 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab05742e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.017036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.029669 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7337be0c-b2b3-49db-aac6-1b79acc46070 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.218722 Jul 18 02:16:00.031070 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 484/1031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:15:59 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:00.327695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.328499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:00.336636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.337284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.338470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.338757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.554921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:00.576565 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b777a514-67ef-4241-8c16-756b920298e4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1319 microversion: 2.1 time: 0.252219 Jul 18 02:16:00.578248 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 485/1032] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:00.591134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:00.592786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:00.609611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.611106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:00.613066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:00.616223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.025769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.037027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc94de8f-2708-45af-a0ba-eccaaf18ca3e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.456690 Jul 18 02:16:01.045408 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 486/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:00 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.062952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.063624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.097339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.105189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.108786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.114802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.157942 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b HTTP/1.1 Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:16:01.164308 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:01.167163 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '93532a39-fba4-486b-aa2f-3f18982ced7b'} Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:01.168832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:01.171781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.177706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:01.179461 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1444130-f3f3-4b52-8cdc-92fb082b4be8 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 404 len: 111 microversion: 2.1 time: 0.128214 Jul 18 02:16:01.180887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 487/1034] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:01.190669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.192623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.206159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.206718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.208074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.208524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.340087 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a20d2808-12a6-4719-bc73-6025f9fbb022 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/1fd22947-fafd-40ba-9e31-6ff525ce99e8" status: 202 len: 0 microversion: 2.1 time: 1.494988 Jul 18 02:16:01.341605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 548/1035] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:15:59 2022] DELETE /compute/v2.1/os-floating-ips/1fd22947-fafd-40ba-9e31-6ff525ce99e8 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:01.348307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e90fda1a-d70e-4987-a6ce-a2d37f5f8bf8 req-2dcf5dad-264a-47dd-ac13-d6438893826d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76977d61-442a-4ecb-8f99-2573009eda60", "name": "network-vif-plugged", "status": "completed", "tag": "0e59e343-155c-4163-8a05-e4bd96c2f454"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:01.376859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e90fda1a-d70e-4987-a6ce-a2d37f5f8bf8 req-2dcf5dad-264a-47dd-ac13-d6438893826d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.377980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e90fda1a-d70e-4987-a6ce-a2d37f5f8bf8 req-2dcf5dad-264a-47dd-ac13-d6438893826d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.399615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e90fda1a-d70e-4987-a6ce-a2d37f5f8bf8 req-2dcf5dad-264a-47dd-ac13-d6438893826d service nova] Creating event network-vif-plugged:0e59e343-155c-4163-8a05-e4bd96c2f454 for instance 76977d61-442a-4ecb-8f99-2573009eda60 on n-h1-849796-1 Jul 18 02:16:01.409231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.412384 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e90fda1a-d70e-4987-a6ce-a2d37f5f8bf8 req-2dcf5dad-264a-47dd-ac13-d6438893826d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068633 Jul 18 02:16:01.418023 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 549/1036] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:01.422411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a204641-f615-446d-a5fd-cb1c410ed014 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1491 microversion: 2.1 time: 0.235488 Jul 18 02:16:01.434727 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 488/1037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1491 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.434727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.436783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.447395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.453057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.453528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.454409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.454612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.454859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.469878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.470948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.473174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.474163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.487208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb HTTP/1.1 Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:16:01.490425 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.491991 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '4f9eaca4-4373-41ba-9017-7cb68dca58fb'} Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:01.492974 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.494413 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.500708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:01.501946 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdefc4f0-9c2f-4337-8adc-7658b5c4d57e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 404 len: 111 microversion: 2.1 time: 0.077903 Jul 18 02:16:01.506738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 489/1038] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:01 2022] DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:01.512419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a59627aa-4b4d-4799-b713-3f3acf4567af tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab0497fe50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.722300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:01.732670 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4166b787-fcb0-4253-816f-8d27764770dd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.312480 Jul 18 02:16:01.733631 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 550/1039] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.738249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.739623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.747373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.747973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.748844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.749412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.917323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c7f5cd5-dba0-413b-9ea3-87a5b20064b6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1642 microversion: 2.1 time: 0.179298 Jul 18 02:16:01.923000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 551/1040] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1642 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:01.937548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.941778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.951740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.952279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a59627aa-4b4d-4799-b713-3f3acf4567af tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.443374 Jul 18 02:16:01.952824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.954579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:01.954937 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 490/1041] 10.222.0.67 () {58 vars in 1163 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:16:01.955988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:01.966128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:01.967748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:01.982344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb HTTP/1.1 Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:01.984154 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.994467 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '4f9eaca4-4373-41ba-9017-7cb68dca58fb'} Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:01.996090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:01.998991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:02.001027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:02.001027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6e0e78c-1584-4876-8a07-d8d218cf1add tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 404 len: 111 microversion: 2.1 time: 0.060329 Jul 18 02:16:02.001027 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 552/1042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:02.001027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.001027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.002514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.003246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.003438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.004423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.004769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.005493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.006163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.007090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.180772 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8df61a53-59c5-412e-97ff-610fe93e24bd tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1642 microversion: 2.1 time: 0.192681 Jul 18 02:16:02.181439 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 553/1043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1642 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.186841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-332cab0d-d677-42c4-ac8c-a92b40a2278b tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab057e0430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.330582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:02.341985 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eaaba00b-965f-4dc5-8caf-4b80be714df4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1319 microversion: 2.1 time: 0.384665 Jul 18 02:16:02.342752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 491/1044] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:01 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.348301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3700c04d-f876-4a4b-8755-e2f159736cfa tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '.version_select at 0x7fab04a26280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.378311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3700c04d-f876-4a4b-8755-e2f159736cfa tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660151589" status: 202 len: 0 microversion: 2.1 time: 0.033926 Jul 18 02:16:02.380250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 492/1045] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:16:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660151589 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:02.389812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.389812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.393118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.393915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.395014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.395730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.546859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-332cab0d-d677-42c4-ac8c-a92b40a2278b tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.363850 Jul 18 02:16:02.548522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 554/1046] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:02.557549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.560456 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:02.560456 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:16:02.562473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.563432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.565372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.567457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.624577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-77408cc9-3acf-41b8-8f17-c0c7221e9d68 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073895 Jul 18 02:16:02.625611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 555/1047] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:02.632292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b24e02f-402c-4e6f-9205-7a1292cd53ff tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab05742790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.639407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:02.652352 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-847b1e28-51a6-445a-8d78-7bfc5179932f tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.271596 Jul 18 02:16:02.653055 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 493/1048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.665395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:02.665962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.673567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.674439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.675726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.676601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.704029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.792687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af8aa0fc-f8ed-4e1d-9735-d51454ddabc7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4/action" status: 202 len: 0 microversion: 2.1 time: 0.134028 Jul 18 02:16:02.797154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 494/1049] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:02 2022] POST /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:02.819768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:02.819768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:02.828756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.829690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:02.831502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:02.832889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.224817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.235460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-807b57c5-5db3-4538-be6c-139dd70f6f4b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.436527 Jul 18 02:16:03.236145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 495/1050] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:02 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:03.243532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.244499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:03.251350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.252425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.253503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.254671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.517501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20d19f3c-cf33-44b3-8190-368bb53a7eed tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1647 microversion: 2.1 time: 0.279193 Jul 18 02:16:03.518652 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 496/1051] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1647 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:03.528541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.529199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:03.538654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.539844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.541238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.541831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.932721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:03.942613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd9a5bd1-d4b7-4b8a-8235-3b490c0ff353 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1319 microversion: 2.1 time: 0.423431 Jul 18 02:16:03.948700 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 497/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:03.949253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:03.950687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:03.962095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.962863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:03.964291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:03.965422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.206741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:04.220720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b53e8181-5b0c-4f4f-b43b-362c438eddff tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1471 microversion: 2.1 time: 0.275561 Jul 18 02:16:04.221722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 498/1053] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:03 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.232175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ea342c2-9df1-4c11-b9a3-e975a3a4c626 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.234439 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:04.234439 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:16:04.267154 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ea342c2-9df1-4c11-b9a3-e975a3a4c626 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1014338745" status: 202 len: 0 microversion: 2.1 time: 0.043117 Jul 18 02:16:04.274383 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 499/1054] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:16:04 2022] DELETE /compute/v2.1/flavors/1014338745 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:04.279797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.280080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.289476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.290071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.291171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.291983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.491805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:04.500815 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96a7e05f-f5b4-4a3b-bf5b-fa7b77ee0ec1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.226734 Jul 18 02:16:04.508880 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 500/1055] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:04 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.508880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-23f5ba4c-467a-4478-a3a8-ad1f582d9a3f tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.528948 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-23f5ba4c-467a-4478-a3a8-ad1f582d9a3f tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.025651 Jul 18 02:16:04.530027 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 501/1056] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:16:04 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.552100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.553449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.582647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.582647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.582647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.582647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.745235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b24e02f-402c-4e6f-9205-7a1292cd53ff tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/0f8accee-2737-441b-96fa-b90c09a72cea" status: 202 len: 0 microversion: 2.1 time: 2.117778 Jul 18 02:16:04.751103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 556/1057] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:02 2022] DELETE /compute/v2.1/os-floating-ips/0f8accee-2737-441b-96fa-b90c09a72cea => generated 0 bytes in 2120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:04.758041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e067838d-eb8f-4b49-8fc3-960f89c4472e tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.759313 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:04.759313 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:16:04.788123 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e067838d-eb8f-4b49-8fc3-960f89c4472e tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/875054882" status: 202 len: 0 microversion: 2.1 time: 0.040348 Jul 18 02:16:04.789513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 557/1058] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:16:04 2022] DELETE /compute/v2.1/flavors/875054882 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:04.797968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a412dacf-e392-449b-b052-80e010335389 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab05cb2dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.829068 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad954930-a90a-431f-93f0-85ec73ca4b62 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1627 microversion: 2.1 time: 0.282408 Jul 18 02:16:04.829976 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 502/1059] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:04 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1627 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:04.841678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41cc7fea-ac39-4792-bb23-95a72ed35282 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:04.869873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41cc7fea-ac39-4792-bb23-95a72ed35282 tempest-ServersWithSpecificFlavorTestJSON-1362361211 tempest-ServersWithSpecificFlavorTestJSON-1362361211-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038154 Jul 18 02:16:04.870497 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 503/1060] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:16:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.875167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-849796-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:04.876325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:04.896292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.896292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.896292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:04.896292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:04.953998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lazy-loading 'flavor' on Instance uuid 4ef48022-cee6-4b7e-b266-50eff1f1afc4 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:04.981611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Going to try to live migrate instance to n-h1-849796-1 {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:16:06.045527 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a412dacf-e392-449b-b052-80e010335389 tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/8cb2919d-b9da-4937-a7b1-e35c7876d5f4" status: 202 len: 0 microversion: 2.1 time: 1.253863 Jul 18 02:16:06.046373 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 558/1061] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:04 2022] DELETE /compute/v2.1/os-floating-ips/8cb2919d-b9da-4937-a7b1-e35c7876d5f4 => generated 0 bytes in 1256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:06.054915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.055405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.063430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.064018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.065093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.070989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.090922 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b HTTP/1.1 Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:06.092546 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:06.094158 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '93532a39-fba4-486b-aa2f-3f18982ced7b'} Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:06.095151 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:06.096667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:06.098736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:06.098736 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ed257fa-7624-4b03-818c-285b8a661a7e tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 404 len: 111 microversion: 2.1 time: 0.046482 Jul 18 02:16:06.098736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 559/1062] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:06 2022] DELETE /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:06.102768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.103395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.110371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.110821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.111943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.112546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.320799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.335045 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c129b258-8947-4acb-ab43-83acf2311c77 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1469 microversion: 2.1 time: 0.238338 Jul 18 02:16:06.335739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 560/1063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.340659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.341385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.349399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.349957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.350863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.351300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.584485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.602962 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37cf8f06-c766-40bf-9b2c-9a1f12bc0395 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 0.265646 Jul 18 02:16:06.612735 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 561/1064] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.618470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.619126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.627447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.627931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.628843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.631289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.807233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:06.815802 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e79d6ff-90fe-4bc8-8489-b4b4490d08c6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.201632 Jul 18 02:16:06.816995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 562/1065] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:06.822580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c631213e-1d9a-4419-b7b8-6d222befb3bb tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] Calling method '.version_select at 0x7fab05c4d310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.891919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3e604c2-0d78-47c3-8c7b-b51b538cf449 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4/action" status: 202 len: 0 microversion: 2.1 time: 2.019157 Jul 18 02:16:06.895461 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 504/1066] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:04 2022] POST /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4/action => generated 0 bytes in 2024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:06.931620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:06.939446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 93532a39-fba4-486b-aa2f-3f18982ced7b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:06.979356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.984730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:06.988091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:06.992688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.027951 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b HTTP/1.1 Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:16:07.030408 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:07.033529 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '93532a39-fba4-486b-aa2f-3f18982ced7b'} Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:07.035775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. Jul 18 02:16:07.039313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.041752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 93532a39-fba4-486b-aa2f-3f18982ced7b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:07.041752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-67110886-dce2-4d9d-9f84-c90f85b3457a tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b" status: 404 len: 111 microversion: 2.1 time: 0.130205 Jul 18 02:16:07.041752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 505/1067] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:06 2022] GET /compute/v2.1/servers/93532a39-fba4-486b-aa2f-3f18982ced7b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:07.046653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.050508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.053063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Searching by: {'reservation_id': 'r-lxcp22hg', 'deleted': False, 'project_id': '46ba6d7afda14ac8a41818afb217ab40'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:07.058380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.058804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.059905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.060345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.226979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:07.322416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:07.330731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.331242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.724111 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e58bf8c-cf50-4447-b31a-9a2af9d6cc53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-lxcp22hg" status: 200 len: 2930 microversion: 2.1 time: 0.681831 Jul 18 02:16:07.737919 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 506/1068] 10.222.0.67 () {58 vars in 1196 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lxcp22hg => generated 2930 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:07.756725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.757637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:07.770151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.771496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.773143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.774276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.881241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c631213e-1d9a-4419-b7b8-6d222befb3bb tempest-FloatingIPDetailsTestJSON-450356751 tempest-FloatingIPDetailsTestJSON-450356751-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/3f0ec2eb-32af-484b-a5e7-138e3b8f89a1" status: 202 len: 0 microversion: 2.1 time: 1.060820 Jul 18 02:16:07.885668 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 563/1069] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:06 2022] DELETE /compute/v2.1/os-floating-ips/3f0ec2eb-32af-484b-a5e7-138e3b8f89a1 => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:07.887844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.888371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:07.907539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.908039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.909509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.910607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.933797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb HTTP/1.1 Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:07.935826 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:07.937750 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '4f9eaca4-4373-41ba-9017-7cb68dca58fb'} Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:07.938638 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:07.940076 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:07.942771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:07.942771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aac9522b-6e84-4822-803a-b2b14d3dafb4 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 404 len: 111 microversion: 2.1 time: 0.055168 Jul 18 02:16:07.942771 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 564/1070] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:07 2022] DELETE /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:07.952169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:07.953037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:07.961491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.962052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:07.962938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:07.963464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.054646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:08.070877 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e14253c-a032-4c96-be1d-9717406f9657 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.331244 Jul 18 02:16:08.071963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 507/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.080979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eed2bc5c-9fa6-41f6-814c-bf32c51e626b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.130487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_groups [None req-eed2bc5c-9fa6-41f6-814c-bf32c51e626b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Querying cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) for 2 instances {{(pid=119440) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:16:08.132428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eed2bc5c-9fa6-41f6-814c-bf32c51e626b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.133571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eed2bc5c-9fa6-41f6-814c-bf32c51e626b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.190571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eed2bc5c-9fa6-41f6-814c-bf32c51e626b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/fdab30e6-449f-4e7b-a55a-b1470654f76f" status: 200 len: 265 microversion: 2.1 time: 0.116682 Jul 18 02:16:08.192451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 508/1072] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/os-server-groups/fdab30e6-449f-4e7b-a55a-b1470654f76f => generated 265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:08.199328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.200012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.207838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.208740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.209606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.210105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.322890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:08.341397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-413b9ba3-6b78-4275-94fa-10d3595b5fb4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 0.393942 Jul 18 02:16:08.354177 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 565/1073] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:07 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.370132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.371801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] [instance: 4f9eaca4-4373-41ba-9017-7cb68dca58fb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.384968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.386440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.387629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.389016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.413777 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] HTTP exception thrown: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Request method failure captured: Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb HTTP/1.1 Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1ME8sEB0omKwr-uQziOJtvTFb69wxgunBPpRSyknkMfyliNkH2X20Mvv8jHXXFonl1enUCv3VuFv_vDlH5VjAVrFDP-iZIZhF5pxfJgpVaJECvRXWcGZIivEQbF76xJxt3RKS_7tmsh0AeijBRURBiQaudgMyXZoJqr_HU5z-wC7s6I Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:08.416873 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/26519510f3bf4d98814641c3f445ee9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 26519510f3bf4d98814641c3f445ee9f Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402 Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d8f728feedf3481e9495821fbd27813a Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-778859402-project Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:08.419994 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '4f9eaca4-4373-41ba-9017-7cb68dca58fb'} Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:08.423012 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. Jul 18 02:16:08.426393 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:08.428756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] Returning 404 to user: Instance 4f9eaca4-4373-41ba-9017-7cb68dca58fb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:08.428756 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc3007b2-9a82-4a35-b2bf-4b1a3d034258 tempest-ServersWithSpecificFlavorTestJSON-778859402 tempest-ServersWithSpecificFlavorTestJSON-778859402-project] 10.222.0.67 "GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb" status: 404 len: 111 microversion: 2.1 time: 0.062851 Jul 18 02:16:08.428756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 566/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/4f9eaca4-4373-41ba-9017-7cb68dca58fb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:08.431927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.431927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.443230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.443993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.445431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.446444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.479519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:08.496292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.511324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70d14dd4-b83e-40e0-9d63-76be0db49d07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1475 microversion: 2.1 time: 0.307884 Jul 18 02:16:08.512668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 509/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.886241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2188ec99-ad58-443e-b4a0-24352f4957cd tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1620 microversion: 2.1 time: 0.463852 Jul 18 02:16:08.897044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 567/1076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1620 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:08.911695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:08.913919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:08.935131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.935659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:08.936681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:08.937755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.101620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:09.102679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:09.109885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.110971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.112189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.112909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.296074 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0daea00-a8f8-4630-9225-e77d5eccfeaa tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 200 len: 1619 microversion: 2.1 time: 0.394617 Jul 18 02:16:09.297983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 510/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:08 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 1619 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:09.319139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: .version_select at 0x7fab04c15ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-371773850", "policies": ["anti-affinity"]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:09.345387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:09.352244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:09.433382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:09.438552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:09.443316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:09.463884 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ecb26804-802c-48d4-bbb7-d685a2b5de16 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.149890 Jul 18 02:16:09.480829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 511/1078] 10.222.0.67 () {60 vars in 1173 bytes} [Mon Jul 18 02:16:09 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:16:09.500640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:09.501597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:09.548345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.548958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.549869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:09.551066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:09.616102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.162599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.192388 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b25dcd28-3630-41d9-bbaf-0e69dee01578 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.095419 Jul 18 02:16:10.200111 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 568/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:09 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:10.211784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:10.212746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:10.225655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.226692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.227269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.228372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.229212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.237167 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba168303-9317-4998-9a92-8110b10b9f53 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 0.754088 Jul 18 02:16:10.237782 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 512/1080] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:09 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:10.257492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1274314761", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "de626d73-3627-413d-9d1a-44772b7cc237"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:10.359502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:10.781914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:10.795689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a4e63348-e808-4581-a119-726cd1120a32 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1474 microversion: 2.1 time: 0.590473 Jul 18 02:16:10.797308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 569/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:10 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:10.890115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6ec6cb53-bee1-4f02-901e-1f0e7b3142d6 req-4ad760c4-2b52-434e-9513-ded66c80d468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-unplugged", "status": "completed", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:10.913056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6ec6cb53-bee1-4f02-901e-1f0e7b3142d6 req-4ad760c4-2b52-434e-9513-ded66c80d468 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:10.914150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6ec6cb53-bee1-4f02-901e-1f0e7b3142d6 req-4ad760c4-2b52-434e-9513-ded66c80d468 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:10.936236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6ec6cb53-bee1-4f02-901e-1f0e7b3142d6 req-4ad760c4-2b52-434e-9513-ded66c80d468 service nova] Creating event network-vif-unplugged:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:16:10.944841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6ec6cb53-bee1-4f02-901e-1f0e7b3142d6 req-4ad760c4-2b52-434e-9513-ded66c80d468 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061160 Jul 18 02:16:10.947110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 570/1082] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:16:11.228103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.235768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:11.263394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.264638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.266411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:11.267466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:11.953395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:11.954276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:11.955472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:11.958303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:11.966183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:11.967337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:11.970441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72805910-3b6f-42ce-b5a7-865d0e0f5364 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.755950 Jul 18 02:16:11.971520 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 571/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:11.983416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:11.983761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:12.003150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.003907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.005108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.005646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.041793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.047111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.053123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.055798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.158060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:12.171789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:12.226511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 2 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:12.229278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:12.286598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119440) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 18 02:16:12.311271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:12.319585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:12.413475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:12.433676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:12.489286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=258109a8-1364-4cc7-8c2b-892c98163817,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:12.593356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:12.656634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:12.681276 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24940649-d64a-4335-8366-5d2a10e2cf82 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 0.708258 Jul 18 02:16:12.684852 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 572/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:11 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:12.710585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:12.711236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:12.723957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:12.731739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.732963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.735481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:12.735727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:12.735727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:12.864252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:12.875732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'server_group_members'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:13.002759 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b3f1b4d2-0421-47bf-b5d7-88733ce983a9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.759842 Jul 18 02:16:13.003449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 513/1085] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2761 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:16:13.019898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-60ac0b8f-9260-4c04-98b0-392990d97a35 req-2c23d20a-8cb9-4380-a2a6-e351e343d4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "name": "network-vif-unplugged", "status": "completed", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:13.049249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-60ac0b8f-9260-4c04-98b0-392990d97a35 req-2c23d20a-8cb9-4380-a2a6-e351e343d4b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.049603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-60ac0b8f-9260-4c04-98b0-392990d97a35 req-2c23d20a-8cb9-4380-a2a6-e351e343d4b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.078151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-60ac0b8f-9260-4c04-98b0-392990d97a35 req-2c23d20a-8cb9-4380-a2a6-e351e343d4b6 service nova] Creating event network-vif-unplugged:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h2-849796-1 Jul 18 02:16:13.085449 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-60ac0b8f-9260-4c04-98b0-392990d97a35 req-2c23d20a-8cb9-4380-a2a6-e351e343d4b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078585 Jul 18 02:16:13.094670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 514/1086] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:13.102469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:13.103189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:13.117652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.118312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:13.119190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:13.119644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.100997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.138231 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6eedcb7e-a961-4a06-ace9-7bd25c44bdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1474 microversion: 2.1 time: 1.450067 Jul 18 02:16:14.139473 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 573/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:12 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1474 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:14.148914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:14.154503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.156818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Searching by: {'deleted': False, 'project_id': '46ba6d7afda14ac8a41818afb217ab40'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:14.204819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.205706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.208736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.209549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.447738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:14.634487 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-494653e8-9434-4f4e-8183-ade45422324b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.493531 Jul 18 02:16:14.643186 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 574/1088] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers => generated 1666 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:14.672956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:14.679608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:14.696205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.701152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.704449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.705383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.826199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:14.842424 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a25af03a-e28e-407b-b146-6476cb0ffe76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.744741 Jul 18 02:16:14.843778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 515/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:13 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:14.867832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f707dce1-8fe2-4c49-be3a-a3d720a37bc4", "name": "network-vif-unplugged", "status": "completed", "tag": "a8142dee-d890-46f0-973d-029eece75a69"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:14.882429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:14.883094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:14.899923 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] Creating event network-vif-unplugged:a8142dee-d890-46f0-973d-029eece75a69 for instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 on n-h2-849796-1 Jul 18 02:16:14.924293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:16:14.969543 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2339ef5f-083d-42ac-9c45-060058f8b83f req-7e1a7973-d47e-4cec-9dc8-a5b534a62924 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111406 Jul 18 02:16:14.976615 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 516/1090] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:14.995861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c46045c-96aa-43de-9eb5-508d30563e5c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:15.000959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c46045c-96aa-43de-9eb5-508d30563e5c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:15.195994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2c46045c-96aa-43de-9eb5-508d30563e5c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:15.219661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c46045c-96aa-43de-9eb5-508d30563e5c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1219 microversion: 2.1 time: 0.239912 Jul 18 02:16:15.220735 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 517/1091] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1219 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:15.267583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b24bfbb1-0b30-4009-bb5d-44182f93d6a0 req-4d034d30-0dfc-4378-b6c6-c289c2ef319c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:15.283196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b24bfbb1-0b30-4009-bb5d-44182f93d6a0 req-4d034d30-0dfc-4378-b6c6-c289c2ef319c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.283652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b24bfbb1-0b30-4009-bb5d-44182f93d6a0 req-4d034d30-0dfc-4378-b6c6-c289c2ef319c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.297304 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b24bfbb1-0b30-4009-bb5d-44182f93d6a0 req-4d034d30-0dfc-4378-b6c6-c289c2ef319c service nova] Creating event network-changed:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h2-849796-1 Jul 18 02:16:15.304154 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b24bfbb1-0b30-4009-bb5d-44182f93d6a0 req-4d034d30-0dfc-4378-b6c6-c289c2ef319c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048739 Jul 18 02:16:15.305538 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 518/1092] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:15.312089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:15.313202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:15.329817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.330952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:15.332768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:15.334082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.011676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.031161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.057489 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22c21820-d55d-4559-aa5e-90134115764f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1472 microversion: 2.1 time: 0.743660 Jul 18 02:16:16.063333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 519/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:15 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1472 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:16.063677 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28063abc-62a8-48c4-be4b-09463c6a321e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 1.411963 Jul 18 02:16:16.069661 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 575/1094] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:14 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:16.096034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:16.098153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:16.111484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.112281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.115726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.116451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.270811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:16.271969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:16.309517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.310804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.315971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:16.321329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:16.581392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.616425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2417c2a5-7731-4391-a684-8cb0b05c792a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.548461 Jul 18 02:16:16.622724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 520/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:16 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:16.755671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:16.788504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a8b0f7a-8e4d-4c23-a947-496c17117c53 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1271 microversion: 2.1 time: 0.538794 Jul 18 02:16:16.797088 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 576/1096] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:16 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1271 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:17.063773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-93517afe-711a-4839-a8f1-a267da67f3a7 req-cddf01a4-ef51-47a9-a90c-0110b7a7769b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-plugged", "status": "completed", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:17.075743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:17.077173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:17.096692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.097789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.103169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.103627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.110029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93517afe-711a-4839-a8f1-a267da67f3a7 req-cddf01a4-ef51-47a9-a90c-0110b7a7769b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.117632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93517afe-711a-4839-a8f1-a267da67f3a7 req-cddf01a4-ef51-47a9-a90c-0110b7a7769b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.182390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-93517afe-711a-4839-a8f1-a267da67f3a7 req-cddf01a4-ef51-47a9-a90c-0110b7a7769b service nova] Creating event network-vif-plugged:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:16:17.201163 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-93517afe-711a-4839-a8f1-a267da67f3a7 req-cddf01a4-ef51-47a9-a90c-0110b7a7769b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149667 Jul 18 02:16:17.207344 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 521/1097] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:17.240275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:17.245026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:17.277896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.299713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.302214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.321796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.581220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:17.600058 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-edab0f72-db12-4567-8cd7-15aecccfebdf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1469 microversion: 2.1 time: 0.523184 Jul 18 02:16:17.613660 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 577/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:17 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1469 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:17.629147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:17.630088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:17.648999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.649770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.650759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.651383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.791973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11edbb56-838c-4bd9-9ddf-a0e8a36d2a40 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4/action" status: 204 len: 0 microversion: 2.1 time: 0.166672 Jul 18 02:16:17.793447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 578/1099] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:17 2022] POST /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4/action => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:17.799747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:17.801852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:17.811789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.812806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:17.814100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:17.814918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.415026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:18.446620 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c07c5cff-a24d-429a-b620-e69003ef8ed5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 1.233358 Jul 18 02:16:18.449197 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 522/1100] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:17 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:18.476016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:18.477404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:18.485660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.486429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:18.488450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:18.489131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.173568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:19.187566 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80ab1a33-9b99-4149-aa35-e6ac3dbd0538 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1469 microversion: 2.1 time: 0.732127 Jul 18 02:16:19.214753 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 523/1101] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:18 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1469 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:19.220165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:19.231118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:19.241348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.248359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.249310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.252320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.254063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.347658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:19.366753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ffcd223e-ea13-4cd1-92bd-beec47e142d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.571225 Jul 18 02:16:19.374617 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 579/1102] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:17 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:19.485643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:19.486982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:19.516506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.521220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.522270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.525063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:19.531229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:19.564455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:19.588530 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc03ed9a-4d27-4bf9-a707-65b57eeafedd tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1277 microversion: 2.1 time: 0.372257 Jul 18 02:16:19.589522 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 524/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:19 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:20.208795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:20.213193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:20.227876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.228577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:20.236475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.237262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:20.554144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:20.571240 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75a25b5b-1664-47a4-a576-9939026af070 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1477 microversion: 2.1 time: 1.094605 Jul 18 02:16:20.575681 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 580/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:19 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1477 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:20.607438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:20.614990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:20.640340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.641180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:20.651221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:20.652959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.640442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:21.707343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95cca720-8b9a-4bda-b21d-5eaeb3060164 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1469 microversion: 2.1 time: 1.502321 Jul 18 02:16:21.714537 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 525/1105] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:20 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1469 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:21.731369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.732107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:21.739833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.740390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.741331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.741860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.781820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:21.857200 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-292ab64c-73dc-4bb0-a071-f5285407b225 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.277111 Jul 18 02:16:21.859298 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 581/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:20 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:21.865186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:21.867618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:21.874506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.875430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:21.876586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:21.877289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:22.129844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:22.483659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:22.502760 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d26a441-4224-4f3d-8538-ef047dd9925e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.775528 Jul 18 02:16:22.514513 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 526/1107] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:21 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:22.542643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f707dce1-8fe2-4c49-be3a-a3d720a37bc4", "name": "network-vif-plugged", "status": "completed", "tag": "a8142dee-d890-46f0-973d-029eece75a69"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:22.565439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:22.567472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:22.605038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] Creating event network-vif-plugged:a8142dee-d890-46f0-973d-029eece75a69 for instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 on n-h2-849796-1 Jul 18 02:16:22.638593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:16:22.656285 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-947fc89e-597c-4d01-9c59-7341a0bb4091 req-6be79dca-1150-4585-b79a-0fb5f7cb44dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118428 Jul 18 02:16:22.657865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 527/1108] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:22.734738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:22.739525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:22.756568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:22.757202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:22.760652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:22.761301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.605767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:23.616119 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af94692e-e026-4ceb-a502-9c4312b2bab7 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1462 microversion: 2.1 time: 1.755561 Jul 18 02:16:23.622150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 582/1109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:21 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1462 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:23.628704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:23.637921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:23.675137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:23.676561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.677689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:23.678506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:23.752994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:23.807770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:23.825880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d88de9c-c3e8-4721-9531-f428f6b41436 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1469 microversion: 2.1 time: 1.096669 Jul 18 02:16:23.830642 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 528/1110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:22 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1469 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:24.033006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-851196195", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "d3f7aa94-7f60-4ecd-8d8b-0cdebeb05439"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:24.148505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] validate_networks() for [('d3f7aa94-7f60-4ecd-8d8b-0cdebeb05439', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:24.324105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.566223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:24.588805 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66770bbd-f132-46ab-a894-d296c80fd6ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.965097 Jul 18 02:16:24.601122 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 583/1111] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:23 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:24.622655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:24.626736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:24.656896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.659555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:24.664069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:24.668967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:25.211711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=34 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.074758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:26.080517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:26.115653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:26.116955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:26.117956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:26.169409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.175079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.178101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.178575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.249243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Getting quotas for project d3db19db96ca48f8a2292f7e068c0f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:26.258097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Getting quotas for user 3365bf8981d4473eb4cd5d7dfb1506c8 and project d3db19db96ca48f8a2292f7e068c0f9d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:26.284789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:26.287919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:26.440062 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b424d9fa-f587-43c9-a079-255eac8eb53c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.606119 Jul 18 02:16:26.445426 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 529/1112] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:16:26.463793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:26.466882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:26.493488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.494238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.495246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.495929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.708635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:26.741740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09cfb76c-1b6c-4a48-9fbe-ac7f6bec1deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 2.136847 Jul 18 02:16:26.746727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 584/1113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:24 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:26.797057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f2f796db-7127-450b-9d3e-6196629a704d req-c2b2f74e-0b5b-4a60-b282-2f15c9bfdb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "name": "network-vif-unplugged", "status": "completed", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:26.817684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f88f6d99-873a-435e-bc7b-5c47520e44af tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 0 microversion: 2.1 time: 0.369963 Jul 18 02:16:26.821381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 530/1114] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:26 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:26.847060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1bae80fb-1354-4cf7-856b-2e46b8ab0ce1 req-c724138e-c535-4463-933e-4e9e1c7c3139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6", "tag": "f930f675-58de-457a-bc31-d92eda71c9cd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:26.854320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f2f796db-7127-450b-9d3e-6196629a704d req-c2b2f74e-0b5b-4a60-b282-2f15c9bfdb6e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.855305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f2f796db-7127-450b-9d3e-6196629a704d req-c2b2f74e-0b5b-4a60-b282-2f15c9bfdb6e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.880880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1bae80fb-1354-4cf7-856b-2e46b8ab0ce1 req-c724138e-c535-4463-933e-4e9e1c7c3139 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.883484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1bae80fb-1354-4cf7-856b-2e46b8ab0ce1 req-c724138e-c535-4463-933e-4e9e1c7c3139 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.906047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f2f796db-7127-450b-9d3e-6196629a704d req-c2b2f74e-0b5b-4a60-b282-2f15c9bfdb6e service nova] Creating event network-vif-unplugged:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h2-849796-1 Jul 18 02:16:26.917887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f2f796db-7127-450b-9d3e-6196629a704d req-c2b2f74e-0b5b-4a60-b282-2f15c9bfdb6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166322 Jul 18 02:16:26.921454 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 585/1115] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:26.928649 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1bae80fb-1354-4cf7-856b-2e46b8ab0ce1 req-c724138e-c535-4463-933e-4e9e1c7c3139 service nova] Creating event network-changed:f930f675-58de-457a-bc31-d92eda71c9cd for instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 on n-h1-849796-1 Jul 18 02:16:26.935305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.937495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:26.960722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.961462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.962986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:26.965587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1bae80fb-1354-4cf7-856b-2e46b8ab0ce1 req-c724138e-c535-4463-933e-4e9e1c7c3139 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141582 Jul 18 02:16:26.967805 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 531/1116] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:26.969352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:26.997579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:26.998869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.060572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.061073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.062145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.062837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.591364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:27.626176 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd80c383-4301-4728-84b6-84ecdd450bcf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1461 microversion: 2.1 time: 0.701446 Jul 18 02:16:27.629564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 586/1117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:26 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1461 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.656239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:27.663758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.684695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:27.694914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.697294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.700894 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d7d454d-d0c2-4c71-a7d1-ab9f316acf48 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.730982 Jul 18 02:16:27.701534 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 532/1118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:26 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.709859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:27.710515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.711327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.711646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.718779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.719547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.720610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.721348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.726762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.829040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.830591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.831412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lazy-loading 'fault' on Instance uuid eadcb7a8-716b-41fd-b3cc-e2e8707fb17a {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:27.913915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:27.928474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2863f539-8bac-4c2d-9262-3fd56ed97bba tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1219 microversion: 2.1 time: 0.296953 Jul 18 02:16:27.938272 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 587/1119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:27 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.944208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:27.944831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:27.955562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.956013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:27.959342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:27.959793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.277935 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-431140f4-a8db-4d3b-8325-af4691de4d45 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1596 microversion: 2.1 time: 0.574419 Jul 18 02:16:28.279747 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 533/1120] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:27 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1596 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:28.287151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.288730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.296650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.297480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.298487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.299225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.490887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:28.508095 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6993a60a-f8ce-48d2-ad10-35cdcd8baddb tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1461 microversion: 2.1 time: 0.568030 Jul 18 02:16:28.525460 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 588/1121] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:27 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1461 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:28.541906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:28.543660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.553578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:28.556329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.556904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.557962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.558513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.571943 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-34f6a7a1-42b9-428d-9f92-f16ceb5e5f80 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.290100 Jul 18 02:16:28.573954 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 534/1122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:28.593082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8edb28bb-e482-4292-a7fe-0b1d0ee62438 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'create', calling method: .version_select at 0x7fab04a7e790>, body: {"keypair": {"name": "tempest-keypair-348400281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN6izE8wVUTjOgbnp36SYzznb7wIK12VUUetRX6+L8pHvdUTP78WYeH8YI+3uBvgEUBDELRgQl30/4PppMy1Rzx0NVcoPmStznBZDztFBxW5qGJlcd0r6B5z4b44Wg1PQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:28.644645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-8edb28bb-e482-4292-a7fe-0b1d0ee62438 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:28.653221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-8edb28bb-e482-4292-a7fe-0b1d0ee62438 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:28.715454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8edb28bb-e482-4292-a7fe-0b1d0ee62438 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138960 Jul 18 02:16:28.717206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 535/1123] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:16:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:28.744193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.745093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.751133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8f35801-5a2a-4a94-981c-7bb4fab2e67f tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action" status: 202 len: 0 microversion: 2.1 time: 0.222945 Jul 18 02:16:28.754077 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 589/1124] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:16:28 2022] POST /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:16:28.754592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.755271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.756374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.757060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.775214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:28.782588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:28.808010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.809436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.811382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:28.812523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:28.985847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:28.994875 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58323423-393d-4cc1-8732-55ba45926529 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.263212 Jul 18 02:16:28.995797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 536/1125] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.010949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.011859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.019230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.020162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.021229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.021848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.171071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:29.199390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6da925da-6552-4e01-a791-776ff98b2d14 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1267 microversion: 2.1 time: 0.192389 Jul 18 02:16:29.200357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 537/1126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.213589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cadf7094-2933-4c76-9e44-c2dea2993d53 req-074ec7c2-1cde-466c-baef-3d64fcdbdd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258109a8-1364-4cc7-8c2b-892c98163817", "tag": "1296929f-1df0-4a83-8d68-b7388c1f17ec"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:29.232427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cadf7094-2933-4c76-9e44-c2dea2993d53 req-074ec7c2-1cde-466c-baef-3d64fcdbdd29 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.232892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cadf7094-2933-4c76-9e44-c2dea2993d53 req-074ec7c2-1cde-466c-baef-3d64fcdbdd29 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.257576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08cee792-3346-4bad-82db-f41475fc93d3 tempest-ServersAdminTestJSON-192672383 tempest-ServersAdminTestJSON-192672383-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1613 microversion: 2.1 time: 0.495089 Jul 18 02:16:29.259804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 590/1127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:28 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1613 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:29.268349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cadf7094-2933-4c76-9e44-c2dea2993d53 req-074ec7c2-1cde-466c-baef-3d64fcdbdd29 service nova] Creating event network-changed:1296929f-1df0-4a83-8d68-b7388c1f17ec for instance 258109a8-1364-4cc7-8c2b-892c98163817 on n-h2-849796-1 Jul 18 02:16:29.288510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cadf7094-2933-4c76-9e44-c2dea2993d53 req-074ec7c2-1cde-466c-baef-3d64fcdbdd29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084469 Jul 18 02:16:29.289210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 538/1128] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:29.309565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.311196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.372909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.372909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.373989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.374697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.473493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:29.608949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.609539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.618549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.619934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.622043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.623188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.748719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa020fc0-1031-4359-993d-ec598424a53e tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 204 len: 0 microversion: 2.1 time: 0.457434 Jul 18 02:16:29.755855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 591/1129] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:29 2022] DELETE /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:29.766800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:29.768251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:29.782514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.783343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.785058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:29.786153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:29.915927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:29.924734 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f421b8d-27fe-4eb0-8efb-3d6a57f23daf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.321403 Jul 18 02:16:29.927358 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 539/1130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:30.155298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:30.168132 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e60570d7-6e0e-41b5-baf4-487a7b05d841 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1470 microversion: 2.1 time: 0.410201 Jul 18 02:16:30.169079 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 592/1131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:29 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:30.187257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:30.188863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:30.207486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.208634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.210328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.211303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.246827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-945331264", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:30.365380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:30.721868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:30.744582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bf6a65d-104c-491e-b54e-ffd57bf3378b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 0.573815 Jul 18 02:16:30.746055 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 593/1132] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:30 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:30.756257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:30.757348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:30.770441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.771258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.773888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:30.774195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:30.921354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:30.950363 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e191a72d-fe7b-47c1-a931-0d3461b48fbd tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1267 microversion: 2.1 time: 0.192024 Jul 18 02:16:30.956413 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 594/1133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:30 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:30.976261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:30.980277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:31.007485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.026473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.039619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.044854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.432693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:31.438092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:31.448466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:31.450277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:31.452625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:31.486979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.490392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.493349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.494696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.629447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Getting quotas for project ad246f5d093c48c48152059d277671cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:31.636966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Getting quotas for user b1ba4e1d4061429c9a861e8020c10454 and project ad246f5d093c48c48152059d277671cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:31.658885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:31.662697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:31.693991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:31.708860 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9413c3ff-4b8a-4063-adc7-1fe4313925fb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.749470 Jul 18 02:16:31.711226 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 595/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:30 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:31.722719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:31.723881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:31.743947 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-020e6ce1-a616-4cb4-aa24-c0dc7a81d27d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815083 Jul 18 02:16:31.745293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 540/1135] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:16:31.763862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.765772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb0a9aa4-5dad-48bd-8b07-c3b36309a173 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:31.766357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:31.768391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:31.769609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb0a9aa4-5dad-48bd-8b07-c3b36309a173 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:31.773519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:32.100686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb0a9aa4-5dad-48bd-8b07-c3b36309a173 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:32.112161 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb0a9aa4-5dad-48bd-8b07-c3b36309a173 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1216 microversion: 2.1 time: 0.357265 Jul 18 02:16:32.115718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 541/1136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:31 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1216 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:32.143645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:32.144326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:32.159148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.159957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:32.161358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:32.161887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:33.020370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:33.029487 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47b728bf-8511-4bae-b631-f27d57f5b087 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1470 microversion: 2.1 time: 1.316759 Jul 18 02:16:33.030102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 596/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:31 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1470 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:33.058931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:33.060336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:33.083141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:33.084198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:33.088622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:33.091740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:33.205496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.547598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:33.579148 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b17715f3-c69b-47ff-8c38-d86e63fe09df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.534850 Jul 18 02:16:33.580579 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 597/1138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:33 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:33.591015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:33.593362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:33.613210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:33.615115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:33.618124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:33.626297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:33.962299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:33.999365 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c168703-ec5f-4310-aee3-5dce97a63782 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.869670 Jul 18 02:16:34.001763 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 542/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:32 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.027465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.028807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.049212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.050882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.052335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.059654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.532137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:34.588127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b72e2974-532b-4253-a9e0-cfa72cf44692 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1286 microversion: 2.1 time: 0.583178 Jul 18 02:16:34.591655 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 543/1140] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1286 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:34.630618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:34.636194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:34.689371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.701002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.709797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.713288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.825095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:34.825970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:34.828330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lazy-loading 'fault' on Instance uuid 1517eb7b-29f3-42ca-810e-901023e82b1f {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:35.157115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:35.177147 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9da5508-7c7e-4913-908c-fed138c87d40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 1.589843 Jul 18 02:16:35.181955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 598/1141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:33 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:35.198473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:35.200294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:35.224654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.225978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.230985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.232144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.582775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:35.591706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81ac170a-655f-49a9-8824-6c208cfa2b89 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 200 len: 1304 microversion: 2.1 time: 0.996882 Jul 18 02:16:35.604097 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 544/1142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:34 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 1304 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:35.604097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a872714f-ebce-415c-8ba0-6f6fb1550b9e req-b674e245-0a4f-47b7-8e6b-e6d8acd5ce60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1517eb7b-29f3-42ca-810e-901023e82b1f", "name": "network-vif-deleted", "tag": "c58c17d6-6128-45b1-b4f7-fe002ea8177e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:35.622354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a872714f-ebce-415c-8ba0-6f6fb1550b9e req-b674e245-0a4f-47b7-8e6b-e6d8acd5ce60 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.631521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a872714f-ebce-415c-8ba0-6f6fb1550b9e req-b674e245-0a4f-47b7-8e6b-e6d8acd5ce60 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.680965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a872714f-ebce-415c-8ba0-6f6fb1550b9e req-b674e245-0a4f-47b7-8e6b-e6d8acd5ce60 service nova] Creating event network-vif-deleted:c58c17d6-6128-45b1-b4f7-fe002ea8177e for instance 1517eb7b-29f3-42ca-810e-901023e82b1f on n-h1-849796-1 Jul 18 02:16:35.696073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a872714f-ebce-415c-8ba0-6f6fb1550b9e req-b674e245-0a4f-47b7-8e6b-e6d8acd5ce60 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101365 Jul 18 02:16:35.698031 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 545/1143] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:35.705256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:35.706851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:35.726087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.727470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.731698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.740688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.795956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:35.840019 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e561c00-fc19-4511-b95f-2f582b0414bf tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.653415 Jul 18 02:16:35.863190 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 599/1144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:35 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:35.891999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5fbd358f-8204-4235-a142-7010688b9f0d req-f669fdb7-a859-4858-91e6-d7ee991f25a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6", "name": "network-vif-plugged", "status": "completed", "tag": "f930f675-58de-457a-bc31-d92eda71c9cd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:35.939931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5fbd358f-8204-4235-a142-7010688b9f0d req-f669fdb7-a859-4858-91e6-d7ee991f25a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:35.942618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5fbd358f-8204-4235-a142-7010688b9f0d req-f669fdb7-a859-4858-91e6-d7ee991f25a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:35.982712 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5fbd358f-8204-4235-a142-7010688b9f0d req-f669fdb7-a859-4858-91e6-d7ee991f25a5 service nova] Creating event network-vif-plugged:f930f675-58de-457a-bc31-d92eda71c9cd for instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 on n-h1-849796-1 Jul 18 02:16:35.997131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5fbd358f-8204-4235-a142-7010688b9f0d req-f669fdb7-a859-4858-91e6-d7ee991f25a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130057 Jul 18 02:16:36.001059 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 600/1145] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:36.015446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.017428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.031442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.033013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.034981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.036073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.230578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:36.248162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f923fd5-b47b-4550-9ac7-93d0ab7be541 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1274 microversion: 2.1 time: 0.241521 Jul 18 02:16:36.249613 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 601/1146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.282301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.285499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.297615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.298451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.301324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.302241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.751033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:36.791671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:36.808393 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f95bbe6-c3c6-4966-abde-64703114f645 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1501 microversion: 2.1 time: 1.106711 Jul 18 02:16:36.841223 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ce2be9c-414f-4e8a-bf4f-d304709c4191 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.588744 Jul 18 02:16:36.843750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 546/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:35 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1501 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.858812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 602/1148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.866304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.867261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: 1517eb7b-29f3-42ca-810e-901023e82b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.879749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.880550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.882304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.883086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.892269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.894407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:36.923315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.924814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.926706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:36.927943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:36.939704 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] HTTP exception thrown: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Request method failure captured: Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f HTTP/1.1 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHLLrv_nbChRPsBmNFVPZ9E87ABW3u_LRzBVyfMZjUu3sna9fZk6giu0UteOxGaaXK5LaSzpjBx7j-cNytAyyFJokQhWZO-F2MU9Z1HlbRP3oncjaS9kFiz505i1H50r6RkKPXHd1tq5SidCm2fiGvvw8Qqy8BoxzforDWQdybadqs Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:16:36.944205 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_952dae33267642bd982964e23ca1b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/952dae33267642bd982964e23ca1b231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8d162823ac51401ba0d2fb537f76af60 Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. Jul 18 02:16:36.947174 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1517eb7b-29f3-42ca-810e-901023e82b1f'} Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:36.948832 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. Jul 18 02:16:36.951462 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:36.956910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Returning 404 to user: Instance 1517eb7b-29f3-42ca-810e-901023e82b1f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:36.958320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-724f0a75-054b-4013-9a90-0055d1c3a40b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f" status: 404 len: 111 microversion: 2.1 time: 0.109975 Jul 18 02:16:36.959568 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 547/1149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/1517eb7b-29f3-42ca-810e-901023e82b1f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:36.981863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:36.982837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:37.028346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.029218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.030869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.031655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.090642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:37.339167 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1b6e60db-fe3e-4237-9f7f-a5bdd21c7a93 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 204 len: 0 microversion: 2.1 time: 0.371669 Jul 18 02:16:37.340716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 548/1150] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:36 2022] DELETE /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:37.351798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:37.353743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:37.360608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:37.371482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.372606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.374266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.376018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.531101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:37.590478 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88d68649-9970-40ed-8f46-30dd6a58708e tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.712627 Jul 18 02:16:37.595776 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 603/1151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:36 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:37.626663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:37.628524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:37.641193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.642449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.644333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.645551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.869908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:37.879533 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45734875-4c11-464d-bfb1-305def9e4f1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.536287 Jul 18 02:16:37.881022 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 549/1152] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:37 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:37.886433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5e1036a-03ff-47ee-a4aa-b7e20c50f456 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '.version_select at 0x7fab047b89d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:37.892283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5e1036a-03ff-47ee-a4aa-b7e20c50f456 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:37.911699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5e1036a-03ff-47ee-a4aa-b7e20c50f456 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:37.959677 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5e1036a-03ff-47ee-a4aa-b7e20c50f456 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.076798 Jul 18 02:16:37.961363 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 550/1153] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:16:37 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:37.971291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-57b1cdc9-843d-4af0-ac18-1d97ce9f8b16 req-681594ef-e658-4bda-8108-8ebcd2eed73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67391aa-8605-44cd-b9db-f985751b41cd", "tag": "6792c608-8e1e-42b1-9e82-1ceafcd04124"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:38.000513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-57b1cdc9-843d-4af0-ac18-1d97ce9f8b16 req-681594ef-e658-4bda-8108-8ebcd2eed73d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.006087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-57b1cdc9-843d-4af0-ac18-1d97ce9f8b16 req-681594ef-e658-4bda-8108-8ebcd2eed73d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.064826 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-57b1cdc9-843d-4af0-ac18-1d97ce9f8b16 req-681594ef-e658-4bda-8108-8ebcd2eed73d service nova] Creating event network-changed:6792c608-8e1e-42b1-9e82-1ceafcd04124 for instance a67391aa-8605-44cd-b9db-f985751b41cd on n-h2-849796-1 Jul 18 02:16:38.085368 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-57b1cdc9-843d-4af0-ac18-1d97ce9f8b16 req-681594ef-e658-4bda-8108-8ebcd2eed73d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119723 Jul 18 02:16:38.086456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 551/1154] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:38.095853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.096464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.106392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.107637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.108652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.109154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.179865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:38.195514 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b44174b2-5c69-4b0c-a1f1-9d8e1142f251 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1469 microversion: 2.1 time: 0.596084 Jul 18 02:16:38.201339 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 604/1155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:37 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.201981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.202383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.214379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.214887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.216598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.217217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.400266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:38.418578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc13c056-7673-4e95-9c3a-6155eb7fd6a3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1476 microversion: 2.1 time: 0.329573 Jul 18 02:16:38.420306 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 552/1156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.431105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f40a361-50f2-44c2-b862-b0c2694dfedf tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.445234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f40a361-50f2-44c2-b862-b0c2694dfedf tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023098 Jul 18 02:16:38.446209 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 553/1157] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:38.455040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-77b79735-affe-41bc-b4ff-fdff15193439 req-40395ca8-7a3e-4744-b833-e5c3e3d57d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258109a8-1364-4cc7-8c2b-892c98163817", "name": "network-vif-plugged", "status": "completed", "tag": "1296929f-1df0-4a83-8d68-b7388c1f17ec"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:38.475674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-77b79735-affe-41bc-b4ff-fdff15193439 req-40395ca8-7a3e-4744-b833-e5c3e3d57d88 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.477455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-77b79735-affe-41bc-b4ff-fdff15193439 req-40395ca8-7a3e-4744-b833-e5c3e3d57d88 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.503401 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-77b79735-affe-41bc-b4ff-fdff15193439 req-40395ca8-7a3e-4744-b833-e5c3e3d57d88 service nova] Creating event network-vif-plugged:1296929f-1df0-4a83-8d68-b7388c1f17ec for instance 258109a8-1364-4cc7-8c2b-892c98163817 on n-h2-849796-1 Jul 18 02:16:38.513575 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-77b79735-affe-41bc-b4ff-fdff15193439 req-40395ca8-7a3e-4744-b833-e5c3e3d57d88 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064459 Jul 18 02:16:38.514931 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 554/1158] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:38.523973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e86e653d-df9d-487a-8b25-8941f6440bf5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '.version_select at 0x7fab049df040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.528635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e86e653d-df9d-487a-8b25-8941f6440bf5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.529297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e86e653d-df9d-487a-8b25-8941f6440bf5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.531720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:38.547579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e86e653d-df9d-487a-8b25-8941f6440bf5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.030589 Jul 18 02:16:38.548805 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 555/1159] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.559911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8178640-f5cc-40dc-a0e5-4746bf5026b4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1477956653", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:38.564511 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:38.564511 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:16:38.594865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8178640-f5cc-40dc-a0e5-4746bf5026b4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.044547 Jul 18 02:16:38.597456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 556/1160] 10.222.0.67 () {60 vars in 1145 bytes} [Mon Jul 18 02:16:38 2022] POST /compute/v2.1/flavors => generated 499 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:38.607635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.608502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.621424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.622513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.622742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:38.624021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.624823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.639076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bf57284-86e2-4df8-963b-5adcd2e58178 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1319 microversion: 2.1 time: 0.440869 Jul 18 02:16:38.641171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 605/1161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:38.652822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46c90e3f-66c5-4394-b133-bd41d78b8be8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.684469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46c90e3f-66c5-4394-b133-bd41d78b8be8 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038209 Jul 18 02:16:38.688455 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 606/1162] 10.222.0.67 () {58 vars in 1181 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:16:38.704963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:38.706221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:38.718033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.719115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.720752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:38.722780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:38.971683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35ed388a-0d69-4a04-8516-afdaf10a6b5c tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1627 microversion: 2.1 time: 0.372017 Jul 18 02:16:38.989578 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 557/1163] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1627 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:39.003465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1828015651", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "db62eb13-e23f-48e1-b40d-8d6f1846705b"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:39.077334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:39.464212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:39.479547 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9bd0ccb-348d-43ff-afe1-327a02480efe tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.788501 Jul 18 02:16:39.497082 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 607/1164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:38 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:39.508965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:39.510392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:39.523930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.525202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.527032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.528107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.969796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:39.970705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:39.972649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:39.974711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:39.975729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:39.994795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.995727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:39.997436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:39.998347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.038412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:40.045163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:40.067294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:40.070779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:40.078279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:40.090044 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1bd39873-8792-44df-aa8f-bd6f7e208dd0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.590046 Jul 18 02:16:40.092461 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 608/1165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:39 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:40.107662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04b4c678-6275-4384-87d5-b7423ad14013 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: .version_select at 0x7fab057e0670>, body: {"keypair": {"name": "tempest-keypair-1845830473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBKH1n4pueQAgil+DK2I/jywzErYfytqPYGXed63b+AEPLTQNY5aescwmjsDGKPyHCV3ELl1xpKYWxqoUBZurqrDlcfvrzY9d/2bk3xU4kPB2Ov5FiJjKms8BDX5dasqg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:40.146109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-04b4c678-6275-4384-87d5-b7423ad14013 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:40.158848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-04b4c678-6275-4384-87d5-b7423ad14013 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for user d2b97e560fcf4750b2aad92d6d37e611 and project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:40.182138 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be2fbf38-ca6d-4b0a-9293-7e14a8fcba89 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191409 Jul 18 02:16:40.185434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 558/1166] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:16:40.198021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:40.211293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:40.231670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.244038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.245320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.249639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.275906 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04b4c678-6275-4384-87d5-b7423ad14013 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180882 Jul 18 02:16:40.277562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 609/1167] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:16:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:40.282692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:40.287355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:40.304845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.309506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.313384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.313854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.621571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:40.636866 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f565d428-3753-43a9-b2cc-d32fb0e788c5 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1469 microversion: 2.1 time: 0.448955 Jul 18 02:16:40.643669 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 559/1168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:40 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:40.670881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40c27d3b-0833-47a7-88f1-305f00dbbc35 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:40.671958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40c27d3b-0833-47a7-88f1-305f00dbbc35 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:40.848401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40c27d3b-0833-47a7-88f1-305f00dbbc35 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:40.867384 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40c27d3b-0833-47a7-88f1-305f00dbbc35 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1279 microversion: 2.1 time: 0.215327 Jul 18 02:16:40.869876 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 560/1169] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:40 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:40.891889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:40.894370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:40.918340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.924871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:40.929211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:40.931108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.098485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:41.148477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f2f5b75-6f11-4edc-baf4-6e17628dd9ef tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1469 microversion: 2.1 time: 0.869567 Jul 18 02:16:41.154018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 610/1170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:40 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1469 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:41.172047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:41.177806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:41.198910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.200694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.202145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.203052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.610194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:41.619228 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4dc28355-2ca5-4420-82dd-8771006de0ea tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.460381 Jul 18 02:16:41.619833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 611/1171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:41 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:41.626442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:41.627075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:41.638144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.638894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.639882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.640539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.796402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:41.827352 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-781f271a-b420-44a9-943d-2d42df1d7b29 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.955000 Jul 18 02:16:41.828366 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 561/1172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:40 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:41.854952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-81f25ff4-0099-4a3d-af33-f8147ecee053 req-876e00bd-02b4-4cc2-bb17-ce1a29b88cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeee982-0343-4f11-a4a1-13eab45fbbe2", "name": "network-vif-deleted", "tag": "7204817d-cf9e-4e65-bb24-6369404e1fff"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:41.882911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-81f25ff4-0099-4a3d-af33-f8147ecee053 req-876e00bd-02b4-4cc2-bb17-ce1a29b88cc9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.883489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-81f25ff4-0099-4a3d-af33-f8147ecee053 req-876e00bd-02b4-4cc2-bb17-ce1a29b88cc9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.937570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-81f25ff4-0099-4a3d-af33-f8147ecee053 req-876e00bd-02b4-4cc2-bb17-ce1a29b88cc9 service nova] Creating event network-vif-deleted:7204817d-cf9e-4e65-bb24-6369404e1fff for instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 on n-h2-849796-1 Jul 18 02:16:41.959229 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-81f25ff4-0099-4a3d-af33-f8147ecee053 req-876e00bd-02b4-4cc2-bb17-ce1a29b88cc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127888 Jul 18 02:16:41.961120 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 562/1173] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:41.979536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:41.981193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:41.981401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:41.993456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.994502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:41.996193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:41.997489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.008577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4202e491-fd82-483f-9f92-e21f13e9ce1a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1319 microversion: 2.1 time: 0.386729 Jul 18 02:16:42.010061 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 612/1174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:41 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.020884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.022246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:42.034378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.035475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.037018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.037800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.148350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:42.182965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc2ea57e-406c-48ff-848b-cef4d8417524 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1427 microversion: 2.1 time: 0.216128 Jul 18 02:16:42.184394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 563/1175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:41 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1427 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.233270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:42.255001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb2f3b65-782f-4105-a93e-3a8e98608c78 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1283 microversion: 2.1 time: 0.239911 Jul 18 02:16:42.283605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 613/1176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1283 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:42.638908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.639987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:42.649542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.650401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.651542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.652345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.856911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:42.858173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:42.939612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.951538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:42.956862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:42.957900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.361534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:43.375352 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec097205-8089-43f7-9075-428ad9a8aa8c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.532160 Jul 18 02:16:43.388330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 614/1177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:43.395399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:43.396267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:43.403658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.405211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.406488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.407300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.785444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:43.797650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9cdc8a29-e1e2-4bce-b855-dcde13a7673d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1319 microversion: 2.1 time: 0.407443 Jul 18 02:16:43.802004 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 615/1178] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:43.814058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:43.819027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:43.829188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.830256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.831605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.832292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.885009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:43.886753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:43.887421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lazy-loading 'fault' on Instance uuid ddeee982-0343-4f11-a4a1-13eab45fbbe2 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:16:43.891184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.990140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:43.998286 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3cf5d2b1-4f78-4643-83ed-c3e9717e0aa4 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 200 len: 1303 microversion: 2.1 time: 0.194690 Jul 18 02:16:43.999129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 616/1179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 1303 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.004307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.004956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.011670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.012433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.013594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.014213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.105514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:44.138859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a902b4b-fa8a-40d8-a32f-347d390452d2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1339 microversion: 2.1 time: 0.119266 Jul 18 02:16:44.157257 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 617/1180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:43 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.166584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5bac88cd-20f7-45fc-89e3-12177d3f14e5 req-76dda6c7-ff67-498a-96ce-a5bf67b37ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:44.190409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5bac88cd-20f7-45fc-89e3-12177d3f14e5 req-76dda6c7-ff67-498a-96ce-a5bf67b37ef5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.190879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5bac88cd-20f7-45fc-89e3-12177d3f14e5 req-76dda6c7-ff67-498a-96ce-a5bf67b37ef5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.220195 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5bac88cd-20f7-45fc-89e3-12177d3f14e5 req-76dda6c7-ff67-498a-96ce-a5bf67b37ef5 service nova] Creating event network-changed:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:16:44.231257 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5bac88cd-20f7-45fc-89e3-12177d3f14e5 req-76dda6c7-ff67-498a-96ce-a5bf67b37ef5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081136 Jul 18 02:16:44.236189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 618/1181] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:44.339027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:44.360776 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb6d9da7-45cc-4f32-9d03-1992c2a461b9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 1.725278 Jul 18 02:16:44.364003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 564/1182] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:42 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.397717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.399299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.415509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.416299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.417576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.419140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.816297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:44.817284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:44.830081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.831588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:44.833843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:44.834517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.052319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:45.082317 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c56f85f5-121f-4a5e-8fd3-58e38c3944f3 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.687801 Jul 18 02:16:45.086404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 619/1183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:44 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:45.114071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.117561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: ddeee982-0343-4f11-a4a1-13eab45fbbe2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.131770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.132808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.134659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.135831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.179689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] HTTP exception thrown: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Request method failure captured: Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 HTTP/1.1 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHLLrv_nbChRPsBmNFVPZ9E87ABW3u_LRzBVyfMZjUu3sna9fZk6giu0UteOxGaaXK5LaSzpjBx7j-cNytAyyFJokQhWZO-F2MU9Z1HlbRP3oncjaS9kFiz505i1H50r6RkKPXHd1tq5SidCm2fiGvvw8Qqy8BoxzforDWQdybadqs Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:45.186973 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_952dae33267642bd982964e23ca1b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/952dae33267642bd982964e23ca1b231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8d162823ac51401ba0d2fb537f76af60 Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. Jul 18 02:16:45.190056 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ddeee982-0343-4f11-a4a1-13eab45fbbe2'} Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:45.192273 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. Jul 18 02:16:45.195101 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:45.202127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Returning 404 to user: Instance ddeee982-0343-4f11-a4a1-13eab45fbbe2 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:45.202504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8536d304-ca6a-445e-a890-d9864f32ccc1 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2" status: 404 len: 111 microversion: 2.1 time: 0.113952 Jul 18 02:16:45.209016 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 620/1184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/ddeee982-0343-4f11-a4a1-13eab45fbbe2 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:45.218339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.218971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.229058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.266205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.267039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.275250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:45.286450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.287599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.297446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90dd0624-5880-46c6-88dd-91582c0bce5a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1468 microversion: 2.1 time: 0.479156 Jul 18 02:16:45.298407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 565/1185] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:44 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1468 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:45.314816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.317267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.337439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.338218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.339718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.339718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.393708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:45.523992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:45.562830 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-660aea0e-093e-481c-bcc0-d3cb4147dc21 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1337 microversion: 2.1 time: 0.352362 Jul 18 02:16:45.565474 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 621/1186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1337 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:45.575860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6abe4391-c142-4b57-9238-83972e6c09c9 tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 204 len: 0 microversion: 2.1 time: 0.270651 Jul 18 02:16:45.575860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 566/1187] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:45 2022] DELETE /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:45.580234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.588293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:45.589160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:45.597378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.598452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.599486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.600318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.606349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:45.607990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Searching by: {'reservation_id': 'r-frdhlqwn', 'deleted': False, 'project_id': '46ba6d7afda14ac8a41818afb217ab40'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:16:45.629843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.630629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.637179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.637983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.790203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:16:45.911703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:45.926412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:45.927215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:45.995065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:46.007974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b30dc532-9dd0-41c7-b637-f947d45d6473 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.429426 Jul 18 02:16:46.008894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 622/1188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.016013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.017000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:46.026320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.027077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.028977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.031111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.122273 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-035b9f54-3cd5-48b6-8b8a-b1e011b6367f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-frdhlqwn" status: 200 len: 2930 microversion: 2.1 time: 0.549513 Jul 18 02:16:46.123018 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 567/1189] 10.222.0.67 () {58 vars in 1196 bytes} [Mon Jul 18 02:16:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-frdhlqwn => generated 2930 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.368038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:46.384724 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de1ec0a2-2b1e-4b8a-a938-e2b464302c4b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1468 microversion: 2.1 time: 0.374025 Jul 18 02:16:46.386440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 623/1190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1468 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.414777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1439374094", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "02468610-b7a9-4f9f-b82b-fcd8322cd0c8"}], "security_groups": [{"name": "tempest-securitygroup--1969286796"}], "key_name": "tempest-keypair-1845830473", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:46.451017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4ed01b8-50fc-4965-b41c-7ec51a81b605 tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] Calling method '.version_select at 0x7fab047264c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.598174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] validate_networks() for [('02468610-b7a9-4f9f-b82b-fcd8322cd0c8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:46.624227 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4ed01b8-50fc-4965-b41c-7ec51a81b605 tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 5361 microversion: 2.1 time: 0.498628 Jul 18 02:16:46.625761 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 568/1191] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/os-networks => generated 5361 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.706328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d4b0fc42-b1e8-4700-baad-c128d9ed4d8c req-abd52af0-b89f-4b37-ae32-f429626d808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67391aa-8605-44cd-b9db-f985751b41cd", "name": "network-vif-plugged", "status": "completed", "tag": "6792c608-8e1e-42b1-9e82-1ceafcd04124"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:46.718439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d4b0fc42-b1e8-4700-baad-c128d9ed4d8c req-abd52af0-b89f-4b37-ae32-f429626d808e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.718964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d4b0fc42-b1e8-4700-baad-c128d9ed4d8c req-abd52af0-b89f-4b37-ae32-f429626d808e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.734981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d4b0fc42-b1e8-4700-baad-c128d9ed4d8c req-abd52af0-b89f-4b37-ae32-f429626d808e service nova] Creating event network-vif-plugged:6792c608-8e1e-42b1-9e82-1ceafcd04124 for instance a67391aa-8605-44cd-b9db-f985751b41cd on n-h2-849796-1 Jul 18 02:16:46.741156 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d4b0fc42-b1e8-4700-baad-c128d9ed4d8c req-abd52af0-b89f-4b37-ae32-f429626d808e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113426 Jul 18 02:16:46.741831 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 569/1192] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:46.747462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.748159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:46.756753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.757283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.758085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.758732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.936032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:46.945234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b152f37-6092-47bf-8d8e-440d8e9922f9 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 0.202036 Jul 18 02:16:46.946125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 570/1193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.951226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49996b50-6e7b-4049-bfb5-85ea19fb9eee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:46.969145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_groups [None req-49996b50-6e7b-4049-bfb5-85ea19fb9eee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Querying cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) for 2 instances {{(pid=119440) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:16:46.969985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49996b50-6e7b-4049-bfb5-85ea19fb9eee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:46.972129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49996b50-6e7b-4049-bfb5-85ea19fb9eee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:46.993931 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49996b50-6e7b-4049-bfb5-85ea19fb9eee tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/de626d73-3627-413d-9d1a-44772b7cc237" status: 200 len: 270 microversion: 2.1 time: 0.046492 Jul 18 02:16:46.994528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 571/1194] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/os-server-groups/de626d73-3627-413d-9d1a-44772b7cc237 => generated 270 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:47.004055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.004606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.011364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.011818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.012613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.013084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.101489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:47.102433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:47.103208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:47.104182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:47.105779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:47.120790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.121514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.122603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.123352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.151435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:47.157159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for user d2b97e560fcf4750b2aad92d6d37e611 and project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:47.176179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:47.179374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:47.185114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:47.199356 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aecbb6cd-75d3-4fa0-a28d-4e1ff5ca6bd5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.202666 Jul 18 02:16:47.200753 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 572/1195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:46 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.227560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e631467b-7713-49d1-af9b-d77165a5faaa tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] Calling method '.version_select at 0x7fab0482bee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.262356 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-82cb519d-b6e7-4044-9e09-447a8b7e5f25 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857046 Jul 18 02:16:47.264428 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 624/1196] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:16:47.275900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.277042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.286678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.287192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.288620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.289159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.398802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e631467b-7713-49d1-af9b-d77165a5faaa tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks/004947f5-27ae-49b3-adb0-22d85e36f691" status: 200 len: 652 microversion: 2.1 time: 0.178064 Jul 18 02:16:47.399411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 573/1197] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/os-networks/004947f5-27ae-49b3-adb0-22d85e36f691 => generated 652 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:47.420477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.420477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.431154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.431802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.432843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:47.433563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:47.548766 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78ae5761-a834-4f3a-b1ce-a3bdb6cf8d19 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1619 microversion: 2.1 time: 0.281859 Jul 18 02:16:47.554129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 625/1198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1619 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.556840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93d5d0d9-6d20-4248-8f49-198740f04c6e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:47.558233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93d5d0d9-6d20-4248-8f49-198740f04c6e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:47.703618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93d5d0d9-6d20-4248-8f49-198740f04c6e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:47.720134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93d5d0d9-6d20-4248-8f49-198740f04c6e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1235 microversion: 2.1 time: 0.167743 Jul 18 02:16:47.723797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 626/1199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1235 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.745936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66d45280-b726-4182-a9de-9122544ff4b1 tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] Calling method '.version_select at 0x7fab05767ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.019119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:48.046645 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-464cdb04-846b-40c0-a736-4313305e1e4b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.637471 Jul 18 02:16:48.047608 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 574/1200] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:48.055236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.055908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:48.064879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.066560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.067562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.069526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.288128 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66d45280-b726-4182-a9de-9122544ff4b1 tempest-NetworksTest-1787713795 tempest-NetworksTest-1787713795-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 5361 microversion: 2.1 time: 0.560377 Jul 18 02:16:48.289767 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 627/1201] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:16:47 2022] GET /compute/v2.1/os-networks => generated 5361 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:48.303863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.308566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:48.323069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.324227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.326294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.328970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.591847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162823ac51401ba0d2fb537f76af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952dae33267642bd982964e23ca1b231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:48.623503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de3447b2-e273-4f33-98d6-aa72e8ec154b tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 200 len: 1468 microversion: 2.1 time: 0.570914 Jul 18 02:16:48.624794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 575/1202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:48 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 1468 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:48.645655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.650861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:48.667886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.676216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.678307 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ce9edb8-b1f8-4593-8835-a85355da2957 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 200 len: 1620 microversion: 2.1 time: 0.382961 Jul 18 02:16:48.679432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.683156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.693152 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 628/1203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:48 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 1620 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:48.698584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:48.699517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:48.719137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.720361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.722081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:48.722738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:48.824205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:49.639696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:49.666374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-caa447e4-a54b-48cd-97a3-777b193e67b4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.971356 Jul 18 02:16:49.668503 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 629/1204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:48 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:49.714209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:49.718342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:49.743473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:49.744331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:49.747216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:49.747897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:49.789555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:49.821897 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-337527e1-d87c-4f62-b567-fdccb130c682 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1315 microversion: 2.1 time: 1.189349 Jul 18 02:16:49.828140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 576/1205] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:48 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1315 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:49.858646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1551507934", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:50.031690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:16:50.039287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:50.053728 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f40580e9-2f20-494b-8580-a879c289dce8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1293 microversion: 2.1 time: 0.383363 Jul 18 02:16:50.058008 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 630/1206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:49 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:50.068850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:50.070495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:50.086858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.087364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:50.090329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:50.092039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.012865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:16:51.013839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:16:51.014532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:16:51.015242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:16:51.021085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:16:51.041502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.042846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.051161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.052571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.100448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:16:51.114021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:16:51.152817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:16:51.165524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:16:51.273009 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f426d2f4-adeb-4dc3-aba6-e07523b8e308 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440731 Jul 18 02:16:51.277191 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 577/1207] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:16:51.288584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.290061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] [instance: eadcb7a8-716b-41fd-b3cc-e2e8707fb17a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:51.308306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.309605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.312758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.313784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.341915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] HTTP exception thrown: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Request method failure captured: Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a HTTP/1.1 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHLLrv_nbChRPsBmNFVPZ9E87ABW3u_LRzBVyfMZjUu3sna9fZk6giu0UteOxGaaXK5LaSzpjBx7j-cNytAyyFJokQhWZO-F2MU9Z1HlbRP3oncjaS9kFiz505i1H50r6RkKPXHd1tq5SidCm2fiGvvw8Qqy8BoxzforDWQdybadqs Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:16:51.344789 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_952dae33267642bd982964e23ca1b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/952dae33267642bd982964e23ca1b231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/952dae33267642bd982964e23ca1b231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 952dae33267642bd982964e23ca1b231 Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminTestJSON-1408827217 Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8d162823ac51401ba0d2fb537f76af60 Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminTestJSON-1408827217-project Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. Jul 18 02:16:51.347089 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'eadcb7a8-716b-41fd-b3cc-e2e8707fb17a'} Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:51.348013 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. Jul 18 02:16:51.350278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:51.355298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] Returning 404 to user: Instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:51.356583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24cd39b5-b5a1-4635-b2f1-b7e0b5cbd9fb tempest-ServersAdminTestJSON-1408827217 tempest-ServersAdminTestJSON-1408827217-project] 10.222.0.67 "GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a" status: 404 len: 111 microversion: 2.1 time: 0.077657 Jul 18 02:16:51.358396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 578/1208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers/eadcb7a8-716b-41fd-b3cc-e2e8707fb17a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:51.588550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:51.662012 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cff36a17-4073-4b4c-b594-6d2f2ee3c36c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 1.583987 Jul 18 02:16:51.673218 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 631/1209] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:50 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.684760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a2bd7f16-3262-4514-9e3e-a2960132140f req-577890fa-0cbd-43b2-b98b-aeb530a1bddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadcb7a8-716b-41fd-b3cc-e2e8707fb17a", "name": "network-vif-deleted", "tag": "23f20067-b9d8-4e1f-a813-fbd5e5efc872"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:51.694464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.695617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:51.717509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a2bd7f16-3262-4514-9e3e-a2960132140f req-577890fa-0cbd-43b2-b98b-aeb530a1bddf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.719020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a2bd7f16-3262-4514-9e3e-a2960132140f req-577890fa-0cbd-43b2-b98b-aeb530a1bddf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.725632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.726609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.732679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.734784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.749037 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a2bd7f16-3262-4514-9e3e-a2960132140f req-577890fa-0cbd-43b2-b98b-aeb530a1bddf service nova] Creating event network-vif-deleted:23f20067-b9d8-4e1f-a813-fbd5e5efc872 for instance eadcb7a8-716b-41fd-b3cc-e2e8707fb17a on n-h1-849796-1 Jul 18 02:16:51.765179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a2bd7f16-3262-4514-9e3e-a2960132140f req-577890fa-0cbd-43b2-b98b-aeb530a1bddf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404072 Jul 18 02:16:51.766764 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 579/1210] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:51.780712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-123a7d0e-298c-4a44-ad98-b5e4a3b95eb2 req-f513a860-32e4-4afa-8bf5-517dc3489e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:51.803557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-123a7d0e-298c-4a44-ad98-b5e4a3b95eb2 req-f513a860-32e4-4afa-8bf5-517dc3489e36 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.804546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-123a7d0e-298c-4a44-ad98-b5e4a3b95eb2 req-f513a860-32e4-4afa-8bf5-517dc3489e36 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.835496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-123a7d0e-298c-4a44-ad98-b5e4a3b95eb2 req-f513a860-32e4-4afa-8bf5-517dc3489e36 service nova] Creating event network-changed:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:16:51.850202 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-123a7d0e-298c-4a44-ad98-b5e4a3b95eb2 req-f513a860-32e4-4afa-8bf5-517dc3489e36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073483 Jul 18 02:16:51.852029 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 580/1211] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:51.865441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:51.868655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:51.882713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.884484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:51.887698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:51.889475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.370133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:52.388625 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d7b5ab0-cedb-4031-b897-b8266d6a0465 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1502 microversion: 2.1 time: 0.534144 Jul 18 02:16:52.390214 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 581/1212] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1502 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:52.406102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.410127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.422045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.426113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.429300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.431430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.432634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.566478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:52.582730 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e73b5ed-962c-453c-a4ce-7ba8bebf63a0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1293 microversion: 2.1 time: 0.189013 Jul 18 02:16:52.584343 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 582/1213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:52.594910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.597664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.610506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.611304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.613659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.614618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.696812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:52.708183 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8002bb5a-4689-42e6-8eb2-cd7d03cf0d47 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 1.029103 Jul 18 02:16:52.708827 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 632/1214] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:51 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:52.716741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-03b40596-c973-485d-8d9e-4f1b2766181b req-cf63bcd4-409e-4360-bbba-31c05179b447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-plugged", "status": "completed", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:52.722545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:52.732973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d1b2817-f976-490b-99cb-d323c2f5fa8e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1221 microversion: 2.1 time: 0.146907 Jul 18 02:16:52.743118 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 583/1215] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:52.750447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.751288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.751999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-03b40596-c973-485d-8d9e-4f1b2766181b req-cf63bcd4-409e-4360-bbba-31c05179b447 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.753024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-03b40596-c973-485d-8d9e-4f1b2766181b req-cf63bcd4-409e-4360-bbba-31c05179b447 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.762619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.763276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.764382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.765105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.768834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-03b40596-c973-485d-8d9e-4f1b2766181b req-cf63bcd4-409e-4360-bbba-31c05179b447 service nova] Creating event network-vif-plugged:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:16:52.774558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-03b40596-c973-485d-8d9e-4f1b2766181b req-cf63bcd4-409e-4360-bbba-31c05179b447 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064122 Jul 18 02:16:52.775179 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 633/1216] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:52.782746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:52.784238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:52.795261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.797578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.802440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:52.803504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:52.812064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:16:53.103156 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1916aead-c59c-4a3b-b0e1-c284596a009c tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 204 len: 0 microversion: 2.1 time: 0.363244 Jul 18 02:16:53.108716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 584/1217] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:16:52 2022] DELETE /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:53.122314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.125448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:53.134741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.135354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.136254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.136783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.385074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:53.401815 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f9637ef-01d8-4b2d-b01c-77189617aedb tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1508 microversion: 2.1 time: 0.291545 Jul 18 02:16:53.403034 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 585/1218] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:53 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:53.546009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:53.555387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-accab20d-4d36-4e23-bf7d-921941cb4fb9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.778615 Jul 18 02:16:53.556500 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 634/1219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:52 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:53.618417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.624013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:53.642155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.642363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.645617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.646134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.739581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:53.740343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:53.749933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.750561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:53.751570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:53.752316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.001987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:54.031200 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-00ab5be8-9708-42b4-a3fc-8968fbe03a3b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.431501 Jul 18 02:16:54.039655 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 586/1220] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:53 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:54.045244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.046483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:54.056876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.058959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.060696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.061401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.131044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:54.146579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7dead585-92af-4261-a830-0b076460331a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.417239 Jul 18 02:16:54.148162 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 635/1221] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:53 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:54.161326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:54.169920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28ac352d-21d6-4fb0-a7d7-fb09731fc68c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1269 microversion: 2.1 time: 0.128673 Jul 18 02:16:54.181371 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 587/1222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:54 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:54.432887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.437563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:54.458652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.461897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.462939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.463502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.591676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:54.592497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:54.602986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.603444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.605180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:54.605879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:54.826362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:54.838256 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01d79963-d666-455c-92e7-d70c1cea788d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.248206 Jul 18 02:16:54.850017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 588/1223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:54 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:54.974147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.016540 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ce37c23-2931-46cc-b7c5-62ef6dd2209b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1508 microversion: 2.1 time: 0.589137 Jul 18 02:16:55.031545 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 636/1224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:54 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1508 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.046986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.047787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:55.061485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.065872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.067173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.073314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.166186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.166873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:55.188165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.190482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.193308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.193909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.316226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.325735 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf6e488a-0f2b-42bf-8be7-c00871fe7166 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.282951 Jul 18 02:16:55.335221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 589/1225] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:55.346238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.347742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:55.368817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.369926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.371293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.375032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.488393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.500818 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c7d01eb-ed1f-4365-8818-00bcb5322713 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1269 microversion: 2.1 time: 0.163411 Jul 18 02:16:55.513625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 590/1226] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.564429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:55.568771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.577608 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-41b4bada-dc14-4d50-b51b-a78e28841823 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.415727 Jul 18 02:16:55.579132 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 637/1227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:55.805172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ea827cee-e045-49ed-a970-6b7d5f09603f req-dbab1617-3dd0-48fa-8ccc-c80c2326e91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:55.829067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ea827cee-e045-49ed-a970-6b7d5f09603f req-dbab1617-3dd0-48fa-8ccc-c80c2326e91d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.829642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ea827cee-e045-49ed-a970-6b7d5f09603f req-dbab1617-3dd0-48fa-8ccc-c80c2326e91d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.859710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:55.861167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:55.880296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.880990 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ea827cee-e045-49ed-a970-6b7d5f09603f req-dbab1617-3dd0-48fa-8ccc-c80c2326e91d service nova] Creating event network-changed:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:16:55.885257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.886580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:55.887393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:55.890342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ea827cee-e045-49ed-a970-6b7d5f09603f req-dbab1617-3dd0-48fa-8ccc-c80c2326e91d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375326 Jul 18 02:16:55.898106 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 591/1228] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:56.040122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.040860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.055079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.055768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.056882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.057537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.164144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:56.176848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3f56913-541a-4601-8682-9ca6a6050290 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.323825 Jul 18 02:16:56.189521 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 638/1229] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:55 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:56.348032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.349508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.361405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.362676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.364097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.365407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.442246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:56.462445 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3931c026-f780-4cbc-87eb-ce3c36ea5262 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1508 microversion: 2.1 time: 0.425676 Jul 18 02:16:56.463670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 592/1230] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:56.527743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.529391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.552260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.553597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.555104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.555954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.640728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:56.660773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5837ba49-93d6-4628-9f40-9ed3bb20959e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.318918 Jul 18 02:16:56.671241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 639/1231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:56.671553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:56.673066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:56.696106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.697299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.697505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:56.699123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:56.700191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:56.706981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a6fec9d-34d2-4b57-9a3c-48423115d97f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1269 microversion: 2.1 time: 0.189243 Jul 18 02:16:56.708112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 593/1232] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:56.949751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:56.964248 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6e0c7f8-0bb6-469b-86ff-5fab5f78dc8c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.299746 Jul 18 02:16:56.965330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 640/1233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:56 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:57.154978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.204326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e666bb2e-23ca-4c24-a9be-0489522d9931 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T02%3A16%3A57.106285&end=2022-07-19T02%3A16%3A57.106285" status: 404 len: 112 microversion: - time: 0.093587 Jul 18 02:16:57.210445 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 641/1234] 10.222.0.67 () {58 vars in 1315 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-17T02%3A16%3A57.106285&end=2022-07-19T02%3A16%3A57.106285 => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:16:57.216320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.217180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:57.220804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84c39791-d8ff-44f3-bce8-3d3ecd57b333 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] Calling method '.version_select at 0x7fab04726550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.222088 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:57.222088 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:16:57.226201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.226913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.227927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.228565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.229795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=35 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.244005 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84c39791-d8ff-44f3-bce8-3d3ecd57b333 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.237790 Jul 18 02:16:57.245995 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 594/1235] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:57.255842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ac0e67f-7c36-4aac-91e0-5f0a3eabb623 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] Calling method '.version_select at 0x7fab049dfca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.259959 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7ac0e67f-7c36-4aac-91e0-5f0a3eabb623 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ac0e67f-7c36-4aac-91e0-5f0a3eabb623 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] Request method failure captured: Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-simple-tenant-usage/ff29b53ae660472abf0daa938fdf3da3?start=2022-07-19T02%3A16%3A57.106285&end=2022-07-17T02%3A16%3A57.106285 HTTP/1.1 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MKYscCoV3xrgTmB4mnT6P22J-FcAUff7GM7alX0TLopH9-V2BpjUD0Jo_N6RWKUMozExfvNxhYOHN9GW8FzgPaN-Wz0wg--ZwxlJrD6OHHomTjJEwubtZUl7y5-VIl8R73WDKYjvF_weIKmuJdh_SdX47brnmN-nu3l3lHZEHUlmcs Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d4e38568bedb4348b55951f3847a13c1 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1089095215 Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:16:57.262906 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4e38568bedb4348b55951f3847a13c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d4e38568bedb4348b55951f3847a13c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d4e38568bedb4348b55951f3847a13c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4e38568bedb4348b55951f3847a13c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1089095215 Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d4e38568bedb4348b55951f3847a13c1 Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1089095215 Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 051e743b51dc4bac8c4c31e7dce27128 Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid start time. The start time cannot occur after the end time. Jul 18 02:16:57.265592 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ff29b53ae660472abf0daa938fdf3da3'} Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:16:57.267783 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ac0e67f-7c36-4aac-91e0-5f0a3eabb623 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:57.273268 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ac0e67f-7c36-4aac-91e0-5f0a3eabb623 tempest-TenantUsagesNegativeTestJSON-1089095215 tempest-TenantUsagesNegativeTestJSON-1089095215-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/ff29b53ae660472abf0daa938fdf3da3?start=2022-07-19T02%3A16%3A57.106285&end=2022-07-17T02%3A16%3A57.106285" status: 400 len: 111 microversion: 2.1 time: 0.018238 Jul 18 02:16:57.276075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 595/1236] 10.222.0.67 () {58 vars in 1411 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/os-simple-tenant-usage/ff29b53ae660472abf0daa938fdf3da3?start=2022-07-19T02%3A16%3A57.106285&end=2022-07-17T02%3A16%3A57.106285 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:16:57.279269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1406012a-bda2-465b-afab-449ad53657b5 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] Action: 'update', calling method: .version_select at 0x7fab04a7e5e0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:57.282831 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:57.282831 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:16:57.452560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:57.468944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a79887c-4dd1-42d9-82e0-7cd4c2b788be tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.256490 Jul 18 02:16:57.470775 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 642/1237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:57.634634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a498afcb-3ba5-4b36-92f0-ad956ec5ba0c tempest-TenantUsagesNegativeTestJSON-655916024 tempest-TenantUsagesNegativeTestJSON-655916024-project] Calling method '.version_select at 0x7fab057c9670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.653490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a498afcb-3ba5-4b36-92f0-ad956ec5ba0c tempest-TenantUsagesNegativeTestJSON-655916024 tempest-TenantUsagesNegativeTestJSON-655916024-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e590fc423baa426bbae1544908c22ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff29b53ae660472abf0daa938fdf3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a498afcb-3ba5-4b36-92f0-ad956ec5ba0c tempest-TenantUsagesNegativeTestJSON-655916024 tempest-TenantUsagesNegativeTestJSON-655916024-project] Request method failure captured: Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A16%3A57.106285&end=2022-07-19T02%3A16%3A57.106285&detailed=1 HTTP/1.1 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MKXWieQforjP34CLV-Dpaj8ehSCiYilmkwfBTihWeqKBoA0NS2VgfGQeJZ3eFA6cjSnGN_N_TPE85uDeGsngEEqlE494vj1Y0gI4N-5xywduntOMEesPrcbFREQNzUCPhzGW38eGSibS0BHgkALJGb4wrJzvz-LTwSZBiRUuJb86T8 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: ff29b53ae660472abf0daa938fdf3da3 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-655916024 Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:16:57.661767 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ff29b53ae660472abf0daa938fdf3da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ff29b53ae660472abf0daa938fdf3da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ff29b53ae660472abf0daa938fdf3da3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ff29b53ae660472abf0daa938fdf3da3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-655916024 Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: ff29b53ae660472abf0daa938fdf3da3 Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-655916024 Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TenantUsagesNegativeTestJSON-655916024-project Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: e590fc423baa426bbae1544908c22ba6 Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-655916024-project Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:16:57.664782 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:16:57.666619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:16:57.672414 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:16:57.678071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 18 02:16:57.678071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:16:57.678071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a498afcb-3ba5-4b36-92f0-ad956ec5ba0c tempest-TenantUsagesNegativeTestJSON-655916024 tempest-TenantUsagesNegativeTestJSON-655916024-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:16:57.678071 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a498afcb-3ba5-4b36-92f0-ad956ec5ba0c tempest-TenantUsagesNegativeTestJSON-655916024 tempest-TenantUsagesNegativeTestJSON-655916024-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A16%3A57.106285&end=2022-07-19T02%3A16%3A57.106285&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.190201 Jul 18 02:16:57.678071 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 643/1238] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-17T02%3A16%3A57.106285&end=2022-07-19T02%3A16%3A57.106285&detailed=1 => generated 123 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:16:57.712586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.713790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:57.716910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.748012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.759222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.761218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.762672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.876517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1406012a-bda2-465b-afab-449ad53657b5 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.603479 Jul 18 02:16:57.878138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 596/1239] 10.222.0.67 () {60 vars in 1205 bytes} [Mon Jul 18 02:16:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:57.888200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:57.890494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:57.909043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.910668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:57.912233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:57.920648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.245908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:58.278077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.282242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97254be2-5396-4e35-9b7d-a09e226262fc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.402260 Jul 18 02:16:58.283756 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 597/1240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:58.308784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:58.310451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:58.323358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.324198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.325967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.326881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.423736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:58.433226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-684b5644-a3f1-4f82-b21b-ef0408c98493 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1508 microversion: 2.1 time: 0.763567 Jul 18 02:16:58.440265 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 644/1241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:57 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1508 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:58.445504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86c6fe7f-f9bb-4b86-bddb-31cfc1c3ff41 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] Calling method '.version_select at 0x7fab059a6040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:58.446434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:58.454175 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:58.454175 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:16:58.482814 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c6a927b-50a0-441c-bb80-4be834dc5549 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1275 microversion: 2.1 time: 0.183812 Jul 18 02:16:58.487211 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86c6fe7f-f9bb-4b86-bddb-31cfc1c3ff41 tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.044134 Jul 18 02:16:58.497986 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 645/1242] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:58.504232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 598/1243] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:58.523294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:58.524680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:58.531915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:58.534138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:58.537205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.537999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.540220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.542227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.553329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.554324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.559732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:58.561131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:58.884069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:58.897461 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ce51186-ef71-469c-b7c6-0823386e87bf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1316 microversion: 2.1 time: 0.384338 Jul 18 02:16:58.905308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 599/1244] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:58.908067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61e1772c-792b-4b1b-b951-6c0b1d864c1f tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] Action: 'update', calling method: .version_select at 0x7fab054384c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:16:58.912212 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:16:58.912212 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:16:58.919515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=14,nova_api:INSERT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.105530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:59.125991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a157032-06fc-4c5c-87b2-b98939ffa5f7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.624296 Jul 18 02:16:59.127018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 646/1245] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:58 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:59.130454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61e1772c-792b-4b1b-b951-6c0b1d864c1f tempest-QuotaClassesAdminTestJSON-549657625 tempest-QuotaClassesAdminTestJSON-549657625-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.229574 Jul 18 02:16:59.131442 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 600/1246] 10.222.0.67 () {60 vars in 1205 bytes} [Mon Jul 18 02:16:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:16:59.327160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.332406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:59.378206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.382467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.388231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.390652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.465779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.466772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:59.480507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.481033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.481867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.482381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.738136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3365bf8981d4473eb4cd5d7dfb1506c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db19db96ca48f8a2292f7e068c0f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:59.747312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6cae803f-f130-4c7d-acf1-1f35b6772ca4 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 200 len: 1508 microversion: 2.1 time: 0.285452 Jul 18 02:16:59.748991 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 601/1247] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:59 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:59.754500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.755141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:59.762738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.763392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.764255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.764709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.897160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:16:59.911342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-00569aa7-e854-4ee1-a669-6093cc2ce274 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1275 microversion: 2.1 time: 0.161475 Jul 18 02:16:59.917132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 602/1248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:59 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:59.928457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:16:59.929268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:16:59.937565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.938218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:16:59.940655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:16:59.940655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.631439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:00.648207 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed88d272-96d2-4ef6-b246-f64cd34da040 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1465 microversion: 2.1 time: 0.721473 Jul 18 02:17:00.663547 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 603/1249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:59 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1465 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:00.678375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:00.679449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:00.687782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.688536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.689864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.690954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.755204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:00.775415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7673f2e7-d2ae-4716-b572-8516099f88dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 1.468232 Jul 18 02:17:00.801423 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 647/1250] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:16:59 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:00.819149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:00.820286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:00.836500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.839666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:00.841525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:00.842389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.072200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.104562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:01.118784 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab188649-8bac-463d-a2da-dd39ba924be0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.451802 Jul 18 02:17:01.119492 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 604/1251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:00 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:01.134370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-789523262", "metadata": {"image_type": "test"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:01.135812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:01.152797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.153410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.154181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.154652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.290751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Getting quotas for project ad246f5d093c48c48152059d277671cb. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:01.308307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Getting quotas for user b1ba4e1d4061429c9a861e8020c10454 and project ad246f5d093c48c48152059d277671cb. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:01.896509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13077709-b267-4ba6-a202-d4df50197dae tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "POST /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060/action" status: 202 len: 0 microversion: 2.1 time: 0.772454 Jul 18 02:17:01.912056 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 605/1252] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:17:01 2022] POST /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:17:01.930563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:01.938038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:01.959434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.970554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.974213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:01.977831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:01.996751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:02.028646 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18fcc294-aa0f-4a62-ae93-79686a84057d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 2340 microversion: 2.25 time: 1.222855 Jul 18 02:17:02.029673 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 648/1253] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:00 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 2340 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:02.044180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:02.053206 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:02.053947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd HTTP/1.1 Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:02.057624 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:02.059126 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a67391aa-8605-44cd-b9db-f985751b41cd'} Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:02.060210 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:02.062355 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:02.064137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:02.064137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-703f9e8d-78c0-4895-9db1-b9e65efea074 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 404 len: 111 microversion: 2.1 time: 0.143250 Jul 18 02:17:02.072615 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 606/1254] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:01 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:02.093660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.094124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.106552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.107516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.113925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-bd152232-abd8-4525-9e0e-8b55295eb0c9 req-842b6cce-d542-449a-98ad-55d02c247f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67391aa-8605-44cd-b9db-f985751b41cd", "name": "network-vif-deleted", "tag": "6792c608-8e1e-42b1-9e82-1ceafcd04124"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:02.170260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bd152232-abd8-4525-9e0e-8b55295eb0c9 req-842b6cce-d542-449a-98ad-55d02c247f58 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.171062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bd152232-abd8-4525-9e0e-8b55295eb0c9 req-842b6cce-d542-449a-98ad-55d02c247f58 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.252817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-bd152232-abd8-4525-9e0e-8b55295eb0c9 req-842b6cce-d542-449a-98ad-55d02c247f58 service nova] Creating event network-vif-deleted:6792c608-8e1e-42b1-9e82-1ceafcd04124 for instance a67391aa-8605-44cd-b9db-f985751b41cd on n-h2-849796-1 Jul 18 02:17:02.296964 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-bd152232-abd8-4525-9e0e-8b55295eb0c9 req-842b6cce-d542-449a-98ad-55d02c247f58 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201864 Jul 18 02:17:02.301437 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 607/1255] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:02.329422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-84e5afd3-9d0f-4a4e-9360-368777e1521b req-88d3dc40-b223-495a-aa6b-525b0de81bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-plugged", "status": "completed", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:02.372484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-84e5afd3-9d0f-4a4e-9360-368777e1521b req-88d3dc40-b223-495a-aa6b-525b0de81bd8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.372994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-84e5afd3-9d0f-4a4e-9360-368777e1521b req-88d3dc40-b223-495a-aa6b-525b0de81bd8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.424639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-84e5afd3-9d0f-4a4e-9360-368777e1521b req-88d3dc40-b223-495a-aa6b-525b0de81bd8 service nova] Creating event network-vif-plugged:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:17:02.453096 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-84e5afd3-9d0f-4a4e-9360-368777e1521b req-88d3dc40-b223-495a-aa6b-525b0de81bd8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149045 Jul 18 02:17:02.454258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 608/1256] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:02.477775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:02.479131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:02.496757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.497590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.499073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:02.499877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:02.994970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:03.033217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30375223-b885-45b0-82fa-9e000c024759 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.575922 Jul 18 02:17:03.035947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 609/1257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:02 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.043190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea6432d5-1d70-4196-b3ec-5d1855d1357c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05438e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.084132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:03.099020 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8fd54b9-8e86-499b-b1d2-c9fe311db436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 1.061369 Jul 18 02:17:03.099372 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 649/1258] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:02 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.116820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.121470 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:17:03.121470 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:17:03.121939 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea6432d5-1d70-4196-b3ec-5d1855d1357c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.083252 Jul 18 02:17:03.123083 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 610/1259] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.128563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.129405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.133115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.133957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.134101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-482688002", "metadata": {"image_type": "test"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:03.136001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.148313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.149265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.154691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.155784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.203544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd/action HTTP/1.1 Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 111 Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.208493 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-482688002", "metadata": {"image_type": "test"}}} Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.209983 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a67391aa-8605-44cd-b9db-f985751b41cd', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-482688002', 'metadata': {'image_type': 'test'}}}} Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.210865 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.215495 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.217048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.217048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.217048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.217048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.217305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-82a68541-5b1a-439b-8cd1-634632c8fd2f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.099074 Jul 18 02:17:03.217305 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 650/1260] 10.222.0.67 () {60 vars in 1216 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:03.224850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.230671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.237671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.240370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73e41e20-9528-42a2-b407-220a66d095df tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "POST /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd/action" status: 404 len: 111 microversion: 2.1 time: 0.113574 Jul 18 02:17:03.251340 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 611/1261] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Jul 18 02:17:03 2022] POST /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.254906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.257577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.261446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1180046710", "metadata": {"image_type": "test"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:03.263400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.265221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Failed to fetch instance by id tempest-invalid-1860820879 {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:17:03.265754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.267852 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance tempest-invalid-1860820879 could not be found. Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/tempest-invalid-1860820879/action HTTP/1.1 Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 112 Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.275724 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1180046710", "metadata": {"image_type": "test"}}} Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.277175 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance tempest-invalid-1860820879 could not be found. Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'tempest-invalid-1860820879', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1180046710', 'metadata': {'image_type': 'test'}}}} Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1860820879 could not be found. Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.278212 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1860820879 could not be found. Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1860820879 could not be found. Jul 18 02:17:03.281403 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.282592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance tempest-invalid-1860820879 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.282592 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12665b23-ffca-4f31-9024-c0bbb2a694c0 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "POST /compute/v2.1/servers/tempest-invalid-1860820879/action" status: 404 len: 101 microversion: 2.1 time: 0.025605 Jul 18 02:17:03.282592 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 612/1262] 10.222.0.67 () {60 vars in 1248 bytes} [Mon Jul 18 02:17:03 2022] POST /compute/v2.1/servers/tempest-invalid-1860820879/action => generated 101 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.295437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1561904593"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:03.297961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:17:03.298888 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 57 Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.302131 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-test-snap-1561904593"}} Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.303849 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1561904593'}}} Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.305222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.306494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.307681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.307681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d87e145-7f58-418d-b3f9-7903acaa1a80 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016501 Jul 18 02:17:03.308664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 613/1263] 10.222.0.67 () {60 vars in 1274 bytes} [Mon Jul 18 02:17:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:17:03.338389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1638087939"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:03.340388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:17:03.341531 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 57 Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.344895 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-test-snap-1638087939"}} Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.347323 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1638087939'}}} Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.348250 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 18 02:17:03.352120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.354585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.358758 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a6eef31-7da9-405d-a328-6b9f7cf7364b tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.040205 Jul 18 02:17:03.359973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 614/1264] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Jul 18 02:17:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.384142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.388850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.415661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.420468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.427173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.428121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.486855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd HTTP/1.1 Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.501487 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.504644 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a67391aa-8605-44cd-b9db-f985751b41cd'} Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.506159 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.510526 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.516830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.520005 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f3341c27-baf0-4267-a75c-a2562d193749 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 404 len: 111 microversion: 2.1 time: 0.152386 Jul 18 02:17:03.522449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 615/1265] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:03 2022] DELETE /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.538069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:03.540170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] [instance: a67391aa-8605-44cd-b9db-f985751b41cd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:03.555098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.556605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.558474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:03.559519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:03.592379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] HTTP exception thrown: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Request method failure captured: Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd HTTP/1.1 Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ2qrwGc06PsqlX27RVwdvN8yAjygzWegNMLfpaavqpLs4aB8CG-Ap092HhJlkjPpKjV4yhXXrXVzT2Xbsce3gIn8w0JP7xsaqlHnAZnknaiPfo6vQS_GqVYR3syX6F6cGUw0eubU1hrPk9iZl7_vKhPoG6oyqRQxQhOoSdW6imKNs Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:03.596287 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3db19db96ca48f8a2292f7e068c0f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d3db19db96ca48f8a2292f7e068c0f9d Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-263086757 Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3365bf8981d4473eb4cd5d7dfb1506c8 Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesNegativeTestJSON-263086757-project Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.599219 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a67391aa-8605-44cd-b9db-f985751b41cd'} Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:03.606089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. Jul 18 02:17:03.608656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:03.610724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] Returning 404 to user: Instance a67391aa-8605-44cd-b9db-f985751b41cd could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:03.610724 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-98b6ab35-c344-45f0-be60-7d052174c280 tempest-ImagesNegativeTestJSON-263086757 tempest-ImagesNegativeTestJSON-263086757-project] 10.222.0.67 "GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd" status: 404 len: 111 microversion: 2.1 time: 0.071161 Jul 18 02:17:03.610724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 616/1266] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/servers/a67391aa-8605-44cd-b9db-f985751b41cd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:03.984255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:04.004957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32afb9c7-52ac-4bc6-88be-6b5bc70ac097 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.789865 Jul 18 02:17:04.011096 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 651/1267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:03 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:04.059953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:04.062521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:04.083422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.084218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.089468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.090373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.127895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:04.129923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:04.145165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.147809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.150231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:04.151000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:04.429620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:04.443903 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d2ee275-98a5-43fc-b67c-de90b97d31f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.393025 Jul 18 02:17:04.457090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 617/1268] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:04 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:04.468318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a896931f-93ad-46bb-b230-51bee8d9e79d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04f37940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:04.547029 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a896931f-93ad-46bb-b230-51bee8d9e79d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.086816 Jul 18 02:17:04.549533 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 618/1269] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:04 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:05.044765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:05.046072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:05.069989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.071077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.072337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.073196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.126426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:05.144973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb5d4d77-5a3f-4a32-a5da-efe8121cc2b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 1.022370 Jul 18 02:17:05.159082 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 652/1270] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:04 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:05.468823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:05.469935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:05.473173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:05.496070 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a138c10a-450d-443c-95ac-ad3a0fea37d7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1379 microversion: 2.1 time: 0.465054 Jul 18 02:17:05.499497 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 619/1271] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:05 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1379 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:05.507834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.530826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.532401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:05.533244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:05.590926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd3a7509-b5cd-499e-9f72-c2fe873d8f40 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055c10d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:05.755716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd3a7509-b5cd-499e-9f72-c2fe873d8f40 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.172920 Jul 18 02:17:05.775443 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 620/1272] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:05 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:06.584947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:06.610783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9eff192-b745-4c2e-b55d-9796b7912093 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 1.150193 Jul 18 02:17:06.615436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 653/1273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:05 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:06.632909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:06.640345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:06.662914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.664661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:06.667367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.669291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:06.749903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eafe3be0-c22c-40ad-a778-303cc3268ca5 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:06.767394 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eafe3be0-c22c-40ad-a778-303cc3268ca5 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.871136 Jul 18 02:17:06.769457 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 621/1274] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:06.775287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:06.776403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:06.789033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.790597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:06.791906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:06.792641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.063674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:07.076049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b87abee0-fe12-4ee6-b21a-d5351931e878 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1529 microversion: 2.1 time: 0.304556 Jul 18 02:17:07.078752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 622/1275] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:06 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1529 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.086319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9c27af9f-ab2a-462a-b45f-694860655b40 req-439467ba-5a69-4d18-9874-a602ae3178ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "name": "network-vif-plugged", "status": "completed", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:07.101962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9c27af9f-ab2a-462a-b45f-694860655b40 req-439467ba-5a69-4d18-9874-a602ae3178ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.102787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9c27af9f-ab2a-462a-b45f-694860655b40 req-439467ba-5a69-4d18-9874-a602ae3178ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.129918 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9c27af9f-ab2a-462a-b45f-694860655b40 req-439467ba-5a69-4d18-9874-a602ae3178ad service nova] Creating event network-vif-plugged:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:17:07.157588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9c27af9f-ab2a-462a-b45f-694860655b40 req-439467ba-5a69-4d18-9874-a602ae3178ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077190 Jul 18 02:17:07.172337 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 623/1276] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:07.183566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-355f701b-a152-41d0-a7e6-a68dec34cb56 req-844248ac-4c89-4718-a5ae-b02ba9c46fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65987e31-9565-4c7c-99cc-4a45fc1c47cf", "tag": "8b974140-67f9-4093-bf5b-bd2d99bd7357"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:07.211969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-355f701b-a152-41d0-a7e6-a68dec34cb56 req-844248ac-4c89-4718-a5ae-b02ba9c46fef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.212551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-355f701b-a152-41d0-a7e6-a68dec34cb56 req-844248ac-4c89-4718-a5ae-b02ba9c46fef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.245150 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-355f701b-a152-41d0-a7e6-a68dec34cb56 req-844248ac-4c89-4718-a5ae-b02ba9c46fef service nova] Creating event network-changed:8b974140-67f9-4093-bf5b-bd2d99bd7357 for instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf on n-h2-849796-1 Jul 18 02:17:07.267335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-355f701b-a152-41d0-a7e6-a68dec34cb56 req-844248ac-4c89-4718-a5ae-b02ba9c46fef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092905 Jul 18 02:17:07.271774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 624/1277] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:07.286265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c9595f7-24c8-4e35-b196-b21ac6126fe4 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab053d6e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.351371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c9595f7-24c8-4e35-b196-b21ac6126fe4 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.076526 Jul 18 02:17:07.352684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 625/1278] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.357958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6422b261-46d8-42fd-aa07-a93cce557804 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.382678 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6422b261-46d8-42fd-aa07-a93cce557804 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 2912 microversion: 2.1 time: 0.028486 Jul 18 02:17:07.384141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 626/1279] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/flavors => generated 2912 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.390349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.392086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:07.400650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.401474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.402541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.403271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.602964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:07.606894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.623333 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b3273b0a-c3d6-4951-a698-dc59ebc539c4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1529 microversion: 2.1 time: 0.237658 Jul 18 02:17:07.624634 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 627/1280] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1529 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.645345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca038722-e12a-40a0-ad06-409009f31d56 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.659562 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca038722-e12a-40a0-ad06-409009f31d56 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032804 Jul 18 02:17:07.669184 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 628/1281] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:07.675912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.676870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:07.685813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.686560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.687561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:07.688688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:07.715350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:07.745047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c650143f-00a0-407f-b822-0ae88c390d99 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 1.117995 Jul 18 02:17:07.750048 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 654/1282] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:06 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:07.782616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a27e32b-6662-46c1-be05-64b8280d4e7f tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.785433 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:17:07.785433 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:17:07.884529 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a27e32b-6662-46c1-be05-64b8280d4e7f tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/db62eb13-e23f-48e1-b40d-8d6f1846705b" status: 202 len: 0 microversion: 2.1 time: 0.129097 Jul 18 02:17:07.885665 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 655/1283] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:17:07 2022] DELETE /compute/v2.1/flavors/db62eb13-e23f-48e1-b40d-8d6f1846705b => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:07.917636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-209031cd-747b-4ab8-8bdf-76c6c740517c tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:07.969225 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-209031cd-747b-4ab8-8bdf-76c6c740517c tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.074285 Jul 18 02:17:07.970327 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 656/1284] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:07.983877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b683e36-f40e-4abe-8c0d-f13a2df0b72e tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.076576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b683e36-f40e-4abe-8c0d-f13a2df0b72e tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099447 Jul 18 02:17:08.078184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 657/1285] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.095070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:08.106152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba6634c4-6f7d-4e34-a880-8364363df8db tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.137898 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75459531-d7d6-41ca-8053-ddbc60e1f5b1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1361 microversion: 2.1 time: 0.463759 Jul 18 02:17:08.153423 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 629/1286] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:07 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.160473 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba6634c4-6f7d-4e34-a880-8364363df8db tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.065136 Jul 18 02:17:08.163030 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 658/1287] 10.222.0.67 () {58 vars in 1164 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.167679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:08.169733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.181470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.181470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.182309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.182960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.192060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df03ff14-8b6a-4ecb-881f-b537bbf5b178 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.205698 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df03ff14-8b6a-4ecb-881f-b537bbf5b178 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021184 Jul 18 02:17:08.207711 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 659/1288] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:08.223915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85c3a26d-5473-44b5-bbb5-3cfc63dd9d0f tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.234485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:08.245845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Old instance type tempest-test_resize_flavor_-1477956653, new instance type m1.heat {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:17:08.273675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:17:08.274729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:17:08.276065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:17:08.279497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:17:08.280572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:17:08.292794 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85c3a26d-5473-44b5-bbb5-3cfc63dd9d0f tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.075325 Jul 18 02:17:08.294649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 660/1289] 10.222.0.67 () {58 vars in 1168 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.326019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac2a2c07-a521-4795-9799-0f33df508d80 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.339672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.375590 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac2a2c07-a521-4795-9799-0f33df508d80 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.058668 Jul 18 02:17:08.378698 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 661/1290] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:08.405509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e66c930e-5227-4a14-972d-9b8ce4f9445a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055fcd30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.448229 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6772c7e5-5612-47e0-929c-1131ee40efbd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72/action" status: 202 len: 0 microversion: 2.1 time: 0.284929 Jul 18 02:17:08.452356 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 630/1291] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:17:08 2022] POST /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:08.472762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92347d2-bfcc-4dfe-8f5c-b422ee1d291a", "device": "/dev/xvdb"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:08.476763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.479792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.489604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.490075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.490914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.491403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.549779 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e66c930e-5227-4a14-972d-9b8ce4f9445a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.162248 Jul 18 02:17:08.551344 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 662/1292] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:08.563182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-745296ab-7ac2-45e5-a48b-b866192f035b tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.582431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-745296ab-7ac2-45e5-a48b-b866192f035b tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028548 Jul 18 02:17:08.584151 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 663/1293] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:08.594454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:08.596242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:08.621278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.622113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.623668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:08.624635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:08.967155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:08.982155 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9db44cf-506e-48a5-be0d-fff0750394ae tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1538 microversion: 2.1 time: 0.395857 Jul 18 02:17:08.997781 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 664/1294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:08 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1538 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:09.128824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.350347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Action: 'update', calling method: .version_select at 0x7fab05624c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:09.448543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.448724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.449657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.450114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.509223 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2676b9dd-60e6-477c-b451-b142af84fd59 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.051643 Jul 18 02:17:09.511006 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 631/1295] 10.222.0.67 () {62 vars in 1363 bytes} [Mon Jul 18 02:17:08 2022] POST /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:09.527951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c4a42f7-8f03-4da8-b30c-d9bd95c3acfa tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.585098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2c099089-1dd2-4b3f-b5e8-4f13dc4e31ae tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70" status: 200 len: 148 microversion: 2.57 time: 0.600844 Jul 18 02:17:09.588702 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 665/1296] 10.222.0.67 () {62 vars in 1302 bytes} [Mon Jul 18 02:17:08 2022] PUT /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70 => generated 148 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:09.603168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.605802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:09.636048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.644666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.646598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.647427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.687184 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c4a42f7-8f03-4da8-b30c-d9bd95c3acfa tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.167216 Jul 18 02:17:09.689918 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 632/1297] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:09.719469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:09.721475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:09.733339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.734389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.735944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:09.737554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:09.949253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:09.965713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-adaceb3e-d183-41f4-b99d-630a3ac981d2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1544 microversion: 2.1 time: 0.258450 Jul 18 02:17:09.966619 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 633/1298] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:09.988548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-125a2ad7-7f08-4cec-b344-06c7ab8bb43e req-21d5fed2-3dc9-4ceb-8d30-174b30fd3b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-plugged", "status": "completed", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:10.000265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-125a2ad7-7f08-4cec-b344-06c7ab8bb43e req-21d5fed2-3dc9-4ceb-8d30-174b30fd3b5c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.000701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-125a2ad7-7f08-4cec-b344-06c7ab8bb43e req-21d5fed2-3dc9-4ceb-8d30-174b30fd3b5c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.018119 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-125a2ad7-7f08-4cec-b344-06c7ab8bb43e req-21d5fed2-3dc9-4ceb-8d30-174b30fd3b5c service nova] Creating event network-vif-plugged:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:17:10.024638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-125a2ad7-7f08-4cec-b344-06c7ab8bb43e req-21d5fed2-3dc9-4ceb-8d30-174b30fd3b5c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051503 Jul 18 02:17:10.030996 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 634/1299] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:10.038704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be4d08d6-0db1-4389-a619-b5d9b6685c5f tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab047aec10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.099578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be4d08d6-0db1-4389-a619-b5d9b6685c5f tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.067033 Jul 18 02:17:10.100974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 635/1300] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:10.110236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Calling method '.version_select at 0x7fab04f78f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.190631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.191188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:10.192116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.193285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.193894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.201744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98957066-82af-4f95-9678-65566ffa7deb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 0.611767 Jul 18 02:17:10.203588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 666/1301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:09 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:10.210260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b0361216-90aa-44d6-8660-5cc0d2ac42ec tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.220489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b0361216-90aa-44d6-8660-5cc0d2ac42ec tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015157 Jul 18 02:17:10.222804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 667/1302] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:10.223028 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-370cc16c-b2db-499f-abdb-bb4119385b02 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70/detail" status: 200 len: 463 microversion: 2.57 time: 0.120273 Jul 18 02:17:10.228225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.229368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:10.230172 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 636/1303] 10.222.0.67 () {60 vars in 1303 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70/detail => generated 463 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:10.236047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.237763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:10.252891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.254167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.256180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.258916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.269630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.273357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.274726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.275425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.308743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.442333 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2aedf902-b723-4843-a228-c6be39b9bcd8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216159 Jul 18 02:17:10.443194 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 668/1304] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:10.452105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac969d5f-bd4e-4e0d-a760-dd4adb8fa772 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.500756 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac969d5f-bd4e-4e0d-a760-dd4adb8fa772 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.056132 Jul 18 02:17:10.516959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 669/1305] 10.222.0.67 () {58 vars in 1143 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:10.516959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Action: 'update', calling method: .version_select at 0x7fab057675e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:10.648951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.649419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.650250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.650809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.747978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.748523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.749516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:10.750202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:10.846854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:10.867438 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57f7eb44-2127-4a5a-a520-3bcd30d28acc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1538 microversion: 2.1 time: 0.635511 Jul 18 02:17:10.871321 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 637/1306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1538 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:10.892844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ef40002-2f19-4cfe-b8f1-4d0cfed3e8dd tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70?user_id=f34d8b98b03d4a558f580d137da06b5e" status: 200 len: 148 microversion: 2.57 time: 0.387494 Jul 18 02:17:10.895462 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 670/1307] 10.222.0.67 () {62 vars in 1383 bytes} [Mon Jul 18 02:17:10 2022] PUT /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70?user_id=f34d8b98b03d4a558f580d137da06b5e => generated 148 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:10.895704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1bdd9dd-6651-47d6-ae07-6564038cb88f tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.906840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d2ee1db-8460-4cc7-b093-5358d2698642 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] Calling method '.version_select at 0x7fab055fce50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:10.921142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=11 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.931708 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1bdd9dd-6651-47d6-ae07-6564038cb88f tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048561 Jul 18 02:17:10.932703 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 638/1308] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:10.962219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a69e8630-856f-470f-93dd-3b1e2a357d23 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.038687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a69e8630-856f-470f-93dd-3b1e2a357d23 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.082359 Jul 18 02:17:11.040139 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 639/1309] 10.222.0.67 () {58 vars in 1147 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.053229 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d2ee1db-8460-4cc7-b093-5358d2698642 tempest-QuotasAdminTestV257-2101880328 tempest-QuotasAdminTestV257-2101880328-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70?user_id=f34d8b98b03d4a558f580d137da06b5e" status: 200 len: 190 microversion: 2.57 time: 0.150158 Jul 18 02:17:11.060708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 671/1310] 10.222.0.67 () {60 vars in 1363 bytes} [Mon Jul 18 02:17:10 2022] GET /compute/v2.1/os-quota-sets/4990cbea5f2d49cebd422f9b0d3ffb70?user_id=f34d8b98b03d4a558f580d137da06b5e => generated 190 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:11.098287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54fcaab8-0ff2-4553-9e6b-db7949e28732 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.123493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-297e9937-9fef-4a28-99ec-cb23e63414a5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055ef4c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.132533 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54fcaab8-0ff2-4553-9e6b-db7949e28732 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.078145 Jul 18 02:17:11.143215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 640/1311] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:11.149171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea0bc994-f2fc-4264-bde0-3a07e9afc871 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.172010 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea0bc994-f2fc-4264-bde0-3a07e9afc871 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027411 Jul 18 02:17:11.184436 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 641/1312] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:11.190498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e078cff1-dac6-4a59-90ce-654db8357d94 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.241852 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e078cff1-dac6-4a59-90ce-654db8357d94 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.055005 Jul 18 02:17:11.254601 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 642/1313] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.254793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-297e9937-9fef-4a28-99ec-cb23e63414a5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.133720 Jul 18 02:17:11.255422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.255422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:11.255689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 672/1314] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.269146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.269573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdf3a57b-9e1c-452f-bb85-131ea6f958a9 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.269723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:11.270870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.270960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:11.332377 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdf3a57b-9e1c-452f-bb85-131ea6f958a9 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068039 Jul 18 02:17:11.336201 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 673/1315] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.358497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bceda762-8deb-454e-a3da-8fcde9d390d1 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.378184 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bceda762-8deb-454e-a3da-8fcde9d390d1 tempest-FlavorsV2TestJSON-1649784424 tempest-FlavorsV2TestJSON-1649784424-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024204 Jul 18 02:17:11.383390 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 674/1316] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:11.717212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:11.735588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-191a3552-a1c7-4c45-900f-d90391ec2010 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 0.491512 Jul 18 02:17:11.736296 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 643/1317] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:11.888571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:11.889755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:11.920737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.927222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:11.932624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:11.939129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:12.259801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7dbb16fc-f039-435d-8d44-b674090b7456 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05969310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:12.346541 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7dbb16fc-f039-435d-8d44-b674090b7456 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.090059 Jul 18 02:17:12.353042 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 644/1318] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:12 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:12.757309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:12.759436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:12.776008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.777349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:12.779495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:12.784406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:13.259808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:13.275074 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5abae8a2-1f37-46fa-adf2-0a6244d3e501 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 0.525303 Jul 18 02:17:13.278535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 645/1319] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:12 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:13.363500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6542995d-11ec-4a14-a609-e9656c299897 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05155280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:13.474583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6542995d-11ec-4a14-a609-e9656c299897 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.107898 Jul 18 02:17:13.474583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 646/1320] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:13 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:13.564229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:13.586611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8f028bd-dd7c-4295-afd3-a3958b3a02b8 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1538 microversion: 2.1 time: 1.701876 Jul 18 02:17:13.601594 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 675/1321] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:11 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1538 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:13.656816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e0ff27a9-f67a-4c5e-a808-6ba2907d900e req-27eda9d9-22bc-431f-9b14-898dfbe7f068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:13.686285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0ff27a9-f67a-4c5e-a808-6ba2907d900e req-27eda9d9-22bc-431f-9b14-898dfbe7f068 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:13.689799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0ff27a9-f67a-4c5e-a808-6ba2907d900e req-27eda9d9-22bc-431f-9b14-898dfbe7f068 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:13.710349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e0ff27a9-f67a-4c5e-a808-6ba2907d900e req-27eda9d9-22bc-431f-9b14-898dfbe7f068 service nova] Creating event network-changed:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:17:13.735369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e0ff27a9-f67a-4c5e-a808-6ba2907d900e req-27eda9d9-22bc-431f-9b14-898dfbe7f068 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083897 Jul 18 02:17:13.741155 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 647/1322] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:14.301464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:14.303061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:14.336243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.346281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:14.348700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.356616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:14.483533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f92c7fc7-db2b-41e0-bcc3-ffdf91e3299f tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04a6cf70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:14.629799 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f92c7fc7-db2b-41e0-bcc3-ffdf91e3299f tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.150648 Jul 18 02:17:14.638750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 648/1323] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:14 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:14.652615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:14.653413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:14.678159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.678666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:14.680484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:14.681045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:15.396485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:15.413470 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4eddaea1-f988-4a48-8dc9-6761c6fa04e7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1538 microversion: 2.1 time: 0.763430 Jul 18 02:17:15.423800 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 649/1324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:14 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1538 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:15.646426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58f8f273-de36-4679-b028-ef48ac9d67cb tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab049d9b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:15.742458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:15.750340 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58f8f273-de36-4679-b028-ef48ac9d67cb tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.110429 Jul 18 02:17:15.756487 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 650/1325] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:15 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:15.763769 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e6b29de-a7af-49bc-9df7-7977ea5338f8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 1.471568 Jul 18 02:17:15.773488 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 676/1326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:14 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:16.433550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:16.434783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:16.475455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:16.476273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:16.477915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:16.478737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:16.770751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66847c3d-9e6c-4b12-9edd-c4ddba3cd0b7 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055efca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:16.864795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66847c3d-9e6c-4b12-9edd-c4ddba3cd0b7 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.098591 Jul 18 02:17:16.867227 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 677/1327] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:16 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:16.874623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:16.875465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:16.905206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:16.906002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:16.907258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:16.908839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:17.507418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:17.552983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e23dd5c1-b0a1-4d9b-b57c-c1a436b6f153 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1538 microversion: 2.1 time: 1.123194 Jul 18 02:17:17.555437 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 651/1328] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:16 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1538 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:17.893063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8aa908a4-4b8e-4e2d-b0ce-9f7edd801c02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab048180d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:18.107306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8aa908a4-4b8e-4e2d-b0ce-9f7edd801c02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.214369 Jul 18 02:17:18.111787 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 652/1329] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:17 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:18.239469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:18.309786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee94f994-b007-4de8-9e43-3e88f703dd36 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 1.440723 Jul 18 02:17:18.316511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 678/1330] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:16 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:18.595296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:18.599150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:18.611508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:18.611970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:18.612801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:18.619356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:19.092664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:19.110334 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5bf8bdc-794b-48e9-b130-9602948ed781 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.520077 Jul 18 02:17:19.113922 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 653/1331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:18 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:19.133997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da95458f-dafe-4b3f-9d29-e56aa8c628de tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055c8670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:19.199279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da95458f-dafe-4b3f-9d29-e56aa8c628de tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.069997 Jul 18 02:17:19.206678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 679/1332] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:19 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:19.352474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:19.359183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:19.405528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:19.412096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:19.417289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:19.424207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:19.809827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-77f41328-d8b7-419d-92e3-2ad25829e31c req-8c486765-aed3-430a-be64-4ded57fbf3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65987e31-9565-4c7c-99cc-4a45fc1c47cf", "name": "network-vif-plugged", "status": "completed", "tag": "8b974140-67f9-4093-bf5b-bd2d99bd7357"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:19.827384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-77f41328-d8b7-419d-92e3-2ad25829e31c req-8c486765-aed3-430a-be64-4ded57fbf3d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:19.827844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-77f41328-d8b7-419d-92e3-2ad25829e31c req-8c486765-aed3-430a-be64-4ded57fbf3d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:19.896570 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-77f41328-d8b7-419d-92e3-2ad25829e31c req-8c486765-aed3-430a-be64-4ded57fbf3d5 service nova] Creating event network-vif-plugged:8b974140-67f9-4093-bf5b-bd2d99bd7357 for instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf on n-h2-849796-1 Jul 18 02:17:19.916228 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-77f41328-d8b7-419d-92e3-2ad25829e31c req-8c486765-aed3-430a-be64-4ded57fbf3d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106932 Jul 18 02:17:19.917139 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 680/1333] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:17:19.943176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:19.969204 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-404fce6f-c8ef-4fc7-9886-8d15497e4f89 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 0.625216 Jul 18 02:17:20.000239 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 654/1334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:19 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:20.138773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:20.140319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:20.163111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:20.168304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:20.170065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:20.170904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:20.218115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-143b0bf0-d363-4537-a0fd-48209632870c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04f78af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:20.288773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:20.301347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:20.476272 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-143b0bf0-d363-4537-a0fd-48209632870c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.260504 Jul 18 02:17:20.477061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 655/1335] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:20 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:20.635444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:20.668602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06f99b7a-930a-4ec2-83e8-aa4173af86cc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.538238 Jul 18 02:17:20.670327 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 681/1336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:20 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:21.011291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:21.012632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:21.028708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:21.037044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:21.038392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:21.039129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:21.485287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:21.494833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a01a92c-d7e2-4782-bd6e-cb4141a1fc50 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055d13a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:21.496294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36a1ebeb-d218-4062-9b1a-90cfc93dce43 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1317 microversion: 2.1 time: 0.489328 Jul 18 02:17:21.497776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 656/1337] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:21 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:21.507099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=9 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.519648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=24 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.607919 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a01a92c-d7e2-4782-bd6e-cb4141a1fc50 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.120711 Jul 18 02:17:21.608524 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 682/1338] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:21 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:21.688430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:21.690195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:21.697466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:21.698444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:21.699659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:21.700471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:22.223616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:22.234811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.242050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ac6a993-9c1b-4610-a2aa-a05e9ec8cdd3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.558433 Jul 18 02:17:22.246329 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 657/1339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:21 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:22.526917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:22.527598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:22.558184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:22.558656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:22.559733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:22.560422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:22.626017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6457864-4800-47db-9595-b19d418f6d64 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab048189d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:22.755130 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6457864-4800-47db-9595-b19d418f6d64 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.134826 Jul 18 02:17:22.755790 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 658/1340] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:22 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:23.244039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:23.276136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:23.277251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:23.283537 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09ab53d5-cf45-4571-a163-33502148663a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1466 microversion: 2.1 time: 0.761623 Jul 18 02:17:23.313906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 683/1341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:22 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1466 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:23.322944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:23.325321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:23.327676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:23.333377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:23.333848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:23.335375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:23.358400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:23.370152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:23.372051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:23.373153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:24.256246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:24.275932 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28c767ec-6d68-4a24-9558-415ce1925a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 1.017447 Jul 18 02:17:24.277593 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 659/1342] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:23 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:24.316856 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-edc4f56b-5ceb-4920-b6cf-463fa4b65802 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1617 microversion: 2.1 time: 1.000515 Jul 18 02:17:24.319063 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 684/1343] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:23 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1617 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:24.332155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bec5b855-daa0-44bd-b0ec-2e1f449dbcdf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055dd280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:24.481352 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bec5b855-daa0-44bd-b0ec-2e1f449dbcdf tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.157474 Jul 18 02:17:24.538652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 685/1344] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:24 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:24.554440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e71ea0c2-ea8f-4a38-bffe-e7f1344d9495 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] Action: 'create', calling method: .version_select at 0x7fab047ae280>, body: {"security_group": {"name": "tempest-securitygroup-370083058", "description": "tempest-description-972014848"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:24.871911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1412249179", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:24.962093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:17:25.998346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:17:26.002153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:17:26.003538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:17:26.007677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:17:26.009558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:17:26.045892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:26.046983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:26.051942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:26.056972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:26.123706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e71ea0c2-ea8f-4a38-bffe-e7f1344d9495 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.842997 Jul 18 02:17:26.131594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 660/1345] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:17:24 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:26.158816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:26.159448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:26.176194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:26.186444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:26.186905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:26.190623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:26.191082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:26.195710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:26.234461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:17:26.242354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:17:26.410494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75737c7b-f5be-40e8-b34e-9097b76ed3fa tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549735 Jul 18 02:17:26.426254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 686/1346] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:17:26.452164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3431b72-85b2-4ade-94ce-04d0191af2c1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055d1dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:26.535768 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3431b72-85b2-4ade-94ce-04d0191af2c1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.107431 Jul 18 02:17:26.537100 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 687/1347] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:26 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:26.543691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45eb4f58-6c89-4b49-9955-058c0a099971 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] Action: 'create', calling method: .version_select at 0x7fab05739160>, body: {"security_group": {"name": "tempest-securitygroup-1123830621", "description": "tempest-description-1002462553"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:26.975941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:26.988456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b4173e5-417d-4a6a-8f4a-61390b8b1cfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.854972 Jul 18 02:17:26.989727 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 661/1348] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:26 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:27.010535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7cdc603-dd17-4a3f-b790-328fca7476ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:27.011668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c7cdc603-dd17-4a3f-b790-328fca7476ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:27.148224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c7cdc603-dd17-4a3f-b790-328fca7476ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:27.157010 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7cdc603-dd17-4a3f-b790-328fca7476ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1217 microversion: 2.1 time: 0.156112 Jul 18 02:17:27.177803 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 662/1349] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:26 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:27.419877 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45eb4f58-6c89-4b49-9955-058c0a099971 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.880975 Jul 18 02:17:27.421817 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 688/1350] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:17:26 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:27.560278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63237d4d-a854-476c-bb1c-e571575670c6 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab056420d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:27.640410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a842326-e6e5-48bd-9df5-bc4eb1ade603 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] Action: 'create', calling method: .version_select at 0x7fab049d95e0>, body: {"security_group": {"name": "tempest-securitygroup-141381503", "description": "tempest-description-1531907652"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:27.742073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63237d4d-a854-476c-bb1c-e571575670c6 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.189598 Jul 18 02:17:27.759986 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 689/1351] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:27 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:28.007541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:28.008404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:28.049822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:28.052009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:28.055710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:28.061244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:28.565347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:28.580670 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aef1f3b7-399b-4760-90c7-cbb7f8b00182 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.577330 Jul 18 02:17:28.583785 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 690/1352] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:28 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:17:28.597531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:28.598672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:28.608290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:28.609341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:28.610737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:28.618213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:28.855858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:28.891736 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a9b0036-362b-4ca5-8f98-6223f3e12804 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1269 microversion: 2.1 time: 0.303483 Jul 18 02:17:28.894576 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 691/1353] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:28 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:28.915654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2060ce0d-5a51-424e-84ce-bb87822636f7 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055b68b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:29.051278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2060ce0d-5a51-424e-84ce-bb87822636f7 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.152701 Jul 18 02:17:29.057433 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 692/1354] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:28 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:29.601255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:29.601911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:29.619835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:29.620471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:29.625367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:29.625844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:30.066982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a842326-e6e5-48bd-9df5-bc4eb1ade603 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.630727 Jul 18 02:17:30.068585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 663/1355] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:17:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:30.074844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:30.078797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:30.113173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:30.117787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:30.118971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:30.122914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:30.793302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:30.807966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ff4834b-3fa3-42b2-9b98-b80cec2f14d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 1.210770 Jul 18 02:17:30.833122 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 693/1356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:29 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:30.858910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:30.863375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:30.879240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:30.880272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:30.881432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:30.882188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:31.144641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:31.162067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c67475c-054f-45a9-a14c-aaaadcf500f3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1275 microversion: 2.1 time: 0.321995 Jul 18 02:17:31.172891 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 694/1357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:30 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1275 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:31.186938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:31.189280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b9a5cc9-e4ad-4e2c-8ac2-2907d1dd70a4 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab0556c820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:31.256865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75eb8c25-9b24-45a0-946b-1e48f07ae060 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 2418 microversion: 2.25 time: 1.186918 Jul 18 02:17:31.267558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b9a5cc9-e4ad-4e2c-8ac2-2907d1dd70a4 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.091961 Jul 18 02:17:31.268880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 695/1358] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:31 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:31.279770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 664/1359] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:30 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 2418 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:31.290392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a7f92ac-cbba-4384-b36e-268f713e4dca tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] Action: 'create', calling method: .version_select at 0x7fab055efc10>, body: {"security_group": {"name": "tempest-securitygroup-225370517", "description": "tempest-description-1477966416"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:31.310268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849796-1", "block_migration": "auto"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:31.316863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:31.365323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:31.369730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:31.374973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:31.379726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:31.506541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'flavor' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:17:31.563684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Going to try to live migrate instance to n-h2-849796-1 {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:17:34.125427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a7f92ac-cbba-4384-b36e-268f713e4dca tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.854753 Jul 18 02:17:34.140109 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 696/1360] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:17:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:34.150587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:34.152198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:34.163658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:34.164426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:34.165515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:34.166151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:35.086809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:35.098718 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9efd6c8a-481c-4ef4-9a84-97e206600df5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.955512 Jul 18 02:17:35.106093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 697/1361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:34 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:35.124113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:35.129905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:35.144664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:35.166763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:35.167458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:35.169452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:35.169452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:36.121688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.164602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:36.180734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef7e1887-b44b-4f9b-bac0-843d0cf21988 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1275 microversion: 2.1 time: 1.069389 Jul 18 02:17:36.181807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 698/1362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:35 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1275 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:36.194938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f618127-fd35-4d63-bd7b-725c7b51e55b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055dd550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:36.222205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.299192 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f618127-fd35-4d63-bd7b-725c7b51e55b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.115936 Jul 18 02:17:36.312083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 699/1363] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:36 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:36.450861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1299008360", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "b1c06da5-9949-4076-be04-78c7c3500dff"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:36.534565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] validate_networks() for [('b1c06da5-9949-4076-be04-78c7c3500dff', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:17:37.153516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.527211 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-034794c1-b32f-4fb6-8e80-6818f4994f1f tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/action" status: 202 len: 0 microversion: 2.25 time: 6.234337 Jul 18 02:17:37.528339 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 665/1364] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:17:31 2022] POST /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/action => generated 0 bytes in 6236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:37.533315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37dd5903-0e51-467c-90ad-567116c202b8 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] Calling method '.version_select at 0x7fab04839820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:39.448808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:17:39.449743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:17:39.450812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:17:39.451690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:17:39.452587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:17:39.552816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:39.553643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:39.556429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:39.557372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:39.662061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:39.676261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for user 0f2de3928dac470c90a709b3da9c95f0 and project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:39.760634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:17:39.775126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:17:40.014236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-279b29b4-b15f-4a0e-a632-93a82e96bfdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.694981 Jul 18 02:17:40.016479 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 700/1365] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:17:40.035684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:40.037419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:40.061056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:40.062229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:40.064400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:40.066571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:40.604470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:40.629303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=88 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.640152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7919e60a-eb6a-447f-a487-d7ecb775f1a2 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1543 microversion: 2.1 time: 0.620542 Jul 18 02:17:40.644878 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 701/1366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:40 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1543 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:40.656790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:40.659364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:40.691611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:40.692628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:40.694328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:40.695359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:41.494384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:41.505770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-555b5f7c-3095-4d1f-a959-6e6135483324 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.856419 Jul 18 02:17:41.513564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 702/1367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:40 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:41.524592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f491b11-0cb1-49a1-8e21-2687d6849831 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05694040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:41.641950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=42 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:41.664100 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f491b11-0cb1-49a1-8e21-2687d6849831 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.148605 Jul 18 02:17:41.668536 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 703/1368] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:41 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:41.684218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:41.685218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:41.720883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:41.730687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:41.731729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:41.732193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:41.857735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.327564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:43.355073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:43.381969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:43.389397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0fdba203-7375-48e2-b60b-1b5f98055236 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 1.711471 Jul 18 02:17:43.393959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 704/1369] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:41 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:43.536531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-153cc209-10c0-464b-87a3-802a1e573bea tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Action: 'create', calling method: .version_select at 0x7fab05694160>, body: {"pool": null} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:44.832733 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37dd5903-0e51-467c-90ad-567116c202b8 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13668 microversion: 2.1 time: 7.302592 Jul 18 02:17:44.833665 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 666/1370] 10.222.0.67 () {58 vars in 1190 bytes} [Mon Jul 18 02:17:37 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13668 bytes in 7304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:44.838495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:44.842688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:44.868643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:44.878200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:44.899336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:44.904353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.142515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:45.176988 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac7b5e0b-9289-4087-ae6c-bde5bafa463e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1283 microversion: 2.1 time: 0.342585 Jul 18 02:17:45.185267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 667/1371] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:44 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1283 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:45.205630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d87dcfcb-9dac-4185-a640-628279d4ef12 req-dcd8facd-3327-463b-a533-5c480d6cbc8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e8e82b-1107-458f-96c8-4f40daee87ce", "tag": "2a6daa59-0c8c-4792-928e-d515d88cd09c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:45.249851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d87dcfcb-9dac-4185-a640-628279d4ef12 req-dcd8facd-3327-463b-a533-5c480d6cbc8f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.250698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d87dcfcb-9dac-4185-a640-628279d4ef12 req-dcd8facd-3327-463b-a533-5c480d6cbc8f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.347049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d87dcfcb-9dac-4185-a640-628279d4ef12 req-dcd8facd-3327-463b-a533-5c480d6cbc8f service nova] Creating event network-changed:2a6daa59-0c8c-4792-928e-d515d88cd09c for instance a5e8e82b-1107-458f-96c8-4f40daee87ce on n-h2-849796-1 Jul 18 02:17:45.401736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d87dcfcb-9dac-4185-a640-628279d4ef12 req-dcd8facd-3327-463b-a533-5c480d6cbc8f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204938 Jul 18 02:17:45.413489 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 668/1372] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:45.467802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:45.474130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:45.499060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.509574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:45.514545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:45.517002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:46.234292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:46.252969 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7203962-e803-46f8-ad5f-2ac195e87217 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1542 microversion: 2.1 time: 0.831082 Jul 18 02:17:46.256368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 669/1373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:45 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1542 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:46.274441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:46.275654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:46.291297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:46.295789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:46.301658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:46.302543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:46.602300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:46.617064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30e3ba44-47c6-42e6-8719-9c80d3bb3436 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.358981 Jul 18 02:17:46.619037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 670/1374] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:46 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:46.628338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04178342-0c43-4bda-bcb8-81959431c063 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046774c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:46.702426 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04178342-0c43-4bda-bcb8-81959431c063 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1421 microversion: 2.1 time: 0.081971 Jul 18 02:17:46.703788 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 671/1375] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:46 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:46.712135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:46.713272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:46.725245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:46.726152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:46.731200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:46.731952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.196361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:47.219551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:47.223160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:47.226119 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85b3a4fb-3377-4056-9bfa-97b0ef7eae48 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.518763 Jul 18 02:17:47.226119 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 672/1376] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:46 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:47.231209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-31b666af-9791-4ab1-b9e3-1631b084f117 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] Calling method '.version_select at 0x7fab049d9160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:47.508282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-31b666af-9791-4ab1-b9e3-1631b084f117 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.281397 Jul 18 02:17:47.508998 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 673/1377] 10.222.0.67 () {58 vars in 1190 bytes} [Mon Jul 18 02:17:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:47.521558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-unplugged", "status": "completed", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:47.543053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.543505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.578786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] Creating event network-vif-unplugged:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:17:47.590888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:17:47.621177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-180f56fd-33e2-4fe0-ae9b-44d786b75531 req-1ebd581b-f8ab-4973-bf0a-0d120f6bc1d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102602 Jul 18 02:17:47.622020 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 674/1378] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:47.642588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:47.643483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:47.652682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.655054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.656382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.657040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.862697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:47.877335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-465ad884-c7e7-47ea-8acd-a23d233f9336 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.242451 Jul 18 02:17:47.878427 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 675/1379] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:47 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:47.887730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:47.889263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:47.901253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.902533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.904402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:47.905571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:47.957357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-153cc209-10c0-464b-87a3-802a1e573bea tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.560097 Jul 18 02:17:47.958398 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 705/1380] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:17:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:47.964890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ebb4112b-6fb7-4ff3-976c-9e17ca86af16 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] Calling method '.version_select at 0x7fab055d1dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.154997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:48.229022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39b6b3fc-c8be-43e2-952c-7a4958aaf646 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1542 microversion: 2.1 time: 0.348602 Jul 18 02:17:48.240757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 676/1381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:47 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1542 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:48.267599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.270050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:48.278316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.278965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.279801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.280247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.482517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ebb4112b-6fb7-4ff3-976c-9e17ca86af16 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8f64d6c1-7aef-4100-87e7-0f19b86e7456" status: 202 len: 0 microversion: 2.1 time: 0.522461 Jul 18 02:17:48.483631 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 706/1382] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:17:47 2022] DELETE /compute/v2.1/os-security-groups/8f64d6c1-7aef-4100-87e7-0f19b86e7456 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:48.490935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd18f92d-117a-4ec7-ac24-8f438a53af72 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055ef4c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.521638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:48.544618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ce81e28-3091-4569-bf48-71ca9304aae8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.301865 Jul 18 02:17:48.544983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 677/1383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:48.557540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe073b38-88e4-4e4f-879e-be886b602ed1 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab04818790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.616759 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd18f92d-117a-4ec7-ac24-8f438a53af72 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1430 microversion: 2.1 time: 0.129880 Jul 18 02:17:48.632490 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 707/1384] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1430 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:48.632490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:48.632490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:48.655600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.656053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:48.656854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:48.657603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:49.288283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:49.306745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:49.312515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:49.316825 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d325c5bb-aa7e-4e2a-863f-e5c7e4b04643 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.689371 Jul 18 02:17:49.336957 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 708/1385] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:49.350066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9f2a07b-9851-44a1-8f87-94c3858c7a38 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] Calling method '.version_select at 0x7fab05767280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:49.608733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.645368 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe073b38-88e4-4e4f-879e-be886b602ed1 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/0dc4d4ad-e7f4-4e55-ad71-e59a33086794" status: 200 len: 141 microversion: 2.1 time: 1.099238 Jul 18 02:17:49.651857 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 678/1386] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:17:48 2022] GET /compute/v2.1/os-floating-ips/0dc4d4ad-e7f4-4e55-ad71-e59a33086794 => generated 141 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:49.658350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1b00a0d-dfb8-4100-9d67-f62e89a6efac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05a3bca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:49.712985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.742994 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1b00a0d-dfb8-4100-9d67-f62e89a6efac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 200 len: 1430 microversion: 2.1 time: 0.089873 Jul 18 02:17:49.746490 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 679/1387] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:49 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 1430 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:49.756424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:49.757442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:49.767124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:49.768001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:49.769114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:49.769771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:49.851015 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9f2a07b-9851-44a1-8f87-94c3858c7a38 tempest-SecurityGroupsTestAdminJSON-1934623422 tempest-SecurityGroupsTestAdminJSON-1934623422-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/bc201fdc-7a56-46f3-8a62-0ab5606e5105" status: 202 len: 0 microversion: 2.1 time: 0.512053 Jul 18 02:17:49.852154 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 709/1388] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:17:49 2022] DELETE /compute/v2.1/os-security-groups/bc201fdc-7a56-46f3-8a62-0ab5606e5105 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:49.859754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:49.860994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:49.879633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:49.880426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:49.884567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:49.885493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.109664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.123231 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ba477cd-5689-487d-aca4-7515c1074ebd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1474 microversion: 2.1 time: 0.267353 Jul 18 02:17:50.123955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 710/1389] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:49 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1474 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:50.135327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.135969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:50.155775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.156291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.157220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.157721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.289636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.303755 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab4a8ca8-472c-4b76-bb3a-4a776979751c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.554153 Jul 18 02:17:50.304559 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 680/1390] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:49 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:50.332151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39c3f760-57bd-402c-9b5a-c433ad0726b4 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab04664e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.444416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.455797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71209524-7cad-45ca-b5eb-62eb368f9f40 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.330669 Jul 18 02:17:50.456955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 711/1391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:50 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:50.462730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.463695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:50.479376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.480245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.481717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.482437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.713824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:50.730043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2eab2043-d60c-4191-9e09-b9c02fbbe025 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1465 microversion: 2.1 time: 0.271492 Jul 18 02:17:50.731105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 712/1392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:50 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:50.742068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-917170e5-51bd-4a3f-a906-d8cb970adcbd tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] Calling method '.version_select at 0x7fab0556c160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.842433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39c3f760-57bd-402c-9b5a-c433ad0726b4 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.517412 Jul 18 02:17:50.845244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 681/1393] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:17:50 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:50.856350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:50.858208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:50.876583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.878535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:50.881482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:50.883455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.144067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-917170e5-51bd-4a3f-a906-d8cb970adcbd tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/18b6ad05-4097-45e7-ab52-ae1688caef38" status: 202 len: 0 microversion: 2.1 time: 0.408837 Jul 18 02:17:51.146717 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 713/1394] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:17:50 2022] DELETE /compute/v2.1/os-security-groups/18b6ad05-4097-45e7-ab52-ae1688caef38 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:51.170382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25d696ed-0958-4d80-9dec-1cf5cc6a650a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055d13a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.213259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.240221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.243690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.246598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c17411db-979a-4bca-99ff-d0313d15092e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.398695 Jul 18 02:17:51.248509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25d696ed-0958-4d80-9dec-1cf5cc6a650a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef" status: 200 len: 784 microversion: 2.1 time: 0.089058 Jul 18 02:17:51.256258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 714/1395] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:51 2022] GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef => generated 784 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:51.258338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 682/1396] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:50 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:51.263575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05488d3e-bc34-47a2-a4e8-cba4d2731b2f tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab055c81f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.263825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9d016b98-1a31-49dd-85f6-42fe16bdd939 req-9c37ba90-aca5-437a-b28f-bb1661d4a117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd333e5b-d005-4786-af0e-1e0aa88d19a2", "tag": "5c639a82-e392-402e-ad94-ea3782fc86b1"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:51.274357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9d016b98-1a31-49dd-85f6-42fe16bdd939 req-9c37ba90-aca5-437a-b28f-bb1661d4a117 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.275086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9d016b98-1a31-49dd-85f6-42fe16bdd939 req-9c37ba90-aca5-437a-b28f-bb1661d4a117 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.295766 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9d016b98-1a31-49dd-85f6-42fe16bdd939 req-9c37ba90-aca5-437a-b28f-bb1661d4a117 service nova] Creating event network-changed:5c639a82-e392-402e-ad94-ea3782fc86b1 for instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 on n-h2-849796-1 Jul 18 02:17:51.303248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9d016b98-1a31-49dd-85f6-42fe16bdd939 req-9c37ba90-aca5-437a-b28f-bb1661d4a117 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042455 Jul 18 02:17:51.304758 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 683/1397] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:51.317902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.319517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:51.332697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.334109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.335759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.336804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.583080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:51.596665 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2207f3de-951e-4d84-9cea-d4da752ca24f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1474 microversion: 2.1 time: 0.288396 Jul 18 02:17:51.612849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 684/1398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:51 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:51.621681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ad93512-66e7-45dd-8819-ab7976beab05 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] Calling method '.version_select at 0x7fab04664ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.867360 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ad93512-66e7-45dd-8819-ab7976beab05 tempest-SecurityGroupsTestAdminJSON-945311960 tempest-SecurityGroupsTestAdminJSON-945311960-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/6d65c2a8-504f-4d45-8ec3-c971034999c1" status: 202 len: 0 microversion: 2.1 time: 0.253404 Jul 18 02:17:51.869406 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 685/1399] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:17:51 2022] DELETE /compute/v2.1/os-security-groups/6d65c2a8-504f-4d45-8ec3-c971034999c1 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:51.877689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef1099fb-61f6-402c-a19d-5b8496001884 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.906441 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef1099fb-61f6-402c-a19d-5b8496001884 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035282 Jul 18 02:17:51.908206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 686/1400] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:17:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:51.917231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:51.919541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:51.929881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.930344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:51.931384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:51.931819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:52.183951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:52.194712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-908b6d78-c6e0-49d0-9d52-b89d16c493b9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.284050 Jul 18 02:17:52.207072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 687/1401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:51 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:52.221918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:52.223248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:52.236057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:52.237010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:52.238663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:52.239682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:52.455601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:52.467839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8807ca6-d1d7-4c2c-a5a5-068f162486ad tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.258575 Jul 18 02:17:52.468460 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 688/1402] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:52 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:52.474628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c890b4d-f98b-41b9-9d21-7e3e715e3342 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab0466c8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:52.880440 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05488d3e-bc34-47a2-a4e8-cba4d2731b2f tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/0dc4d4ad-e7f4-4e55-ad71-e59a33086794" status: 202 len: 0 microversion: 2.1 time: 1.623637 Jul 18 02:17:52.885898 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 715/1403] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:17:51 2022] DELETE /compute/v2.1/os-floating-ips/0dc4d4ad-e7f4-4e55-ad71-e59a33086794 => generated 0 bytes in 1627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:52.901264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:52.902628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:52.924250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:52.926195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:52.928622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:52.929162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.350253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:53.361119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:53.363572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:53.365204 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-165b4109-f49c-4649-966c-bb9686cd00bf tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.481681 Jul 18 02:17:53.366671 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 716/1404] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:52 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:53.383596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:53.384595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:53.391871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.392335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.393753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.393753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.780856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:53.795361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c890b4d-f98b-41b9-9d21-7e3e715e3342 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "DELETE /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 204 len: 0 microversion: 2.1 time: 1.324977 Jul 18 02:17:53.796344 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 689/1405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:52 2022] DELETE /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:53.796510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40260dbc-8434-432a-bd11-2b206bc06b1a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1474 microversion: 2.1 time: 0.417070 Jul 18 02:17:53.798391 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 717/1406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:53 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:53.809311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-999640c8-fd51-441e-9c0a-23e4986085b9 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Action: 'create', calling method: .version_select at 0x7fab055dd280>, body: {"pool": null} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:53.818164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9b31aba0-b8b1-4d49-bce9-5e2cf0da023c req-f1b8f5ce-1ff4-487c-b297-c04fe682bf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8e82b-1107-458f-96c8-4f40daee87ce", "name": "network-vif-plugged", "status": "completed", "tag": "2a6daa59-0c8c-4792-928e-d515d88cd09c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:53.839509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9b31aba0-b8b1-4d49-bce9-5e2cf0da023c req-f1b8f5ce-1ff4-487c-b297-c04fe682bf56 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.840004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9b31aba0-b8b1-4d49-bce9-5e2cf0da023c req-f1b8f5ce-1ff4-487c-b297-c04fe682bf56 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.855475 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9b31aba0-b8b1-4d49-bce9-5e2cf0da023c req-f1b8f5ce-1ff4-487c-b297-c04fe682bf56 service nova] Creating event network-vif-plugged:2a6daa59-0c8c-4792-928e-d515d88cd09c for instance a5e8e82b-1107-458f-96c8-4f40daee87ce on n-h2-849796-1 Jul 18 02:17:53.861800 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9b31aba0-b8b1-4d49-bce9-5e2cf0da023c req-f1b8f5ce-1ff4-487c-b297-c04fe682bf56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063823 Jul 18 02:17:53.863118 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 690/1407] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:53.870498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:53.871446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:53.879042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.879864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:53.881174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:53.881854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.235569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:54.259595 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52eab708-219a-45c2-95a3-9c8dc5a7315b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.394109 Jul 18 02:17:54.261329 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 691/1408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:53 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:54.287483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:54.288126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:54.306749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.308040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.308040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.308502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.618659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:54.636858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70c254ad-0b5a-499d-b9ac-891e22c63fd3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1317 microversion: 2.1 time: 0.353098 Jul 18 02:17:54.640128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 692/1409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:54 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:54.662976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-283d7761-bb3e-413d-b64b-1ce716364714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab049d93a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:54.723460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-283d7761-bb3e-413d-b64b-1ce716364714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] HTTP exception thrown: Image not found. Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-283d7761-bb3e-413d-b64b-1ce716364714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Request method failure captured: Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 HTTP/1.1 Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ9cIGFOW2bcyyc6R8ppfKJH-5HFpW9ursr000FTn2SrE_og8g971bgSyXBayIoSELDawrL5neDmwpdYn4Li2xCieD377VlGp85f4ht42kwOW9bE-0aU7nJZIg_vIU3jS5x52W4rt0ukxii1fma2wxNSQ2B5tByEvHIoVPfJsv39ME Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:17:54.736159 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad246f5d093c48c48152059d277671cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad246f5d093c48c48152059d277671cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b1ba4e1d4061429c9a861e8020c10454 Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '54f52b98-f6c8-47b1-97da-c17763654607'} Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:54.737998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 54f52b98-f6c8-47b1-97da-c17763654607 Jul 18 02:17:54.739314 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:17:54.740504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 54f52b98-f6c8-47b1-97da-c17763654607 could not be found. Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:17:54.741744 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-283d7761-bb3e-413d-b64b-1ce716364714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:54.742957 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-283d7761-bb3e-413d-b64b-1ce716364714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 404 len: 62 microversion: 2.1 time: 0.094840 Jul 18 02:17:54.745130 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 693/1410] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:54 2022] GET /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:17:54.749413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:54.750034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:54.769134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.769903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:54.771649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:54.772423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.182971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:55.200648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:55.211265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:55.215930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:55.218494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51c7b166-56ef-4c0c-8400-d1f3133c2719 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.475452 Jul 18 02:17:55.221843 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 694/1411] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:54 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:55.233170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1577960041"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:55.236132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:55.249368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.253700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.255216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.256415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.898575 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-420d5f55-622c-442f-82be-249e1154987d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "POST /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060/action" status: 202 len: 0 microversion: 2.1 time: 0.674170 Jul 18 02:17:55.899690 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 695/1412] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:17:55 2022] POST /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:17:55.924412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:55.940493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:55.959168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.959965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:55.961685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:55.962464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.378800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.393759 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1df7d51d-4696-4be6-99ce-321ce2025880 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1471 microversion: 2.1 time: 0.482458 Jul 18 02:17:56.397086 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 696/1413] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:55 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1471 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:56.403952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:56.405122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:56.417687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.418473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.419978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.420972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.943271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:56.961106 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0ade14de-397d-41f3-a06f-c09cbff98f01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.564310 Jul 18 02:17:56.962174 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 697/1414] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:56 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:56.976304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:56.976953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:56.986023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.986542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:56.987483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:56.988210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.260484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-999640c8-fd51-441e-9c0a-23e4986085b9 tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.460361 Jul 18 02:17:57.261308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 718/1415] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:17:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:57.269091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-85e173a7-0094-4787-869b-9f1f2b7b42a5 req-9e6037c2-52f2-444d-8fa0-f4f24fa86c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-unplugged", "status": "completed", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:57.281626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-85e173a7-0094-4787-869b-9f1f2b7b42a5 req-9e6037c2-52f2-444d-8fa0-f4f24fa86c14 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.282274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-85e173a7-0094-4787-869b-9f1f2b7b42a5 req-9e6037c2-52f2-444d-8fa0-f4f24fa86c14 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.297306 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-85e173a7-0094-4787-869b-9f1f2b7b42a5 req-9e6037c2-52f2-444d-8fa0-f4f24fa86c14 service nova] Creating event network-vif-unplugged:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:17:57.304063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-85e173a7-0094-4787-869b-9f1f2b7b42a5 req-9e6037c2-52f2-444d-8fa0-f4f24fa86c14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041049 Jul 18 02:17:57.305068 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 719/1416] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:57.312542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adb5d5d7-dfe7-4346-8ad5-a7fb32790b1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055b6ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.371629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adb5d5d7-dfe7-4346-8ad5-a7fb32790b1a tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.064954 Jul 18 02:17:57.377704 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 720/1417] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:57 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:57.383445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.385052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:57.390877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:57.393704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.394835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.395976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.396672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.417551 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6bec280e-9c2e-4a73-bc7d-9eaa1d1ea664 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1467 microversion: 2.1 time: 0.451281 Jul 18 02:17:57.418852 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 698/1418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:56 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1467 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:57.446553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:57.449565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:57.462353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.462947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.463872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.464430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.518070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.518547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.519562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.520124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.564440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:57.577398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:57.665554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:57.682815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:57.682815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:57.682815 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37954570-69db-46fd-b6a4-19583932e188 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.302772 Jul 18 02:17:57.705550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 721/1419] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:57 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:57.716045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f3506c-45a4-43ff-8f98-de0cfec80a0c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab05528c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.797074 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15d27442-8d98-4dbf-8d7c-b5f2805d26f9 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72/action" status: 202 len: 0 microversion: 2.1 time: 0.374784 Jul 18 02:17:57.800485 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 699/1420] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:17:57 2022] POST /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:57.817857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:57.820633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:57.839421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.840208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:57.842391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:57.846243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.069023 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1b5723c-cf0c-4a70-80d8-fec023493c95 tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1618 microversion: 2.1 time: 0.266103 Jul 18 02:17:58.084237 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 700/1421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:57 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1618 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:58.091743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:58.092749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:58.108889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.109358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.110014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.111254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.345447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.358554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5741ff65-fa0f-42b7-820e-6c4de712aa1e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.271515 Jul 18 02:17:58.360819 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 701/1422] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:58 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:58.370035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:58.371451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:58.384350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.385327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.387344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:58.388329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:58.607486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:58.620705 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f176147-c16d-494c-be07-3e792d34acde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.258361 Jul 18 02:17:58.635535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 702/1423] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:58 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:58.642187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-500538911", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:58.771798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:17:59.091374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8f3506c-45a4-43ff-8f98-de0cfec80a0c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab" status: 202 len: 0 microversion: 2.1 time: 1.384065 Jul 18 02:17:59.093690 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 722/1424] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:17:57 2022] DELETE /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab => generated 0 bytes in 1387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:17:59.104852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9444377c-91d2-4529-8480-dc51ebc93ae5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab0556c5e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.198867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9444377c-91d2-4529-8480-dc51ebc93ae5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.101888 Jul 18 02:17:59.200256 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 723/1425] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:59.210206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.211563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.224190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.224984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.226458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.227459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.473224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:59.482843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:17:59.484866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:17:59.484866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:17:59.485381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:17:59.486753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:17:59.507970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:59.519399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:17:59.521627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd94914f-66a4-49ac-a9ba-558d81893c71 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.319270 Jul 18 02:17:59.522672 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 724/1426] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:17:59.534320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.536971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.538904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.539702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.548213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab0557daf0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.589229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:17:59.602714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Getting quotas for user a76d13efbc0841f4b0a479a87b964a67 and project 46ba6d7afda14ac8a41818afb217ab40. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:17:59.624686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 89968a72-e26f-4888-b909-563e8822a9ab could not be found", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:17:59.626504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] HTTP exception thrown: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Request method failure captured: Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab HTTP/1.1 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MLDFgg5GrbAhSVtcwCQmff1AAys9gO1fkQ-j4VHnFuMzAKTenaHduQ-ZWAFlbOIo5SoNykJVmJJuey48wLR9V_JG7shEbfLjhblKg2pd0Xz7VE27KjpXsujYxZmQXwUeL2eSXeOKVaypkNGsmIDF6M_gFnAMgXTPacWA-d-PxtGkv8 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 733f8ded6aa74d8fa7d9beffc7ccfca8 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:17:59.641118 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 733f8ded6aa74d8fa7d9beffc7ccfca8 Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FloatingIPsTestJSON-1143289303-project Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ac55993765ed4330ba94ca93508be9ae Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FloatingIPsTestJSON-1143289303-project Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: exception: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '89968a72-e26f-4888-b909-563e8822a9ab'} Jul 18 02:17:59.645583 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:17:59.648473 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 89968a72-e26f-4888-b909-563e8822a9ab could not be found Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21d29537-8eb8-47d6-bc5c-c287e1149370'] Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab. Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:59.652391 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:17:59.656540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:17:59.659694 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:17:59.659694 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:17:59.659992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:17:59.659992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:17:59.664609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Returning 404 to user: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:17:59.664609 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97c2bad8-eed5-4ae4-be5a-432f872b291c tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab" status: 404 len: 111 microversion: 2.1 time: 0.137251 Jul 18 02:17:59.665418 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 725/1427] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:17:59.675315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-plugged", "status": "completed", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:17:59.703206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.707367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.739666 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] Creating event network-vif-plugged:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:17:59.747803 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c31c5fb-af81-4c8f-85ed-ae3f337da52d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110365 Jul 18 02:17:59.753152 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 703/1428] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:17:59.768839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.772749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.787795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:17:59.788796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.789301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.790127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.793612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.807349 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-bfb9a931-4768-41c0-a1e1-28e7bf3a4286 req-185867f7-c93e-4abb-8065-5f284795482b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139554 Jul 18 02:17:59.809130 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 726/1429] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:17:59.824266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:17:59.825641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:17:59.863644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.864394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:17:59.865391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:17:59.865901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:00.180643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.192190 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-76e84c12-43f4-4cdb-a89c-feac8a08f29c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.436214 Jul 18 02:18:00.192421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 704/1430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:00.204095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Calling method '.version_select at 0x7fab04602e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:00.213262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.243505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65bf405f-2fc5-4d22-a3c2-624b4f823b3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.431239 Jul 18 02:18:00.245763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 727/1431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:17:59 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:00.258191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11b85d62-c47f-425d-8e1c-882d4694a0ff tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:00.270209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11b85d62-c47f-425d-8e1c-882d4694a0ff tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:00.278605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 89968a72-e26f-4888-b909-563e8822a9ab could not be found", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:18:00.279316 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] HTTP exception thrown: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Request method failure captured: Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab HTTP/1.1 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MLDFgg5GrbAhSVtcwCQmff1AAys9gO1fkQ-j4VHnFuMzAKTenaHduQ-ZWAFlbOIo5SoNykJVmJJuey48wLR9V_JG7shEbfLjhblKg2pd0Xz7VE27KjpXsujYxZmQXwUeL2eSXeOKVaypkNGsmIDF6M_gFnAMgXTPacWA-d-PxtGkv8 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 733f8ded6aa74d8fa7d9beffc7ccfca8 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:00.281664 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733f8ded6aa74d8fa7d9beffc7ccfca8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 733f8ded6aa74d8fa7d9beffc7ccfca8 Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1143289303 Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsTestJSON-1143289303-project Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: ac55993765ed4330ba94ca93508be9ae Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsTestJSON-1143289303-project Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: exception: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '89968a72-e26f-4888-b909-563e8822a9ab'} Jul 18 02:18:00.283852 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:18:00.285060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 89968a72-e26f-4888-b909-563e8822a9ab could not be found Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f61a7dc7-c051-438b-86dc-0933000de125'] Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab. Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:00.287124 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:00.289778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:00.292460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab Jul 18 02:18:00.292460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:00.293656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] Returning 404 to user: Floating IP not found for ID 89968a72-e26f-4888-b909-563e8822a9ab {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:00.294893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd5ff446-aee4-42e0-9ceb-2e06825c5d0e tempest-FloatingIPsTestJSON-1143289303 tempest-FloatingIPsTestJSON-1143289303-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab" status: 404 len: 111 microversion: 2.1 time: 0.098851 Jul 18 02:18:00.296102 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 705/1432] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:18:00 2022] DELETE /compute/v2.1/os-floating-ips/89968a72-e26f-4888-b909-563e8822a9ab => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:18:00.302445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f3d85cc-03c1-4d5e-9c6a-9eb8aee47382 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04677ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:00.363228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f3d85cc-03c1-4d5e-9c6a-9eb8aee47382 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.065612 Jul 18 02:18:00.364661 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 706/1433] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:00 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:00.465046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11b85d62-c47f-425d-8e1c-882d4694a0ff tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:00.480956 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11b85d62-c47f-425d-8e1c-882d4694a0ff tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1216 microversion: 2.1 time: 0.232871 Jul 18 02:18:00.481579 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 728/1434] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:00 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:00.551670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:00.553507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:00.566368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:00.567052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:00.568299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:00.569210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.012055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:01.033488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:01.035584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:01.037065 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c8e9274-f10c-4cf7-9928-02b2861cdd2c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.493313 Jul 18 02:18:01.043845 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 707/1435] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:00 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:01.213699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.214492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:01.223098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.223880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.224953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.226560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.265456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.266125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:01.283436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.284017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.289362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.289976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.749919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:01.759385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:01.784279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f2a6149-41da-4aad-80b5-5b0d7b4d3b66 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.573857 Jul 18 02:18:01.801754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1826c11-0698-445f-98d5-f566094c5bc4 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.526871 Jul 18 02:18:01.802569 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 729/1436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:01.807497 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 708/1437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:01.825549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a454192c-c587-4d58-8fee-78d06e685bf5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab0557de50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.826433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:01.830136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:01.862215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.863884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:01.878620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:01.881698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.003953 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a454192c-c587-4d58-8fee-78d06e685bf5 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.196917 Jul 18 02:18:02.016709 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 730/1438] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:02.076753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:02.077812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:02.085907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:02.086700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.087869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:02.088627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.701798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.713045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:02.716756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f30182c-6e8c-43b6-83c2-035a27f541c3 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1274 microversion: 2.1 time: 0.907645 Jul 18 02:18:02.717900 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 709/1439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:01 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1274 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:02.815125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:02.816249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:02.830296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:02.831395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.833096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:02.835355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:02.958689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.983769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.985997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:02.987796 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7f17949-4785-4ed9-a050-bdeb5e5f3a07 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.916164 Jul 18 02:18:02.999580 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 731/1440] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:02 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:03.005546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:03.006497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:03.014139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.014910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.015959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.017149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.455195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.470594 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e11b99d-f36d-4b3b-8e1a-761c92ef1bdc tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.661632 Jul 18 02:18:03.488982 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 710/1441] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:02 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:03.501396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cecc391a-e443-4619-95ff-66b8ad468714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046020d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:03.605730 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cecc391a-e443-4619-95ff-66b8ad468714 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.114423 Jul 18 02:18:03.616235 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 711/1442] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:03 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:03.650961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.672086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-254273c4-6818-4e10-84d0-cc20f294d553 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.670691 Jul 18 02:18:03.674424 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 732/1443] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:02 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:03.737344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:03.738556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:03.768232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.769234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.771529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:03.777153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:03.927359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:03.956026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8efbbaf-2630-4b0e-921c-451eb1dad25d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1274 microversion: 2.1 time: 0.221217 Jul 18 02:18:03.972981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 712/1444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:03 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:04.010130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:04.013829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:04.051893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.066158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.067623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.069636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.497670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:04.498626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:04.502033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:04.516353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.529486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.530841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.531488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.587904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.624076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.631979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:04.636080 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bedecdbb-a466-4e83-aceb-c09593f27da7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.629870 Jul 18 02:18:04.648054 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 733/1445] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:04 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:04.652626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dda17be-ed80-47f2-bbca-3e3cf45003e0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055b6ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:04.738042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0dda17be-ed80-47f2-bbca-3e3cf45003e0 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.090545 Jul 18 02:18:04.739966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 734/1446] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:04 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:04.749777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:04.755303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:04.771106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.772406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.774411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:04.775568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:04.880821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:05.478485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:05.490283 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-931b7c31-7ea4-4f65-9e72-2706968ebf36 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.996436 Jul 18 02:18:05.491993 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 713/1447] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:04 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:05.505068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:05.514284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:05.531034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.532891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:05.535762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.542775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:05.839258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:05.859539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3662008-3bbd-4c02-a02a-e418d1afd17c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 1.117056 Jul 18 02:18:05.861819 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 735/1448] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:04 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:05.867215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:05.871680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:05.874717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:05.904072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.904674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:05.905958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:05.909129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:06.350917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:06.360259 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1ae16fe-f8c3-4adb-9825-7e29d39342b0 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.866719 Jul 18 02:18:06.367567 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 714/1449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:05 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:06.376070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-882d4091-3ea4-4cd4-b4ac-d00cf037a690 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab045b6700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:06.498430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-882d4091-3ea4-4cd4-b4ac-d00cf037a690 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.128984 Jul 18 02:18:06.500300 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 715/1450] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:06 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:06.525049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:06.533174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:06.546858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:06.562916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:06.565714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:06.566831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:06.895022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:06.905768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:06.915313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:06.917071 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43970370-2f2f-4677-885c-8bf2b1bbac7c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 1.053899 Jul 18 02:18:06.922237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 736/1451] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:05 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:06.928068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:06.936358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:06.967514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:06.968374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:06.974423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:06.975369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:07.242507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:07.271149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e3e56b9c-3b34-498e-9ae9-62c54a9c93b5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.753104 Jul 18 02:18:07.307950 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 716/1452] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:06 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:07.340257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:07.353460 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9dabec9-83d8-48a0-91fd-e4a6febacdd3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.429501 Jul 18 02:18:07.354243 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 737/1453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:06 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:07.400791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:07.413462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:07.446438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:07.450150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:07.455928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:07.457316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:07.519044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a654d15-f146-4941-b0cd-243756e43690 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab055dd430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:07.737863 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a654d15-f146-4941-b0cd-243756e43690 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.218197 Jul 18 02:18:07.742812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 738/1454] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:07 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:07.762599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-60cc9a15-f7ff-42b6-b3c1-9c3dbfd12233 req-dea6fcd3-8a8e-4864-9313-957f89e39834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "name": "network-vif-unplugged", "status": "completed", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:07.804716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-60cc9a15-f7ff-42b6-b3c1-9c3dbfd12233 req-dea6fcd3-8a8e-4864-9313-957f89e39834 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:07.822575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-60cc9a15-f7ff-42b6-b3c1-9c3dbfd12233 req-dea6fcd3-8a8e-4864-9313-957f89e39834 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:07.888671 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-60cc9a15-f7ff-42b6-b3c1-9c3dbfd12233 req-dea6fcd3-8a8e-4864-9313-957f89e39834 service nova] Creating event network-vif-unplugged:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:18:07.930453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-60cc9a15-f7ff-42b6-b3c1-9c3dbfd12233 req-dea6fcd3-8a8e-4864-9313-957f89e39834 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181226 Jul 18 02:18:07.936469 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 739/1455] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:07.960068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:07.966772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:08.003740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.010068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.022544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.030902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.138408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:08.160080 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d88b36c-52a0-4e0b-92f3-14d3460b17ed tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.769391 Jul 18 02:18:08.167082 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 717/1456] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:07 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:08.315322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:08.316855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:08.333915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.334641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.337690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.341475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.909669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:08.920014 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d8889a6-2013-4c1f-b2c7-18a6b20aa47d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1470 microversion: 2.1 time: 0.612459 Jul 18 02:18:08.935303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 718/1457] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:08 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:08.944839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:08.950483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:08.961823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.962694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:08.963753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:08.964411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:09.216293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.242933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.256486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.278263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:09.280615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c70fde5-d105-4317-9b96-5868d8032c28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 1.328329 Jul 18 02:18:09.293143 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4172cd27-5352-41fe-b910-1e4767d04fd9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.355242 Jul 18 02:18:09.295095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 719/1458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:08 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:09.302641 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 740/1459] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:07 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:09.314229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:09.320509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:09.322068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0fff816-1fe4-46e8-a19f-246bca609650 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046118b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:09.351214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:09.352210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:09.353740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:09.354540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:09.437078 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0fff816-1fe4-46e8-a19f-246bca609650 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.139257 Jul 18 02:18:09.440716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 720/1460] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:09 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:09.951706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:09.956127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:09.986150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:09.998371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:10.062227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.063596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.085429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.086378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.470839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:10.619262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:10.647580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d19a8c3-c6e0-41fb-b884-a9b2273be0d8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 1.338989 Jul 18 02:18:10.651656 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 741/1461] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:09 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:10.673734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-cc8d70b0-3855-430f-9ab0-05c33ff56f3b req-f46b4ac5-ef5c-4abf-b883-03f01a29a828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60d3201-8618-4c09-8fe0-429fb7be97ed", "tag": "67c9ffee-f71c-467e-a8ea-34cecb53b8f7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:10.706076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cc8d70b0-3855-430f-9ab0-05c33ff56f3b req-f46b4ac5-ef5c-4abf-b883-03f01a29a828 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.707723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cc8d70b0-3855-430f-9ab0-05c33ff56f3b req-f46b4ac5-ef5c-4abf-b883-03f01a29a828 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.748062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-cc8d70b0-3855-430f-9ab0-05c33ff56f3b req-f46b4ac5-ef5c-4abf-b883-03f01a29a828 service nova] Creating event network-changed:67c9ffee-f71c-467e-a8ea-34cecb53b8f7 for instance d60d3201-8618-4c09-8fe0-429fb7be97ed on n-h1-849796-1 Jul 18 02:18:10.755000 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-cc8d70b0-3855-430f-9ab0-05c33ff56f3b req-f46b4ac5-ef5c-4abf-b883-03f01a29a828 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098718 Jul 18 02:18:10.757089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 742/1462] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:10.763675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:10.764753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:10.775025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.775907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.777004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.777749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.909553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:10.926683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50c83c71-7b24-4ac0-8253-b684888c46e0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1536 microversion: 2.1 time: 0.989421 Jul 18 02:18:10.937410 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 721/1463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:09 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1536 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:10.960125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:10.961636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:10.989905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.990623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:10.992039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:10.993250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:11.323415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:11.339178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:11.341483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:11.362513 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b36ca5af-aeba-4558-a341-0eeb51846d09 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.403715 Jul 18 02:18:11.364832 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 722/1464] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:10 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:11.373313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-452cb67d-f08a-4242-94d6-ac5372f19118 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046779d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:11.452052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:11.468540 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-921b1884-2895-4896-adaa-1f59cf8e2e88 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.709360 Jul 18 02:18:11.470499 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 743/1465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:10 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:11.515155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-452cb67d-f08a-4242-94d6-ac5372f19118 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.148196 Jul 18 02:18:11.515988 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 723/1466] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:11 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:11.682364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:11.686275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:11.711204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.713917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:11.717449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.723616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:11.956183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:11.959640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:11.989717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.990496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:11.991582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:11.992896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.363705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.380535 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b36afc82-821b-4c34-9c7a-45518a9e150c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.712561 Jul 18 02:18:12.383075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 744/1467] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:11 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:12.387455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.398545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-435968da-5905-4bdb-a00d-54fe3af0e6fd req-8d03d448-7e2b-4d98-bbc6-52838b1176e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd333e5b-d005-4786-af0e-1e0aa88d19a2", "name": "network-vif-plugged", "status": "completed", "tag": "5c639a82-e392-402e-ad94-ea3782fc86b1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:12.403344 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe7cc325-02a1-45ae-9ef0-8ef0e1071d7c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1536 microversion: 2.1 time: 0.453143 Jul 18 02:18:12.405373 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 724/1468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:11 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1536 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:12.419107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:12.423179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:12.432409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-435968da-5905-4bdb-a00d-54fe3af0e6fd req-8d03d448-7e2b-4d98-bbc6-52838b1176e0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.432949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-435968da-5905-4bdb-a00d-54fe3af0e6fd req-8d03d448-7e2b-4d98-bbc6-52838b1176e0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.442623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.443585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.444873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.447004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.474623 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-435968da-5905-4bdb-a00d-54fe3af0e6fd req-8d03d448-7e2b-4d98-bbc6-52838b1176e0 service nova] Creating event network-vif-plugged:5c639a82-e392-402e-ad94-ea3782fc86b1 for instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 on n-h2-849796-1 Jul 18 02:18:12.488984 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-435968da-5905-4bdb-a00d-54fe3af0e6fd req-8d03d448-7e2b-4d98-bbc6-52838b1176e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103328 Jul 18 02:18:12.492611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 745/1469] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:12.507160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:12.510247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:12.521353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.523852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.526243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.527158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.816603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.842215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.847308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.849308 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d1f7368-367c-418f-a40e-8577aa206231 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.440380 Jul 18 02:18:12.850567 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 725/1470] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:12 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:12.856408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71ff5362-c263-4bff-be71-d506088c6ed6 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05058040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:12.873394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:12.887771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4531989d-8f01-425e-b7ec-227239394e1d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.392174 Jul 18 02:18:12.891015 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 746/1471] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:12 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:12.908681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-dae134c6-33af-46f5-b6bd-3b2f4135c53b req-51a28476-8e0c-4470-b9da-4ff5580957d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:12.939374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dae134c6-33af-46f5-b6bd-3b2f4135c53b req-51a28476-8e0c-4470-b9da-4ff5580957d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:12.942767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dae134c6-33af-46f5-b6bd-3b2f4135c53b req-51a28476-8e0c-4470-b9da-4ff5580957d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:12.976668 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-dae134c6-33af-46f5-b6bd-3b2f4135c53b req-51a28476-8e0c-4470-b9da-4ff5580957d0 service nova] Creating event network-changed:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:18:12.998159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-dae134c6-33af-46f5-b6bd-3b2f4135c53b req-51a28476-8e0c-4470-b9da-4ff5580957d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103174 Jul 18 02:18:12.998396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71ff5362-c263-4bff-be71-d506088c6ed6 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.146184 Jul 18 02:18:13.007678 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 726/1472] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:12 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:13.010414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 747/1473] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:13.399397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.400031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:13.412653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.413160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.414974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.419115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.440177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.440892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:13.481800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.488415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.492603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.496506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.822502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:13.846405 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f1d0c90-a414-48cd-a0cd-7973add27200 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1536 microversion: 2.1 time: 0.412687 Jul 18 02:18:13.867757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 748/1474] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:13 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1536 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:13.893814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:13.895335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:13.907926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.910885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:13.912222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:13.913417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.221625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.256000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73f2e459-dfda-4be8-9824-569c082b8b61 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.860085 Jul 18 02:18:14.265258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 727/1475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:13 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:14.278503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:14.278974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:14.295438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.303088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.306590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.308442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.496965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.513129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.519303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.523456 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f015a0ca-5b83-483f-b0c8-c6793a43b67d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.642321 Jul 18 02:18:14.536978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 749/1476] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:13 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:18:14.536978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b402ddd7-7117-4711-91cb-3c8c679342fc tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab054aeb80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:14.673839 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b402ddd7-7117-4711-91cb-3c8c679342fc tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.144624 Jul 18 02:18:14.681133 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 750/1477] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:14 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:14.688357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ed90da58-a30a-4722-993e-26313a9602de req-41becf85-9e91-48d4-985c-5125adb6b10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-plugged", "status": "completed", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:14.714623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ed90da58-a30a-4722-993e-26313a9602de req-41becf85-9e91-48d4-985c-5125adb6b10b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.715077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ed90da58-a30a-4722-993e-26313a9602de req-41becf85-9e91-48d4-985c-5125adb6b10b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.745220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ed90da58-a30a-4722-993e-26313a9602de req-41becf85-9e91-48d4-985c-5125adb6b10b service nova] Creating event network-vif-plugged:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:18:14.758016 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ed90da58-a30a-4722-993e-26313a9602de req-41becf85-9e91-48d4-985c-5125adb6b10b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073829 Jul 18 02:18:14.758970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 751/1478] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:14.855528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:14.870346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-808b63a3-4bd0-4906-8741-0725e85f0ec7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.602171 Jul 18 02:18:14.874221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 728/1479] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:14 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:14.875124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:14.876193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:14.888210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.888677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:14.889521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:14.897012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.284371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:15.285014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:15.305875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.306654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.307647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.308462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.594305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:15.619316 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a0f262b-5a79-4f96-b32c-93ffa53d115e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1536 microversion: 2.1 time: 0.748836 Jul 18 02:18:15.626391 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 752/1480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:14 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1536 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:15.649556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:15.654510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:15.682711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.683935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.686476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:15.687932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:15.855329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:15.872148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22c30d92-f3ea-4ba9-94b2-e273232dcb6a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.594354 Jul 18 02:18:15.874059 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 729/1481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:18:15.888453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56362cfa-4a19-4d99-9aaa-425e6c3f7120 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04602a60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.184447 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56362cfa-4a19-4d99-9aaa-425e6c3f7120 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.308980 Jul 18 02:18:16.185829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 730/1482] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:16.194358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.209900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.255996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.259437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.264657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.268764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.657130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.711278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.714757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.722359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:16.726569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e4c3307-1cae-441e-b0c4-daf6695e5892 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.539374 Jul 18 02:18:16.729860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 731/1483] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:16.733239 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-205418c7-1a5e-4713-b9c2-fae493b6fafc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 1.104332 Jul 18 02:18:16.749028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.756634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.760731 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 753/1484] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:15 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:16.798397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.799464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.803562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.804847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.869421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:16.908080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:16.912762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:16.939053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.943051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:16.950819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:16.952379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:17.309445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:17.333518 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-299fa064-e2ce-4a2d-8169-107d243ae76b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1536 microversion: 2.1 time: 0.598123 Jul 18 02:18:17.335940 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 732/1485] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1536 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:17.355832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3e6df88b-d515-4d41-acd2-136a50d9aebd req-e0975952-16ec-4729-91ff-8a847fe47a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-unplugged", "status": "completed", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:17.389922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3e6df88b-d515-4d41-acd2-136a50d9aebd req-e0975952-16ec-4729-91ff-8a847fe47a12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:17.391792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3e6df88b-d515-4d41-acd2-136a50d9aebd req-e0975952-16ec-4729-91ff-8a847fe47a12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:17.442261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3e6df88b-d515-4d41-acd2-136a50d9aebd req-e0975952-16ec-4729-91ff-8a847fe47a12 service nova] Creating event network-vif-unplugged:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:18:17.466534 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3e6df88b-d515-4d41-acd2-136a50d9aebd req-e0975952-16ec-4729-91ff-8a847fe47a12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124057 Jul 18 02:18:17.470709 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 733/1486] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:17.487187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f2f4575-a16b-4e2b-9a7d-3f90cc254f36 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046113a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:17.617403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f2f4575-a16b-4e2b-9a7d-3f90cc254f36 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.144062 Jul 18 02:18:17.631385 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 734/1487] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:17 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:17.763395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:17.768581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:17.788707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:17.794790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:17.798760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:17.812578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:18.397480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:18.426026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:18.449046 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e7a7a9e0-97db-4cca-9f4d-92bb8dc6018c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1325 microversion: 2.1 time: 0.691848 Jul 18 02:18:18.452346 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 735/1488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:17 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1325 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:18.464529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:18.466438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:18.468277 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-253213a5-1891-4ef8-95a3-d2f0c910925b tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 1.568861 Jul 18 02:18:18.480117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:18.481530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:18.482013 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 754/1489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:16 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:18.483892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:18.485164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:18.508207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:18.511852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:18.541358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:18.544367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:18.546086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:18.549548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:18.713707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:18.744902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:18.761359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:18.769604 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b28bf83a-73d9-4268-83ad-b99213d5376b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.313451 Jul 18 02:18:18.778730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 736/1490] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:18 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:18.793179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7f7b63b-ba97-4d1f-8eb3-d5b7e665b9c8 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04818430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:18.940437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7f7b63b-ba97-4d1f-8eb3-d5b7e665b9c8 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.154295 Jul 18 02:18:18.943065 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 737/1491] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:18 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:18.976152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.004598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-820be59e-adc8-418f-a00d-56ccc17719d4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1529 microversion: 2.1 time: 0.520699 Jul 18 02:18:19.026516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 755/1492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:18 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1529 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:19.038322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:19.043357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.093235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.103442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.105498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.110359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.482812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:19.486192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.511493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.524317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.527179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.538069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.667226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:19.683381 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5abd83a9-d0a9-4e26-8af0-a91708281138 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1529 microversion: 2.1 time: 0.653015 Jul 18 02:18:19.697375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 738/1493] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:19 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1529 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:19.710061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:19.713277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:19.727373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.731229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:19.732396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:19.733080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.110565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.131003 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-18254304-45c3-46d0-931c-1457df8e0de2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.424331 Jul 18 02:18:20.134710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 739/1494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:19 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:20.197337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04210274-9862-4c0c-aa57-c5f8f3f9add4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.200868 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:18:20.200868 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:18:20.217343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-04210274-9862-4c0c-aa57-c5f8f3f9add4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] HTTP exception thrown: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04210274-9862-4c0c-aa57-c5f8f3f9add4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Request method failure captured: Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/flavors/db62eb13-e23f-48e1-b40d-8d6f1846705b HTTP/1.1 Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHqFZlHt96lPpOnM1-4s3QEqCFCpW3sQXGnUtWQArVLYFEEN2R30RC3MOheSNMTTvPR0gy2b9wMs_K0w5_TIYG7r1D6VTSh001Smq3DhtQYmYblV3Ah2LZ2XUYy9NgGGR5iElS_pzKqEpYHt0T0jTC8_z2OglSq8caiDXUaccF5ezM Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 13458fa338ea4d77a4df1b8c59d0e86a Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-MigrationsAdminTest-1265821999 Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:18:20.233387 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/13458fa338ea4d77a4df1b8c59d0e86a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_13458fa338ea4d77a4df1b8c59d0e86a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/13458fa338ea4d77a4df1b8c59d0e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/13458fa338ea4d77a4df1b8c59d0e86a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-MigrationsAdminTest-1265821999 Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 13458fa338ea4d77a4df1b8c59d0e86a Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-MigrationsAdminTest-1265821999 Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-MigrationsAdminTest-1265821999-project-admin Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 048399aedda54b55b75892105ef78f26 Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-MigrationsAdminTest-1265821999-project-admin Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: exception: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. Jul 18 02:18:20.235355 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'db62eb13-e23f-48e1-b40d-8d6f1846705b'} Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:20.236939 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. Jul 18 02:18:20.238667 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:20.240064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04210274-9862-4c0c-aa57-c5f8f3f9add4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Returning 404 to user: Flavor db62eb13-e23f-48e1-b40d-8d6f1846705b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:20.240064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04210274-9862-4c0c-aa57-c5f8f3f9add4 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/db62eb13-e23f-48e1-b40d-8d6f1846705b" status: 404 len: 109 microversion: 2.1 time: 0.098415 Jul 18 02:18:20.245535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 740/1495] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:18:20 2022] DELETE /compute/v2.1/flavors/db62eb13-e23f-48e1-b40d-8d6f1846705b => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:18:20.260487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.261166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:20.298643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.299315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.300215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.300670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.371325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.386558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfc4b3c5-df63-4bdb-b5e5-3ac7f82d4947 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.910610 Jul 18 02:18:20.387158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 756/1496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:19 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:20.425245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6af5313f-f8c6-4541-b83e-c6d727e490d2 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab0557dee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.588554 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6af5313f-f8c6-4541-b83e-c6d727e490d2 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.200032 Jul 18 02:18:20.595570 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 757/1497] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:20 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:20.605902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:20.606618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:20.616492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.617028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.618054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:20.618713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:20.658257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:20.737106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.778680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.780791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:20.782255 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c93345d-fda4-4f07-aaa7-a07622aac74a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.535527 Jul 18 02:18:20.783243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 741/1498] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:20 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:20.814140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2116833103", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:21.038820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:18:21.169523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:21.182643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9550db0c-5519-4004-966c-d2f2cdfc8c01 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.591663 Jul 18 02:18:21.185482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 758/1499] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:20 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:21.193920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.200196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:21.219733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.222978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.226879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.228887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.558993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:18:21.559842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:18:21.560382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:18:21.561179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:18:21.561771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:18:21.574183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.574672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.575913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.576575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.602321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:18:21.608522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Getting quotas for user 4c85ff74393d48febcae3bd1c49d3887 and project 9a814973df884fc6972477bf52853e15. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:18:21.632950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:18:21.636690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:18:21.730172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:21.744873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb3c83c9-09ab-459a-b64a-c6f499f1794f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959736 Jul 18 02:18:21.746795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee5f7b38-8cb0-47f8-95c8-fe8a9607d21e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 0.556248 Jul 18 02:18:21.749900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 759/1500] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:21.757521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 742/1501] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:18:21.768809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4638db3c-787c-48ac-b0a2-603c51ff4989 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1035899140", "metadata": {"": ""}}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:21.771348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fefe27d-fdd4-47cc-803b-b153aa9dd997 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04602160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4638db3c-787c-48ac-b0a2-603c51ff4989 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action HTTP/1.1 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 107 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:18:21.780754 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1035899140", "metadata": {"": ""}}} Jul 18 02:18:21.782849 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1035899140', 'metadata': {'': ''}}}} Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'': ''} Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:21.784518 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.786456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:21.788305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:21.807361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4638db3c-787c-48ac-b0a2-603c51ff4989 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:21.808601 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4638db3c-787c-48ac-b0a2-603c51ff4989 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action" status: 400 len: 170 microversion: 2.1 time: 0.055125 Jul 18 02:18:21.815322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 760/1502] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Jul 18 02:18:21 2022] POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action => generated 170 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:18:21.834331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d79742d8-a643-4679-887a-ee34975c3ce5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.837204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d79742d8-a643-4679-887a-ee34975c3ce5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:21.911343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fefe27d-fdd4-47cc-803b-b153aa9dd997 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.152374 Jul 18 02:18:21.915047 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 743/1503] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:21.949366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:21.955965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:21.982817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.983289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:21.984128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:21.984649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.295226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d79742d8-a643-4679-887a-ee34975c3ce5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.341059 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d79742d8-a643-4679-887a-ee34975c3ce5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1213 microversion: 2.1 time: 0.523867 Jul 18 02:18:22.345203 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 761/1504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1213 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:22.382038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:22.383218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:22.411055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.412218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.414212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:22.418151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:22.908491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.964478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.985632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:22.988056 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cf5e07f-9f91-4ee4-9cc2-a6ae507f10db tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 1.069892 Jul 18 02:18:23.001723 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 744/1505] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:21 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:23.018005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:23.024862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:23.064193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.065524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:23.073165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:23.074308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:23.831112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:23.847633 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0cf4b00d-0496-452e-90c2-d2f6072b3ba9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 1.500265 Jul 18 02:18:23.848490 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 762/1506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:22 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:23.861673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-791a1342-eb78-4c5c-9c47-492ed39aad9b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab054d58b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.002694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-791a1342-eb78-4c5c-9c47-492ed39aad9b tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.152814 Jul 18 02:18:24.003714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 763/1507] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:23 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:24.025046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.032497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:24.060245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.064840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.069421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.075715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.093638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.107970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0958b940-33e9-4f76-9d74-ca82d905ebcb tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 1.104143 Jul 18 02:18:24.112115 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 745/1508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:23 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:24.131202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.131874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:24.150987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.151465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.162656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.163134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.334193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.353420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0d643e2-4a52-4af1-a89d-7376d853b60a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1265 microversion: 2.1 time: 0.347169 Jul 18 02:18:24.360490 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 764/1509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:24.385140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:24.387879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:24.426024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.427176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.429051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:24.429787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:24.929809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:24.959546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-959c981b-9de1-4488-b34e-e0e673686925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.844589 Jul 18 02:18:24.962896 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 746/1510] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:24.984074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60d3201-8618-4c09-8fe0-429fb7be97ed", "name": "network-vif-plugged", "status": "completed", "tag": "67c9ffee-f71c-467e-a8ea-34cecb53b8f7"}, {"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-plugged", "status": "completed", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:25.051047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.053491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.122782 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] Creating event network-vif-plugged:67c9ffee-f71c-467e-a8ea-34cecb53b8f7 for instance d60d3201-8618-4c09-8fe0-429fb7be97ed on n-h1-849796-1 Jul 18 02:18:25.125977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] Creating event network-vif-plugged:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:18:25.179926 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e654cc97-8080-42ec-b88b-903115134453 req-cf71145d-7758-4f58-8365-aa44184285a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.208956 Jul 18 02:18:25.184187 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 747/1511] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:25.201718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fafd930b-b0ca-45f3-b722-d24ab4b9dac5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195198179", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fafd930b-b0ca-45f3-b722-d24ab4b9dac5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action HTTP/1.1 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 618 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:25.215985 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:25.220001 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:18:25.221506 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195198179", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 18 02:18:25.221506 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:18:25.221506 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-195198179', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 18 02:18:25.222027 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:25.223540 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.226240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:18:25.227768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:25.238222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fafd930b-b0ca-45f3-b722-d24ab4b9dac5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:25.238222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fafd930b-b0ca-45f3-b722-d24ab4b9dac5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action" status: 400 len: 938 microversion: 2.1 time: 0.040091 Jul 18 02:18:25.238222 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 748/1512] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Jul 18 02:18:25 2022] POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action => generated 938 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:18:25.276504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1bc39422-b585-4a7f-8361-07cc4c135032 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04677f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:25.325785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.346065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.353440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:25.356070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-583bfa2c-a08d-4dbc-ab03-7ce065d74cc7 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.994212 Jul 18 02:18:25.376315 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 765/1513] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:24 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:25.393746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:25.399458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:25.414381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.417557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.418681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.421213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.505079 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1bc39422-b585-4a7f-8361-07cc4c135032 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.265376 Jul 18 02:18:25.510711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 749/1514] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:25 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:25.540014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:25.542193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:25.565399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.566787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:25.568526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:25.571844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.175920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.223877 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03e53925-92f1-4d33-af59-85c0be317b8c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1316 microversion: 2.1 time: 1.842312 Jul 18 02:18:27.235886 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 766/1515] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:25 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1316 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:27.304662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:27.319827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:27.348361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.350084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.351512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.356773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.621684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:27.654315 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9f64ebe-324a-4a6e-b590-ec9e5f837d36 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 2.141310 Jul 18 02:18:27.659597 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 750/1516] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:25 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:27.691780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:27.697407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:27.739325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.740718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:27.744774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:27.747916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.427936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.456589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.462191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:28.464497 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5a11c52-f884-4a22-a3fa-cda592a4c9d9 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.798093 Jul 18 02:18:28.477794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 751/1517] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:27 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:28.537639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1874f375-06f0-4a9b-96b2-eadbb0b76c03 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04664550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:28.707335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1874f375-06f0-4a9b-96b2-eadbb0b76c03 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.202866 Jul 18 02:18:28.727233 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 752/1518] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:28 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:28.784720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-55c5c509-5de4-4374-b79e-346df074353a req-7afec1cb-6255-4030-be94-3a128e9ae6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "name": "network-vif-unplugged", "status": "completed", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:28.840363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-55c5c509-5de4-4374-b79e-346df074353a req-7afec1cb-6255-4030-be94-3a128e9ae6a4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:28.841263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-55c5c509-5de4-4374-b79e-346df074353a req-7afec1cb-6255-4030-be94-3a128e9ae6a4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:28.894804 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-55c5c509-5de4-4374-b79e-346df074353a req-7afec1cb-6255-4030-be94-3a128e9ae6a4 service nova] Creating event network-vif-unplugged:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h1-849796-1 Jul 18 02:18:28.942042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-55c5c509-5de4-4374-b79e-346df074353a req-7afec1cb-6255-4030-be94-3a128e9ae6a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202742 Jul 18 02:18:28.946042 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 753/1519] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:28.985416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:28.991165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:29.023938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.023938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.033933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.034952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.686731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:29.743441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8eff4bd-3a41-46b7-bbed-632da1042358 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 2.504512 Jul 18 02:18:29.745932 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 767/1520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:27 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:29.756548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:29.758478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:29.791739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.792795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.798030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:29.802246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:29.916039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:29.946743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3644195c-8837-46bc-a23b-e7ee7d8269ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.995499 Jul 18 02:18:29.965202 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 754/1521] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:28 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:29.987223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:29.989580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:30.037086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.043279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.045741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.050816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.496122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:30.526842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:30.535003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:30.541988 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed61f225-3561-4957-b28d-2f9fe295efe6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.574492 Jul 18 02:18:30.547142 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 755/1522] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:29 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:30.565187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5c82952-92aa-46d9-b4b1-02b8c69ef95d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab046023a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:30.740171 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5c82952-92aa-46d9-b4b1-02b8c69ef95d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.190920 Jul 18 02:18:30.742263 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 756/1523] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:30 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:30.749541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-700a87d3-c7d9-4cfb-b455-e40df4269901 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-700a87d3-c7d9-4cfb-b455-e40df4269901 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action HTTP/1.1 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 285 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:30.754056 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:18:30.757181 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:18:30.758053 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:18:30.758998 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:18:30.761855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:18:30.763137 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:18:30.763137 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:30.768361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-700a87d3-c7d9-4cfb-b455-e40df4269901 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:30.771024 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-700a87d3-c7d9-4cfb-b455-e40df4269901 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action" status: 400 len: 619 microversion: 2.1 time: 0.026888 Jul 18 02:18:30.777524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 757/1524] 10.222.0.67 () {60 vars in 1278 bytes} [Mon Jul 18 02:18:30 2022] POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:18:30.788685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:30.789630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:30.802810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.803592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:30.804848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:30.805520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.510606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.523355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-716f54c8-f696-4cb2-a9df-a788149a0e93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 0.744287 Jul 18 02:18:31.529504 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 758/1525] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:30 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:31.535220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:31.535863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:31.560830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.561327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.562170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.563802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.639316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:31.640159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:31.649400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:31.695631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca3f1aa9-4512-4846-ad8e-3784c9fda1e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1466 microversion: 2.1 time: 1.947037 Jul 18 02:18:31.721668 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 768/1526] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:29 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1466 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:31.743917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c5cb2248-4b5e-4f59-91a8-db442199d13e req-e457d05d-c3eb-4b03-a7f1-9c6af5f77e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:31.762898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c5cb2248-4b5e-4f59-91a8-db442199d13e req-e457d05d-c3eb-4b03-a7f1-9c6af5f77e4a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.763965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c5cb2248-4b5e-4f59-91a8-db442199d13e req-e457d05d-c3eb-4b03-a7f1-9c6af5f77e4a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.790467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c5cb2248-4b5e-4f59-91a8-db442199d13e req-e457d05d-c3eb-4b03-a7f1-9c6af5f77e4a service nova] Creating event network-changed:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:18:31.799124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c5cb2248-4b5e-4f59-91a8-db442199d13e req-e457d05d-c3eb-4b03-a7f1-9c6af5f77e4a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066339 Jul 18 02:18:31.801703 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 769/1527] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:31.811292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:31.813396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:31.823335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.824118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:31.825167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:31.827255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.062633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.075534 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d3ba199-e7eb-45b8-91fe-32ad94c5e6a0 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.544703 Jul 18 02:18:32.077719 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 759/1528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:31 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:32.092582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.095132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:32.120501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.121033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.121873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.122328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.304198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:32.352362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.367131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.369082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:32.378208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2183a9e-95ac-4212-9888-21d158f1e86d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.571335 Jul 18 02:18:32.392616 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 770/1529] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:31 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:32.408812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea62137a-acce-4ec0-8998-6ac97c5c0020 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab05624040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.496124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea62137a-acce-4ec0-8998-6ac97c5c0020 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.101922 Jul 18 02:18:32.496776 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 771/1530] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:32.511376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.514326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:32.524072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.524855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.526477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.527159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.700387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:32.705893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-add3ce91-dc77-4971-aecd-4d3e11b0efce tempest-ServersOnMultiNodesTest-1234294166 tempest-ServersOnMultiNodesTest-1234294166-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1617 microversion: 2.1 time: 0.623484 Jul 18 02:18:32.711067 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 760/1531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1617 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:32.731154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:32.732201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:32.754036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.754860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:32.759344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:32.760126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.177358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:33.193880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed234a72-3eec-4ef2-882f-10751b9af19a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 0.481082 Jul 18 02:18:33.194984 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 761/1532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:33.207075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:33.208324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:33.221294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.222423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.224102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.225199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.302730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:18:33.554946 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d42eb520-7869-4c7c-bd00-9c8435cc78e2 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 204 len: 0 microversion: 2.1 time: 0.357525 Jul 18 02:18:33.558970 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 762/1533] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:18:33 2022] DELETE /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:33.576475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:33.583127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:33.605470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.606836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.611742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.613414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.616415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:33.629881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d4beb34-9fd8-4b9d-af2f-452ee9c6115a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 1.131958 Jul 18 02:18:33.630896 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 772/1534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:32 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:33.642060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-504df332-5f07-4e1f-ae0d-be07e1695921 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab054d58b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:33.887166 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-504df332-5f07-4e1f-ae0d-be07e1695921 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.249964 Jul 18 02:18:33.888336 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 773/1535] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:33 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:33.908801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:33.909875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:33.948110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.949063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:33.950182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:33.951514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.056326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.086742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.091970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.097282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe948bd1-f8f8-4c7f-8202-39e196814613 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1810 microversion: 2.25 time: 0.535146 Jul 18 02:18:34.098920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 763/1536] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:33 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1810 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:34.135478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-224900383"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:34.138728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:34.157384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.158596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.160230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.162882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.421138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:34.432513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-44d3a6d2-ef02-44bc-aa0a-a9fbb3266149 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 200 len: 1472 microversion: 2.1 time: 0.539490 Jul 18 02:18:34.453521 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 774/1537] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:33 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 1472 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:34.453521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:34.453521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:34.470192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.472039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.475205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.476300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.865267 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef215243-9029-405e-a46b-b16d58bf3d90 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action" status: 202 len: 0 microversion: 2.1 time: 0.736285 Jul 18 02:18:34.879336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 764/1538] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:18:34 2022] POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:18:34.908600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1028067578"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:34.919274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:34.929492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.949119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.952133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:34.957860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:34.958586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:35.065655 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Cannot 'createImage' instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 while it is in task_state image_snapshot_pending Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action HTTP/1.1 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 85 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:35.072514 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1028067578"}} Jul 18 02:18:35.075473 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'createImage' instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 while it is in task_state image_snapshot_pending Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1028067578'}}} Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:35.077195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 while it is in task_state image_snapshot_pending Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 while it is in task_state image_snapshot_pending Jul 18 02:18:35.080368 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:35.087107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 409 to user: Cannot 'createImage' instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 while it is in task_state image_snapshot_pending {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:35.087482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3857cc0d-75dc-47cd-a121-312b552d57ce tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action" status: 409 len: 167 microversion: 2.1 time: 0.203276 Jul 18 02:18:35.093976 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 765/1539] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:18:34 2022] POST /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2/action => generated 167 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:18:35.103500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-296e254c-81ca-47c7-b39b-437607cff18e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04611ee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:35.979924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:36.018162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4db95bd-0859-4780-93b6-76c7fee36d60 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 1.575068 Jul 18 02:18:36.033556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 775/1540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:34 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:36.059484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df76be10-b702-475f-9cac-9e17b244dc8d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab05624c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:42.819914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-296e254c-81ca-47c7-b39b-437607cff18e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 7.723836 Jul 18 02:18:42.825364 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 766/1541] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:35 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 7730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:42.845541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:42.855196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:42.896246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:42.897761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:42.904421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:42.906759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.393008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df76be10-b702-475f-9cac-9e17b244dc8d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/images/30c99007-e86d-45f1-b9dc-1607aeabec7e" status: 204 len: 0 microversion: 2.1 time: 7.356488 Jul 18 02:18:43.394230 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 776/1542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:36 2022] DELETE /compute/v2.1/images/30c99007-e86d-45f1-b9dc-1607aeabec7e => generated 0 bytes in 7359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:43.414768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:43.423021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: d60d3201-8618-4c09-8fe0-429fb7be97ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:43.465485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=68 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:43.474469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.477650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.483459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.494721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.563263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed HTTP/1.1 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:18:43.571091 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. Jul 18 02:18:43.572731 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd60d3201-8618-4c09-8fe0-429fb7be97ed'} Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:43.573660 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. Jul 18 02:18:43.575035 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:43.583768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance d60d3201-8618-4c09-8fe0-429fb7be97ed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:43.586808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdb1e419-c72d-468d-bbf8-421de20e335d tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed" status: 404 len: 111 microversion: 2.1 time: 0.189977 Jul 18 02:18:43.590451 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 777/1543] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:43 2022] GET /compute/v2.1/servers/d60d3201-8618-4c09-8fe0-429fb7be97ed => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:18:43.630520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:43.638285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:43.677899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.679693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.681041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.688173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:43.884344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.905717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.911346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:43.915104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74bbb6a1-e468-4648-9f79-d8fc09eb8ef4 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1800 microversion: 2.25 time: 1.084374 Jul 18 02:18:43.930247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 767/1544] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:42 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1800 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:43.947151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8f7b74f3-b355-432b-a1b9-960e77acb15d req-4bb6ec50-a14d-4d40-9295-cb419a0a93b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60d3201-8618-4c09-8fe0-429fb7be97ed", "name": "network-vif-deleted", "tag": "67c9ffee-f71c-467e-a8ea-34cecb53b8f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:43.989469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8f7b74f3-b355-432b-a1b9-960e77acb15d req-4bb6ec50-a14d-4d40-9295-cb419a0a93b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:43.998297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8f7b74f3-b355-432b-a1b9-960e77acb15d req-4bb6ec50-a14d-4d40-9295-cb419a0a93b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.040160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:44.043374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8f7b74f3-b355-432b-a1b9-960e77acb15d req-4bb6ec50-a14d-4d40-9295-cb419a0a93b8 service nova] Creating event network-vif-deleted:67c9ffee-f71c-467e-a8ea-34cecb53b8f7 for instance d60d3201-8618-4c09-8fe0-429fb7be97ed on n-h1-849796-1 Jul 18 02:18:44.062514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8f7b74f3-b355-432b-a1b9-960e77acb15d req-4bb6ec50-a14d-4d40-9295-cb419a0a93b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130339 Jul 18 02:18:44.071687 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 768/1545] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:44.080705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0def441-aec2-4b9c-8218-24061b24cc87 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 0.481378 Jul 18 02:18:44.087076 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 778/1546] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:43 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:44.091681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:44.099910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:44.101506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:44.107069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:44.131370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.132269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.133573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.135560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.136343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.139262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:44.141990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:44.144893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.029592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:45.065415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fc3a1c2-9acc-49c6-bf1e-f953b5c1c829 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1540 microversion: 2.1 time: 0.975880 Jul 18 02:18:45.069992 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 779/1547] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:44 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1540 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:45.088379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.102821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:45.132228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c34017d-7ea7-4372-8d7e-60c1b5111900 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1813 microversion: 2.1 time: 1.052612 Jul 18 02:18:45.135044 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 769/1548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:44 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1813 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:45.136487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.137352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.138956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.139608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.151166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1bc8c80-e486-4eef-b7b3-6aaf33253e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab045bbee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.332753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:18:45.490033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1bc8c80-e486-4eef-b7b3-6aaf33253e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.350440 Jul 18 02:18:45.493775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 770/1549] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:45 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:45.513883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-026a4167-9f79-49e5-a5c3-b93c75263eac tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '.version_select at 0x7fab045a0b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.520843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-026a4167-9f79-49e5-a5c3-b93c75263eac tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.521896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-026a4167-9f79-49e5-a5c3-b93c75263eac tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.552297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:45.585416 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-026a4167-9f79-49e5-a5c3-b93c75263eac tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3381 microversion: 2.25 time: 0.087438 Jul 18 02:18:45.599757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 771/1550] 10.222.0.67 () {60 vars in 1183 bytes} [Mon Jul 18 02:18:45 2022] GET /compute/v2.1/os-migrations => generated 3381 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:45.623953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.627063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:45.696062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.696523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.716893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.717726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.775062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40242438-d4fb-4f09-9761-1f516ad2e96f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 204 len: 0 microversion: 2.1 time: 0.701246 Jul 18 02:18:45.779104 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 780/1551] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:18:45 2022] DELETE /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:45.822229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:45.832805 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:18:45.832805 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:18:45.841477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.842995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:45.878990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:45.888033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.121744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd0a38ee-3f47-4a0e-93b0-471ccb269438 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.320161 Jul 18 02:18:46.126170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 781/1552] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:18:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:46.170785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:46.173955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:46.234023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.238982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.242824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.252238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.549998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:46.604917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8306744-ecab-4c16-8f66-1f02fa7ea16c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 1.002636 Jul 18 02:18:46.611028 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 772/1553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:45 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:46.664244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:46.665813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:46.707348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.730163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:46.741609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:46.745549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:47.621088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:18:47.770107 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df6c8e4c-7d9e-4da2-bfdd-5d0317d09c32 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 2418 microversion: 2.25 time: 1.635224 Jul 18 02:18:47.777749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 782/1554] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:46 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 2418 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:47.814649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:47.815761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:47.867626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:47.875437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:47.883841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:47.886151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:48.679249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:48.752844 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-620f785c-46de-4fc4-b2cb-1500d7901db6 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1473 microversion: 2.1 time: 2.118244 Jul 18 02:18:48.768390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 773/1555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:46 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1473 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:48.836394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d4a762cd-b885-474c-89a6-c5cb64dcf3b2 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04527700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:49.197805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:49.235874 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e079c6f8-6e6e-48b1-88e3-1dec8d171473 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1540 microversion: 2.1 time: 1.449112 Jul 18 02:18:49.237261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 783/1556] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:47 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1540 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:49.254937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:49.258640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:49.271628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.272376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:49.273426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.275688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:49.279004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d4a762cd-b885-474c-89a6-c5cb64dcf3b2 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.466955 Jul 18 02:18:49.300280 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 774/1557] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:48 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:49.352021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:49.369526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:49.447929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.452230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:49.467774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:49.470472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:50.294568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:50.353124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86b601dc-ac4f-42b6-8241-198e879f45d6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 1.111838 Jul 18 02:18:50.367055 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 784/1558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:49 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:50.413634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:50.418930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:50.467827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:50.469213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:50.470598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:50.471425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:50.970784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:50.981484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0335e3b-161e-4e23-b4a9-f333740c6848 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1473 microversion: 2.1 time: 0.603408 Jul 18 02:18:50.990027 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 785/1559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:50 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1473 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:51.004502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:51.005493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:51.019889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.022766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.023992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.031941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.292246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:18:51.365333 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a71abdb3-c7ac-43fa-b4a2-bfa08bb1b775 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 2418 microversion: 2.25 time: 2.062967 Jul 18 02:18:51.377677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 775/1560] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:18:49 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 2418 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:18:51.402147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe4a669c-31a8-4baf-90cd-9ac4c1dde65d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04f230d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:51.431760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:51.464821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-77ddb56d-0c73-4614-b436-adae8b93b83a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1522 microversion: 2.1 time: 0.473312 Jul 18 02:18:51.485896 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 786/1561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:50 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:51.504509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4fdef9aa-009b-4a54-a30c-a196b8b88038 req-5377ff69-6c69-4d57-98d3-5b8e5da9be5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-plugged", "status": "completed", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:51.560215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4fdef9aa-009b-4a54-a30c-a196b8b88038 req-5377ff69-6c69-4d57-98d3-5b8e5da9be5a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.560720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4fdef9aa-009b-4a54-a30c-a196b8b88038 req-5377ff69-6c69-4d57-98d3-5b8e5da9be5a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.620857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe4a669c-31a8-4baf-90cd-9ac4c1dde65d tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1427 microversion: 2.1 time: 0.241670 Jul 18 02:18:51.627043 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 776/1562] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:51 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:51.632212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:51.632848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:51.664301 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4fdef9aa-009b-4a54-a30c-a196b8b88038 req-5377ff69-6c69-4d57-98d3-5b8e5da9be5a service nova] Creating event network-vif-plugged:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:18:51.690790 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4fdef9aa-009b-4a54-a30c-a196b8b88038 req-5377ff69-6c69-4d57-98d3-5b8e5da9be5a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194765 Jul 18 02:18:51.692757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.693330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 787/1563] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:51.694644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.699221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.701600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.712570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:51.726377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:51.753043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.762728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.767207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:51.769670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:51.889393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:18:52.186356 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa409009-8032-43c8-99bf-9584af266a53 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 204 len: 0 microversion: 2.1 time: 0.490405 Jul 18 02:18:52.188130 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 788/1564] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:18:51 2022] DELETE /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:52.202056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:52.204828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:52.220736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.222735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:52.223885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.225724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:52.545898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lazy-loading 'services' on Instance uuid c28a4804-94ea-45b7-ac0e-fc714026de47 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:18:52.866711 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96bc70f6-0923-40ee-afc6-8b3ad4614db0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments/b92347d2-bfcc-4dfe-8f5c-b422ee1d291a" status: 202 len: 0 microversion: 2.25 time: 0.676293 Jul 18 02:18:52.867346 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 789/1565] 10.222.0.67 () {60 vars in 1456 bytes} [Mon Jul 18 02:18:52 2022] DELETE /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments/b92347d2-bfcc-4dfe-8f5c-b422ee1d291a => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:52.886734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:52.887363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:52.921787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.926994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:52.927999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:52.928469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.068082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.081761 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0ff0b19-e705-4253-9d61-32a9b7c26d4c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 1.450914 Jul 18 02:18:53.098667 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 777/1566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:51 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:53.109213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:53.116300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:53.134113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.138405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.139674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.142785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.187086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.199639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60ab7edb-67f3-4fdf-9f1b-2c24010be16a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1431 microversion: 2.1 time: 0.327174 Jul 18 02:18:53.200260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 790/1567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:52 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1431 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:53.710133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-088f7fc6-a77f-4aff-8a12-707f310a18bd tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Calling method '.version_select at 0x7fab0a795ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:53.756865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:53.777760 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3605ef54-85b5-4f5b-9d82-be0c217283a6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1528 microversion: 2.1 time: 0.670655 Jul 18 02:18:53.785762 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 778/1568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:53 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1528 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:53.792784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9e82c2b-7750-4831-a357-a03cdfd1df27 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab045a0940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:53.863447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-088f7fc6-a77f-4aff-8a12-707f310a18bd tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.652260 Jul 18 02:18:53.864797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 791/1569] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:18:53 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:18:53.870869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:53.872282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:53.895949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.897543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.906188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:53.907058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:53.964447 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9e82c2b-7750-4831-a357-a03cdfd1df27 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1436 microversion: 2.1 time: 0.177038 Jul 18 02:18:53.974680 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 779/1570] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:53 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1436 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:54.003134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cfd7073e-b097-4214-8710-d1bb62b43a67 req-946cb1e6-2923-4734-a3f1-df6f0cf95910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8e82b-1107-458f-96c8-4f40daee87ce", "name": "network-vif-deleted", "tag": "2a6daa59-0c8c-4792-928e-d515d88cd09c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:54.036330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cfd7073e-b097-4214-8710-d1bb62b43a67 req-946cb1e6-2923-4734-a3f1-df6f0cf95910 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.045653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cfd7073e-b097-4214-8710-d1bb62b43a67 req-946cb1e6-2923-4734-a3f1-df6f0cf95910 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.078326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cfd7073e-b097-4214-8710-d1bb62b43a67 req-946cb1e6-2923-4734-a3f1-df6f0cf95910 service nova] Creating event network-vif-deleted:2a6daa59-0c8c-4792-928e-d515d88cd09c for instance a5e8e82b-1107-458f-96c8-4f40daee87ce on n-h2-849796-1 Jul 18 02:18:54.094516 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cfd7073e-b097-4214-8710-d1bb62b43a67 req-946cb1e6-2923-4734-a3f1-df6f0cf95910 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103816 Jul 18 02:18:54.106707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 780/1571] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:54.115292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6090d52-3df8-413d-91e6-eec606beda8e tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Action: 'create', calling method: .version_select at 0x7fab05058040>, body: {"pool": "non_exist_pool"} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:54.181981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b6090d52-3df8-413d-91e6-eec606beda8e tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] HTTP exception thrown: Floating IP pool not found. Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6090d52-3df8-413d-91e6-eec606beda8e tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Request method failure captured: Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 26 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MMLJRiAPhoIsgpD3qj2n7_RMyUzCxM-vXCBAF6DiNdPLG0HGsQRW2Nol7dnSR_UQb8QLsZmsUanq8LCPCsVlFHHAxY1XDeAnPU8x5ZJdT0S51-xLDoVw5XV6Ma9kwaDkVaJ7FrLxiDr8P9hRWvm1pf6TOZyvcOBIF2t2m2T-CrgojY Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 770bfea0e74242daa9554e2fb1c22e09 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:54.184136 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 770bfea0e74242daa9554e2fb1c22e09 Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsNegativeTestJSON-231033426-project Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 38c6b7541b23400b9c97874df32479e3 Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-231033426-project Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: {"pool": "non_exist_pool"} Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: exception: Floating IP pool not found. Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 18 02:18:54.186026 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:54.187643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 18 02:18:54.189107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.194507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6090d52-3df8-413d-91e6-eec606beda8e tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Returning 404 to user: Floating IP pool not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:54.195951 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6090d52-3df8-413d-91e6-eec606beda8e tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.087839 Jul 18 02:18:54.197901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 781/1572] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:18:54 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:18:54.206186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-067f9c09-c9fd-4454-956f-0619c8cb3121 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04596c10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.350692 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f2186604-392c-46ef-882d-b75fa52f4398 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.484168 Jul 18 02:18:54.351275 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 792/1573] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:18:53 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:54.357659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.358267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:54.376039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.376455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.377407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.377744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.434503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-067f9c09-c9fd-4454-956f-0619c8cb3121 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 200 len: 1436 microversion: 2.1 time: 0.235022 Jul 18 02:18:54.435394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 782/1574] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 1436 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:54.451953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Calling method '.version_select at 0x7fab04a6c5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.572383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fb880819-4fb0-42ec-bf25-9ce48ce663f9 could not be found", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:18:54.575272 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] HTTP exception thrown: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Request method failure captured: Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-floating-ips/fb880819-4fb0-42ec-bf25-9ce48ce663f9 HTTP/1.1 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MMLJRiAPhoIsgpD3qj2n7_RMyUzCxM-vXCBAF6DiNdPLG0HGsQRW2Nol7dnSR_UQb8QLsZmsUanq8LCPCsVlFHHAxY1XDeAnPU8x5ZJdT0S51-xLDoVw5XV6Ma9kwaDkVaJ7FrLxiDr8P9hRWvm1pf6TOZyvcOBIF2t2m2T-CrgojY Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 770bfea0e74242daa9554e2fb1c22e09 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:18:54.580157 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/770bfea0e74242daa9554e2fb1c22e09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 770bfea0e74242daa9554e2fb1c22e09 Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-231033426 Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-FloatingIPsNegativeTestJSON-231033426-project Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 38c6b7541b23400b9c97874df32479e3 Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-231033426-project Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: exception: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9 Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'fb880819-4fb0-42ec-bf25-9ce48ce663f9'} Jul 18 02:18:54.582917 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:18:54.584644 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fb880819-4fb0-42ec-bf25-9ce48ce663f9 could not be found Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c9de192-229b-4c5b-9985-4337361d4cb1'] Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9. Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:54.587298 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9 Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:54.590278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:54.597048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9 Jul 18 02:18:54.597048 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:18:54.597048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] Returning 404 to user: Floating IP not found for ID fb880819-4fb0-42ec-bf25-9ce48ce663f9 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:54.598125 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69459b31-5310-47af-99cd-cedef8a01f1f tempest-FloatingIPsNegativeTestJSON-231033426 tempest-FloatingIPsNegativeTestJSON-231033426-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/fb880819-4fb0-42ec-bf25-9ce48ce663f9" status: 404 len: 111 microversion: 2.1 time: 0.160692 Jul 18 02:18:54.598497 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 783/1575] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:18:54 2022] DELETE /compute/v2.1/os-floating-ips/fb880819-4fb0-42ec-bf25-9ce48ce663f9 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:18:54.622319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.624110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:54.638243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.639552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.642963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.644286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.653690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:54.730124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.753533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25e6e78e-3f26-40c0-8059-7afa5251d314 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 0.399409 Jul 18 02:18:54.755237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 793/1576] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:54.765840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.767339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:54.778698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.779362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.781326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.782377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.826859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:54.860187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e87cd437-364a-4290-9559-8b42bbf7e24a tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1302 microversion: 2.1 time: 0.259630 Jul 18 02:18:54.866373 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 784/1577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1302 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:54.879692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:54.880637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:54.890564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.891342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:54.892343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:54.893019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.066603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:55.081220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b5d031e-c54f-4ee0-ae4f-9e3553a65c35 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1478 microversion: 2.1 time: 0.323655 Jul 18 02:18:55.083811 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 794/1578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1478 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:55.237488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-57caa29b-9cec-4416-ab5d-bfdba69b56c1 req-596f8be0-2777-46c7-b4da-e336c82ae75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd333e5b-d005-4786-af0e-1e0aa88d19a2", "name": "network-vif-plugged", "status": "completed", "tag": "5c639a82-e392-402e-ad94-ea3782fc86b1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:55.247489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-57caa29b-9cec-4416-ab5d-bfdba69b56c1 req-596f8be0-2777-46c7-b4da-e336c82ae75d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.248363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-57caa29b-9cec-4416-ab5d-bfdba69b56c1 req-596f8be0-2777-46c7-b4da-e336c82ae75d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.266338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-57caa29b-9cec-4416-ab5d-bfdba69b56c1 req-596f8be0-2777-46c7-b4da-e336c82ae75d service nova] Creating event network-vif-plugged:5c639a82-e392-402e-ad94-ea3782fc86b1 for instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 on n-h2-849796-1 Jul 18 02:18:55.272719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-57caa29b-9cec-4416-ab5d-bfdba69b56c1 req-596f8be0-2777-46c7-b4da-e336c82ae75d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038997 Jul 18 02:18:55.274073 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 795/1579] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:55.367744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:55.368902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:55.383865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.396238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.397285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.397834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.414819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:55.436512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1cf153a-e2f1-4e02-a9a3-8e14e2abdb3f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1528 microversion: 2.1 time: 0.568267 Jul 18 02:18:55.458402 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 785/1580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:54 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1528 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:55.462642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5418118-c2b5-4b15-a6aa-69f55aab442b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099699 Jul 18 02:18:55.463997 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 796/1581] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:18:55 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:18:55.689228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c627517e-4655-46e9-b8e1-bb4c4896bd70", "device": "/dev/xvdb"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:55.694641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:55.709884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.712904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.715097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.730021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.771799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:55.772406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:55.792400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.792873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.800823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:55.801911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:55.960047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:56.391049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:56.392664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fa5dcdf0-53ac-4ad8-8c90-68ecfef06bbd tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715477 Jul 18 02:18:56.393974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 786/1582] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:18:55 2022] POST /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:56.419709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:56.426906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:56.431935 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7832063b-c5d0-40d2-9eba-c28e3aeec4ca tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1313 microversion: 2.1 time: 0.663880 Jul 18 02:18:56.432476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:56.434070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 797/1583] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:55 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:56.458023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:56.459544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:56.478614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.479099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.480101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.480361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.493612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.494974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.499673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.509284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.585869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.586325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.586985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lazy-loading 'fault' on Instance uuid a5e8e82b-1107-458f-96c8-4f40daee87ce {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:18:56.823681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:56.832324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad281cd8-6012-4b51-a6ca-f8f4b2399bae tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 200 len: 1307 microversion: 2.1 time: 0.430206 Jul 18 02:18:56.838718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 787/1584] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:56 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:56.848121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:56.850820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:56.868803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.872894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:56.874162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:56.875324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:57.591048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:57.679717 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b085b86-b3f4-4e1c-8b33-38f0e5905cac tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1465 microversion: 2.1 time: 1.232682 Jul 18 02:18:57.685732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 798/1585] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:56 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1465 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:57.748319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:57.756241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:57.830701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:57.831166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:57.832069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:57.832583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:57.947158 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab8d1767-c36e-46d7-b4de-029bd15078ae tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.252349 Jul 18 02:18:57.947846 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 799/1586] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:18:57 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:57.963066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-75614564-20ba-431b-8fc6-81cb9947fde8 req-bb866c6a-d509-4113-b8f9-86f12b58f45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd333e5b-d005-4786-af0e-1e0aa88d19a2", "name": "network-vif-unplugged", "status": "completed", "tag": "5c639a82-e392-402e-ad94-ea3782fc86b1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:57.991823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-75614564-20ba-431b-8fc6-81cb9947fde8 req-bb866c6a-d509-4113-b8f9-86f12b58f45c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:57.992291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-75614564-20ba-431b-8fc6-81cb9947fde8 req-bb866c6a-d509-4113-b8f9-86f12b58f45c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.040554 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-75614564-20ba-431b-8fc6-81cb9947fde8 req-bb866c6a-d509-4113-b8f9-86f12b58f45c service nova] Creating event network-vif-unplugged:5c639a82-e392-402e-ad94-ea3782fc86b1 for instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 on n-h2-849796-1 Jul 18 02:18:58.052245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-75614564-20ba-431b-8fc6-81cb9947fde8 req-bb866c6a-d509-4113-b8f9-86f12b58f45c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103085 Jul 18 02:18:58.053539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 800/1587] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:58.064835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:58.065879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:58.085562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.086286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.087284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.087900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.528619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:58.550891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf41d581-cc93-4ec1-b313-dbc06b0a4b9b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1461 microversion: 2.1 time: 0.495857 Jul 18 02:18:58.557389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 801/1588] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:58 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1461 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:58.573750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6667b65a-9a0d-4ba6-a16b-861e2fc218ec req-1ee944b5-77b7-4e4f-9046-4aeecd9f86b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd333e5b-d005-4786-af0e-1e0aa88d19a2", "name": "network-vif-deleted", "tag": "5c639a82-e392-402e-ad94-ea3782fc86b1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:58.607136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6667b65a-9a0d-4ba6-a16b-861e2fc218ec req-1ee944b5-77b7-4e4f-9046-4aeecd9f86b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.607751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6667b65a-9a0d-4ba6-a16b-861e2fc218ec req-1ee944b5-77b7-4e4f-9046-4aeecd9f86b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.607878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:58.630938 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19b9dd89-f7fd-4a4f-9463-16a067870099 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 200 len: 1486 microversion: 2.1 time: 1.789567 Jul 18 02:18:58.643796 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 788/1589] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:56 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 1486 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:58.664008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6667b65a-9a0d-4ba6-a16b-861e2fc218ec req-1ee944b5-77b7-4e4f-9046-4aeecd9f86b8 service nova] Creating event network-vif-deleted:5c639a82-e392-402e-ad94-ea3782fc86b1 for instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 on n-h2-849796-1 Jul 18 02:18:58.668415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-195a2872-f446-454e-9c8c-58abd1cb2e1e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab047cc8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:58.691621 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6667b65a-9a0d-4ba6-a16b-861e2fc218ec req-1ee944b5-77b7-4e4f-9046-4aeecd9f86b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132471 Jul 18 02:18:58.692629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 802/1590] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:18:58.715267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:58.715999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: a5e8e82b-1107-458f-96c8-4f40daee87ce] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:58.745340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.746009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.747623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.748326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.784501 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce HTTP/1.1 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:18:58.786276 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. Jul 18 02:18:58.789049 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'a5e8e82b-1107-458f-96c8-4f40daee87ce'} Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:18:58.790515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. Jul 18 02:18:58.792033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:18:58.797496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance a5e8e82b-1107-458f-96c8-4f40daee87ce could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:18:58.798792 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70172632-eac2-4727-9915-b0c1b67e811c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce" status: 404 len: 111 microversion: 2.1 time: 0.104625 Jul 18 02:18:58.799404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 803/1591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:58 2022] GET /compute/v2.1/servers/a5e8e82b-1107-458f-96c8-4f40daee87ce => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:18:58.852948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:58.853680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:58.875981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.876446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:58.877361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:58.877809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.329639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13252db3-9d3c-4da9-8851-aa03ae9c5e0c tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1612 microversion: 2.1 time: 0.511684 Jul 18 02:18:59.342340 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 804/1592] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:58 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1612 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:18:59.351750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:59.352995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.360594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.361528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.363072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.363817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.416465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:18:59.714981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c7fc82b-2558-4eb5-b9f1-9f8e21d42e6c tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 204 len: 0 microversion: 2.1 time: 0.370180 Jul 18 02:18:59.722439 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 805/1593] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:18:59 2022] DELETE /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:59.738626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:59.741222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.759220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.760843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.762189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.764568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.850884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-380846b1-2e9c-4d89-8a01-6442cbf2e5ee tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125572 Jul 18 02:18:59.854393 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 806/1594] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:18:59 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:59.865105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:18:59.867009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.881915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.882734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.883813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:18:59.884493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:18:59.887057 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-195a2872-f446-454e-9c8c-58abd1cb2e1e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "DELETE /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292" status: 204 len: 0 microversion: 2.1 time: 1.240430 Jul 18 02:18:59.888131 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 789/1595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:58 2022] DELETE /compute/v2.1/images/ec9e791a-7233-473c-8df2-ff0340e6a292 => generated 0 bytes in 1244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:18:59.934327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:18:59.953759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:18:59.985253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '048399aedda54b55b75892105ef78f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13458fa338ea4d77a4df1b8c59d0e86a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:18:59.985934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] flavor_id is None. Assuming migration. {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 02:18:59.986399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 02:19:00.004382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.008574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.010297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.012881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.073230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 HTTP/1.1 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:00.076514 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:19:00.080654 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2'} Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:00.082423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:19:00.085218 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.087432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:00.087432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-76e0fba3-956b-4426-8e5a-a9bb85efca72 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 404 len: 111 microversion: 2.1 time: 0.193910 Jul 18 02:19:00.087432 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 790/1596] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:18:59 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:00.118054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:00.119707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:00.152209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.153116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.154549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.155924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.524212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:00.539207 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eaf50cee-18b9-4033-9e25-34c41b70fbcf tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1472 microversion: 2.1 time: 0.448039 Jul 18 02:19:00.541320 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 791/1597] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:00 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:00.550911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2b3952a-7af3-4217-aa48-bd5577fbdec9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '.version_select at 0x7fab04a6cb80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:00.600301 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-288f2cdd-8fae-4e5f-8878-6d7d66f5c9ef tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da/action" status: 202 len: 0 microversion: 2.1 time: 0.744257 Jul 18 02:19:00.601198 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 807/1598] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:18:59 2022] POST /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:19:00.620688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea9fdfda-e231-48f5-a72d-1eab780a3e15 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'create', calling method: .version_select at 0x7fab0a74fe50>, body: {"keypair": {"name": "tempest-keypair-2060261889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMryBR4+sBrsrwQHMxqKhxHQmXPmMdOma7UTwd65hYqPn554HCIPvxmQVf4MlNdmLBXnTJc0YQG/4D+WKEZ7k3y8rVT2Y38hyG34z9aNbOE1yVqkjpPGlVZ6fUYdI1Zpmw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:00.660652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b2b3952a-7af3-4217-aa48-bd5577fbdec9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] HTTP exception thrown: Image not found. Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2b3952a-7af3-4217-aa48-bd5577fbdec9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Request method failure captured: Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 HTTP/1.1 Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ9cIGFOW2bcyyc6R8ppfKJH-5HFpW9ursr000FTn2SrE_og8g971bgSyXBayIoSELDawrL5neDmwpdYn4Li2xCieD377VlGp85f4ht42kwOW9bE-0aU7nJZIg_vIU3jS5x52W4rt0ukxii1fma2wxNSQ2B5tByEvHIoVPfJsv39ME Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:00.662848 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad246f5d093c48c48152059d277671cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad246f5d093c48c48152059d277671cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b1ba4e1d4061429c9a861e8020c10454 Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '54f52b98-f6c8-47b1-97da-c17763654607'} Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:00.664696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 54f52b98-f6c8-47b1-97da-c17763654607 to delete Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.665852 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 54f52b98-f6c8-47b1-97da-c17763654607 could not be found. Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:00.667565 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:19:00.669378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:00.671683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2b3952a-7af3-4217-aa48-bd5577fbdec9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:00.672802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2b3952a-7af3-4217-aa48-bd5577fbdec9 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "DELETE /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607" status: 404 len: 62 microversion: 2.1 time: 0.130089 Jul 18 02:19:00.673577 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 792/1599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:00 2022] DELETE /compute/v2.1/images/54f52b98-f6c8-47b1-97da-c17763654607 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:19:00.678852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ea9fdfda-e231-48f5-a72d-1eab780a3e15 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for project 01891a23b968415c9c86225a210fe256. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:00.683272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1369955b-8344-48e7-985f-55dfe016d916 req-9abfdabf-09c2-40ef-ad64-df266da452e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-unplugged", "status": "completed", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:00.698283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ea9fdfda-e231-48f5-a72d-1eab780a3e15 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for user 0f2de3928dac470c90a709b3da9c95f0 and project 01891a23b968415c9c86225a210fe256. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:00.727158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1369955b-8344-48e7-985f-55dfe016d916 req-9abfdabf-09c2-40ef-ad64-df266da452e6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.728614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1369955b-8344-48e7-985f-55dfe016d916 req-9abfdabf-09c2-40ef-ad64-df266da452e6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.758039 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1369955b-8344-48e7-985f-55dfe016d916 req-9abfdabf-09c2-40ef-ad64-df266da452e6 service nova] Creating event network-vif-unplugged:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:19:00.772565 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1369955b-8344-48e7-985f-55dfe016d916 req-9abfdabf-09c2-40ef-ad64-df266da452e6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097436 Jul 18 02:19:00.774587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea9fdfda-e231-48f5-a72d-1eab780a3e15 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163390 Jul 18 02:19:00.775138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 793/1600] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:00.775475 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 808/1601] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:19:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:00.788907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:00.789588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:00.791460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:00.794019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:00.815495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.816294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.817785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.818508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.818897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.820684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.821810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:00.824645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:00.896139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:01.095386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:01.107730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4d042a5-1c9b-475d-8049-9505ed050a9c tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "DELETE /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 204 len: 0 microversion: 2.1 time: 0.330768 Jul 18 02:19:01.113013 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 809/1602] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:00 2022] DELETE /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:01.124554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:01.127951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:01.141691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.142546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.143692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.144540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.196088 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8d913f5-dbea-4881-8fb9-e34ecccd24cb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085158 Jul 18 02:19:01.198898 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 810/1603] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:01 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:01.210127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:01.211079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:01.220960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.221736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.222743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.223838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.520561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.532247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc24dfee-76bc-46e6-aa53-cc6514f510d5 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1470 microversion: 2.1 time: 0.755310 Jul 18 02:19:01.535154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 794/1604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:00 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1470 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:01.559004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:01.560188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:01.568738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.569868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.573992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:01.574826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:01.681196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:01.695864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcbb5f8f-bd12-400d-87c0-517c1aa1fa4e tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1471 microversion: 2.1 time: 0.491362 Jul 18 02:19:01.708248 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 811/1605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:01 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:02.110136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:02.121439 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3ed0c56-e0f8-454a-9cdd-dddfe1eb513e tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1472 microversion: 2.1 time: 0.567147 Jul 18 02:19:02.128485 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 795/1606] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:01 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1472 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:02.214480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:02.215749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:02.235336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.237045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.243270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.245719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.322268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:02.381970 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c793fdd7-874a-45bc-bd21-f9811e8e0d15 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.170541 Jul 18 02:19:02.383111 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 812/1607] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:02 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:02.568399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:02.575201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:02.618629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.631931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.637155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.638829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.722015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:02.722773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:02.765733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.766745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:02.768740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:02.769308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.163756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.226609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2d058710-e24f-4f93-8cf1-d7551a2b631b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1470 microversion: 2.1 time: 0.667701 Jul 18 02:19:03.238991 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 796/1608] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:02 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:03.250968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:03.252168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:03.263490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.270366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:03.273910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0844b702-5c7a-42fe-84fe-32a23c01a1db tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1471 microversion: 2.1 time: 0.560435 Jul 18 02:19:03.281905 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 813/1609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:02 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1471 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:19:03.286525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.295159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:03.297320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.412857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:03.412857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:03.443561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:03.444276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.444836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:03.448641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:03.598393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40142cd7-782a-4284-ae85-37116c65397a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.203980 Jul 18 02:19:03.602160 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 814/1610] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:03 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:19:03.760489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:03.782064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2b8bb29-f30f-49e8-b9a5-ca5e85841e85 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1472 microversion: 2.1 time: 0.541305 Jul 18 02:19:03.784724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 797/1611] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:03 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:04.305606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.306993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:04.332247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.332835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.333867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.335738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.496531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:04.497339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:04.518198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.522581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:04.523822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:04.525806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.240954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:05.266963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55337031-5634-4faa-b19c-8519741b4e02 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1471 microversion: 2.1 time: 0.966352 Jul 18 02:19:05.282645 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 798/1612] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:04 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1471 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:05.316621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:05.322640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:05.338039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=48 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:05.365667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:05.376972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.378183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:05.382055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.498311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de8fa0c6-c334-4041-b3fb-ff14a6a1c90b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.213866 Jul 18 02:19:05.500416 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 799/1613] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:05 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:05.517524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:05.519329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:05.529808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:05.532270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.534037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:05.534810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:05.888805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:05.908769 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4261cd7-c6cb-4e5d-922b-79ab67e6f253 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1470 microversion: 2.1 time: 1.667985 Jul 18 02:19:05.909962 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 815/1614] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:04 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1470 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.160376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:06.189910 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c514cab5-de10-41fa-9612-abd1204e5a72 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1472 microversion: 2.1 time: 0.679955 Jul 18 02:19:06.192215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 800/1615] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:05 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1472 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.299226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.299870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.315537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.316003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.316849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.317535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.501353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d907d844-15ad-4b3c-9b14-077bedbdccd9 req-10268258-6e36-4796-acd3-766edbd94d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78564771-6b2e-480c-b939-c9d0afa16060", "name": "network-vif-deleted", "tag": "fbb15e21-761f-4ec1-8c5c-ae65963c1a76"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:06.523534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d907d844-15ad-4b3c-9b14-077bedbdccd9 req-10268258-6e36-4796-acd3-766edbd94d64 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.524451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d907d844-15ad-4b3c-9b14-077bedbdccd9 req-10268258-6e36-4796-acd3-766edbd94d64 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.555697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ba4e1d4061429c9a861e8020c10454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad246f5d093c48c48152059d277671cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:06.567133 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d907d844-15ad-4b3c-9b14-077bedbdccd9 req-10268258-6e36-4796-acd3-766edbd94d64 service nova] Creating event network-vif-deleted:fbb15e21-761f-4ec1-8c5c-ae65963c1a76 for instance 78564771-6b2e-480c-b939-c9d0afa16060 on n-h2-849796-1 Jul 18 02:19:06.573441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0b6349f-7122-4f61-90ae-0216cec8fe56 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 200 len: 1429 microversion: 2.1 time: 0.279010 Jul 18 02:19:06.579025 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 816/1616] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 1429 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:06.581245 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d907d844-15ad-4b3c-9b14-077bedbdccd9 req-10268258-6e36-4796-acd3-766edbd94d64 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085867 Jul 18 02:19:06.594246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 801/1617] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:06.598581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.601898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.617835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.618672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.619718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.622418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:06.732220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23aaf16b-356e-4d9f-b968-ea105853fcab tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145906 Jul 18 02:19:06.744025 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 817/1618] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:06.953314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:06.954970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:06.979788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:06.980651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.002064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.008239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.232333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:07.234702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:07.280880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.281633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.284364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:07.290184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:07.953122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:08.021989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b8ca5f8-60ae-4240-9eda-6c36e7a84edd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1470 microversion: 2.1 time: 1.077673 Jul 18 02:19:08.026863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 802/1619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:06 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1470 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:08.049991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:08.054339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] [instance: 78564771-6b2e-480c-b939-c9d0afa16060] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:08.080493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.084599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.092034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.095316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.125547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:08.211396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] HTTP exception thrown: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Request method failure captured: Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 HTTP/1.1 Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MJ9cIGFOW2bcyyc6R8ppfKJH-5HFpW9ursr000FTn2SrE_og8g971bgSyXBayIoSELDawrL5neDmwpdYn4Li2xCieD377VlGp85f4ht42kwOW9bE-0aU7nJZIg_vIU3jS5x52W4rt0ukxii1fma2wxNSQ2B5tByEvHIoVPfJsv39ME Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:08.220111 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad246f5d093c48c48152059d277671cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad246f5d093c48c48152059d277671cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad246f5d093c48c48152059d277671cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ad246f5d093c48c48152059d277671cb Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-971372903 Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b1ba4e1d4061429c9a861e8020c10454 Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerTestJSON-971372903-project Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. Jul 18 02:19:08.221769 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '78564771-6b2e-480c-b939-c9d0afa16060'} Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:08.222571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. Jul 18 02:19:08.223857 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:08.225031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] Returning 404 to user: Instance 78564771-6b2e-480c-b939-c9d0afa16060 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:08.225031 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b05e4ec6-0025-4b0d-bf01-ad45af90f3a1 tempest-ImagesOneServerTestJSON-971372903 tempest-ImagesOneServerTestJSON-971372903-project] 10.222.0.67 "GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060" status: 404 len: 111 microversion: 2.1 time: 0.189355 Jul 18 02:19:08.225031 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 803/1620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:08 2022] GET /compute/v2.1/servers/78564771-6b2e-480c-b939-c9d0afa16060 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:08.253848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:08.263292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:08.296562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.297221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.304396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.310169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.366803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:08.400210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4801f368-fe78-4297-8b1c-aac61df1ec59 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 200 len: 1430 microversion: 2.1 time: 1.175754 Jul 18 02:19:08.430920 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 818/1621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:07 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 1430 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:08.455223 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f3559739-d0e1-423e-9255-f8df83234435 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.230907 Jul 18 02:19:08.462111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 804/1622] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:08 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:19:08.476065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6b886367-18cf-4854-a7d3-b803c03b59fd req-215c8bbd-c4d8-4831-bb10-0e88da55af59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65987e31-9565-4c7c-99cc-4a45fc1c47cf", "name": "network-vif-deleted", "tag": "8b974140-67f9-4093-bf5b-bd2d99bd7357"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:08.556525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6b886367-18cf-4854-a7d3-b803c03b59fd req-215c8bbd-c4d8-4831-bb10-0e88da55af59 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:08.563344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6b886367-18cf-4854-a7d3-b803c03b59fd req-215c8bbd-c4d8-4831-bb10-0e88da55af59 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:08.652027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6b886367-18cf-4854-a7d3-b803c03b59fd req-215c8bbd-c4d8-4831-bb10-0e88da55af59 service nova] Creating event network-vif-deleted:8b974140-67f9-4093-bf5b-bd2d99bd7357 for instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf on n-h2-849796-1 Jul 18 02:19:08.706651 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6b886367-18cf-4854-a7d3-b803c03b59fd req-215c8bbd-c4d8-4831-bb10-0e88da55af59 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263127 Jul 18 02:19:08.713161 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 819/1623] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:09.059266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:09.060209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:09.081140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.085388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.086329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:09.086800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:09.317833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-721223020", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:09.644866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] validate_networks() for [('b1c06da5-9949-4076-be04-78c7c3500dff', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:19:10.488957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:10.519181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-91cd908d-9937-469c-a1a7-4d61e4791a54 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 1.464361 Jul 18 02:19:10.538528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 805/1624] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:09 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:10.570526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:10.575192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 65987e31-9565-4c7c-99cc-4a45fc1c47cf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:10.606001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.608425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.613101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.616607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.693526 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf HTTP/1.1 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:10.697971 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. Jul 18 02:19:10.700775 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '65987e31-9565-4c7c-99cc-4a45fc1c47cf'} Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:10.702911 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. Jul 18 02:19:10.709071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:10.716136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance 65987e31-9565-4c7c-99cc-4a45fc1c47cf could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:10.729986 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-696d4b6c-8373-48f0-8d8e-07f38738f773 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf" status: 404 len: 111 microversion: 2.1 time: 0.173177 Jul 18 02:19:10.732545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:10.738405 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 806/1625] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:10 2022] GET /compute/v2.1/servers/65987e31-9565-4c7c-99cc-4a45fc1c47cf => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:10.763177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:10.768645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:10.818593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.823608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:10.834288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:10.837158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.003979 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58aab3bf-0c15-4b36-811c-b1966876fac6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.268041 Jul 18 02:19:11.006953 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 807/1626] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:19:10 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47/os-volume_attachments => generated 25 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:11.019510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:11.022116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:11.041097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.046840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.049745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.050862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.120501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:11.393960 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ade9ea4-b0b9-42a9-9ec8-da95b982078f tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 204 len: 0 microversion: 2.1 time: 0.383760 Jul 18 02:19:11.400738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 808/1627] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:11 2022] DELETE /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:11.420305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:11.423914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:11.443753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.444607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.447964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.450027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.499446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:19:11.500306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:19:11.501346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:19:11.502112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:19:11.502953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:19:11.555712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.561050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.562817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.563816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.595305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:11.603806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:11.616044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for user 0f2de3928dac470c90a709b3da9c95f0 and project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:11.660053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:19:11.663832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:19:11.737178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e71c666-d05c-4c1c-af31-1bb4f5397972 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.425419 Jul 18 02:19:11.738446 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 820/1628] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:19:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:19:11.769466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:11.770642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:11.803206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.804338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.806018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:11.807130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:11.950276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20179850-d9bc-44e4-9338-bbcdda83d008 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 204 len: 0 microversion: 2.1 time: 0.535934 Jul 18 02:19:11.950276 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 809/1629] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:11 2022] DELETE /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:11.958823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-639bdb89-2f33-4483-8f94-f2b98b914afc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:11.961448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-639bdb89-2f33-4483-8f94-f2b98b914afc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:12.091276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-639bdb89-2f33-4483-8f94-f2b98b914afc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:12.104278 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-639bdb89-2f33-4483-8f94-f2b98b914afc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1224 microversion: 2.1 time: 0.160539 Jul 18 02:19:12.109733 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 810/1630] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:11 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:12.117545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:12.118594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:12.148238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:12.149832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:12.162888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:12.164125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:12.384285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:12.408831 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d9ef9512-aee6-4109-85e3-75cb4c741f57 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.668701 Jul 18 02:19:12.423929 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 821/1631] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:11 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:12.649284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:12.663220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a27cacf2-411a-4203-bbc7-bb89a6437d04 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1474 microversion: 2.1 time: 0.550707 Jul 18 02:19:12.664698 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 811/1632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:12 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:13.136698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d78631b-9085-4b9d-8a63-99348e001893 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.138062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d78631b-9085-4b9d-8a63-99348e001893 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.272278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d78631b-9085-4b9d-8a63-99348e001893 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:13.292649 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d78631b-9085-4b9d-8a63-99348e001893 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1224 microversion: 2.1 time: 0.159896 Jul 18 02:19:13.300552 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 822/1633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1224 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:13.444277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.445392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.471474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.472818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.477362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.479245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.698130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:13.698130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:13.718365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.721545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:13.723358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:13.734696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:14.268222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:14.292738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09dcd5da-0546-48d9-b919-0cddc5de1675 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.853705 Jul 18 02:19:14.293423 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 812/1634] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:14.585596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:14.600677 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d311929-bf63-4870-9609-b5a0efc34224 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1474 microversion: 2.1 time: 0.909948 Jul 18 02:19:14.609478 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 823/1635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:13 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1474 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:14.619408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:14.629549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:14.650866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:14.661691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:14.663630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:14.664804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:15.279928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:15.299936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93883944-008d-4651-9e28-267c8cd28c3b tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1276 microversion: 2.1 time: 0.687553 Jul 18 02:19:15.301904 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 824/1636] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:14 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1276 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:15.355517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab045274c0>, body: {"keypair": {"name": "tempest-keypair-1094533251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKakbubzHy2Sb8dAyh61Y+2sNUG5VpxZiy+AHrTxOjG/R5WVlWQGuib4F07cb45tYz5E+v/NNOSPNsRZyafN3jQnaAElH0qUjtCAuaAK6U/GmZNAwDkiirno7ZHgWpG+lQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:15.433366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:15.438827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:15.492982 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 02:19:15.645615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Calling method '.version_select at 0x7fab0a74f160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:15.718603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.719860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:15.726137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.732375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:15.920531 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5edafcdf-7dc5-48fe-a505-4c9d5683963e tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.615324 Jul 18 02:19:15.924319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 825/1637] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Jul 18 02:19:15 2022] GET /compute/v2.1/limits => generated 511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:15.938595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:15.941782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:15.966960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.968872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:15.970888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:15.972135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:16.509616 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 49200. Jul 18 02:19:16.625646 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9dcb8448-7184-4137-90ae-c3addb086a51 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 2.320205 Jul 18 02:19:16.633415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 813/1638] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2339 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:16.707788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:16.708997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:16.788774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:16.789886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:16.804512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:16.805306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.166765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:17.204520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-914166fd-fbe7-445f-a75f-b15678fd82ac tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 1.275649 Jul 18 02:19:17.206244 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 826/1639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:15 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:17.217161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f071f044-603d-4d02-bddd-0547ac287060 req-e6a0c731-3f64-4f7d-a7aa-08e6338e92ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6", "name": "network-vif-deleted", "tag": "f930f675-58de-457a-bc31-d92eda71c9cd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:17.240027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f071f044-603d-4d02-bddd-0547ac287060 req-e6a0c731-3f64-4f7d-a7aa-08e6338e92ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.241996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f071f044-603d-4d02-bddd-0547ac287060 req-e6a0c731-3f64-4f7d-a7aa-08e6338e92ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.274789 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f071f044-603d-4d02-bddd-0547ac287060 req-e6a0c731-3f64-4f7d-a7aa-08e6338e92ed service nova] Creating event network-vif-deleted:f930f675-58de-457a-bc31-d92eda71c9cd for instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 on n-h1-849796-1 Jul 18 02:19:17.290490 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f071f044-603d-4d02-bddd-0547ac287060 req-e6a0c731-3f64-4f7d-a7aa-08e6338e92ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081830 Jul 18 02:19:17.294101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 827/1640] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:17.308968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1044967877", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:17.758210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:17.792602 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d2ba35c-6552-4d46-9ee6-d35eef1363b1 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 200 len: 1304 microversion: 2.1 time: 1.143029 Jul 18 02:19:17.815600 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 814/1641] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:16 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 1304 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:17.843231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:17.844952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:17.857681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.859434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:17.861309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:17.863081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.173003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:18.202192 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1db28941-20de-4fdd-b20e-06e202947305 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1282 microversion: 2.1 time: 0.384105 Jul 18 02:19:18.231431 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 815/1642] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:17 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1282 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:18.293906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-031cb80e-9550-42be-8c40-02a876f99bf5 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab045513a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:18.328793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-031cb80e-9550-42be-8c40-02a876f99bf5 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-1094533251" status: 200 len: 512 microversion: 2.2 time: 0.084426 Jul 18 02:19:18.330411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 816/1643] 10.222.0.67 () {60 vars in 1257 bytes} [Mon Jul 18 02:19:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1094533251 => generated 512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:18.353931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:18.356300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:18.394081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.399978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:18.401570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:18.402382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:19.829296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:19.881855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-134899ac-5968-42de-9bcf-137b23395c97 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 1.547581 Jul 18 02:19:19.892891 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 817/1644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:18 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:19.918068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a457682d-79c0-4fdb-8422-0d06347ee040 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab04596f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:19.980566 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a457682d-79c0-4fdb-8422-0d06347ee040 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094533251" status: 204 len: 0 microversion: 2.2 time: 0.085132 Jul 18 02:19:19.982605 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 818/1645] 10.222.0.67 () {60 vars in 1260 bytes} [Mon Jul 18 02:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094533251 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:20.043455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:20.050675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 258109a8-1364-4cc7-8c2b-892c98163817] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:20.070033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.072416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.076595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.078733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.130915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 HTTP/1.1 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '258109a8-1364-4cc7-8c2b-892c98163817'} Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:20.132570 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance 258109a8-1364-4cc7-8c2b-892c98163817 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1bb0275-b8e5-44c0-ac44-c4f51e72ddb8 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817" status: 404 len: 111 microversion: 2.1 time: 0.145111 Jul 18 02:19:20.145938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 819/1646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:19 2022] GET /compute/v2.1/servers/258109a8-1364-4cc7-8c2b-892c98163817 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:20.153304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:20.154367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:20.176830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.177787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.178978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.179711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.709997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:20.743292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7dee79c-fefc-47e3-bce7-7e9ec31372ec tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.606794 Jul 18 02:19:20.744674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 820/1647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:20 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:20.755620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7559f4e6-9b49-486a-a43e-9a305b8ac10d req-0e418f60-2715-4df7-be07-2fe6bebdfca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258109a8-1364-4cc7-8c2b-892c98163817", "name": "network-vif-deleted", "tag": "1296929f-1df0-4a83-8d68-b7388c1f17ec"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:20.794700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7559f4e6-9b49-486a-a43e-9a305b8ac10d req-0e418f60-2715-4df7-be07-2fe6bebdfca3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:20.798269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7559f4e6-9b49-486a-a43e-9a305b8ac10d req-0e418f60-2715-4df7-be07-2fe6bebdfca3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:20.849240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7559f4e6-9b49-486a-a43e-9a305b8ac10d req-0e418f60-2715-4df7-be07-2fe6bebdfca3 service nova] Creating event network-vif-deleted:1296929f-1df0-4a83-8d68-b7388c1f17ec for instance 258109a8-1364-4cc7-8c2b-892c98163817 on n-h2-849796-1 Jul 18 02:19:20.858357 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7559f4e6-9b49-486a-a43e-9a305b8ac10d req-0e418f60-2715-4df7-be07-2fe6bebdfca3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110837 Jul 18 02:19:20.862111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 821/1648] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:20.885395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a2bcf37-e498-4b44-887c-6cb5143813af tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab04551f70>, body: {"keypair": {"name": "tempest-keypair-1851060173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOgbKC7zGdsFkR1n0UY5EKGeZIHFZPnl2410cj+2xfQEO2VFV/Rs2MC5ou4tSmI2MX8CETqxnxjkOFj8CXecrtgpKegb+jqcIMlkJ5q74lDUKlVFF6AECnZaUVksGE7iA=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:20.935631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6a2bcf37-e498-4b44-887c-6cb5143813af tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:20.963591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6a2bcf37-e498-4b44-887c-6cb5143813af tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:21.050101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a2bcf37-e498-4b44-887c-6cb5143813af tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.185364 Jul 18 02:19:21.052083 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 822/1649] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:21.080575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.081914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:21.108585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.109427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.110980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.122362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.191003 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 HTTP/1.1 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6'} Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:21.203789 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. Jul 18 02:19:21.217325 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:21.221800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance 88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:21.230765 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c673762-6149-4dbb-8d72-62702720a204 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6" status: 404 len: 111 microversion: 2.1 time: 0.163132 Jul 18 02:19:21.232201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 823/1650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:21 2022] GET /compute/v2.1/servers/88192b8e-0ef3-43ef-bb0f-aeb86afcb6b6 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:21.254288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.256554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:21.302514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.311534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.317400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:21.319080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:21.901041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:21.912183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:21.915465 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06273921-e029-49f9-9e69-660480561bfd tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.680624 Jul 18 02:19:21.921666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 824/1651] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:21 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:21.932135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec9ec27a-63d8-4567-a2b5-27b6b6c3161d tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab0454e790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:21.999090 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec9ec27a-63d8-4567-a2b5-27b6b6c3161d tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851060173" status: 204 len: 0 microversion: 2.2 time: 0.075408 Jul 18 02:19:22.000158 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 825/1652] 10.222.0.67 () {60 vars in 1260 bytes} [Mon Jul 18 02:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851060173 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:22.011908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b94c4a4a-2187-4886-9c31-c18c8c6b03a4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:22.140825 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b94c4a4a-2187-4886-9c31-c18c8c6b03a4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/de626d73-3627-413d-9d1a-44772b7cc237" status: 204 len: 0 microversion: 2.1 time: 0.138064 Jul 18 02:19:22.142204 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 826/1653] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:19:22 2022] DELETE /compute/v2.1/os-server-groups/de626d73-3627-413d-9d1a-44772b7cc237 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:22.164489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:22.165655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:22.178906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:22.207663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.208251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.210668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.211957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.629427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:22.641871 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3af7f4f-47ca-4563-ac06-079f0a8d4031 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.487865 Jul 18 02:19:22.645561 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 827/1654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:22 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:22.651104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-158a0bc9-8a4c-4021-b330-6940f5065fa8 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab045db700>, body: {"keypair": {"name": "tempest-keypair-1472646294", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:22.708012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-158a0bc9-8a4c-4021-b330-6940f5065fa8 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:22.738088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-158a0bc9-8a4c-4021-b330-6940f5065fa8 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:22.802481 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-158a0bc9-8a4c-4021-b330-6940f5065fa8 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.155329 Jul 18 02:19:22.804119 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 828/1655] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:22 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:22.813851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7670785c-f469-4209-9fdb-b4f75f72f2fb req-24ea94cd-801e-443c-a5fe-ed4c707110c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d533dac5-ebb4-4042-a8fd-5126a176f7f5", "tag": "8da9ca78-2f84-4a70-93cd-3a21ba542fb8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:22.834177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7670785c-f469-4209-9fdb-b4f75f72f2fb req-24ea94cd-801e-443c-a5fe-ed4c707110c9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.835813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7670785c-f469-4209-9fdb-b4f75f72f2fb req-24ea94cd-801e-443c-a5fe-ed4c707110c9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.859890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7670785c-f469-4209-9fdb-b4f75f72f2fb req-24ea94cd-801e-443c-a5fe-ed4c707110c9 service nova] Creating event network-changed:8da9ca78-2f84-4a70-93cd-3a21ba542fb8 for instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 on n-h1-849796-1 Jul 18 02:19:22.869675 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7670785c-f469-4209-9fdb-b4f75f72f2fb req-24ea94cd-801e-443c-a5fe-ed4c707110c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062922 Jul 18 02:19:22.870999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 829/1656] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:22.886548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:22.888124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:22.901347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.903444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.906743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:22.908083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:22.969374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:23.187341 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6976b44-a086-4c7f-9d59-c0b71f313d07 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 204 len: 0 microversion: 2.1 time: 0.313496 Jul 18 02:19:23.191358 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 830/1657] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:22 2022] DELETE /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:23.200127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a593f63-834e-4dd5-9561-c526219119ff tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab0454eb80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:23.241630 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a593f63-834e-4dd5-9561-c526219119ff tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472646294" status: 204 len: 0 microversion: 2.2 time: 0.048512 Jul 18 02:19:23.242783 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 831/1658] 10.222.0.67 () {60 vars in 1260 bytes} [Mon Jul 18 02:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472646294 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:23.248889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:23.250164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:23.263023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.263780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.266140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.266863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.502956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:23.512636 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96dda457-ece3-4f46-b97e-e012395d38ff tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.268485 Jul 18 02:19:23.513610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 832/1659] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:23 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:23.519591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:23.520136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:23.531577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.532316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.533726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.534428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.587252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:23.733609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75d3b976-3504-4847-a09f-6a760db671e7 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 204 len: 0 microversion: 2.1 time: 0.217509 Jul 18 02:19:23.735403 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 833/1660] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:23 2022] DELETE /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:23.742378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab1448d8-f544-4f0f-8ef3-b7e9eea7f322 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab04611550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-377575091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7DojOYXPSfuvDH5yBcrvqy8LkeWcZW0DY41YDAl3esMs2zcGdsPp260DysLtKgUHYRRfv8fU8we04WEoWWMtuBk7O7d7yeTxeQwZhfC2ZRgr3p2a9VUYGguIgbL4WvWw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:23.767407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ab1448d8-f544-4f0f-8ef3-b7e9eea7f322 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:23.773984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ab1448d8-f544-4f0f-8ef3-b7e9eea7f322 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:23.810438 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab1448d8-f544-4f0f-8ef3-b7e9eea7f322 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.073089 Jul 18 02:19:23.819376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 834/1661] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:23.819376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:23.819752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:23.828554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.829268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:23.830372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:23.830729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.057486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:24.075423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39b59f1b-673e-442f-acef-dca1d7db50d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.260776 Jul 18 02:19:24.076312 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 835/1662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:23 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:24.092196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:24.094332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:24.105168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.105968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.107341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.108676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.232966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:19:24.407455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:24.421821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10e87291-83eb-4d29-9fbb-7578977f21e9 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1475 microversion: 2.1 time: 0.337034 Jul 18 02:19:24.422724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 836/1663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:24 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:24.438512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-233640e5-4a16-4901-a531-beb5f62d8bb6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab048184c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-740726410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8+yItpjwUYXKWWLgvZ2ItJYCF05uqi8q/mtzeGz10mf1eoFMAiU2yL0zhy2ghx/VYK/PWA+bwUbVKFgy0BcXoP24TBOWkDHS3VVgMoOnVV+jn2kK8Nv9RlQksi+XP2mA=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:24.463876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-233640e5-4a16-4901-a531-beb5f62d8bb6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:24.474247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-233640e5-4a16-4901-a531-beb5f62d8bb6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:24.519962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-233640e5-4a16-4901-a531-beb5f62d8bb6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.094023 Jul 18 02:19:24.520888 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 837/1664] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:24.621461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Getting quotas for project 8cd595a0d9c94819b4190fb3babda5eb. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:24.628738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Getting quotas for user 0b4d31b897754565a430bb220002c977 and project 8cd595a0d9c94819b4190fb3babda5eb. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:24.645260 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Request method failure captured: Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 1752 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MMiYLtnmkLHZCCnwRAlkAcaho8KUCzGw7neClRy6OFFuQGQtzw-IrUCuKyy2WURZPl4mMCLMpsFByF1tRggJnGMlVADoE6FqV0JLocXZvJBXcoy6abuvuO-h5mb4t73U-h2xJC2e16SUZVwSODFbR09VpwjC-8sE83-Ejh9pl1RoB8 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 8cd595a0d9c94819b4190fb3babda5eb Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-230223273 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8cd595a0d9c94819b4190fb3babda5eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8cd595a0d9c94819b4190fb3babda5eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8cd595a0d9c94819b4190fb3babda5eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8cd595a0d9c94819b4190fb3babda5eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-230223273 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 8cd595a0d9c94819b4190fb3babda5eb Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-230223273 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-230223273-project Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0b4d31b897754565a430bb220002c977 Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-230223273-project Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1044967877", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:19:24.660826 n-d-849796-1 devstack@n-api.service[119439]: exception: Maximum number of metadata items exceeds 128 Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1044967877', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:19:24.666106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ef28f3e-40a1-4a6e-918e-7d9718835bd4 tempest-AbsoluteLimitsNegativeTestJSON-230223273 tempest-AbsoluteLimitsNegativeTestJSON-230223273-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 7.371667 Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 828/1665] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Jul 18 02:19:17 2022] POST /compute/v2.1/servers => generated 87 bytes in 7374 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:24.681757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:24.685710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.685936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.687713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:24.687982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:24.743844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7dd0d424-279f-4461-8eee-d5b9f176ffea tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Action: 'create', calling method: .version_select at 0x7fab045510d0>, body: {"keypair": {"name": "tempest-keypair-100559741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISGsm5/43SF5RsR90IkWo+bi59vATvSf3z1QQQLD3upM0HyLd7CpFxy4ArIse2sYkxht/2lW9Fev1g01hiApGy9psiDvEEthCmOYKrSI4m0VB+dLYVY5x3qWQxjJ9eQCA=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:24.788348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7dd0d424-279f-4461-8eee-d5b9f176ffea tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Getting quotas for project 0161712c03e4448396c227dea011c725. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:24.807373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7dd0d424-279f-4461-8eee-d5b9f176ffea tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Getting quotas for user edd9caa3ac3041bfafca9ef5c8c0a0be and project 0161712c03e4448396c227dea011c725. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:24.855330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7dd0d424-279f-4461-8eee-d5b9f176ffea tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.332559 Jul 18 02:19:24.856899 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 838/1666] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:19:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:24.867672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78f6665f-9453-4748-9280-ec57de0b05da tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab045518b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-68083469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKIzx6tT0czk9mLuQ+h+nieOTKAZM2/O6Gv45+J3OI270T0oscJHeKbLocWgGnCEHEvVNTUshpVhR6PBqQ1pSQlp4381mBouRJAxgGHrCXbuVZNUVUU9+ihI1jRihns5w=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:24.879162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:24.891120 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adf51abd-bf2e-4a9b-af87-d26aceddbf5e tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.221330 Jul 18 02:19:24.898546 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 829/1667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:24 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:24.907612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-78f6665f-9453-4748-9280-ec57de0b05da tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:24.915113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-78f6665f-9453-4748-9280-ec57de0b05da tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:24.983241 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78f6665f-9453-4748-9280-ec57de0b05da tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.123970 Jul 18 02:19:24.985227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 839/1668] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:24 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:19:25.000357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5b77961-70de-40ae-b6cd-b3b0435d5425 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab0a795af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.004567 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-a5b77961-70de-40ae-b6cd-b3b0435d5425 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:19:25.028264 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5b77961-70de-40ae-b6cd-b3b0435d5425 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1138 microversion: 2.2 time: 0.034091 Jul 18 02:19:25.034679 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 830/1669] 10.222.0.67 () {60 vars in 1176 bytes} [Mon Jul 18 02:19:24 2022] GET /compute/v2.1/os-keypairs => generated 1138 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:25.041502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01b7cab9-0379-471c-90ca-ff7aa204da05 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab05155700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.085058 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01b7cab9-0379-471c-90ca-ff7aa204da05 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-68083469" status: 204 len: 0 microversion: 2.2 time: 0.048123 Jul 18 02:19:25.092798 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 840/1670] 10.222.0.67 () {60 vars in 1314 bytes} [Mon Jul 18 02:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-68083469 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:25.095284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.095901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:25.099827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ccc11561-9e78-424c-bf8f-2b9f44ed1cf6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab0454eb80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.122129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.129241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.130534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.131354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.147121 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ccc11561-9e78-424c-bf8f-2b9f44ed1cf6 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-740726410" status: 204 len: 0 microversion: 2.2 time: 0.051613 Jul 18 02:19:25.149570 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 841/1671] 10.222.0.67 () {60 vars in 1317 bytes} [Mon Jul 18 02:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-740726410 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:25.172659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-231b8903-c0a1-4b06-bc69-968cf352cc5e tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab04527c10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.214482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:25.228413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-231b8903-c0a1-4b06-bc69-968cf352cc5e tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-377575091" status: 204 len: 0 microversion: 2.2 time: 0.068707 Jul 18 02:19:25.230208 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 842/1672] 10.222.0.67 () {60 vars in 1317 bytes} [Mon Jul 18 02:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-377575091 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:19:25.257890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24e278a7-ac96-4350-af45-1f77c8c4ba7c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab045610d0>, body: {"keypair": {"name": "tempest-keypair-437348000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBxwgVWRqd82ftJJUObGdyOX36HQbzR2++sGNyJsLmgq7/4jU0LyCqolpd9OFwN1P1EhJ/Z74c1WFrQ/zM19xMY1jheUf5cgO02ABV5qVPocsE5sop/JbmDPAeuv3ikXA=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:25.307040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-24e278a7-ac96-4350-af45-1f77c8c4ba7c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:25.320693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-24e278a7-ac96-4350-af45-1f77c8c4ba7c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:25.376917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24e278a7-ac96-4350-af45-1f77c8c4ba7c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.132597 Jul 18 02:19:25.378469 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 843/1673] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Jul 18 02:19:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 18 02:19:25.413072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73fdacf8-6c21-4454-b9d2-8e6ee60c692c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab045513a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.433558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73fdacf8-6c21-4454-b9d2-8e6ee60c692c tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-437348000" status: 200 len: 512 microversion: 2.2 time: 0.025492 Jul 18 02:19:25.437195 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 844/1674] 10.222.0.67 () {60 vars in 1254 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-437348000 => generated 512 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:25.473204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.475552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:25.476143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:25.495237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.496024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.496387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f27de6ec-7412-4001-a7f0-e5e0aacecb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.406070 Jul 18 02:19:25.497492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.499287 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 831/1675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:25.505772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.521134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ddf56e41-d028-4a8f-abc3-cc510c9de79e tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab054ae8b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.530452 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-ddf56e41-d028-4a8f-abc3-cc510c9de79e tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:19:25.541677 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ddf56e41-d028-4a8f-abc3-cc510c9de79e tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.040061 Jul 18 02:19:25.543783 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 832/1676] 10.222.0.67 () {60 vars in 1176 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:25.563646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a838764a-d059-464e-a11c-4c7f5bd3c16a tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab05742310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.614441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a838764a-d059-464e-a11c-4c7f5bd3c16a tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437348000" status: 204 len: 0 microversion: 2.2 time: 0.060807 Jul 18 02:19:25.618581 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 833/1677] 10.222.0.67 () {60 vars in 1257 bytes} [Mon Jul 18 02:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437348000 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:19:25.643498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Action: 'create', calling method: .version_select at 0x7fab05767550>, body: {"keypair": {"name": "tempest-keypair-182534471", "type": "x509"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:25.674835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:25.687017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:25.722503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.processutils [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmphaudwsoa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphaudwsoa/temp.key -subj /CN=013ac32b709843cf86c0fae680d6ce3c -extensions v3_req_client {{(pid=119439) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 02:19:25.838576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:25.851035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a895901-389b-4fa3-8651-e2527b455216 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1475 microversion: 2.1 time: 0.399746 Jul 18 02:19:25.863028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:25.864265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 845/1678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:25.909959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:25.910667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:25.925405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.925858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:25.926750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:25.927695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.230106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:26.243184 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc382871-5ea1-4001-a486-4d2087c5cd85 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.338078 Jul 18 02:19:26.249156 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 846/1679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:25 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:26.471011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.processutils [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmphaudwsoa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphaudwsoa/temp.key -subj /CN=013ac32b709843cf86c0fae680d6ce3c -extensions v3_req_client" returned: 0 in 0.748s {{(pid=119439) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 02:19:26.474124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.processutils [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmphaudwsoa/temp.key -password pass: {{(pid=119439) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 18 02:19:26.522114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.processutils [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] CMD "openssl pkcs12 -export -inkey /tmp/tmphaudwsoa/temp.key -password pass:" returned: 0 in 0.048s {{(pid=119439) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 18 02:19:26.531802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.532961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:26.546199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.546990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.548413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.549243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.601168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:26.610993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Getting quotas for user 013ac32b709843cf86c0fae680d6ce3c and project 05fb4b9e15184a4197c9f680eedf5fb6. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:26.631713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:26.644579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09432c09-5e41-457b-abcc-298bb08c0f02 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.020388 Jul 18 02:19:26.646317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 834/1680] 10.222.0.67 () {62 vars in 1197 bytes} [Mon Jul 18 02:19:25 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1024 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:26.663879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-865a70ec-41d1-4b40-a0f6-d1301058cea1 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab057670d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.688205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-865a70ec-41d1-4b40-a0f6-d1301058cea1 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-182534471" status: 200 len: 1533 microversion: 2.2 time: 0.030060 Jul 18 02:19:26.690234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 835/1681] 10.222.0.67 () {60 vars in 1254 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-182534471 => generated 1533 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:19:26.711587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-813d40b2-a2d0-4b93-a9b9-823e57258df9 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab05742670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.718418 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-813d40b2-a2d0-4b93-a9b9-823e57258df9 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:19:26.732016 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-813d40b2-a2d0-4b93-a9b9-823e57258df9 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.030269 Jul 18 02:19:26.735734 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 836/1682] 10.222.0.67 () {60 vars in 1176 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:26.764553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5adeb495-07de-4369-9c87-edda754e2002 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] Calling method '.version_select at 0x7fab057394c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.805650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5adeb495-07de-4369-9c87-edda754e2002 tempest-KeyPairsV22TestJSON-1858521757 tempest-KeyPairsV22TestJSON-1858521757-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182534471" status: 204 len: 0 microversion: 2.2 time: 0.059577 Jul 18 02:19:26.807958 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 837/1683] 10.222.0.67 () {60 vars in 1257 bytes} [Mon Jul 18 02:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182534471 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:26.880251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:26.883276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:26.906445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.911643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.913273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:26.914198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:26.947082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:26.974420 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eac5a8a7-c710-4fab-9a18-d811f2a9ffde tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.450156 Jul 18 02:19:26.994326 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 847/1684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:19:27.277321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:27.280628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:27.298090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:27.299064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:27.300518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:27.301693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:27.606859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:27.634958 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11c4957a-f2c8-40b0-8a6e-653a7358bd1f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.364905 Jul 18 02:19:27.652694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 848/1685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:27 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:28.007034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:28.014325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:28.035492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.037030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:28.037993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.040558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.041690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.082879 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-199d4769-3701-4c8c-9cf5-28883de686e5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1475 microversion: 2.1 time: 1.211533 Jul 18 02:19:28.085165 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 838/1686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:26 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1475 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:28.404320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:28.414903 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b06a0fbd-4fc0-4e51-a641-dac3bd0ec8d7 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.416651 Jul 18 02:19:28.416335 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 849/1687] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:27 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:28.684444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:28.689875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:28.709883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.711211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:28.713054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:28.714961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.124260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:29.126081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:29.156047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.156832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.159601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.160782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.588400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:29.605267 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f8e307b-36f1-4cf3-b5d1-993a8bf1bbb4 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1475 microversion: 2.1 time: 0.932666 Jul 18 02:19:29.606460 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 839/1688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:28 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1475 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:29.621226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:29.624518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:29.639095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.643834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:29.645760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:29.646665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:30.083160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:30.098021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-86a0869b-3aff-4f16-abc6-a27ab9b32283 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 200 len: 1475 microversion: 2.1 time: 0.986446 Jul 18 02:19:30.099752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 850/1689] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:29 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 1475 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:30.107155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1243027206", "imageRef": "46d659c7-02dd-4700-a72e-03feb0ad03a1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a79a131d-324f-4bc1-aaa0-322f252e041f"}], "security_groups": [{"name": "tempest-securitygroup--726407180"}], "key_name": "tempest-keypair-100559741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:30.180441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:30.184349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:30.214361 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf5c4191-fa2e-4021-9e35-f48661db871a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 0.606182 Jul 18 02:19:30.223813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 840/1690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:29 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:30.241323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:30.247420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:30.275112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:30.276424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:30.291365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:30.292499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:30.788816 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de6a45b0-e220-4911-af5e-d31a5c2fcd16 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1859 microversion: 2.1 time: 0.563200 Jul 18 02:19:30.803074 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 841/1691] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:30 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1859 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:30.829946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2bf8ebd4-6a42-4dc9-b130-d6b90c1b98ca req-de04905d-186f-4323-8b83-b3f46c48e604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76977d61-442a-4ecb-8f99-2573009eda60", "name": "network-vif-deleted", "tag": "0e59e343-155c-4163-8a05-e4bd96c2f454"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:30.983807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2bf8ebd4-6a42-4dc9-b130-d6b90c1b98ca req-de04905d-186f-4323-8b83-b3f46c48e604 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:30.986711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2bf8ebd4-6a42-4dc9-b130-d6b90c1b98ca req-de04905d-186f-4323-8b83-b3f46c48e604 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.010499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] validate_networks() for [('a79a131d-324f-4bc1-aaa0-322f252e041f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:19:31.058100 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2bf8ebd4-6a42-4dc9-b130-d6b90c1b98ca req-de04905d-186f-4323-8b83-b3f46c48e604 service nova] Creating event network-vif-deleted:0e59e343-155c-4163-8a05-e4bd96c2f454 for instance 76977d61-442a-4ecb-8f99-2573009eda60 on n-h1-849796-1 Jul 18 02:19:31.080145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2bf8ebd4-6a42-4dc9-b130-d6b90c1b98ca req-de04905d-186f-4323-8b83-b3f46c48e604 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280769 Jul 18 02:19:31.091176 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 842/1692] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:31.112099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:31.113926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:31.154313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.157106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.161514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.176964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.910484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:31.925109 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a416a70e-ed2a-4c0a-ade8-1a439aee1e2d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1474 microversion: 2.1 time: 0.830153 Jul 18 02:19:31.926056 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 843/1693] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:31 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1474 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:31.936307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849796-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:31.948869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:31.960270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.961346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:31.962440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:31.964346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:32.028717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lazy-loading 'flavor' on Instance uuid 31bc5640-2b9b-4f06-a04c-63ff38508a2b {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:19:32.087916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Going to try to live migrate instance to n-h2-849796-1 {{(pid=119439) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:19:34.360512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:19:34.361662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:19:34.362534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:19:34.363130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:19:34.363759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:19:34.385744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.388122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.392590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.400026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.463905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Getting quotas for project 0161712c03e4448396c227dea011c725. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:19:34.472567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Getting quotas for user edd9caa3ac3041bfafca9ef5c8c0a0be and project 0161712c03e4448396c227dea011c725. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:19:34.496191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:19:34.500526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46d659c7-02dd-4700-a72e-03feb0ad03a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:19:34.604266 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc9e73bc-e7d3-499b-bd4f-2a52262ad7c4 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.502219 Jul 18 02:19:34.609883 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 851/1694] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:19:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 4508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:19:34.631498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:34.634614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 76977d61-442a-4ecb-8f99-2573009eda60] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:34.663627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.664088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.667983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.670884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.719572 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 HTTP/1.1 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '76977d61-442a-4ecb-8f99-2573009eda60'} Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:34.730909 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. Jul 18 02:19:34.739290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:34.741678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance 76977d61-442a-4ecb-8f99-2573009eda60 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:34.745356 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58ad63ac-b94c-47a5-b9a3-c2355e335f57 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60" status: 404 len: 111 microversion: 2.1 time: 0.132999 Jul 18 02:19:34.751058 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 852/1695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:34 2022] GET /compute/v2.1/servers/76977d61-442a-4ecb-8f99-2573009eda60 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:34.769746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:34.773123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:34.795952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.798232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.800751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:34.803680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:34.883806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:35.749533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:35.760536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d39f0bc-ec51-42b5-baa2-7b7e4b9489b6 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 1.007313 Jul 18 02:19:35.765926 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 853/1696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:34 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:35.777321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6875c5c4-cf11-47a5-a46e-dcdf72357410 req-36645765-2925-4bb7-a116-d0b244dd7c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7", "name": "network-vif-deleted", "tag": "a1982c76-1f9d-4c92-94d1-0477894aed63"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:35.803570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6875c5c4-cf11-47a5-a46e-dcdf72357410 req-36645765-2925-4bb7-a116-d0b244dd7c26 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:35.807242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6875c5c4-cf11-47a5-a46e-dcdf72357410 req-36645765-2925-4bb7-a116-d0b244dd7c26 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:35.882023 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6875c5c4-cf11-47a5-a46e-dcdf72357410 req-36645765-2925-4bb7-a116-d0b244dd7c26 service nova] Creating event network-vif-deleted:a1982c76-1f9d-4c92-94d1-0477894aed63 for instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 on n-h1-849796-1 Jul 18 02:19:35.893116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6875c5c4-cf11-47a5-a46e-dcdf72357410 req-36645765-2925-4bb7-a116-d0b244dd7c26 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124997 Jul 18 02:19:35.897164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 854/1697] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:35.921121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:35.921121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:35.952636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:35.953535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:35.959845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:35.973934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.523801 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e3bce67-21d8-4ba5-8d01-e633dbac5902 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/action" status: 202 len: 0 microversion: 2.1 time: 4.595327 Jul 18 02:19:36.527351 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 844/1698] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:31 2022] POST /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/action => generated 0 bytes in 4600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:19:36.547221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-unplugged", "status": "completed", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:36.618200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.620624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.678562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=22 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:36.687343 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] Creating event network-vif-unplugged:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h1-849796-1 Jul 18 02:19:36.703479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:19:36.724944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b1013ae4-e58a-45d6-9366-38782073fce2 req-54334165-0e1b-498f-86b3-3a783aaa479c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193955 Jul 18 02:19:36.725595 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 845/1699] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:36.737985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:36.746198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:36.759987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.760872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.761952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.762433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.802500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:36.828075 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a27eb20-1bdf-43fc-b452-1a9e79e5a88c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1474 microversion: 2.1 time: 0.919840 Jul 18 02:19:36.829926 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 855/1700] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:35 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1474 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:36.843438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:36.850900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:36.868498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.870728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.872496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.876871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:36.915459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 HTTP/1.1 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7'} Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:36.928590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. Jul 18 02:19:36.933729 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:36.939269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:36.940978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-63a8bed4-81c3-47fd-a61e-a2bedbfb72f4 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7" status: 404 len: 111 microversion: 2.1 time: 0.109334 Jul 18 02:19:36.942287 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 856/1701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:36 2022] GET /compute/v2.1/servers/dc7fc18b-cbae-4bee-84ff-ca8a1e2444c7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:36.951596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-24f89243-4055-49ec-a4e9-7ba2d145ed9d req-9124dc02-0fff-4ed3-b3e1-8b6152f91d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d533dac5-ebb4-4042-a8fd-5126a176f7f5", "name": "network-vif-plugged", "status": "completed", "tag": "8da9ca78-2f84-4a70-93cd-3a21ba542fb8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:36.972405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-24f89243-4055-49ec-a4e9-7ba2d145ed9d req-9124dc02-0fff-4ed3-b3e1-8b6152f91d1d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:36.975067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-24f89243-4055-49ec-a4e9-7ba2d145ed9d req-9124dc02-0fff-4ed3-b3e1-8b6152f91d1d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:37.012836 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-24f89243-4055-49ec-a4e9-7ba2d145ed9d req-9124dc02-0fff-4ed3-b3e1-8b6152f91d1d service nova] Creating event network-vif-plugged:8da9ca78-2f84-4a70-93cd-3a21ba542fb8 for instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 on n-h1-849796-1 Jul 18 02:19:37.026127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-24f89243-4055-49ec-a4e9-7ba2d145ed9d req-9124dc02-0fff-4ed3-b3e1-8b6152f91d1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081225 Jul 18 02:19:37.028569 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 857/1702] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:37.179851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:37.188625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f33d108a-5cf1-421b-971b-8bff5d02689c tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1241 microversion: 2.1 time: 0.461509 Jul 18 02:19:37.197459 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 846/1703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:36 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1241 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:37.204545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:37.211204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:37.229184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:37.233766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:37.235003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:37.238291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:37.999789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:38.000943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:38.021662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:38.022248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:38.027752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:38.028282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:38.727120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:38.742612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79471bf0-8867-432e-a38c-266ffa54e17f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.707264 Jul 18 02:19:38.746211 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 858/1704] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:37 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:38.755774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f2823f1e-2640-414f-8046-e02e9ba623b5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:38.856040 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f2823f1e-2640-414f-8046-e02e9ba623b5 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/fdab30e6-449f-4e7b-a55a-b1470654f76f" status: 204 len: 0 microversion: 2.1 time: 0.104545 Jul 18 02:19:38.858070 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 859/1705] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:19:38 2022] DELETE /compute/v2.1/os-server-groups/fdab30e6-449f-4e7b-a55a-b1470654f76f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:38.893211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:38.905947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:38.943541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:38.948489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:38.955159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:38.956602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:39.516264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:39.540185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f2910cfa-8c40-4def-9731-351c64b0a1bb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 2.340957 Jul 18 02:19:39.568210 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 847/1706] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:37 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:39.596665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:39.598354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:39.614925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:39.616297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:39.619063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:39.620631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:39.898923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:39.931461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:39.942998 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d606a3b6-743e-45e3-b393-faab4a724419 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1303 microversion: 2.1 time: 0.372014 Jul 18 02:19:39.949735 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1e22de7-2f80-4ac6-8bef-e31290bc5a9c tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1472 microversion: 2.1 time: 1.086567 Jul 18 02:19:39.957804 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 860/1707] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:38 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1472 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:39.962714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 848/1708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:39 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1303 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:39.979398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:39.980212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:39.986666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:40.010166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.010700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.011614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.012062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.028991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.030598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.078139 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] Creating event network-changed:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h1-849796-1 Jul 18 02:19:40.098449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:19:40.138854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:19:40.199126 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-525980e9-e6ee-4207-b57d-1cd7dbd7823d req-666036e9-8288-4a2e-b135-db409437467d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233703 Jul 18 02:19:40.205533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 849/1709] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:40.225219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:40.232417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:40.297741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.300035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.303489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.309556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.531190 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5697a491-7483-4c00-842d-4b00b42c0814 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "DELETE /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 204 len: 0 microversion: 2.1 time: 0.569731 Jul 18 02:19:40.535981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 861/1710] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:19:39 2022] DELETE /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:40.565126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:40.575088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:40.630091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.647391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:40.660050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:40.664254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:41.418529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:41.429204 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40a52e48-371c-43e7-bc5e-2075dd63cb14 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.221042 Jul 18 02:19:41.448160 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 850/1711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:40 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:41.455591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:41.456227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:41.482182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:41.483219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:41.484206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:41.484684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:41.848858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:41.873840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30fbb94c-2528-4318-acd3-f27913c83334 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1472 microversion: 2.1 time: 1.332905 Jul 18 02:19:41.875324 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 862/1712] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:40 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1472 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:41.886193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:41.887298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:41.900786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:41.906377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:41.907140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:41.907790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:43.228441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:43.263056 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13690a5a-90ef-4c89-a727-9a23f2a9ba75 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1324 microversion: 2.1 time: 1.810168 Jul 18 02:19:43.265311 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 851/1713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:41 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1324 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:43.281776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:43.282471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:43.304829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:43.305330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:43.306177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:43.306973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:43.555572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:43.600062 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1aefc1e-77de-4c56-9cf2-8d3a464d4d68 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1303 microversion: 2.1 time: 1.721703 Jul 18 02:19:43.611746 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 863/1714] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:41 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1303 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:43.628440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:43.632551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:43.656099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:43.665234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:43.667911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:43.668753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:44.148489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:44.165907 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55637716-8537-4e86-a0c5-3cbf724979cf tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1469 microversion: 2.1 time: 0.898664 Jul 18 02:19:44.166897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 852/1715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:43 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1469 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:44.184040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:44.187354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:44.221651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:44.222251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:44.228654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:44.229390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:44.418664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:44.486846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=40 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:45.437237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:45.488341 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9de1f20-0f87-4a20-8d52-d84616ce246a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.874890 Jul 18 02:19:45.537515 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 864/1716] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:43 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:45.582132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:45.585986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:45.618325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:45.618790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:45.619624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:45.620088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:45.974913 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bb327b9-d98b-4951-bedf-b6fb2b5ce40b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "POST /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da/action" status: 202 len: 0 microversion: 2.1 time: 0.429657 Jul 18 02:19:45.976302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 865/1717] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:45 2022] POST /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:19:45.991901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:45.994938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:46.024199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:46.024696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:46.025577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:46.026036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:46.942505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:46.960576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8ba5b10-e19f-4a83-a361-a808b83635f9 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1520 microversion: 2.1 time: 0.978944 Jul 18 02:19:46.961653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 866/1718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:45 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1520 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:46.970770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:46.971419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:47.000286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.000286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.000286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.000286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.349154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:47.403223 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b68f3cfd-0a97-4ac1-a3af-9d9f0c7c6e5f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1303 microversion: 2.1 time: 0.437178 Jul 18 02:19:47.429860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 867/1719] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:46 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1303 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:47.444560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:47.446435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:47.467524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.470272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.471483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.473411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.512837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76d13efbc0841f4b0a479a87b964a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ba6d7afda14ac8a41818afb217ab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:47.610029 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bece2e7-e94d-4c12-9377-5823fe091b92 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 200 len: 1472 microversion: 2.1 time: 3.428894 Jul 18 02:19:47.630710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 853/1720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:44 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 1472 bytes in 3458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:47.675469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:47.689052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:47.722543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.722543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:47.724816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:47.725736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.814216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:48.841775 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-389cdbc9-61d1-4367-9ba4-13da8565c2d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.208915 Jul 18 02:19:48.843103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 854/1721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:47 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:48.853624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5a37a0bb-4a81-4b2a-a3b3-6c5b06c53b8a req-95d4bc51-8d6d-4a9b-860e-5e0a2fb11a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6", "name": "network-vif-deleted", "tag": "972750a5-4e56-4ee2-894b-cfb3b0c4ecec"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:48.912256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5a37a0bb-4a81-4b2a-a3b3-6c5b06c53b8a req-95d4bc51-8d6d-4a9b-860e-5e0a2fb11a5f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:48.912739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5a37a0bb-4a81-4b2a-a3b3-6c5b06c53b8a req-95d4bc51-8d6d-4a9b-860e-5e0a2fb11a5f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:48.964313 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5a37a0bb-4a81-4b2a-a3b3-6c5b06c53b8a req-95d4bc51-8d6d-4a9b-860e-5e0a2fb11a5f service nova] Creating event network-vif-deleted:972750a5-4e56-4ee2-894b-cfb3b0c4ecec for instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 on n-h1-849796-1 Jul 18 02:19:49.003569 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5a37a0bb-4a81-4b2a-a3b3-6c5b06c53b8a req-95d4bc51-8d6d-4a9b-860e-5e0a2fb11a5f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159091 Jul 18 02:19:49.013413 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 855/1722] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:49.040378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:49.052213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:49.087799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.091253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:49.096993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.100461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:49.416745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:49.454656 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-245f9512-638b-4a1e-9eea-87a45d0ff12f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 2.022520 Jul 18 02:19:49.484108 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 868/1723] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:47 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:49.505340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:49.525474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:49.545468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.546716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:49.549007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:49.550263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:49.620892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:50.700951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:50.727928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-30b86503-94b8-49b0-8735-6463bae3b925 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1520 microversion: 2.1 time: 1.712553 Jul 18 02:19:50.734198 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 856/1724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:49 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1520 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:50.764670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:50.768234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] [instance: 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:50.799799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.804910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:50.808034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.815631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:50.876047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] HTTP exception thrown: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Request method failure captured: Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 HTTP/1.1 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MIbkjODgl4OXfvfmPrbu6UfrqLRCJLWcLiKD8Da2wwDRwTNeKJsMDbapH7GU1Fh8QGBV6uvDN7iaHIEJwcMPx2GYTm_rkQIscRhu46jZuYoHSuX9Z6ArzOAP0ZXaJWnIH9RW6fy9wHk5InqaqnrldRWPPKZ4HRjI-CZRHIR_-66Mxw Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/46ba6d7afda14ac8a41818afb217ab40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 46ba6d7afda14ac8a41818afb217ab40 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-433346985 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a76d13efbc0841f4b0a479a87b964a67 Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersOnMultiNodesTest-433346985-project Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6'} Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:50.883687 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] Returning 404 to user: Instance 83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:50.889420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8831784a-9234-44bb-9fda-34a62995f887 tempest-ServersOnMultiNodesTest-433346985 tempest-ServersOnMultiNodesTest-433346985-project] 10.222.0.67 "GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6" status: 404 len: 111 microversion: 2.1 time: 0.149207 Jul 18 02:19:50.893032 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 857/1725] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:50 2022] GET /compute/v2.1/servers/83aa6f8e-d759-410c-aec7-e7dd9b0ed0c6 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:19:50.906100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:50.906946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:50.923226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.923704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:50.924620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:50.925133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:51.070665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:51.149252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:51.159882 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfde7309-f8c0-45aa-915e-cc2231311bb9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 1.673805 Jul 18 02:19:51.179848 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 869/1726] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:49 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:51.216376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:51.217791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:51.256016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:51.265915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:51.277093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:51.278579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:53.320785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:53.345699 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ee202be-7a1b-42e6-9ea9-7a8d31f845f7 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 2.445493 Jul 18 02:19:53.346515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 858/1727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:50 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:53.383156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-83864389"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:53.394268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:53.422054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:53.425049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:53.426511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:53.431340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:54.095155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:54.181555 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d40e509-91c1-44bf-ba9d-a93341fbafb1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 2.990302 Jul 18 02:19:54.182498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 870/1728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:51 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:54.199302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:54.205807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:54.255117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:54.277248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:54.285737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:54.287093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:54.291789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:54.827153 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38da4f14-58aa-4e57-8a83-dc3d45cbc9c2 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5/action" status: 202 len: 0 microversion: 2.1 time: 1.469406 Jul 18 02:19:54.828662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 859/1729] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:19:53 2022] POST /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5/action => generated 0 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:19:54.853655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-plugged", "status": "completed", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:54.908393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:54.909068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:54.973836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] Creating event network-vif-plugged:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h1-849796-1 Jul 18 02:19:54.983986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:55.009354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fcfc41a4-5d43-4221-8e3b-64d846f121d3 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.813333 Jul 18 02:19:55.030746 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 871/1730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:54 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:55.036104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:19:55.047788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:55.049276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:55.098881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.102886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:55.113367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.118410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:55.124468 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-adf0ba8c-6aa8-4254-a931-5df990443315 req-b2b2c627-662c-44b9-9936-6937e73cff7b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293273 Jul 18 02:19:55.137516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 860/1731] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:55.184180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-55e2ce3d-c9f7-4029-b169-4e915bcb7b76 req-3e2eaf7b-0afd-465d-9407-d4dd4d0473c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eca075-975f-46cb-876e-e7b99d627940", "tag": "866ba63d-f6a5-4950-a11c-4732fc33b586"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:19:55.301821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-55e2ce3d-c9f7-4029-b169-4e915bcb7b76 req-3e2eaf7b-0afd-465d-9407-d4dd4d0473c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:55.308977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-55e2ce3d-c9f7-4029-b169-4e915bcb7b76 req-3e2eaf7b-0afd-465d-9407-d4dd4d0473c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:55.428029 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-55e2ce3d-c9f7-4029-b169-4e915bcb7b76 req-3e2eaf7b-0afd-465d-9407-d4dd4d0473c7 service nova] Creating event network-changed:866ba63d-f6a5-4950-a11c-4732fc33b586 for instance e5eca075-975f-46cb-876e-e7b99d627940 on n-h2-849796-1 Jul 18 02:19:55.472235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-55e2ce3d-c9f7-4029-b169-4e915bcb7b76 req-3e2eaf7b-0afd-465d-9407-d4dd4d0473c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319260 Jul 18 02:19:55.481395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 861/1732] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:19:55.515704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5a9d0d4-fa9b-4acb-81bc-3ea5e10bd0b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab0556cdc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:55.978771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:55.993216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9852210-fc51-4226-8809-ad49262f940c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.961087 Jul 18 02:19:56.000454 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 872/1733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:55 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:56.006268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:56.017950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:56.050539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.053888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.058197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.062276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.329599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5a9d0d4-fa9b-4acb-81bc-3ea5e10bd0b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640" status: 204 len: 0 microversion: 2.1 time: 0.843516 Jul 18 02:19:56.330887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 862/1734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:55 2022] DELETE /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:19:56.336694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:56.338819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:56.353612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.358576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.359861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.361080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.620959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:56.636112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2456729-404a-4859-9386-6eac4abb4c07 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 0.632662 Jul 18 02:19:56.641370 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 873/1735] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:56 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:56.648844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b28b3d2-8f44-4bd4-be0f-238edfb27fd8 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab044d8700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:56.735701 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2b28b3d2-8f44-4bd4-be0f-238edfb27fd8 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Image not found. Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b28b3d2-8f44-4bd4-be0f-238edfb27fd8 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640 HTTP/1.1 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd135145e-b142-4634-9127-7ee8dc4b5640'} Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d135145e-b142-4634-9127-7ee8dc4b5640 Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:19:56.740888 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d135145e-b142-4634-9127-7ee8dc4b5640 could not be found. Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b28b3d2-8f44-4bd4-be0f-238edfb27fd8 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:19:56.759382 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b28b3d2-8f44-4bd4-be0f-238edfb27fd8 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640" status: 404 len: 62 microversion: 2.1 time: 0.110881 Jul 18 02:19:56.776558 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 874/1736] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:19:56 2022] GET /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640 => generated 62 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:19:56.810646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:56.818879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:56.900258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.900765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:56.909266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:56.912733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:58.301579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:58.314075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f0967e0-2e0f-4c68-ab85-14d8490aa158 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 1.981792 Jul 18 02:19:58.315765 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 863/1737] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:56 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:58.330414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:58.334248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:58.346167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:58.353856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:58.354695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:58.355772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:58.358202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:58.912306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:19:58.965923 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-08c0f21b-7b33-4e54-8c23-e96f847a64ca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1532 microversion: 2.1 time: 2.185850 Jul 18 02:19:58.973637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 875/1738] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:56 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1532 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:19:59.003966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:19:59.009850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:19:59.068531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:59.073164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:19:59.087475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:19:59.088970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:00.583775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:00.598459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f816799-3fa3-4000-a095-5d4c6d509ad3 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 1.620049 Jul 18 02:20:00.600683 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 876/1739] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:58 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:00.610938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:00.612548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:00.637703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:00.639072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:00.642422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:00.643066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:01.333614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:01.351689 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3856e8cc-0906-447c-aadb-79bb04b80f7d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.741709 Jul 18 02:20:01.352405 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 877/1740] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:00 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:01.360420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:01.361076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:01.396050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:01.401167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:01.406221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:01.410495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:01.933540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:01.963992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a11f1262-12c3-4aaa-b9e1-d0bbc99a1720 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1538 microversion: 2.1 time: 0.610044 Jul 18 02:20:01.981259 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 878/1741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:01 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1538 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:01.999107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:02.001149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:02.010176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:02.010959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:02.012090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:02.012908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:02.088325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:02.101945 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-588257b3-b43e-43c2-b82b-d72a4d68ce4c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 3.783592 Jul 18 02:20:02.110164 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 864/1742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:19:58 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:02.384548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:02.385859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:02.409134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:02.410929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:02.412416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:02.413310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.040813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:03.053258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-789ef393-d56f-42de-a2dc-accfc03e5325 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.673662 Jul 18 02:20:03.054046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 865/1743] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:02 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:03.075352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.078369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:03.096195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.100571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.102390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.103227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.383152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:03.400404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9cea148a-4872-44d7-b629-e1671d59239a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 1.414164 Jul 18 02:20:03.403703 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 879/1744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:01 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:03.415238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:03.418425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:03.440179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.442803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.446662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:03.447184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:03.898262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:03.914269 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0f53fe5-55d0-4f2e-a69a-cf4116491a32 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.506864 Jul 18 02:20:03.921170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 880/1745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:03 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:03.926682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1585679889", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "289de125-f75a-44e5-b795-181da195dbd2"}], "block_device_mapping_v2": [{"uuid": "fdfc19e8-684d-4c95-bdb5-b3a54d702221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:04.121542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] validate_networks() for [('289de125-f75a-44e5-b795-181da195dbd2', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:20:04.230152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:04.283757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2606a908-14a9-472b-bacb-2b5f22f7aad3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1538 microversion: 2.1 time: 1.221826 Jul 18 02:20:04.293516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 866/1746] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:03 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1538 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:04.332698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-unplugged", "status": "completed", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:04.381730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.382583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.461381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] Creating event network-vif-unplugged:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:20:04.495519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:20:04.568509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b3e69e83-03c7-4993-aab9-4cfe21caa9b7 req-cecdc2e5-3095-4ee5-8a15-510cffdeeb12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.269980 Jul 18 02:20:04.571048 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 867/1747] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:04.604538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:04.607766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:04.623041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.626390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:04.639484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:04.646299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.471287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:20:05.472115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:20:05.472427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:20:05.473110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:20:05.473540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:20:05.490053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:05.502326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.503590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.507616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.510182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.515732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4cbd6b7e-078b-43ac-a301-f6c912606cd2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.936104 Jul 18 02:20:05.517766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 868/1748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:04 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:05.531736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:05.535106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:05.556047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.556608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.558175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:05.558637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:05.607436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:05.622890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Getting quotas for user 2affc29a14f847a099dad6deaf668842 and project 0c7d825a621a40dea844b3e2df794cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:05.750349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:20:05.753189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdfc19e8-684d-4c95-bdb5-b3a54d702221',volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:20:06.102693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab06a982-b1c2-42ec-b28c-d63728095f00 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.177950 Jul 18 02:20:06.119124 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 881/1749] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:20:06.141462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:06.143955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:06.168284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:06.171514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:06.185919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:06.186828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:06.381404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:06.397973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0c45e35-1ef9-4990-a6a5-f9a3f898df41 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 0.877482 Jul 18 02:20:06.398831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 869/1750] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:05 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:06.404655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:06.412209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:06.423848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:06.426283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:06.427429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:06.432194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:06.526861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:06.547232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5dc6429-9706-4b06-96ff-20f8ab87236e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.426099 Jul 18 02:20:06.547872 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 882/1751] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:06 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:06.939983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f72a9747-990c-4dd7-bf28-8c377cffb59d tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Calling method '.version_select at 0x7fab04473e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:07.024435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f72a9747-990c-4dd7-bf28-8c377cffb59d tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f72a9747-990c-4dd7-bf28-8c377cffb59d tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/9b1c9539-2b33-4697-9c7e-76d5adf6b73e/metadata/os_distro HTTP/1.1 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'image_id': '9b1c9539-2b33-4697-9c7e-76d5adf6b73e', 'id': 'os_distro'} Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9b1c9539-2b33-4697-9c7e-76d5adf6b73e Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:07.161352 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b1c9539-2b33-4697-9c7e-76d5adf6b73e could not be found. Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f72a9747-990c-4dd7-bf28-8c377cffb59d tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f72a9747-990c-4dd7-bf28-8c377cffb59d tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "DELETE /compute/v2.1/images/9b1c9539-2b33-4697-9c7e-76d5adf6b73e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.609934 Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 883/1752] 10.222.0.67 () {58 vars in 1292 bytes} [Mon Jul 18 02:20:06 2022] DELETE /compute/v2.1/images/9b1c9539-2b33-4697-9c7e-76d5adf6b73e/metadata/os_distro => generated 62 bytes in 611 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:07.176155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:07.188402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:07.315580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:07.340478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:07.343721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:07.350790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4aaea198-0011-4009-908d-7454b5cac711 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1104 microversion: 2.25 time: 0.184222 Jul 18 02:20:07.353297 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 884/1753] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:07 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1104 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:07.367324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:07.374926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:07.385557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:07.387533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:07.390931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:07.391882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:07.707842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:07.741250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b2de3e5-b4c5-47d3-9191-fbdd82c004ab tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.383008 Jul 18 02:20:07.748906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 885/1754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:07 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:07.763023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:07.783838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:07.787039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:07.814155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] Creating event network-changed:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:20:07.828749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 02:20:07.856327 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e714867d-9c5f-454b-8eaf-3834da4a20d0 req-2476d323-1818-43c6-b3bc-e3827cb4655c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100644 Jul 18 02:20:07.860327 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 886/1755] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:07.871187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1967d3c3-2945-4585-b722-34cc5c12dfc5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Calling method '.version_select at 0x7fab045510d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:07.957056 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1967d3c3-2945-4585-b722-34cc5c12dfc5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1967d3c3-2945-4585-b722-34cc5c12dfc5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/8fa44bf3-03c7-4249-9be2-d58c3af8bc16/metadata/os_version HTTP/1.1 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'image_id': '8fa44bf3-03c7-4249-9be2-d58c3af8bc16', 'id': 'os_version'} Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8fa44bf3-03c7-4249-9be2-d58c3af8bc16 Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:07.962781 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fa44bf3-03c7-4249-9be2-d58c3af8bc16 could not be found. Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1967d3c3-2945-4585-b722-34cc5c12dfc5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1967d3c3-2945-4585-b722-34cc5c12dfc5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "GET /compute/v2.1/images/8fa44bf3-03c7-4249-9be2-d58c3af8bc16/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.103985 Jul 18 02:20:07.975524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 887/1756] 10.222.0.67 () {58 vars in 1292 bytes} [Mon Jul 18 02:20:07 2022] GET /compute/v2.1/images/8fa44bf3-03c7-4249-9be2-d58c3af8bc16/metadata/os_version => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:07.991343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:07.992848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:08.004856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.005558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.007633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.008359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.269910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:08.305354 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6dc9294e-0c4e-4a5d-ad26-dfc8ace208ed tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1520 microversion: 2.1 time: 1.904789 Jul 18 02:20:08.307417 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 870/1757] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:06 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1520 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:08.328320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:08.336811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:08.370555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.371716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.372868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.374136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.510265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:08.526608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54e17c8e-7673-4dc6-b5cd-6400d2952a5f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 0.551456 Jul 18 02:20:08.537235 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 888/1758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:07 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:08.543358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2de51bb2-74c1-4050-a3ad-63580ca10ea5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Calling method '.version_select at 0x7fab044fd1f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:08.636952 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2de51bb2-74c1-4050-a3ad-63580ca10ea5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2de51bb2-74c1-4050-a3ad-63580ca10ea5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/4970b236-a772-4171-be36-9049c8f36c39/metadata HTTP/1.1 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'image_id': '4970b236-a772-4171-be36-9049c8f36c39'} Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4970b236-a772-4171-be36-9049c8f36c39 Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:08.639587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4970b236-a772-4171-be36-9049c8f36c39 could not be found. Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2de51bb2-74c1-4050-a3ad-63580ca10ea5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2de51bb2-74c1-4050-a3ad-63580ca10ea5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "GET /compute/v2.1/images/4970b236-a772-4171-be36-9049c8f36c39/metadata" status: 404 len: 62 microversion: 2.1 time: 0.102510 Jul 18 02:20:08.651338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 889/1759] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:20:08 2022] GET /compute/v2.1/images/4970b236-a772-4171-be36-9049c8f36c39/metadata => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:08.661902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d9cf1bd2-2cf6-4df5-a931-8a9951b850cd req-b46e5914-aef0-490e-8f90-e31ba9f80582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d533dac5-ebb4-4042-a8fd-5126a176f7f5", "name": "network-vif-plugged", "status": "completed", "tag": "8da9ca78-2f84-4a70-93cd-3a21ba542fb8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:08.688778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9cf1bd2-2cf6-4df5-a931-8a9951b850cd req-b46e5914-aef0-490e-8f90-e31ba9f80582 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.689464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9cf1bd2-2cf6-4df5-a931-8a9951b850cd req-b46e5914-aef0-490e-8f90-e31ba9f80582 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.725810 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d9cf1bd2-2cf6-4df5-a931-8a9951b850cd req-b46e5914-aef0-490e-8f90-e31ba9f80582 service nova] Creating event network-vif-plugged:8da9ca78-2f84-4a70-93cd-3a21ba542fb8 for instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 on n-h1-849796-1 Jul 18 02:20:08.734970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d9cf1bd2-2cf6-4df5-a931-8a9951b850cd req-b46e5914-aef0-490e-8f90-e31ba9f80582 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092001 Jul 18 02:20:08.736377 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 890/1760] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:08.790891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:08.791912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:08.805499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.806293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.807923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:08.808774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:08.881650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:09.037404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:09.157434 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb623084-15a0-460e-abbb-b7d28f49e592 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 204 len: 0 microversion: 2.1 time: 0.418177 Jul 18 02:20:09.158236 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 891/1761] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:08 2022] DELETE /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:09.166832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:09.168947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:09.193445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.194070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.195969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.196592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.353196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:09.395391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:09.398759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:09.402213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc1b1d20-a349-4813-86e7-6ea69513a43b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1251 microversion: 2.25 time: 0.242185 Jul 18 02:20:09.404342 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 892/1762] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:09 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1251 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:09.427582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-664ec007-64ef-42eb-80c6-093b7bfbd0b5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Action: 'update_all', calling method: .version_select at 0x7fab04551790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:09.461933 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-664ec007-64ef-42eb-80c6-093b7bfbd0b5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-664ec007-64ef-42eb-80c6-093b7bfbd0b5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/images/ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7/metadata HTTP/1.1 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 57 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'image_id': 'ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7 Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:09.465423 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7 could not be found. Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:09.470704 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:09.478441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-664ec007-64ef-42eb-80c6-093b7bfbd0b5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:09.479131 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-664ec007-64ef-42eb-80c6-093b7bfbd0b5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "PUT /compute/v2.1/images/ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071675 Jul 18 02:20:09.480252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 893/1763] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:20:09 2022] PUT /compute/v2.1/images/ee4dcc68-b9bb-4d05-8f2f-bbcd84c01aa7/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:09.485293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:09.487495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:09.502418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.503205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.504543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.505223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.824274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:09.841860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c853cfa-28fb-4d30-970f-e6e07715c25d tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 0.355557 Jul 18 02:20:09.846102 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 894/1764] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:09 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:09.854634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:09.861266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:09.879400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.880221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.881773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:09.882230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:09.957246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:09.987693 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a38bf20-e433-4888-b94a-497582f674c6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.677909 Jul 18 02:20:09.997854 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 871/1765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:08 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:10.010263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-994b68f9-c3ca-45b4-8e81-472509ebfd90 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Action: 'update', calling method: .version_select at 0x7fab055284c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:10.054800 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-994b68f9-c3ca-45b4-8e81-472509ebfd90 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-994b68f9-c3ca-45b4-8e81-472509ebfd90 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/images/e755cedb-57a4-4374-aff2-6f03c09c9684/metadata/os_distro HTTP/1.1 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 30 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: {"meta": {"os_distro": "alt"}} Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'image_id': 'e755cedb-57a4-4374-aff2-6f03c09c9684', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e755cedb-57a4-4374-aff2-6f03c09c9684 Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:10.079595 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e755cedb-57a4-4374-aff2-6f03c09c9684 could not be found. Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-994b68f9-c3ca-45b4-8e81-472509ebfd90 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:10.084794 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-994b68f9-c3ca-45b4-8e81-472509ebfd90 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "PUT /compute/v2.1/images/e755cedb-57a4-4374-aff2-6f03c09c9684/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.083763 Jul 18 02:20:10.105189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 872/1766] 10.222.0.67 () {60 vars in 1309 bytes} [Mon Jul 18 02:20:09 2022] PUT /compute/v2.1/images/e755cedb-57a4-4374-aff2-6f03c09c9684/metadata/os_distro => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:10.152492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:10.154516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:10.191007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:10.194941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:10.203825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:10.207703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:10.233317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:10.246707 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a451d75-2bc6-406f-a81c-eacd3056071c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1526 microversion: 2.1 time: 0.398913 Jul 18 02:20:10.256077 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 895/1767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:09 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1526 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:10.279680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e084a0a-ce91-4b36-99c2-5f09bf3a4bd5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Action: 'create', calling method: .version_select at 0x7fab04937430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:10.354093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1e084a0a-ce91-4b36-99c2-5f09bf3a4bd5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] HTTP exception thrown: Image not found. Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e084a0a-ce91-4b36-99c2-5f09bf3a4bd5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Request method failure captured: Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/images/c9cfd367-bdfa-45e0-92ee-0a266efd679e/metadata HTTP/1.1 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 57 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNV-aJWOFo71sayj4h06I2iUrPQqey_5ju_DScwyuJZvXwz6twJyKSRMdxchL3vJTvnBGCftHKwaKsFtfLoZ6m9ypBagVjK3BIUgzTT6IC9lFiNHA-qDfSo55HsVCmKr9a9YDH7aAsIb7EbOq3oav-f8px-_x_li7Pm6ERxkHJ0UBA Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fdbe669a32d243e88d9070c3b7fe9728"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: fdbe669a32d243e88d9070c3b7fe9728 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1536886b5571466891c15ddf922bdad5 Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1226996589-project Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'image_id': 'c9cfd367-bdfa-45e0-92ee-0a266efd679e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c9cfd367-bdfa-45e0-92ee-0a266efd679e Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:20:10.360842 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c9cfd367-bdfa-45e0-92ee-0a266efd679e could not be found. Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e084a0a-ce91-4b36-99c2-5f09bf3a4bd5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e084a0a-ce91-4b36-99c2-5f09bf3a4bd5 tempest-ImagesMetadataNegativeTestJSON-1226996589 tempest-ImagesMetadataNegativeTestJSON-1226996589-project] 10.222.0.67 "POST /compute/v2.1/images/c9cfd367-bdfa-45e0-92ee-0a266efd679e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.104802 Jul 18 02:20:10.370949 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 896/1768] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Jul 18 02:20:10 2022] POST /compute/v2.1/images/c9cfd367-bdfa-45e0-92ee-0a266efd679e/metadata => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:10.423199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:10.423832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:10.439963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:10.440421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:10.441484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:10.455140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:10.619533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:10.653616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:10.660599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:10.668235 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8575830-854f-415d-92b5-1fb5529d929c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1251 microversion: 2.25 time: 0.249609 Jul 18 02:20:10.674380 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 897/1769] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:10 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1251 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:10.904736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-72ebfb0b-36da-45f8-ae6a-2e8c3de5f017 req-86f6c2ca-0bcc-438e-b9cf-b9421568441b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d533dac5-ebb4-4042-a8fd-5126a176f7f5", "name": "network-vif-unplugged", "status": "completed", "tag": "8da9ca78-2f84-4a70-93cd-3a21ba542fb8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:11.003748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-72ebfb0b-36da-45f8-ae6a-2e8c3de5f017 req-86f6c2ca-0bcc-438e-b9cf-b9421568441b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:11.005182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-72ebfb0b-36da-45f8-ae6a-2e8c3de5f017 req-86f6c2ca-0bcc-438e-b9cf-b9421568441b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:11.096700 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-72ebfb0b-36da-45f8-ae6a-2e8c3de5f017 req-86f6c2ca-0bcc-438e-b9cf-b9421568441b service nova] Creating event network-vif-unplugged:8da9ca78-2f84-4a70-93cd-3a21ba542fb8 for instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 on n-h1-849796-1 Jul 18 02:20:11.132027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-72ebfb0b-36da-45f8-ae6a-2e8c3de5f017 req-86f6c2ca-0bcc-438e-b9cf-b9421568441b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.256142 Jul 18 02:20:11.136780 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 898/1770] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:20:11.144232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:11.144974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:11.195107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:11.195572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:11.196392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:11.197025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:12.301048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:12.344399 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0146fe8-d4f8-4ad8-a5c1-ce52f3750de1 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1468 microversion: 2.1 time: 2.236114 Jul 18 02:20:12.358034 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 873/1771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:10 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1468 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:12.377431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:12.378575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:12.433788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:12.434536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:12.437238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:12.447086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:12.589233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:12.602498 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eea2af47-104e-4804-8dba-7878626d1ff8 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 1.462578 Jul 18 02:20:12.621129 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 899/1772] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:11 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:12.645651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:12.652406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:12.695743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:12.702333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:12.704136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:12.719263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:13.059566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:13.076756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c078a8f6-bc48-4e57-8002-03e8fb697cdb tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 200 len: 1484 microversion: 2.1 time: 0.453351 Jul 18 02:20:13.082248 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 900/1773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:12 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 1484 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:13.676027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96a3411d-ea11-4b83-bedf-e5b57610f673 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Action: 'create', calling method: .version_select at 0x7fab044b1430>, body: {"keypair": {"name": "tempest-keypair-362270285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnTCKOFEB4KLNrftvP7VwcJ0aNZm3IihbONWTYbBMn5yIVyvHZNWi2kQIs8hEBeWwLn7t7IqKs+G8PsTmGNimjq7rzhVQebf48U+Egy9uJ16atThLqRibyxqv6le9nw9w=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:13.740491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-96a3411d-ea11-4b83-bedf-e5b57610f673 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Getting quotas for project 11ee26ae4bea4ceb9ba9ef71aa22bd08. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:13.758326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-96a3411d-ea11-4b83-bedf-e5b57610f673 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Getting quotas for user 4e0bd1dd8f574aa6a257048c25281683 and project 11ee26ae4bea4ceb9ba9ef71aa22bd08. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:13.833783 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96a3411d-ea11-4b83-bedf-e5b57610f673 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.749934 Jul 18 02:20:13.841598 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 901/1774] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:13.849986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:13.850571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:13.880473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:13.880473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:13.881195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:13.890269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:14.227510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:14.239825 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3cdb899a-a270-44a9-95e8-d5d720ec3c02 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.879389 Jul 18 02:20:14.253012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 874/1775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:12 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:14.306466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3a54115a-62dd-480b-9e4e-c06192555065 req-9fb7bf4b-c6ce-4028-99d1-de160da7c0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d533dac5-ebb4-4042-a8fd-5126a176f7f5", "name": "network-vif-deleted", "tag": "8da9ca78-2f84-4a70-93cd-3a21ba542fb8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:14.337695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3a54115a-62dd-480b-9e4e-c06192555065 req-9fb7bf4b-c6ce-4028-99d1-de160da7c0ca service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:14.338926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3a54115a-62dd-480b-9e4e-c06192555065 req-9fb7bf4b-c6ce-4028-99d1-de160da7c0ca service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:14.394192 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3a54115a-62dd-480b-9e4e-c06192555065 req-9fb7bf4b-c6ce-4028-99d1-de160da7c0ca service nova] Creating event network-vif-deleted:8da9ca78-2f84-4a70-93cd-3a21ba542fb8 for instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 on n-h1-849796-1 Jul 18 02:20:14.418893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3a54115a-62dd-480b-9e4e-c06192555065 req-9fb7bf4b-c6ce-4028-99d1-de160da7c0ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162750 Jul 18 02:20:14.433958 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 875/1776] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:14.465169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:14.474429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:14.504087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:14.505918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:14.515410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:14.517244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:14.841790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:14.859300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:14.860985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:14.862233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05eb0d21-20d8-497d-a6af-2d6135476811 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1293 microversion: 2.25 time: 1.019121 Jul 18 02:20:14.876365 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 902/1777] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:13 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1293 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:14.895359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-73d82b9a-7a2b-4e2e-874a-29effa1a1484 req-e3a68876-7c20-430e-89c0-fdc4ae12d9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca075-975f-46cb-876e-e7b99d627940", "name": "network-vif-plugged", "status": "completed", "tag": "866ba63d-f6a5-4950-a11c-4732fc33b586"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:14.920591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73d82b9a-7a2b-4e2e-874a-29effa1a1484 req-e3a68876-7c20-430e-89c0-fdc4ae12d9a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:14.921090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73d82b9a-7a2b-4e2e-874a-29effa1a1484 req-e3a68876-7c20-430e-89c0-fdc4ae12d9a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:14.954710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-73d82b9a-7a2b-4e2e-874a-29effa1a1484 req-e3a68876-7c20-430e-89c0-fdc4ae12d9a9 service nova] Creating event network-vif-plugged:866ba63d-f6a5-4950-a11c-4732fc33b586 for instance e5eca075-975f-46cb-876e-e7b99d627940 on n-h2-849796-1 Jul 18 02:20:14.969483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-73d82b9a-7a2b-4e2e-874a-29effa1a1484 req-e3a68876-7c20-430e-89c0-fdc4ae12d9a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091427 Jul 18 02:20:14.970491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 903/1778] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:14.984885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:14.985798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:15.004758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:15.005386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:15.006260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:15.006755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:15.572083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.990460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:16.000312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a5c51a2-c69e-449f-bda5-a914dbbf4e59 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1370 microversion: 2.1 time: 1.028445 Jul 18 02:20:16.008849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 904/1779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:14 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1370 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:16.019680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:16.020664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:16.039128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.039993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.041192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.041888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.063811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 HTTP/1.1 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd533dac5-ebb4-4042-a8fd-5126a176f7f5'} Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:16.065822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:16.070673 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:20:16.078892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:16.082439 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6a9faaa-8829-494e-ac02-ea8c9fc773fe tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 404 len: 111 microversion: 2.1 time: 0.071840 Jul 18 02:20:16.099220 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 905/1780] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:16 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:16.105097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:16.106149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:16.118685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.120497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.122486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.123357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.593248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:16.621459 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f98fec81-806e-411b-9261-e0661bf00183 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1461 microversion: 2.1 time: 2.171763 Jul 18 02:20:16.623529 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 876/1781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:14 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1461 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:16.630368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:16.631377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:16.672692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.673462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.674821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:16.675574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:16.727018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:17.319712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:17.341693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:17.351940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:17.361186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-644ee7c5-d2d7-4b15-8ac2-149e684d05ef tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1293 microversion: 2.25 time: 0.730508 Jul 18 02:20:17.376656 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 877/1782] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:16 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1293 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:17.393798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1652826706", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:17.434268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:17.472614 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7c50c5b-e8cb-4c10-a9ec-f7f7c7dd8231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.371373 Jul 18 02:20:17.474328 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 906/1783] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:16 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:17.552121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] validate_networks() for [('b1c06da5-9949-4076-be04-78c7c3500dff', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:20:17.981309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:17.987956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:18.024502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.038935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.041312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.045438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.808558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe97a8c7-1db6-4c16-87fc-edd8d4c77fe1 tempest-MigrationsAdminTest-1265821999 tempest-MigrationsAdminTest-1265821999-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1612 microversion: 2.1 time: 1.332175 Jul 18 02:20:18.817103 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 907/1784] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:17 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1612 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:18.858037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}, {"server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:18.878693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:18.893706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:18.935586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] Creating event network-changed:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h1-849796-1 Jul 18 02:20:18.937212 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] Creating event network-vif-unplugged:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:20:18.956554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-aff52226-8ca1-45a9-9c7b-1c94b8d333b9 req-0290c991-77ee-4982-85c9-95a89d7d24e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.136585 Jul 18 02:20:18.959861 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 908/1785] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:18.977786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:18.978978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:19.000458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.001358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.002588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.003280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.850429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:20:19.851021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:20:19.851350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:20:19.851766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:20:19.852184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:20:19.872636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.873161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.874692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:19.875139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:19.908433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:19.914813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Getting quotas for user 0f2de3928dac470c90a709b3da9c95f0 and project 01891a23b968415c9c86225a210fe256. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:19.931021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:20:19.934095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:20:19.967579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:19.984462 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cb630cb-3b00-4c98-bc6f-309ceb54ff3b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1555 microversion: 2.1 time: 1.022929 Jul 18 02:20:19.985709 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 909/1786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:18 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1555 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:19.994785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a94ad760-cbf4-4fab-9761-a2e229dabc9b req-e63603e9-be94-4b07-b7a1-8425fe97b68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-plugged", "status": "completed", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:20.019176 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95cc74f0-7b1b-4e00-b49f-1cfd6cd36d42 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.640917 Jul 18 02:20:20.024418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a94ad760-cbf4-4fab-9761-a2e229dabc9b req-e63603e9-be94-4b07-b7a1-8425fe97b68d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.025907 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 878/1787] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:20:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:20:20.026669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a94ad760-cbf4-4fab-9761-a2e229dabc9b req-e63603e9-be94-4b07-b7a1-8425fe97b68d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.047012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.047652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:20.074282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.074764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.076222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.076687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.093048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a94ad760-cbf4-4fab-9761-a2e229dabc9b req-e63603e9-be94-4b07-b7a1-8425fe97b68d service nova] Creating event network-vif-plugged:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:20:20.119146 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a94ad760-cbf4-4fab-9761-a2e229dabc9b req-e63603e9-be94-4b07-b7a1-8425fe97b68d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131427 Jul 18 02:20:20.129072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 910/1788] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:20.155195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.157067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:20.165726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:20.195093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.199394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.210136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.214890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.366063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.376375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.378020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.387092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45bca5fc-0ee9-4e5b-8fde-01cfb154cd72 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1293 microversion: 2.25 time: 0.352299 Jul 18 02:20:20.388106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 879/1789] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1293 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:20.410881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.411768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:20.423454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.428412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.429622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.432834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.471246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:20.627393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e4f3e1e-c960-4a46-a6a9-f3f63d2e92b0 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 204 len: 0 microversion: 2.1 time: 0.224962 Jul 18 02:20:20.628813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 880/1790] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:20 2022] DELETE /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:20.851832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:20.865151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57f944d9-8125-4b08-a912-c506a505dc72 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.733395 Jul 18 02:20:20.874780 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 911/1791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:20.894194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:20.897648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:20.922474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.927938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.929241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:20.931432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:20.989322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06270c9b-4f01-45b5-9fdc-3244e48017b3 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab055c8b80>, body: {"keypair": {"name": "tempest-keypair-892908501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKu9FxJnYpKbmVjxygBhgNtjr9Evb0xcLF+v0s1/V3stvEJAo99ASRBHn5yxpAxRo5MWTQN9vnwwSxCC2dXpQisKt/1VJLFIRwGk0hvoRnfSV5V9RabimEwZ4Z5CML8XdA=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:21.039387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-06270c9b-4f01-45b5-9fdc-3244e48017b3 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:21.058474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-06270c9b-4f01-45b5-9fdc-3244e48017b3 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:21.118820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06270c9b-4f01-45b5-9fdc-3244e48017b3 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.488130 Jul 18 02:20:21.119805 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 881/1792] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.130216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.132362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:21.146487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.149201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.150270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.151422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.186549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9cf2c1ef-5547-42a1-ae59-09aa49bbd3e5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308143 Jul 18 02:20:21.190198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 912/1793] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:20:20 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-interface => generated 284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.208043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.215205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:21.243498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.244797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.252139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.253460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.317490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:21.342752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f9a18d6-aa71-4f4d-b0f8-24f2068dc184 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1229 microversion: 2.1 time: 0.221642 Jul 18 02:20:21.343955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 882/1794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1229 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:21.360969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4aae0b5c-f0da-4849-8616-6c62ca90a5ff tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab0595f700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.380301 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4aae0b5c-f0da-4849-8616-6c62ca90a5ff tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-892908501" status: 200 len: 497 microversion: 2.1 time: 0.034966 Jul 18 02:20:21.381272 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 883/1795] 10.222.0.67 () {58 vars in 1214 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-892908501 => generated 497 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.386703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-97aa319b-9395-419e-9225-9e590622f0c7 req-3b67a128-171d-42e7-87a6-7ef9f1a794bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:21.397387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-97aa319b-9395-419e-9225-9e590622f0c7 req-3b67a128-171d-42e7-87a6-7ef9f1a794bd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.398165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-97aa319b-9395-419e-9225-9e590622f0c7 req-3b67a128-171d-42e7-87a6-7ef9f1a794bd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.413991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-97aa319b-9395-419e-9225-9e590622f0c7 req-3b67a128-171d-42e7-87a6-7ef9f1a794bd service nova] Creating event network-changed:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:20:21.423745 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-97aa319b-9395-419e-9225-9e590622f0c7 req-3b67a128-171d-42e7-87a6-7ef9f1a794bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040026 Jul 18 02:20:21.425714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 884/1796] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:21.446457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-812f394e-b661-4f81-8a07-aaeef869c127 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab05bb8d30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.489918 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-812f394e-b661-4f81-8a07-aaeef869c127 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892908501" status: 202 len: 0 microversion: 2.1 time: 0.056823 Jul 18 02:20:21.490897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 885/1797] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892908501 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:21.502947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:21.505038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:21.526353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.540119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:21.540119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:21.540119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.006866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:22.021557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:22.023712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:22.029994 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d6f6937f-c020-4498-ade7-968dc60ee3fa tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1293 microversion: 2.25 time: 0.537612 Jul 18 02:20:22.038222 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 886/1798] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1293 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:22.048763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54fe0aae-9673-48dd-ab38-5e56df090bdd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab0595fca0>, body: {"keypair": {"name": "tempest-keypair-641347698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQCLw/A9CWXJCHtkgHJjPZGxrRqsqt+vrc7vhpLhyYimQJF7YVD3RprDhISZpDfKJsqLbUh2BeGhrT/i8QRXBEJ65Gbr3nufTTXqYbuWShDyC1kiJBEcOpGY5uZPlET8g=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:22.105246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-54fe0aae-9673-48dd-ab38-5e56df090bdd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:22.124907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-54fe0aae-9673-48dd-ab38-5e56df090bdd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:22.213655 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-54fe0aae-9673-48dd-ab38-5e56df090bdd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173296 Jul 18 02:20:22.215149 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 887/1799] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:22.248381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:22.249542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:22.294954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.295827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.296818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.297738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.689719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:22.700731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adf1e32e-7323-4be2-9cec-81df5fe3e9ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.476258 Jul 18 02:20:22.720151 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 888/1800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:22 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:22.726083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9c8aef0-d98a-4386-80da-9440ef915c28 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab055283a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:22.767001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9c8aef0-d98a-4386-80da-9440ef915c28 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641347698" status: 202 len: 0 microversion: 2.1 time: 0.045145 Jul 18 02:20:22.768406 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 889/1801] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:20:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641347698 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:22.782985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:22.783829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:22.806896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.807358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.811750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:22.813771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:22.978432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:23.010292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f23130b3-5dbe-44ed-b664-6302345a0378 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1277 microversion: 2.1 time: 0.229226 Jul 18 02:20:23.011003 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 890/1802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:22 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:23.034095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f8bf6b7-6f0c-4845-8341-1d45aa047bc6 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab0595f430>, body: {"keypair": {"name": "tempest-keypair-1224313755", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:23.074865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4f8bf6b7-6f0c-4845-8341-1d45aa047bc6 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:23.080153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.103030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4f8bf6b7-6f0c-4845-8341-1d45aa047bc6 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:23.162576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:23.194243 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2b87449-e8d7-40be-bd8f-b3d47e0a7547 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1467 microversion: 2.1 time: 2.002053 Jul 18 02:20:23.199313 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 913/1803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:21 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1467 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:23.213566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f8bf6b7-6f0c-4845-8341-1d45aa047bc6 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.201314 Jul 18 02:20:23.225072 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 891/1804] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:23 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:23.250178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2dd95d9b-9160-4d5f-8a6d-2e7dcc7c1d84 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab0556c430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:23.268292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:23.269999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:23.306234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:23.307968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:23.308883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:23.310271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:23.350189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2dd95d9b-9160-4d5f-8a6d-2e7dcc7c1d84 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224313755" status: 202 len: 0 microversion: 2.1 time: 0.121700 Jul 18 02:20:23.351329 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 892/1805] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224313755 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:23.380588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3556ec0f-6f8b-4d16-889b-c86cd08d2b2a tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab05db6af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1823317001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiQh2KHu6KA5OJHSRCHBqhcVH1aN3Gvlachn67qLFHOCe9j+1WjizhLraJr+NT0bbLFux8yYtpHWwJqDJGpjjyNxoPq3algvRHrW7Zlh1bBEoV0d62hLMNHbLdcB+mWUg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:23.417188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.441404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3556ec0f-6f8b-4d16-889b-c86cd08d2b2a tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:23.456570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3556ec0f-6f8b-4d16-889b-c86cd08d2b2a tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:23.519658 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3556ec0f-6f8b-4d16-889b-c86cd08d2b2a tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.154879 Jul 18 02:20:23.520752 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 893/1806] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:23.567711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b4d2d2e-af90-49d6-85f9-b9987bdd24dd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab05bdcf70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1357449702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgUzWfF6nCRCk2FCoca9iYZSuhcwuR3JtywZUZRqoiCUDgmBpMvJP7zdhn46zzaoyp/rGbmUqelHGf2CEgmYr/s86xS1LWK/vkW0T1b6U+78Zn7hIW6gz2xT54vGUrb7g=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:23.661049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2b4d2d2e-af90-49d6-85f9-b9987bdd24dd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:23.710933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2b4d2d2e-af90-49d6-85f9-b9987bdd24dd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:23.782573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.863601 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b4d2d2e-af90-49d6-85f9-b9987bdd24dd tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.317856 Jul 18 02:20:23.864966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 894/1807] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:23.885329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:23.886014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:23.912469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:23.923826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:23.927555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:23.932105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:24.569457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:24.588429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:24.592593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:24.595847 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-614b115b-d422-4cac-8d2d-938867639a5a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1293 microversion: 2.25 time: 1.377520 Jul 18 02:20:24.609609 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 914/1808] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:23 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1293 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:24.617257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66b829ff-466a-44a0-a79d-8880668b9aee tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Action: 'create', calling method: .version_select at 0x7fab044b11f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-364375926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd5AxpSzyOkzohsF7to72wXaTY2DFNSFmZdIdYDNAH1RNgFgv6T7tvcT2Ma2KDwjMGezGHDu09eY07JESq6LMcnQ4DLJ4MFejeksfJax0C68wBPGR1716Ql3TEQURRDLQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:24.658902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-66b829ff-466a-44a0-a79d-8880668b9aee tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:24.668240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-66b829ff-466a-44a0-a79d-8880668b9aee tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Getting quotas for user 718e114ec2fc49c0bf1a2247a31557fe and project 9a5ae43f7b41497cb071f4a856c33741. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:24.714712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66b829ff-466a-44a0-a79d-8880668b9aee tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.113014 Jul 18 02:20:24.718110 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 915/1809] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:20:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:24.719569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:24.745845 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05dd00d8-0f24-4d48-bcba-40d16cc8ec3d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.870939 Jul 18 02:20:24.749643 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 895/1810] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:23 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:24.750970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "73433859-b9be-46b4-996b-736de3d7d027"}], "security_groups": [{"name": "tempest-securitygroup--108548795"}], "key_name": "tempest-keypair-362270285", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:24.769835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:24.773368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:24.803776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:24.804722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:24.818922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:24.819984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:24.999680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:25.027456 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1174350-7392-4dfc-bd44-2c5bcb8d6dca tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1283 microversion: 2.1 time: 0.275769 Jul 18 02:20:25.040966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 896/1811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:24 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:25.041475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:25.043247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:25.063005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.064713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:25.066614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.068358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:25.112794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] validate_networks() for [('73433859-b9be-46b4-996b-736de3d7d027', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:20:25.542525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:25.565347 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e43aff9-21e0-4e04-b536-2671fc99762f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 200 len: 1467 microversion: 2.1 time: 0.533645 Jul 18 02:20:25.591963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 897/1812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:25 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 1467 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:25.627583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a68ec06a-4bb3-40b3-aa44-db4086d84b66 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab0a7950d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:25.635657 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-a68ec06a-4bb3-40b3-aa44-db4086d84b66 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:20:25.658406 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a68ec06a-4bb3-40b3-aa44-db4086d84b66 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.064699 Jul 18 02:20:25.666788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 898/1813] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:20:25 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:25.680246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:25.684005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:25.708712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.712336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:25.714157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:25.715409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:26.430151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:26.454773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:26.456472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:26.466757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6be1ce1a-4cd9-4289-bdd1-a08f4ea2f0ca tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.787425 Jul 18 02:20:26.468538 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 899/1814] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:25 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:26.493109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c97c5122-c052-4189-a599-66636f470411 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab0a795af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:26.558489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c97c5122-c052-4189-a599-66636f470411 tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-364375926" status: 202 len: 0 microversion: 2.1 time: 0.085694 Jul 18 02:20:26.559233 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 900/1815] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-364375926 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:26.566021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:26.567688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:26.577771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.578846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:26.580730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:26.581877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.231346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:27.294047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-862a8b92-7da0-4ef4-9d58-2a088931e16f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.731991 Jul 18 02:20:27.310838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 901/1816] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:26 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:27.351809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:27.360540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:27.395938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.396772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.410105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.420120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.849377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:27.863064 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d513f7f9-43bb-4f4a-8057-5bc1d5198d0e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.544175 Jul 18 02:20:27.873604 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 902/1817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:27 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:27.896233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-46b89d5d-7f4f-41d6-a554-54549eb92581 req-9fe668d2-a7de-4ef1-b575-c54ed32e5a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70a04c1-2b98-4fb7-8f51-e99e58c6e1da", "name": "network-vif-deleted", "tag": "400274ff-bc14-4e8f-b2e0-f5d4364b5bb3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:27.921612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-46b89d5d-7f4f-41d6-a554-54549eb92581 req-9fe668d2-a7de-4ef1-b575-c54ed32e5a4e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:27.928688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-46b89d5d-7f4f-41d6-a554-54549eb92581 req-9fe668d2-a7de-4ef1-b575-c54ed32e5a4e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:27.975633 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-46b89d5d-7f4f-41d6-a554-54549eb92581 req-9fe668d2-a7de-4ef1-b575-c54ed32e5a4e service nova] Creating event network-vif-deleted:400274ff-bc14-4e8f-b2e0-f5d4364b5bb3 for instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da on n-h2-849796-1 Jul 18 02:20:27.994442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-46b89d5d-7f4f-41d6-a554-54549eb92581 req-9fe668d2-a7de-4ef1-b575-c54ed32e5a4e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118727 Jul 18 02:20:27.997366 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 903/1818] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:28.016080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-faff24a3-7dae-4e06-ac66-8d8deb1021dc tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab0556cdc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.091552 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-faff24a3-7dae-4e06-ac66-8d8deb1021dc tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1357449702" status: 202 len: 0 microversion: 2.1 time: 0.090979 Jul 18 02:20:28.092857 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 904/1819] 10.222.0.67 () {58 vars in 1277 bytes} [Mon Jul 18 02:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1357449702 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:28.103877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.107880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:20:28.107880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:20:28.110107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:20:28.110975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:20:28.111975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:20:28.112948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: a70a04c1-2b98-4fb7-8f51-e99e58c6e1da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:28.131891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.132351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.136903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.137610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.163512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.164968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.166920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.172327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.193578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] HTTP exception thrown: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Request method failure captured: Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da HTTP/1.1 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHo2nLZi2biQXE2zjdK55vZSjG3KYwSdULq-WhPWDuB2n-ZPyusoFNT9Z2GVpVHgGdOzi5VOe8l_j_mz5nSa64QUaan7sdumAVJUMrZZ8zQB2DwRdP5-BioMpYmb7zk8rAzpIWXwsybkcrONPgTZtRI1D-2VSw7T3gd1CTr0Wr8O5M Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a814973df884fc6972477bf52853e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a814973df884fc6972477bf52853e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 4c85ff74393d48febcae3bd1c49d3887 Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'a70a04c1-2b98-4fb7-8f51-e99e58c6e1da'} Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:28.198490 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Returning 404 to user: Instance a70a04c1-2b98-4fb7-8f51-e99e58c6e1da could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75501ea9-40d5-4279-9de1-d7829ec7452f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da" status: 404 len: 111 microversion: 2.1 time: 0.106570 Jul 18 02:20:28.215143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 905/1820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:28 2022] GET /compute/v2.1/servers/a70a04c1-2b98-4fb7-8f51-e99e58c6e1da => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:28.220800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.226620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:28.258228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.281302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Getting quotas for project 11ee26ae4bea4ceb9ba9ef71aa22bd08. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:20:28.292948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.294664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.295232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.328205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Getting quotas for user 4e0bd1dd8f574aa6a257048c25281683 and project 11ee26ae4bea4ceb9ba9ef71aa22bd08. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:20:28.420158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:20:28.451612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:20:28.753173 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a053a55a-0f8b-4297-9389-33bc8c2905d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.029121 Jul 18 02:20:28.762201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 916/1821] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:20:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 4035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:20:28.767601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ceb3083-080d-404d-befa-9fca29562cbc tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] Calling method '.version_select at 0x7fab044b13a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.818603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ceb3083-080d-404d-befa-9fca29562cbc tempest-KeyPairsV2TestJSON-1677747632 tempest-KeyPairsV2TestJSON-1677747632-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1823317001" status: 202 len: 0 microversion: 2.1 time: 0.062920 Jul 18 02:20:28.819216 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 917/1822] 10.222.0.67 () {58 vars in 1277 bytes} [Mon Jul 18 02:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1823317001 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:28.839354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:28.841422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:28.878404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.882108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:28.889063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:28.892302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.150314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.151265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:29.165560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.173956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.175698 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f8397ae-7f08-4f7d-8c3c-a313176a6035 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.965579 Jul 18 02:20:29.192419 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 906/1823] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:28 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:29.197971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:29.207735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:29.226070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.226937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.230971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.232207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.310952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:29.741717 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-235fbb0b-eb8c-43bd-a8d0-554643bdb84b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "DELETE /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 204 len: 0 microversion: 2.1 time: 0.916393 Jul 18 02:20:29.749075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 918/1824] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:28 2022] DELETE /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:29.800642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0db051ce-8e23-43ce-966b-7fbab9c169c1 req-26775ae7-6f1c-49ae-b5e0-71c42a61d0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510ed705-9bc6-40a8-9cd3-070b6f849456", "tag": "8728281f-3e2f-4d1e-a6b9-76cfdc880381"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:29.814423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:29.862242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76213606-086b-4a78-9d29-bfbbf38084cb tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.667807 Jul 18 02:20:29.875762 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 907/1825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:29 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:29.885945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0db051ce-8e23-43ce-966b-7fbab9c169c1 req-26775ae7-6f1c-49ae-b5e0-71c42a61d0d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:29.890111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0db051ce-8e23-43ce-966b-7fbab9c169c1 req-26775ae7-6f1c-49ae-b5e0-71c42a61d0d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:29.892083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c0e957a-6e60-4441-962e-651d7a76cae4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:29.895034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c0e957a-6e60-4441-962e-651d7a76cae4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:29.907860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:29.959731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0db051ce-8e23-43ce-966b-7fbab9c169c1 req-26775ae7-6f1c-49ae-b5e0-71c42a61d0d5 service nova] Creating event network-changed:8728281f-3e2f-4d1e-a6b9-76cfdc880381 for instance 510ed705-9bc6-40a8-9cd3-070b6f849456 on n-h2-849796-1 Jul 18 02:20:29.984821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0db051ce-8e23-43ce-966b-7fbab9c169c1 req-26775ae7-6f1c-49ae-b5e0-71c42a61d0d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231908 Jul 18 02:20:29.987140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 919/1826] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:30.001319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.003530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.033124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.034783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.037624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.040387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.260114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c0e957a-6e60-4441-962e-651d7a76cae4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.288170 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c0e957a-6e60-4441-962e-651d7a76cae4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1225 microversion: 2.1 time: 0.408204 Jul 18 02:20:30.289713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 908/1827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:29 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1225 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:30.308594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.310895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.381930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.383236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.393726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.394620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.668454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.698618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfb9ea5c-ad97-4843-8aef-acc3bd16d31d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.708646 Jul 18 02:20:30.706720 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 920/1828] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:29 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:30.746654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fc6ff35f-5504-455f-bfed-0331aea482d3 req-beba1e05-8f60-496e-b07b-9b168fc8ccc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eca075-975f-46cb-876e-e7b99d627940", "tag": "866ba63d-f6a5-4950-a11c-4732fc33b586"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:30.777009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fc6ff35f-5504-455f-bfed-0331aea482d3 req-beba1e05-8f60-496e-b07b-9b168fc8ccc7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.787251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fc6ff35f-5504-455f-bfed-0331aea482d3 req-beba1e05-8f60-496e-b07b-9b168fc8ccc7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.808614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:30.820991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4d00783-fd68-4961-915e-fecd4872a353 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1535 microversion: 2.1 time: 0.529692 Jul 18 02:20:30.821612 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 909/1829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1535 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:30.837279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:30.837931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:30.855501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.856653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.858388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.859057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:30.861155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fc6ff35f-5504-455f-bfed-0331aea482d3 req-beba1e05-8f60-496e-b07b-9b168fc8ccc7 service nova] Creating event network-changed:866ba63d-f6a5-4950-a11c-4732fc33b586 for instance e5eca075-975f-46cb-876e-e7b99d627940 on n-h2-849796-1 Jul 18 02:20:30.872111 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fc6ff35f-5504-455f-bfed-0331aea482d3 req-beba1e05-8f60-496e-b07b-9b168fc8ccc7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161372 Jul 18 02:20:30.877713 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 921/1830] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:30.910837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c9dcdce1-b6b9-4a7b-b4f4-e5603208b808 req-8742e0ed-4d56-4c1b-9cb9-91880b30c718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:30.946154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c9dcdce1-b6b9-4a7b-b4f4-e5603208b808 req-8742e0ed-4d56-4c1b-9cb9-91880b30c718 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:30.947269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c9dcdce1-b6b9-4a7b-b4f4-e5603208b808 req-8742e0ed-4d56-4c1b-9cb9-91880b30c718 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:31.010210 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c9dcdce1-b6b9-4a7b-b4f4-e5603208b808 req-8742e0ed-4d56-4c1b-9cb9-91880b30c718 service nova] Creating event network-vif-unplugged:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h1-849796-1 Jul 18 02:20:31.038951 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c9dcdce1-b6b9-4a7b-b4f4-e5603208b808 req-8742e0ed-4d56-4c1b-9cb9-91880b30c718 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156112 Jul 18 02:20:31.045935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 922/1831] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:31.068742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:31.069669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:31.086367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:31.088973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:31.094224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:31.095118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.039303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.105605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.115581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.125696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.133102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b73d395-412f-438b-9d6d-f58f36dbbc70 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.084501 Jul 18 02:20:32.135424 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 923/1832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:31 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:32.137502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73ba5b2d-01f7-43ef-84ba-434cb76f25be tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 1.311060 Jul 18 02:20:32.141561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:32.142530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:32.149702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.150446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.151433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.153267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.173029 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 910/1833] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:30 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:32.217800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:32.225625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:32.271020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.278428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.284044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.286362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.568438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.588869 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e4cdf8c9-44b2-4f78-8f79-ff6f72634deb tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1277 microversion: 2.1 time: 0.449815 Jul 18 02:20:32.596890 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 924/1834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:32 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:32.613191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:32.615616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:32.638694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.639559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.640658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:32.642308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:32.876175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:32.899348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b181d87-b2c8-484d-adb6-fe79acfe867d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1493 microversion: 2.1 time: 0.300795 Jul 18 02:20:32.915689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 925/1835] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:32 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1493 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:33.162525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:33.163532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:33.186357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:33.187035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:33.190385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:33.191643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:33.585235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:33.625552 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e592876-4daf-4fc2-bc43-888e7cd28108 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 1.446581 Jul 18 02:20:33.627118 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 911/1836] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:32 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:33.661563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:33.666410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:33.694049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:33.698924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:33.708582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:33.710718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:33.936718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:33.961356 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c163c61-c7ad-4df5-b85c-98787e244fa1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.803953 Jul 18 02:20:33.976265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 926/1837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:33 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:33.994386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d0d47750-6493-4074-8eea-1ad256affaf6 req-fecca9b2-beb9-4d86-91b0-059f9afdd725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbdd3f-204c-4c1a-842d-69e9027f6f72", "name": "network-vif-deleted", "tag": "a9094cf0-202f-4f65-a1c6-be3d604230b3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:34.021912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d0d47750-6493-4074-8eea-1ad256affaf6 req-fecca9b2-beb9-4d86-91b0-059f9afdd725 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.027524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d0d47750-6493-4074-8eea-1ad256affaf6 req-fecca9b2-beb9-4d86-91b0-059f9afdd725 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.069545 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d0d47750-6493-4074-8eea-1ad256affaf6 req-fecca9b2-beb9-4d86-91b0-059f9afdd725 service nova] Creating event network-vif-deleted:a9094cf0-202f-4f65-a1c6-be3d604230b3 for instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 on n-h2-849796-1 Jul 18 02:20:34.100161 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d0d47750-6493-4074-8eea-1ad256affaf6 req-fecca9b2-beb9-4d86-91b0-059f9afdd725 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120660 Jul 18 02:20:34.102050 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 927/1838] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:34.113807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:34.115515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:34.125670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.126557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.127657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.129160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.228987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:34.241887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:34.266787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:34.274643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-33b3c303-d1df-4c73-bc3a-1c9c4bc9336a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.643414 Jul 18 02:20:34.279047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 912/1839] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:33 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:34.287407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:34.299151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:34.312859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.315131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.317566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.318929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.365063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:34.415613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4798b5ec-dac7-4b8c-b4b5-3347142c9943 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1283 microversion: 2.1 time: 0.311725 Jul 18 02:20:34.429027 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 928/1840] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:34 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1283 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:34.656877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:34.658055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:34.690949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.691727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.717353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:34.719201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:34.724312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:34.739851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61650137-2dfb-46eb-be38-27e39417f523 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 200 len: 1364 microversion: 2.1 time: 0.459384 Jul 18 02:20:34.740502 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 913/1841] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:34 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:35.000673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:35.002396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:35.013405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.013878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.014734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.015204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.423955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:35.439464 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-389c752e-bf59-4e38-9514-c5dc2ff82a58 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.791698 Jul 18 02:20:35.454920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 929/1842] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:34 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:35.473541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:35.474177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:35.490437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.491305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:35.492150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:35.492802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.114528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.131205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.134220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.136561 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5c048ed-4755-4e6a-bd3a-95924ae7c3f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.680374 Jul 18 02:20:36.147943 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 930/1843] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:35 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:36.164219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.165741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:36.183827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.186870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.190052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.191376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.338824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.359995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a08b5d6-6750-4197-b1ad-f1f087db33ae tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 1.371683 Jul 18 02:20:36.365882 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 914/1844] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:34 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:36.399839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.406730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 87dbdd3f-204c-4c1a-842d-69e9027f6f72] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:36.439111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.439967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.441336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.442103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.482615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] HTTP exception thrown: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Request method failure captured: Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 HTTP/1.1 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHo2nLZi2biQXE2zjdK55vZSjG3KYwSdULq-WhPWDuB2n-ZPyusoFNT9Z2GVpVHgGdOzi5VOe8l_j_mz5nSa64QUaan7sdumAVJUMrZZ8zQB2DwRdP5-BioMpYmb7zk8rAzpIWXwsybkcrONPgTZtRI1D-2VSw7T3gd1CTr0Wr8O5M Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a814973df884fc6972477bf52853e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a814973df884fc6972477bf52853e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 4c85ff74393d48febcae3bd1c49d3887 Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '87dbdd3f-204c-4c1a-842d-69e9027f6f72'} Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:36.486013 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. Jul 18 02:20:36.496323 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:36.501863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Returning 404 to user: Instance 87dbdd3f-204c-4c1a-842d-69e9027f6f72 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:36.503895 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adfe15b5-153f-4fc5-bf5f-d5110d88d860 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72" status: 404 len: 111 microversion: 2.1 time: 0.136147 Jul 18 02:20:36.515843 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 915/1845] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:36 2022] GET /compute/v2.1/servers/87dbdd3f-204c-4c1a-842d-69e9027f6f72 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:36.536893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.539474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:36.554816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.556428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.559225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:36.561558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:36.760853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:36.799733 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ff29be5-63be-4240-bf54-2b191ead1fb8 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.643399 Jul 18 02:20:36.801808 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 931/1846] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:36 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:36.821596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8df69c03-f6f1-42fe-afa7-7f2aeb4a4e08 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '.version_select at 0x7fab04494e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:36.889791 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8df69c03-f6f1-42fe-afa7-7f2aeb4a4e08 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-348400281" status: 202 len: 0 microversion: 2.1 time: 0.084463 Jul 18 02:20:36.894053 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 932/1847] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-348400281 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:37.176606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.179689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.209772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.211085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.218440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.219754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.626735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.652604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.660789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.663052 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5af887cc-3e5b-4480-9833-a5066339cee5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.499919 Jul 18 02:20:37.665367 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 933/1848] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:37 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:37.671315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.672527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.686261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.687130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.688217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.688958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.770760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:37.793189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eddf4e81-48f0-44e0-8a7d-14974786be35 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 1.264288 Jul 18 02:20:37.794251 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 916/1849] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:36 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:37.823226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:37.823854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:37.831185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.831637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:37.832650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:37.833303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.232712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:38.327529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.350496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-850d5058-8229-4b65-87cc-712884d52fe1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.682301 Jul 18 02:20:38.352517 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 934/1850] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:37 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:38.529346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:38.547956 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-691bae53-2654-4895-8e53-9156a0b4cbb3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.728537 Jul 18 02:20:38.569946 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 917/1851] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:37 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:38.706073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:38.706709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:38.717721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:38.720768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.721272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.722114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.722572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.829602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:38.830961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:38.838888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.839635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:38.842215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:38.843464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.386695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:39.403241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:39.406025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ecadc63c-8b5f-4617-b6af-1c642b1ebd44 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.581644 Jul 18 02:20:39.409619 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 918/1852] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:38 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:39.411979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:39.437972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fad99cba-3ef4-44ec-a216-6c6d148e5217 req-5274413a-2d79-48d3-8846-c0ba776e3545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c793a11-e110-416b-9617-a70fca7d2bfa", "tag": "d0f42aee-47ae-4c56-a1ac-52a7afaa2525"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:39.447025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:39.457380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:39.459788 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35653687-eede-4599-a807-e3d2f17ea2b6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.757546 Jul 18 02:20:39.464323 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 935/1853] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:38 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:39.465826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fad99cba-3ef4-44ec-a216-6c6d148e5217 req-5274413a-2d79-48d3-8846-c0ba776e3545 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.466577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fad99cba-3ef4-44ec-a216-6c6d148e5217 req-5274413a-2d79-48d3-8846-c0ba776e3545 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.478310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:39.479484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:39.492223 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fad99cba-3ef4-44ec-a216-6c6d148e5217 req-5274413a-2d79-48d3-8846-c0ba776e3545 service nova] Creating event network-changed:d0f42aee-47ae-4c56-a1ac-52a7afaa2525 for instance 5c793a11-e110-416b-9617-a70fca7d2bfa on n-h1-849796-1 Jul 18 02:20:39.499709 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fad99cba-3ef4-44ec-a216-6c6d148e5217 req-5274413a-2d79-48d3-8846-c0ba776e3545 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088157 Jul 18 02:20:39.500590 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 919/1854] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:39.516153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.517027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.527156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.528622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.589025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:39.589807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:39.615703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.631105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:39.632838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:39.633815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.090090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.099077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-80496006-d12d-4b51-9e61-17f81028e1af tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.517469 Jul 18 02:20:40.109687 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 920/1855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:39 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:40.115286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-896b49a5-6ce6-424a-96fa-354e72f6a2dc req-498eaa09-039b-4d97-923c-7a80c680050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "name": "network-vif-plugged", "status": "completed", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:40.132185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-896b49a5-6ce6-424a-96fa-354e72f6a2dc req-498eaa09-039b-4d97-923c-7a80c680050d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.133160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-896b49a5-6ce6-424a-96fa-354e72f6a2dc req-498eaa09-039b-4d97-923c-7a80c680050d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.162402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-896b49a5-6ce6-424a-96fa-354e72f6a2dc req-498eaa09-039b-4d97-923c-7a80c680050d service nova] Creating event network-vif-plugged:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h1-849796-1 Jul 18 02:20:40.175744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-896b49a5-6ce6-424a-96fa-354e72f6a2dc req-498eaa09-039b-4d97-923c-7a80c680050d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056627 Jul 18 02:20:40.175744 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 921/1856] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:40.265598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.291625 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d51c777a-12c1-427e-83a1-2c2bc2da241f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1718 microversion: 2.1 time: 0.819093 Jul 18 02:20:40.303604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 936/1857] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:39 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1718 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:40.422633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:40.428659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.429514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.439466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.440218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.441453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.442087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.469566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.470850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.491252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.494314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.496483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.497740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.541200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:40.690751 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-588928b4-f8e2-4fd2-8239-d012e392ac93 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 204 len: 0 microversion: 2.1 time: 0.228528 Jul 18 02:20:40.693809 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 937/1858] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:40 2022] DELETE /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:40.710981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.711732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.727348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.728829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.732135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.734139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.767040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:40.796055 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fc1a1e7-36fb-4c77-a7fe-51b98165405c tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.373664 Jul 18 02:20:40.797608 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 922/1859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:40 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:40.822579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:40.831590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:40.848713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.849869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:40.852880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:40.854118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.105747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.124297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2598fb85-b1bd-4b2a-8c67-4f5d8fbe7d5b tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1467 microversion: 2.1 time: 0.315618 Jul 18 02:20:41.126764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 923/1860] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:40 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:41.132013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.133417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.135589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:41.149332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.155069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.157447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.158200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.233645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.248849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.251902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.253169 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f804a28-cfff-401a-be24-77c746540c7f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.554717 Jul 18 02:20:41.253879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 938/1861] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:40 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:41.323702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.324677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.336587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.337252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.338091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.338539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.385976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.413880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aca38d71-c9ef-43a8-b343-f7ce359a3b13 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.285276 Jul 18 02:20:41.417362 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 924/1862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:41.664146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:41.677409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e364eee-9337-467e-ba6f-396992e5aa46 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1708 microversion: 2.1 time: 0.357249 Jul 18 02:20:41.679030 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 939/1863] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1708 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:41.709587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb8f246b-0bd8-493b-9a9c-160d468776e5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '.version_select at 0x7fab05dc51f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.714914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb8f246b-0bd8-493b-9a9c-160d468776e5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.716411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb8f246b-0bd8-493b-9a9c-160d468776e5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.741780 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb8f246b-0bd8-493b-9a9c-160d468776e5 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3105 microversion: 2.1 time: 0.038089 Jul 18 02:20:41.743848 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 925/1864] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/os-migrations => generated 3105 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:20:41.769703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.772123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.789369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:41.798876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.800016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.801767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.802775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.828584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:41.832185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:41.875969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.877404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:41.879099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:41.880127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.218255 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-468bdbad-0661-403b-8849-fab3a89ed8fa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1859 microversion: 2.1 time: 0.457503 Jul 18 02:20:42.220073 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 940/1865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1859 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.240406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.242070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:42.266093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.268029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.275899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.278757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.390036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:42.416438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5754da5-dcef-4a78-be96-d53fd3658245 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.604067 Jul 18 02:20:42.427978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 926/1866] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:41 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.444352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-62b01c7b-fbf5-4541-b376-723c23a60e5a req-a6200e3a-97e0-4a7c-a09d-a5886d4a84c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510ed705-9bc6-40a8-9cd3-070b6f849456", "name": "network-vif-plugged", "status": "completed", "tag": "8728281f-3e2f-4d1e-a6b9-76cfdc880381"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:42.494215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62b01c7b-fbf5-4541-b376-723c23a60e5a req-a6200e3a-97e0-4a7c-a09d-a5886d4a84c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.494215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62b01c7b-fbf5-4541-b376-723c23a60e5a req-a6200e3a-97e0-4a7c-a09d-a5886d4a84c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.520313 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-62b01c7b-fbf5-4541-b376-723c23a60e5a req-a6200e3a-97e0-4a7c-a09d-a5886d4a84c5 service nova] Creating event network-vif-plugged:8728281f-3e2f-4d1e-a6b9-76cfdc880381 for instance 510ed705-9bc6-40a8-9cd3-070b6f849456 on n-h2-849796-1 Jul 18 02:20:42.532001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-62b01c7b-fbf5-4541-b376-723c23a60e5a req-a6200e3a-97e0-4a7c-a09d-a5886d4a84c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100100 Jul 18 02:20:42.533828 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 927/1867] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:42.545344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.546685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:42.569234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.570074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.571691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.572493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.584966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:42.911562 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba7ad47c-87e4-495b-b2f1-6672e73572a6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1859 microversion: 2.1 time: 0.375283 Jul 18 02:20:42.912943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 928/1868] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1859 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:42.943687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:42.945088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:42.958972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.959738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:42.961843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:42.962894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.128507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.161930 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9574d45c-31a0-44ff-898f-68748957a31a tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1467 microversion: 2.1 time: 0.939378 Jul 18 02:20:43.164058 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 941/1869] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1467 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:43.175934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:43.177182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:43.190010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.190858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.192315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.193464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.394968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.417288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.421594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:43.423803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6228b5d-c3e1-4e57-b71a-28491edf5c6f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1281 microversion: 2.25 time: 0.488455 Jul 18 02:20:43.439337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 929/1870] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:42 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1281 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:43.456498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:43.457481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:43.470511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.471324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.472988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.473794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.675154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lazy-loading 'services' on Instance uuid 31bc5640-2b9b-4f06-a04c-63ff38508a2b {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:43.855308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-57bbea0a-9c41-41ec-a8c9-a1748778ff80 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments/c627517e-4655-46e9-b8e1-bb4c4896bd70" status: 202 len: 0 microversion: 2.1 time: 0.411673 Jul 18 02:20:43.862292 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 930/1871] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:20:43 2022] DELETE /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments/c627517e-4655-46e9-b8e1-bb4c4896bd70 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:43.883047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:43.883836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:43.897843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.898723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:43.900088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:43.900557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.104830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.121153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-627ad797-6354-4146-8005-790d204a3cb4 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.955177 Jul 18 02:20:44.122169 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 942/1872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:43 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:44.149696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.157705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.201062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.206487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.207802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.209372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.297756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.344201 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d847851-264e-454d-92fd-7e9e815b200e tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1325 microversion: 2.1 time: 0.479323 Jul 18 02:20:44.346809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 931/1873] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:43 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:44.352487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad2315bb-157e-4ab3-a0ed-706156319391 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228906 Jul 18 02:20:44.353123 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 943/1874] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:44.379256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.382348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.405119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.408275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.409951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.410641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.453990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:44.463439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:44.485361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.486947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.489224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:44.489974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:44.766648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:44.792896 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b80a447-2489-4c9e-bbc8-5dc67fbb6c91 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1467 microversion: 2.1 time: 0.424042 Jul 18 02:20:44.807059 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 932/1875] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1467 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:45.148355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:45.149400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.185975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.188892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.195389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.196591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.444444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:45.464852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:45.467861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:45.469623 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1beca0e-45a9-4789-ac8f-719f73da610a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1477 microversion: 2.25 time: 1.021534 Jul 18 02:20:45.470944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 944/1876] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:44 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1477 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:20:45.477117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:45.484230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.499489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.499958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.503042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.503761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.572742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:45.579449 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05749cf9-fa6a-4ef3-871c-15293beb2613 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107020 Jul 18 02:20:45.593393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 945/1877] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:45 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:45.593712 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5562d3ae-25b1-4ded-a16a-068e34dd54f5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.449773 Jul 18 02:20:45.594201 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 933/1878] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:45 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:45.598672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:45.599626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.604768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:45.607930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:45.613579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.613928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.615011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.615466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.650981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.651577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:45.652448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:45.653541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.159854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 27dde308-8251-4416-a75a-48482ee4fce7 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:46.180846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.182199 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e61d7f1-f191-4210-a568-281798f9cdf0 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1970 microversion: 2.25 time: 0.581100 Jul 18 02:20:46.183438 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 934/1879] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:45 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1970 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:46.191129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:46.192022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:46.196937 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5966606-cfef-4de5-9c84-35c112f6f762 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1521 microversion: 2.1 time: 0.598500 Jul 18 02:20:46.198229 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 946/1880] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:45 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:46.203150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.204005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.205132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.205870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.208821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-25089c48-6837-4183-8cb2-1fcc32513da6 req-50fd1aa2-aa7c-4fd2-95b4-fc50766326fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f707dce1-8fe2-4c49-be3a-a3d720a37bc4", "name": "network-vif-deleted", "tag": "a8142dee-d890-46f0-973d-029eece75a69"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:46.237250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25089c48-6837-4183-8cb2-1fcc32513da6 req-50fd1aa2-aa7c-4fd2-95b4-fc50766326fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.243316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25089c48-6837-4183-8cb2-1fcc32513da6 req-50fd1aa2-aa7c-4fd2-95b4-fc50766326fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.285117 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-25089c48-6837-4183-8cb2-1fcc32513da6 req-50fd1aa2-aa7c-4fd2-95b4-fc50766326fc service nova] Creating event network-vif-deleted:a8142dee-d890-46f0-973d-029eece75a69 for instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 on n-h2-849796-1 Jul 18 02:20:46.291587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-25089c48-6837-4183-8cb2-1fcc32513da6 req-50fd1aa2-aa7c-4fd2-95b4-fc50766326fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086265 Jul 18 02:20:46.295250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 947/1881] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:46.299070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.299798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.300438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lazy-loading 'fault' on Instance uuid f707dce1-8fe2-4c49-be3a-a3d720a37bc4 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:46.308317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:46.309147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:46.317226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.318014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.319718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.324053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.363662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:46.375337 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf865007-01ad-449c-900c-a4fa285153a6 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 200 len: 1301 microversion: 2.1 time: 0.189967 Jul 18 02:20:46.376800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 935/1882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:46 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:46.382781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:46.383619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:46.392628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.393737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.394923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.395552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.471058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:46.723918 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04ff4e0c-098a-4786-8cc3-1c944fa0f6df tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 204 len: 0 microversion: 2.1 time: 0.345457 Jul 18 02:20:46.725766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 936/1883] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:46 2022] DELETE /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:46.755936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:46.761764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:46.777470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.778507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.782601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.783066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.889791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c00d032-feef-42a5-a2eb-cba89543755b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155498 Jul 18 02:20:46.891251 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 937/1884] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:46 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:46.912225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:46.914208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:46.928803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.929490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.930525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:46.931133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:46.968848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 27dde308-8251-4416-a75a-48482ee4fce7 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:47.002823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12dffff6-15db-41ee-8656-b8970134898a tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1970 microversion: 2.25 time: 0.700198 Jul 18 02:20:47.004255 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 948/1885] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:46 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1970 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:47.009528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.010542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.021879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.022797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.024349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.025144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.396322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:47.403211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:47.415424 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6dab021-26c2-44b9-8120-dd0cf7ae8bd5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1527 microversion: 2.1 time: 0.402330 Jul 18 02:20:47.416476 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 949/1886] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:47 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1527 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:47.427541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.434731 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:20:47.434731 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:20:47.446526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.448781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.457045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.458051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-076991c4-b5a1-42b0-9e21-795c15e9e925 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.551887 Jul 18 02:20:47.458980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.459343 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 938/1887] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:46 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:47.489066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.492797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: f707dce1-8fe2-4c49-be3a-a3d720a37bc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.510535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.517512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.520554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.520554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.541147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55c4e2ea-29f7-448e-b0f2-19964b08367d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123227 Jul 18 02:20:47.545265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 950/1888] 10.222.0.67 () {60 vars in 1216 bytes} [Mon Jul 18 02:20:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:20:47.564492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849796-1", "block_migration": "auto"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:47.566864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.577758 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] HTTP exception thrown: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Request method failure captured: Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 HTTP/1.1 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHo2nLZi2biQXE2zjdK55vZSjG3KYwSdULq-WhPWDuB2n-ZPyusoFNT9Z2GVpVHgGdOzi5VOe8l_j_mz5nSa64QUaan7sdumAVJUMrZZ8zQB2DwRdP5-BioMpYmb7zk8rAzpIWXwsybkcrONPgTZtRI1D-2VSw7T3gd1CTr0Wr8O5M Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a814973df884fc6972477bf52853e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a814973df884fc6972477bf52853e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 4c85ff74393d48febcae3bd1c49d3887 Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f707dce1-8fe2-4c49-be3a-a3d720a37bc4'} Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:47.581440 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. Jul 18 02:20:47.587545 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:47.590834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.592178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Returning 404 to user: Instance f707dce1-8fe2-4c49-be3a-a3d720a37bc4 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:47.593383 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5fb5faf2-f91d-402e-b259-0d49153f152d tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4" status: 404 len: 111 microversion: 2.1 time: 0.132582 Jul 18 02:20:47.594284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.595754 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 939/1889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:47 2022] GET /compute/v2.1/servers/f707dce1-8fe2-4c49-be3a-a3d720a37bc4 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:47.596863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.597564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.616508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:47.623070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:47.649311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.650481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.652256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:47.654478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:47.663131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'flavor' on Instance uuid 27dde308-8251-4416-a75a-48482ee4fce7 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:47.676328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:47.704238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Going to try to live migrate instance to n-h2-849796-1 {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:20:47.789214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:20:48.000066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:48.116896 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a3f395e-f603-4329-8840-d019912dea99 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 204 len: 0 microversion: 2.1 time: 0.510146 Jul 18 02:20:48.119759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 940/1890] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:47 2022] DELETE /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:48.133379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:48.135938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:48.153476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.154301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.155931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.156678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.227722 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c76ae39-a054-4999-8095-105094c96231 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103892 Jul 18 02:20:48.229807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 941/1891] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:48 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:48.241141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:48.244238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:48.258562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.260096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.262728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.264060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.612071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:48.629410 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9fc0267-587e-4262-97d9-c55910fb3a51 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1467 microversion: 2.1 time: 0.396389 Jul 18 02:20:48.633065 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 942/1892] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:48 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1467 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:48.637832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:48.639082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:48.663306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.663766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:48.664604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:48.665098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:49.194665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:49.237461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-53a6590e-5992-4398-923f-7c089b6d4871 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1527 microversion: 2.1 time: 0.602784 Jul 18 02:20:49.267237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 943/1893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:48 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1527 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:49.279945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:49.283155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:49.336460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:49.336953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:49.339298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:49.342969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:50.802000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:50.830010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19c87b6f-070e-438f-a16b-3ed0ddee30d9 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 1.560459 Jul 18 02:20:50.841991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 944/1894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:49 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:50.858994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:50.860750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:50.889529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:50.890366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:50.891978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:50.892682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.008715 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aef2ba7b-c3b4-4e75-9454-28f36dd940d8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164898 Jul 18 02:20:51.014449 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 945/1895] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:50 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:51.022910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:51.023875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:51.048315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.048781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.052168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.052580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.222968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.233568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.235368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lazy-loading 'fault' on Instance uuid 5109dafc-983b-4078-b7a0-c80460f551ad {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:51.328742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c85ff74393d48febcae3bd1c49d3887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a814973df884fc6972477bf52853e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.341228 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d9294e6-603c-432e-b660-019ed152013f tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 200 len: 1302 microversion: 2.1 time: 0.322685 Jul 18 02:20:51.342290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 946/1896] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:51 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:51.363381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7b3074ac-bbaa-4716-9f6a-ffc88d505fdf req-0662aa24-ae55-47ff-8d2e-90258f86e5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c793a11-e110-416b-9617-a70fca7d2bfa", "name": "network-vif-plugged", "status": "completed", "tag": "d0f42aee-47ae-4c56-a1ac-52a7afaa2525"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:51.393509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7b3074ac-bbaa-4716-9f6a-ffc88d505fdf req-0662aa24-ae55-47ff-8d2e-90258f86e5b2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.393969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7b3074ac-bbaa-4716-9f6a-ffc88d505fdf req-0662aa24-ae55-47ff-8d2e-90258f86e5b2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.417071 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7b3074ac-bbaa-4716-9f6a-ffc88d505fdf req-0662aa24-ae55-47ff-8d2e-90258f86e5b2 service nova] Creating event network-vif-plugged:d0f42aee-47ae-4c56-a1ac-52a7afaa2525 for instance 5c793a11-e110-416b-9617-a70fca7d2bfa on n-h1-849796-1 Jul 18 02:20:51.461151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7b3074ac-bbaa-4716-9f6a-ffc88d505fdf req-0662aa24-ae55-47ff-8d2e-90258f86e5b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093896 Jul 18 02:20:51.466820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 947/1897] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:51.484450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:51.487515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:51.502865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.504502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.508564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.509789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.749398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:51.774811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52b09d8c-4f26-4489-a550-7529a508fc94 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1485 microversion: 2.1 time: 0.305812 Jul 18 02:20:51.775779 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 948/1898] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:51 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:51.800625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-57ecabf6-5b1d-474a-8461-1243fbe8b914 req-92bbc1e1-ae24-42b5-bb4c-c9474fc1d936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5109dafc-983b-4078-b7a0-c80460f551ad", "name": "network-vif-deleted", "tag": "0f589e89-b3ce-4d13-a01c-73376470573b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:51.822414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-57ecabf6-5b1d-474a-8461-1243fbe8b914 req-92bbc1e1-ae24-42b5-bb4c-c9474fc1d936 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.823424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-57ecabf6-5b1d-474a-8461-1243fbe8b914 req-92bbc1e1-ae24-42b5-bb4c-c9474fc1d936 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.838807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-57ecabf6-5b1d-474a-8461-1243fbe8b914 req-92bbc1e1-ae24-42b5-bb4c-c9474fc1d936 service nova] Creating event network-vif-deleted:0f589e89-b3ce-4d13-a01c-73376470573b for instance 5109dafc-983b-4078-b7a0-c80460f551ad on n-h1-849796-1 Jul 18 02:20:51.846219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-57ecabf6-5b1d-474a-8461-1243fbe8b914 req-92bbc1e1-ae24-42b5-bb4c-c9474fc1d936 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050511 Jul 18 02:20:51.848451 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 949/1899] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:51.866092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:51.868545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:51.885388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.886216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:51.888407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:51.889204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.302951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:52.324890 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6e7dcec-78d8-47ca-8701-aa6e704e04da tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.471545 Jul 18 02:20:52.327199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 950/1900] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:51 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:52.350836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:52.356760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:52.381373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.383028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.394630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.396081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.508602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa19230c-bb54-4a2b-aef8-e70e5782b268 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170874 Jul 18 02:20:52.515314 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 951/1901] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:52 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:52.533318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:52.537710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] [instance: 5109dafc-983b-4078-b7a0-c80460f551ad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:52.557930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.558286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.560497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.561197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.587264 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] HTTP exception thrown: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Request method failure captured: Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad HTTP/1.1 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHo2nLZi2biQXE2zjdK55vZSjG3KYwSdULq-WhPWDuB2n-ZPyusoFNT9Z2GVpVHgGdOzi5VOe8l_j_mz5nSa64QUaan7sdumAVJUMrZZ8zQB2DwRdP5-BioMpYmb7zk8rAzpIWXwsybkcrONPgTZtRI1D-2VSw7T3gd1CTr0Wr8O5M Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a814973df884fc6972477bf52853e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a814973df884fc6972477bf52853e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a814973df884fc6972477bf52853e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9a814973df884fc6972477bf52853e15 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MigrationsAdminTest-585629040 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 4c85ff74393d48febcae3bd1c49d3887 Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MigrationsAdminTest-585629040-project Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5109dafc-983b-4078-b7a0-c80460f551ad'} Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:52.596108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] Returning 404 to user: Instance 5109dafc-983b-4078-b7a0-c80460f551ad could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbec0802-5a3c-451f-8687-d0e88559aed7 tempest-MigrationsAdminTest-585629040 tempest-MigrationsAdminTest-585629040-project] 10.222.0.67 "GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad" status: 404 len: 111 microversion: 2.1 time: 0.085789 Jul 18 02:20:52.610562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 952/1902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:52 2022] GET /compute/v2.1/servers/5109dafc-983b-4078-b7a0-c80460f551ad => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:52.618459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2a55c862-a279-434f-b1ac-79a101a9649d req-d5da4afa-d30d-405c-8c90-1c1c360465d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510ed705-9bc6-40a8-9cd3-070b6f849456", "name": "network-vif-deleted", "tag": "8728281f-3e2f-4d1e-a6b9-76cfdc880381"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:52.647552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2a55c862-a279-434f-b1ac-79a101a9649d req-d5da4afa-d30d-405c-8c90-1c1c360465d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.658878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2a55c862-a279-434f-b1ac-79a101a9649d req-d5da4afa-d30d-405c-8c90-1c1c360465d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.679841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2a55c862-a279-434f-b1ac-79a101a9649d req-d5da4afa-d30d-405c-8c90-1c1c360465d9 service nova] Creating event network-vif-deleted:8728281f-3e2f-4d1e-a6b9-76cfdc880381 for instance 510ed705-9bc6-40a8-9cd3-070b6f849456 on n-h2-849796-1 Jul 18 02:20:52.695906 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2a55c862-a279-434f-b1ac-79a101a9649d req-d5da4afa-d30d-405c-8c90-1c1c360465d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080295 Jul 18 02:20:52.696811 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 953/1903] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:52.804996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:52.806044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:52.835536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.836193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.837590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.838140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.987373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:52.990659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:52.992818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lazy-loading 'fault' on Instance uuid 510ed705-9bc6-40a8-9cd3-070b6f849456 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:20:53.149547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2de3928dac470c90a709b3da9c95f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01891a23b968415c9c86225a210fe256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:53.178330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-82624fa1-1798-40eb-b147-73f91e8d56e3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 200 len: 1315 microversion: 2.1 time: 0.379237 Jul 18 02:20:53.181777 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 954/1904] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:52 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:53.385703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:53.391943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:53.451676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.459418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:53.461161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.472127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:53.598826 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f05c69e-0ff2-414a-a5d6-d0e28914b29d tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7/action" status: 202 len: 0 microversion: 2.25 time: 6.045816 Jul 18 02:20:53.600489 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 951/1905] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:20:47 2022] POST /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7/action => generated 0 bytes in 6048 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:20:53.616026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:53.623498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:53.669259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.674799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:53.682547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.686596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:53.771693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d71a83b-5826-49de-af9d-9ebe587be869 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166882 Jul 18 02:20:53.772331 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 952/1906] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:53 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:53.786807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:53.787901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:53.807419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.807892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:53.808809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:53.809304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.304323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.317498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7949764-442a-4962-b634-dfbab48ad9b5 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1350 microversion: 2.1 time: 0.966000 Jul 18 02:20:54.330403 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 955/1907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:53 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1350 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:54.341572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.342750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: 510ed705-9bc6-40a8-9cd3-070b6f849456] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:54.352498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.354519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.357869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.359161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.388223 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 HTTP/1.1 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '510ed705-9bc6-40a8-9cd3-070b6f849456'} Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.390748 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. Jul 18 02:20:54.396895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.399906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance 510ed705-9bc6-40a8-9cd3-070b6f849456 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:54.403217 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75b7f4a2-e081-4fc4-a3f8-60f6d24173f3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456" status: 404 len: 111 microversion: 2.1 time: 0.069066 Jul 18 02:20:54.404595 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 956/1908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:54 2022] GET /compute/v2.1/servers/510ed705-9bc6-40a8-9cd3-070b6f849456 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:54.419754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8119303-2850-416a-ad6d-fdd34703b3b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab05739ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.489604 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e8119303-2850-416a-ad6d-fdd34703b3b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Image not found. Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8119303-2850-416a-ad6d-fdd34703b3b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640 HTTP/1.1 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd135145e-b142-4634-9127-7ee8dc4b5640'} Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d135145e-b142-4634-9127-7ee8dc4b5640 to delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d135145e-b142-4634-9127-7ee8dc4b5640 could not be found. Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.491975 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8119303-2850-416a-ad6d-fdd34703b3b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8119303-2850-416a-ad6d-fdd34703b3b5 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640" status: 404 len: 62 microversion: 2.1 time: 0.082241 Jul 18 02:20:54.498096 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 957/1909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:54 2022] DELETE /compute/v2.1/images/d135145e-b142-4634-9127-7ee8dc4b5640 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:54.505941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.511217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:54.546899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.549741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.550997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.554279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.576320 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 HTTP/1.1 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd533dac5-ebb4-4042-a8fd-5126a176f7f5'} Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:54.578160 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.583563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:54.588513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51bdff8e-4121-42eb-b38a-9f570e1659ba tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 404 len: 111 microversion: 2.1 time: 0.084470 Jul 18 02:20:54.588513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 958/1910] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:54 2022] DELETE /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:54.601529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.602255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: d533dac5-ebb4-4042-a8fd-5126a176f7f5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:54.624347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.627598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.629399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.631467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.670893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 HTTP/1.1 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd533dac5-ebb4-4042-a8fd-5126a176f7f5'} Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.674093 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance d533dac5-ebb4-4042-a8fd-5126a176f7f5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:54.679308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0dc1438d-a458-4151-97a3-96da92d95d4a tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5" status: 404 len: 111 microversion: 2.1 time: 0.082907 Jul 18 02:20:54.682895 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 959/1911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:54 2022] GET /compute/v2.1/servers/d533dac5-ebb4-4042-a8fd-5126a176f7f5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:54.692504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90f9ef32-cd5c-4ed4-a425-7968c719633d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab05742c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.718525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.737397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.745084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:54.747152 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a814e686-6ad4-4f56-a1cc-9f5ea682730e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.973451 Jul 18 02:20:54.748017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 953/1912] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:53 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:54.758333 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90f9ef32-cd5c-4ed4-a425-7968c719633d tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060261889" status: 202 len: 0 microversion: 2.1 time: 0.068760 Jul 18 02:20:54.758333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 960/1913] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060261889 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:20:54.790642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:54.792387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:54.836395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.837244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:54.838681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:54.839471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.015163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eca8aea9-e3fb-4cc5-8f66-d2daa26944f5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232054 Jul 18 02:20:55.016764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 961/1914] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:54 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:55.335961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:55.336803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:55.352015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.352917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.354039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.354736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.770599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:55.773005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:55.809117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.809897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:55.813229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:55.814078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.076175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.089322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.092221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.094537 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fac9070-5251-40ec-8741-8b51274114f1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.331759 Jul 18 02:20:56.104878 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 962/1915] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:55 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:56.104878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:56.104878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:56.110953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:56.111577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.112769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:56.113470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.139244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:56.168975 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6da3c209-d7d4-4916-8eb5-b351cf563fe8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071435 Jul 18 02:20:56.170269 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 963/1916] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:20:56 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:20:56.244364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:56.256122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4563e60a-c4e5-4710-8129-523966f33d82 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1540 microversion: 2.1 time: 0.923512 Jul 18 02:20:56.259336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 954/1917] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:55 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1540 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:20:56.275942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:56.276832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:56.291631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:56.292052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.293648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:56.294356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:56.417000 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac10fe35-9e51-4869-87b7-c6bcaa72a4d3 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144578 Jul 18 02:20:56.427309 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 964/1918] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:20:56 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:57.124128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:57.131758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:57.176443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:57.208229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:57.218455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:57.220249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:57.469045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:57.709875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.775829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.788583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:57.791212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b6f4125-441c-4f72-9a4c-925511b0e6e1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.681008 Jul 18 02:20:57.804575 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 965/1919] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:57 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:20:57.865315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f969f6e-48ea-4770-bf88-e6a622dfeb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '.version_select at 0x7fab05739b80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:57.974429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1f969f6e-48ea-4770-bf88-e6a622dfeb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Image not found. Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f969f6e-48ea-4770-bf88-e6a622dfeb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/30c99007-e86d-45f1-b9dc-1607aeabec7e HTTP/1.1 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '30c99007-e86d-45f1-b9dc-1607aeabec7e'} Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 30c99007-e86d-45f1-b9dc-1607aeabec7e to delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30c99007-e86d-45f1-b9dc-1607aeabec7e could not be found. Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:57.978650 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:57.986733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f969f6e-48ea-4770-bf88-e6a622dfeb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:57.990563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-454338fc-d90f-4f26-9755-c5f93728edcb tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab04453550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1882931534", "description": "tempest-description-1583704173"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:57.990753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f969f6e-48ea-4770-bf88-e6a622dfeb7f tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/images/30c99007-e86d-45f1-b9dc-1607aeabec7e" status: 404 len: 62 microversion: 2.1 time: 0.126234 Jul 18 02:20:57.993116 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 966/1920] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:57 2022] DELETE /compute/v2.1/images/30c99007-e86d-45f1-b9dc-1607aeabec7e => generated 62 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:20:58.006860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:58.007895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:58.018374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:58.058114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.059387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.063278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.069335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.107905 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 HTTP/1.1 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2'} Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:58.113572 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.119895 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.123425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:58.124831 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d0c73fe-4531-4305-aa18-c29344587ab3 tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 404 len: 111 microversion: 2.1 time: 0.129906 Jul 18 02:20:58.129691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 967/1921] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:20:57 2022] DELETE /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:58.136538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:58.137738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] [instance: cd333e5b-d005-4786-af0e-1e0aa88d19a2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:58.146605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.147527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.148669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.149463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.171383 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] HTTP exception thrown: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Request method failure captured: Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 HTTP/1.1 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MK9nELTPwBfm35DTQokF1VMX2vD5grf0Vrbsi2wKXDLjNHAPvLeJB5TplfRILdFHSdQuw8sbz04hbJRnwj5P8oXmHxtQAMx41bDhzEz6cWX-61JVyczUzlLy1LYc4XCW4fhVrZS2mhj7ox1DjM41VQNsGODp_15r91Y9Ni_bckNTso Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01891a23b968415c9c86225a210fe256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01891a23b968415c9c86225a210fe256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01891a23b968415c9c86225a210fe256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 01891a23b968415c9c86225a210fe256 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-444240692 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0f2de3928dac470c90a709b3da9c95f0 Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-444240692-project Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cd333e5b-d005-4786-af0e-1e0aa88d19a2'} Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.173383 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. Jul 18 02:20:58.179999 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:20:58.182968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] Returning 404 to user: Instance cd333e5b-d005-4786-af0e-1e0aa88d19a2 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:20:58.186284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf960b88-6ab1-4ef5-9433-cd352c0e33dc tempest-ImagesOneServerNegativeTestJSON-444240692 tempest-ImagesOneServerNegativeTestJSON-444240692-project] 10.222.0.67 "GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2" status: 404 len: 111 microversion: 2.1 time: 0.053676 Jul 18 02:20:58.191574 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 968/1922] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:20:58 2022] GET /compute/v2.1/servers/cd333e5b-d005-4786-af0e-1e0aa88d19a2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:20:58.778026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-454338fc-d90f-4f26-9755-c5f93728edcb tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.681868 Jul 18 02:20:58.782610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 955/1923] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:20:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:20:58.804223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e0e275b-218c-4031-963f-577b3209d714 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab05742c10>, body: {"security_group_rule": {"parent_group_id": "f9fefb6f-abc5-4d77-8a26-7003150e0cc8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:20:58.834908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:20:58.841675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:20:58.884507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.885852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:58.891794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:20:58.893060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:20:59.720773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.761331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.765709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:20:59.773583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2af71fc6-9cf0-4dd8-a494-d9a1c0550bfc tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.950754 Jul 18 02:20:59.773583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 956/1924] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:20:58 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:00.662631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e0e275b-218c-4031-963f-577b3209d714 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.860893 Jul 18 02:21:00.665537 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 969/1925] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:20:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:00.683666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac52c24f-ea28-4d2d-81ac-e7a5fc4542f0 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab057391f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1826620973", "description": "tempest-description-349999368"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:00.706373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Action: 'update', calling method: .version_select at 0x7fab044539d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:00.864812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.866254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:00.880046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:00.886695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:01.092165 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88b593cf-164d-43cc-85c6-1350f6de832b tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3" status: 200 len: 240 microversion: 2.36 time: 0.761594 Jul 18 02:21:01.093506 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 957/1926] 10.222.0.67 () {62 vars in 1302 bytes} [Mon Jul 18 02:21:00 2022] PUT /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3 => generated 240 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:21:01.106392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:01.107332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:01.126537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:01.127287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:01.128497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:01.129246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:01.528873 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac52c24f-ea28-4d2d-81ac-e7a5fc4542f0 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.854201 Jul 18 02:21:01.529861 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 970/1927] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:01.535616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f800279a-883e-4164-9990-4b890c6d1d65 req-31a40607-9e60-4b1c-aead-43cfe6efd989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c793a11-e110-416b-9617-a70fca7d2bfa", "tag": "d0f42aee-47ae-4c56-a1ac-52a7afaa2525"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:01.572450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f800279a-883e-4164-9990-4b890c6d1d65 req-31a40607-9e60-4b1c-aead-43cfe6efd989 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:01.576150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f800279a-883e-4164-9990-4b890c6d1d65 req-31a40607-9e60-4b1c-aead-43cfe6efd989 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:01.647142 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f800279a-883e-4164-9990-4b890c6d1d65 req-31a40607-9e60-4b1c-aead-43cfe6efd989 service nova] Creating event network-changed:d0f42aee-47ae-4c56-a1ac-52a7afaa2525 for instance 5c793a11-e110-416b-9617-a70fca7d2bfa on n-h1-849796-1 Jul 18 02:21:01.674524 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f800279a-883e-4164-9990-4b890c6d1d65 req-31a40607-9e60-4b1c-aead-43cfe6efd989 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142596 Jul 18 02:21:01.681217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 971/1928] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:01.704659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Calling method '.version_select at 0x7fab055c8c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:01.973312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:01.973772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:01.974638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:01.975139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.066021 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4465e011-4952-43c0-8c12-972f1c11e585 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3/detail" status: 200 len: 672 microversion: 2.36 time: 0.381551 Jul 18 02:21:02.072507 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 972/1929] 10.222.0.67 () {60 vars in 1303 bytes} [Mon Jul 18 02:21:01 2022] GET /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3/detail => generated 672 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:21:02.098268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a445d48-82a1-4679-90ac-681566befb46 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab05cb2430>, body: {"security_group_rule": {"parent_group_id": "53f14be2-b94f-4b01-9370-19960ad7c081", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:02.114887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.155600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.158951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:02.167028 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bee266c5-ab38-4969-a80e-beec57d7c736 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 1.071806 Jul 18 02:21:02.197341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 958/1930] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:01 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:02.586652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Action: 'update', calling method: .version_select at 0x7fab044b18b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:02.765274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.766148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.767312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.768112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.792584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a445d48-82a1-4679-90ac-681566befb46 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.718142 Jul 18 02:21:02.794330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 973/1931] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:21:02 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:02.810989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09c7a218-e684-4614-89d2-4c4b53ed35bc tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab05c4d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-164845426", "description": "tempest-description-1341408029"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:02.834894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.835816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:02.836887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:02.837898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:03.072569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-839c7bfe-cfd7-4c2f-96f5-40c436c41a50 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3?user_id=ec1465068039487aa93084846e57cfca" status: 200 len: 240 microversion: 2.36 time: 0.484456 Jul 18 02:21:03.078153 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 959/1932] 10.222.0.67 () {62 vars in 1383 bytes} [Mon Jul 18 02:21:02 2022] PUT /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3?user_id=ec1465068039487aa93084846e57cfca => generated 240 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:21:03.105074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14c4ce4a-40a5-4cad-9d21-cf7a15cf7461 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] Calling method '.version_select at 0x7fab044949d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:03.373731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09c7a218-e684-4614-89d2-4c4b53ed35bc tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.566728 Jul 18 02:21:03.390113 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 974/1933] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:03.409695 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14c4ce4a-40a5-4cad-9d21-cf7a15cf7461 tempest-QuotasAdminTestV236-1410229146 tempest-QuotasAdminTestV236-1410229146-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3?user_id=ec1465068039487aa93084846e57cfca" status: 200 len: 282 microversion: 2.36 time: 0.324700 Jul 18 02:21:03.415929 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 960/1934] 10.222.0.67 () {60 vars in 1363 bytes} [Mon Jul 18 02:21:03 2022] GET /compute/v2.1/os-quota-sets/a411f5203eb6418284663401d0c829d3?user_id=ec1465068039487aa93084846e57cfca => generated 282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:21:03.434843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:03.441251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:03.443448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd69b69f-037f-49ce-84f0-20df3e69581b tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab045273a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1641642087", "description": "tempest-description-1198199335"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:03.500205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.500972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:03.516998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:03.517971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:05.125590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.167421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.177594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:05.193048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ceb9c5f-2638-4140-81ca-46fdfbdb8b53 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 1.791065 Jul 18 02:21:05.195444 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 975/1935] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:03 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:06.182667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd69b69f-037f-49ce-84f0-20df3e69581b tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.749030 Jul 18 02:21:06.184280 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 961/1936] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:06.196169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5179c51c-49c0-45bd-a49d-6f91e02aa85f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab059cc790>, body: {"security_group_rule": {"parent_group_id": "91856780-322c-4f81-a6d7-f4ca21ea3157", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b3a9c555-ed45-4076-82b9-31b1e1bf282a"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:06.231763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:06.238271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:06.268636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.283125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:06.289944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:06.290964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:06.691751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.733942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.737393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:06.743639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e7c0752-555d-41dc-83df-bd6d431179d6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.520911 Jul 18 02:21:06.744848 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 962/1937] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:06 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:07.314967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5179c51c-49c0-45bd-a49d-6f91e02aa85f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.123056 Jul 18 02:21:07.325703 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 976/1938] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:21:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:07.343795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37c9760e-7705-4894-97a8-330acfeeebba tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab04818e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2146162184", "description": "tempest-description-1671042830"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:07.769974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:07.770945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:07.798208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:07.799792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:07.802126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:07.803475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:07.988118 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37c9760e-7705-4894-97a8-330acfeeebba tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.652391 Jul 18 02:21:07.989874 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 963/1939] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:08.011067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61dbf9e3-e1c4-49ea-947a-a51a121a0f18 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab04439af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-593492572", "description": "tempest-description-84373010"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:08.556007 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61dbf9e3-e1c4-49ea-947a-a51a121a0f18 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.552161 Jul 18 02:21:08.558841 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 964/1940] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:08 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:08.576092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d6d9fcc6-eb32-4a7c-947f-c6b3032f9fc4 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab0443baf0>, body: {"security_group_rule": {"parent_group_id": "2673e898-b897-4d8e-a75d-82a6f26b7004", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c183d893-0104-4b69-91f3-d7aad9b4c834"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:08.676456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.708545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.721435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:08.726103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0faa890-f84c-40c3-a76b-abd8d5cdc969 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.964425 Jul 18 02:21:08.727192 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 977/1941] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:07 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:09.444713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d6d9fcc6-eb32-4a7c-947f-c6b3032f9fc4 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.873460 Jul 18 02:21:09.445483 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 965/1942] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:21:08 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:09.464053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a874cd37-2498-4c25-aa1e-ef92d7030bda tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab0591a940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:09.752092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:09.753643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:09.782199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.782468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:09.783192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:09.783691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:10.278481 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a874cd37-2498-4c25-aa1e-ef92d7030bda tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c183d893-0104-4b69-91f3-d7aad9b4c834" status: 202 len: 0 microversion: 2.1 time: 0.823746 Jul 18 02:21:10.279664 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 978/1943] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:09 2022] DELETE /compute/v2.1/os-security-groups/c183d893-0104-4b69-91f3-d7aad9b4c834 => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:10.290488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-056b69ee-6c59-45bf-aaa3-1643d4d726a3 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab0a5e0b80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:10.438972 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-056b69ee-6c59-45bf-aaa3-1643d4d726a3 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/2673e898-b897-4d8e-a75d-82a6f26b7004" status: 200 len: 248 microversion: 2.1 time: 0.153141 Jul 18 02:21:10.439836 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 979/1944] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:21:10 2022] GET /compute/v2.1/os-security-groups/2673e898-b897-4d8e-a75d-82a6f26b7004 => generated 248 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:10.467916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9442fbcd-e7c1-4023-ad82-b0280a8650ba tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab05739a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1654551136", "description": "tempest-description-1534161598"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:10.627965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:10.662178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:10.674507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:10.675893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-517caf25-d57c-4cbd-9a59-368777e10d22 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.928788 Jul 18 02:21:10.676498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 966/1945] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:09 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:11.206661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9442fbcd-e7c1-4023-ad82-b0280a8650ba tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.746855 Jul 18 02:21:11.220450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 980/1946] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:21:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:11.225931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39313db4-45f8-4d93-b9e2-d442479c9497 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab044d85e0>, body: {"security_group_rule": {"parent_group_id": "ca26d931-54f0-47af-806c-8d5950d6325f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:11.743659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:11.752165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:11.816000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:11.819242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:11.820830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:11.821713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:11.990255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:12.019283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:12.315316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.326988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.329194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:12.330950 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18a73e10-10ef-4d66-b819-9eedf341e7f8 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.618474 Jul 18 02:21:12.345211 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 981/1947] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:11 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:12.849637 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39313db4-45f8-4d93-b9e2-d442479c9497 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.628618 Jul 18 02:21:12.850446 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 967/1948] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:21:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:12.869541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27262283-580d-441a-b355-cc09713fbeb8 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Action: 'create', calling method: .version_select at 0x7fab0575cf70>, body: {"security_group_rule": {"parent_group_id": "ca26d931-54f0-47af-806c-8d5950d6325f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:13.358446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:13.361457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:13.377864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=7 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:13.387601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=24 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:13.397767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:13.452785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:13.453429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:13.454297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:13.454752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:13.468847 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27262283-580d-441a-b355-cc09713fbeb8 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.606809 Jul 18 02:21:13.470839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 982/1949] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:21:12 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:13.486993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d648de6-0a61-4692-b0ce-054e831f9a08 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab05dd6d30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:13.642808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d648de6-0a61-4692-b0ce-054e831f9a08 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/ca26d931-54f0-47af-806c-8d5950d6325f" status: 200 len: 665 microversion: 2.1 time: 0.160425 Jul 18 02:21:13.644293 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 983/1950] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:21:13 2022] GET /compute/v2.1/os-security-groups/ca26d931-54f0-47af-806c-8d5950d6325f => generated 665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:13.673709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4694038-a869-4b51-b13f-eb693635b1c1 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab059a6ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:14.065767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.098713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.104534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:14.107661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7fbc3afa-c329-4cee-bd12-b1b11090e3b3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.757562 Jul 18 02:21:14.113507 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 968/1951] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:13 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:14.144025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4694038-a869-4b51-b13f-eb693635b1c1 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/6e926e44-7006-4980-bd6b-e1c265178872" status: 202 len: 0 microversion: 2.1 time: 0.484986 Jul 18 02:21:14.146047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 984/1952] 10.222.0.67 () {58 vars in 1286 bytes} [Mon Jul 18 02:21:13 2022] DELETE /compute/v2.1/os-security-group-rules/6e926e44-7006-4980-bd6b-e1c265178872 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:14.161308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d97e6a2a-7c21-45ff-93db-af4a65cf05cd tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab044d8f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:14.724257 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d97e6a2a-7c21-45ff-93db-af4a65cf05cd tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/ca26d931-54f0-47af-806c-8d5950d6325f" status: 202 len: 0 microversion: 2.1 time: 0.569693 Jul 18 02:21:14.725202 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 969/1953] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:14 2022] DELETE /compute/v2.1/os-security-groups/ca26d931-54f0-47af-806c-8d5950d6325f => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:14.737317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab04444e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:14.816594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:21:14.817811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Neutron security group c183d893-0104-4b69-91f3-d7aad9b4c834 not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:21:14.818360 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] HTTP exception thrown: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.818360 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Request method failure captured: Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/c183d893-0104-4b69-91f3-d7aad9b4c834 HTTP/1.1 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MOI7iBJhap8fz9vL8r55-3CHCtWzzVp1dA7Aws_0JeOJJ2Ht3hTNnHEzeXir46d38mw4n6gCN7V2_XnLCEfXHDjzxwE-1VZUz4kW3W17F2rtS9hCxhqeviSq-AAaakYbseJBHLw-DdrxMcrMff9SvSfaZZaq-L0kvUiq_jYqVexyWE Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 601f41d19e294c2d87e48b881cb46705 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-188754888 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/601f41d19e294c2d87e48b881cb46705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_601f41d19e294c2d87e48b881cb46705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/601f41d19e294c2d87e48b881cb46705"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/601f41d19e294c2d87e48b881cb46705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesTestJSON-188754888 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 601f41d19e294c2d87e48b881cb46705 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-188754888 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesTestJSON-188754888-project Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c289595220444ab4abeee9c362de9679 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesTestJSON-188754888-project Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'c183d893-0104-4b69-91f3-d7aad9b4c834'} Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:21:14.831990 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] Jul 18 02:21:14.837242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:14.842459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Returning 404 to user: Security group c183d893-0104-4b69-91f3-d7aad9b4c834 does not exist Jul 18 02:21:14.842459 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-f09e3234-d741-4a28-8c4b-01dbdccd31f6'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:14.844160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d46a4e05-1133-4357-9884-747f615d420f tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c183d893-0104-4b69-91f3-d7aad9b4c834" status: 404 len: 194 microversion: 2.1 time: 0.111520 Jul 18 02:21:14.849782 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 970/1954] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:14 2022] DELETE /compute/v2.1/os-security-groups/c183d893-0104-4b69-91f3-d7aad9b4c834 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:21:14.863196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93d25184-95ac-43d9-ae3b-293d12bdc6fd tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab04551550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:14.916655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac6b7c52-9650-4034-a3fa-f4e74450e302 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Calling method '.version_select at 0x7fab05944af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:15.049643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac6b7c52-9650-4034-a3fa-f4e74450e302 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 371 microversion: 2.1 time: 0.684871 Jul 18 02:21:15.050801 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 985/1955] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:21:14 2022] GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 371 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:15.079309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab05bb8430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:15.319749 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93d25184-95ac-43d9-ae3b-293d12bdc6fd tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/2673e898-b897-4d8e-a75d-82a6f26b7004" status: 202 len: 0 microversion: 2.1 time: 0.466843 Jul 18 02:21:15.325151 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 971/1956] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:14 2022] DELETE /compute/v2.1/os-security-groups/2673e898-b897-4d8e-a75d-82a6f26b7004 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:15.340803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:15.344807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:15.362859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.363756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.366862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.368133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.442177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.443134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.445487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:15.446551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:15.583528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4194069-5b79-458c-bb60-720a2e621779 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 328 microversion: 2.1 time: 0.516801 Jul 18 02:21:15.584331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 986/1957] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:15 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 328 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:15.598576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b775c33a-7cdf-4993-b5ab-c2a9c7d7582c tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab055c8ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:15.782802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:15.799000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:15.803895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:15.805767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f48c123-262b-4b58-b0c7-c6c36dda8cda tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.478156 Jul 18 02:21:15.806944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 972/1958] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:15 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:16.204285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-535457822", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:16.369255 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b775c33a-7cdf-4993-b5ab-c2a9c7d7582c tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/b3a9c555-ed45-4076-82b9-31b1e1bf282a" status: 202 len: 0 microversion: 2.1 time: 0.783485 Jul 18 02:21:16.370223 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 987/1959] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:15 2022] DELETE /compute/v2.1/os-security-groups/b3a9c555-ed45-4076-82b9-31b1e1bf282a => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:16.391957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ff022d78-66eb-4f7c-8098-095609174e67 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab0a795af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:16.530092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:16.942706 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ff022d78-66eb-4f7c-8098-095609174e67 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/91856780-322c-4f81-a6d7-f4ca21ea3157" status: 202 len: 0 microversion: 2.1 time: 0.560435 Jul 18 02:21:16.943649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 988/1960] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:16 2022] DELETE /compute/v2.1/os-security-groups/91856780-322c-4f81-a6d7-f4ca21ea3157 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:16.950157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:16.950871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:16.968590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.974911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:16.976004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:16.976488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.219552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:17.220018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:17.220509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:17.221392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:17.221846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:17.234354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.235240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.236514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.237343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.268594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:17.277718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for user 673e6a3177bb423196b7090664dada50 and project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:17.294929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.utils [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] cores quota exceeded for 56fe9934008f4a85a9b367bec85b759a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119440) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:21:17.296026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Request method failure captured: Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 144 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MOYZUTdfaPn5k5ndHNRW0cJnAtAr78BDETOd61jMspCFxcG4AqJutMH8mSEBoCJNNfvgieUX58bWn2GceTG9-SSNO-TxdlkCt3DxgNxSRqcdfcC7nrYlvkvt3A-tdmaDKQvA9GB4Rs41CQojDj2VNRIpaoNzGufMJD7ag_CaW0B5vk Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 673e6a3177bb423196b7090664dada50 Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-535457822", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-535457822', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452'}}} Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:21:17.305800 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b928a244-1fec-4771-8f85-7501b321d471 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.415405 Jul 18 02:21:17.317637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 973/1961] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 1418 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:17.325662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32acf428-2ad2-46c8-b62b-c96b82036e59 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab043fc430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:17.346509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:17.363396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:17.368711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:17.372241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94f0d686-d3e8-421f-84cb-cef8634be36f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.427116 Jul 18 02:21:17.374699 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 989/1962] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:16 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:17.406400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab05a8e280>, body: {"quota_set": {"cores": 20}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:17.568271 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32acf428-2ad2-46c8-b62b-c96b82036e59 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/53f14be2-b94f-4b01-9370-19960ad7c081" status: 202 len: 0 microversion: 2.1 time: 0.256501 Jul 18 02:21:17.569591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 974/1963] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:17 2022] DELETE /compute/v2.1/os-security-groups/53f14be2-b94f-4b01-9370-19960ad7c081 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:17.580779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-437e6d5b-c911-4c00-86c8-81bc09d086f9 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] Calling method '.version_select at 0x7fab04415d30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:17.807681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.815055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.816753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:17.817685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:17.993586 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-edd7305e-83cf-4b9f-ba6d-39a7b5481c16 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 329 microversion: 2.1 time: 0.607567 Jul 18 02:21:17.994665 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 990/1964] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:17 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 329 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:18.017313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d732071f-c4ab-4886-ae6b-225953cf3989 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Calling method '.version_select at 0x7fab0575c670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:18.217018 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-437e6d5b-c911-4c00-86c8-81bc09d086f9 tempest-SecurityGroupRulesTestJSON-188754888 tempest-SecurityGroupRulesTestJSON-188754888-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/f9fefb6f-abc5-4d77-8a26-7003150e0cc8" status: 202 len: 0 microversion: 2.1 time: 0.639435 Jul 18 02:21:18.218440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 975/1965] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:21:17 2022] DELETE /compute/v2.1/os-security-groups/f9fefb6f-abc5-4d77-8a26-7003150e0cc8 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:21:18.301991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d732071f-c4ab-4886-ae6b-225953cf3989 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 371 microversion: 2.1 time: 0.289951 Jul 18 02:21:18.301991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 991/1966] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:21:18 2022] GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:18.322455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab04415280>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:18.403958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:18.412284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:18.445480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:18.446029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:18.446897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:18.447352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:18.582995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:18.592460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:18.595093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:18.601839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:18.644070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:18.818658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a0d1525d-cb5f-4d82-adfb-aff01978c403 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 328 microversion: 2.1 time: 0.506120 Jul 18 02:21:18.835071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 976/1967] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:18 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 328 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:18.846269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c202522-008c-4f6d-95a3-080a8e6e4d35 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043ed700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:18.989254 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c202522-008c-4f6d-95a3-080a8e6e4d35 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3" status: 200 len: 662 microversion: 2.1 time: 0.150507 Jul 18 02:21:18.990947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 977/1968] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:18 2022] GET /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3 => generated 662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:19.018648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2117374567", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:19.160519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:19.181994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.206175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.208469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:19.210939 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06184053-bb33-4a73-bc6c-ad7dfd1f2efd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.812742 Jul 18 02:21:19.231713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 992/1969] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:18 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:19.243304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a50c6323-a4d9-4df2-b808-6e5ca9b923bf tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab05739a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:19.351336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a50c6323-a4d9-4df2-b808-6e5ca9b923bf tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3" status: 200 len: 662 microversion: 2.1 time: 0.117291 Jul 18 02:21:19.352407 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 993/1970] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:19 2022] GET /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3 => generated 662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:19.816615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:19.817576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:19.817576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:19.818171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:19.818402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:19.847790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.848710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.850384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:19.851201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:19.929109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:19.941643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for user 673e6a3177bb423196b7090664dada50 and project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:19.972906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.utils [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] instances quota exceeded for 56fe9934008f4a85a9b367bec85b759a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119440) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:21:19.974507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Request method failure captured: Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 145 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MOYZUTdfaPn5k5ndHNRW0cJnAtAr78BDETOd61jMspCFxcG4AqJutMH8mSEBoCJNNfvgieUX58bWn2GceTG9-SSNO-TxdlkCt3DxgNxSRqcdfcC7nrYlvkvt3A-tdmaDKQvA9GB4Rs41CQojDj2VNRIpaoNzGufMJD7ag_CaW0B5vk Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 673e6a3177bb423196b7090664dada50 Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2117374567", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2117374567', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452'}}} Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:21:19.980538 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 18 02:21:19.993536 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:20.001702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:20.004261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bed69da0-8425-4ff9-9dfd-9c02b8662ee6 tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.010070 Jul 18 02:21:20.005821 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 978/1971] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:18 2022] POST /compute/v2.1/servers => generated 119 bytes in 1013 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:20.024141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab057c9ca0>, body: {"quota_set": {"instances": 10}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:20.237767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:20.238934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:20.268464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.274292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.281894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.290812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.293965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.300061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.303810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:20.304597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:20.540183 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19e58eb6-1495-43ff-b6f9-0d280b3790a4 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 329 microversion: 2.1 time: 0.524254 Jul 18 02:21:20.561514 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 994/1972] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:20 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 329 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:20.588050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02f43a91-42ef-4e27-80a5-a2b201c02bc9 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Calling method '.version_select at 0x7fab055c8ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:20.891878 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02f43a91-42ef-4e27-80a5-a2b201c02bc9 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 371 microversion: 2.1 time: 0.323408 Jul 18 02:21:20.897398 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 995/1973] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:21:20 2022] GET /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:20.922255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab055c8310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:21.038068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.053486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.061325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:21.067582 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9bd3b67d-473b-42d7-90dc-f41598fb7ad6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.834547 Jul 18 02:21:21.068793 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 979/1974] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:20 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:21.187315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:21.189368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:21.198092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:21.201923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:21.545138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59068534-65ec-4559-9cfb-fe8f43841a5a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044640d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:21.561838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19552350-5d4d-4048-88c5-2d4e65cdb1c2 tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 325 microversion: 2.1 time: 0.644398 Jul 18 02:21:21.581893 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 996/1975] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:20 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 325 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:21.648798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59068534-65ec-4559-9cfb-fe8f43841a5a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423" status: 200 len: 662 microversion: 2.1 time: 0.107815 Jul 18 02:21:21.650916 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 980/1976] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:21 2022] GET /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423 => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:21.666434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ab57c7a-cfde-4984-b310-56fd5e1e89b9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab059a6e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:21.762153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1260223292", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:21.767897 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ab57c7a-cfde-4984-b310-56fd5e1e89b9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423" status: 200 len: 662 microversion: 2.1 time: 0.106840 Jul 18 02:21:21.770261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 997/1977] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:21 2022] GET /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423 => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:21.867993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0fd4affa-4701-42c3-8f10-de0ea649e4e0 req-5fc636d2-48c3-47d4-81c8-3868013ac959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "name": "network-vif-unplugged", "status": "completed", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:21.894313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0fd4affa-4701-42c3-8f10-de0ea649e4e0 req-5fc636d2-48c3-47d4-81c8-3868013ac959 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:21.894690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0fd4affa-4701-42c3-8f10-de0ea649e4e0 req-5fc636d2-48c3-47d4-81c8-3868013ac959 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:21.936726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0fd4affa-4701-42c3-8f10-de0ea649e4e0 req-5fc636d2-48c3-47d4-81c8-3868013ac959 service nova] Creating event network-vif-unplugged:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h1-849796-1 Jul 18 02:21:21.949258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:21.963512 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0fd4affa-4701-42c3-8f10-de0ea649e4e0 req-5fc636d2-48c3-47d4-81c8-3868013ac959 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097416 Jul 18 02:21:21.974766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 998/1978] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:22.098285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:22.102181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:22.143315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.145461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.154624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:22.156846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:22.922957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.939650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.951403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:22.959447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-795c33ca-983f-4f3c-b0a3-05ed68a9e1a1 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.871156 Jul 18 02:21:22.963182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 999/1979] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:22 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:23.627006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:23.627881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:23.628674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:23.631298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:23.632048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:23.697186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.702245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.710224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:23.715436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:23.857726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9ab8c96-b32d-43ff-9263-3e225284830e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab05bf9a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:23.862190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:23.893437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Getting quotas for user 673e6a3177bb423196b7090664dada50 and project 56fe9934008f4a85a9b367bec85b759a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:23.985903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.utils [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] ram quota exceeded for 56fe9934008f4a85a9b367bec85b759a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119440) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 18 02:21:23.986888 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Request method failure captured: Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 145 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MOYZUTdfaPn5k5ndHNRW0cJnAtAr78BDETOd61jMspCFxcG4AqJutMH8mSEBoCJNNfvgieUX58bWn2GceTG9-SSNO-TxdlkCt3DxgNxSRqcdfcC7nrYlvkvt3A-tdmaDKQvA9GB4Rs41CQojDj2VNRIpaoNzGufMJD7ag_CaW0B5vk Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 673e6a3177bb423196b7090664dada50 Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1260223292", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1260223292', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452'}}} Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:21:23.991410 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 18 02:21:23.997092 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:21:24.002333 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9ab8c96-b32d-43ff-9263-3e225284830e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac" status: 200 len: 662 microversion: 2.1 time: 0.155949 Jul 18 02:21:24.007312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:24.009331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9243b71-67d0-4984-a59f-d400baa009db tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.251973 Jul 18 02:21:24.011423 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1000/1980] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:23 2022] GET /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac => generated 662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:24.014252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 981/1981] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 2257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:24.031583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f175de86-b4fd-4243-a140-2c5edf3efc8b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043fcb80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:24.052597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:24.053878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:24.083856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.084669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.086266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.093200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.145182 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f175de86-b4fd-4243-a140-2c5edf3efc8b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac" status: 200 len: 662 microversion: 2.1 time: 0.124108 Jul 18 02:21:24.146144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 982/1982] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:21:24 2022] GET /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac => generated 662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:24.169465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Action: 'update', calling method: .version_select at 0x7fab044150d0>, body: {"quota_set": {"ram": 51200}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:24.545235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.546842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.549732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:24.558726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:24.873806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19c302b3-e06e-4807-b2be-a73778341dcf tempest-QuotasAdminNegativeTest-1030912660 tempest-QuotasAdminNegativeTest-1030912660-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 200 len: 329 microversion: 2.1 time: 0.721099 Jul 18 02:21:24.879100 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 983/1983] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:24 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 329 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:24.911882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1771659582", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:25.227522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.248070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:25.254104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.259968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.264797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ad7199c-6919-495f-b8fb-626b8a3b2d38 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 1.242109 Jul 18 02:21:25.266970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1001/1984] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:24 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:25.288092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8f5afd04-4cfa-44a7-9e10-67b54b10e830 req-8a3c7e71-f89b-4b60-80ed-da55b69e0964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:25.307066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:25.315874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8f5afd04-4cfa-44a7-9e10-67b54b10e830 req-8a3c7e71-f89b-4b60-80ed-da55b69e0964 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:25.316970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8f5afd04-4cfa-44a7-9e10-67b54b10e830 req-8a3c7e71-f89b-4b60-80ed-da55b69e0964 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:25.350667 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8f5afd04-4cfa-44a7-9e10-67b54b10e830 req-8a3c7e71-f89b-4b60-80ed-da55b69e0964 service nova] Creating event network-changed:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h1-849796-1 Jul 18 02:21:25.365218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8f5afd04-4cfa-44a7-9e10-67b54b10e830 req-8a3c7e71-f89b-4b60-80ed-da55b69e0964 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090221 Jul 18 02:21:25.367144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1002/1985] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:25.374272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5deb5b8a-c946-4f92-83a6-5a5a40f2224c tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Action: 'update', calling method: .version_select at 0x7fab05c4d5e0>, body: {"quota_set": {"ram": 0}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:25.378150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5deb5b8a-c946-4f92-83a6-5a5a40f2224c tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '673e6a3177bb423196b7090664dada50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fe9934008f4a85a9b367bec85b759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5deb5b8a-c946-4f92-83a6-5a5a40f2224c tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Request method failure captured: Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a HTTP/1.1 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 25 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MOYZUTdfaPn5k5ndHNRW0cJnAtAr78BDETOd61jMspCFxcG4AqJutMH8mSEBoCJNNfvgieUX58bWn2GceTG9-SSNO-TxdlkCt3DxgNxSRqcdfcC7nrYlvkvt3A-tdmaDKQvA9GB4Rs41CQojDj2VNRIpaoNzGufMJD7ag_CaW0B5vk Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56fe9934008f4a85a9b367bec85b759a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 56fe9934008f4a85a9b367bec85b759a Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1351701274 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 673e6a3177bb423196b7090664dada50 Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-QuotasAdminNegativeTest-1351701274-project Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: {"quota_set": {"ram": 0}} Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '56fe9934008f4a85a9b367bec85b759a', 'body': {'quota_set': {'ram': 0}}} Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:21:25.388495 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 18 02:21:25.396399 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:21:25.400241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5deb5b8a-c946-4f92-83a6-5a5a40f2224c tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:21:25.401610 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5deb5b8a-c946-4f92-83a6-5a5a40f2224c tempest-QuotasAdminNegativeTest-1351701274 tempest-QuotasAdminNegativeTest-1351701274-project] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a" status: 403 len: 116 microversion: 2.1 time: 0.032458 Jul 18 02:21:25.403400 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1003/1986] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:21:25 2022] PUT /compute/v2.1/os-quota-sets/56fe9934008f4a85a9b367bec85b759a => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:21:25.408842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-91190603-79b5-4ab5-b294-d3d1e5b13fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Action: 'create', calling method: .version_select at 0x7fab0591a9d0>, body: {"keypair": {"name": "tempest-keypair-396196790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPneHTrXCCjquN+RgYjmstSHE+5wfcduPxbRza0Js8OJACHFlLaCCTQswr9YMpWvfAJhPJb2D6QbAmh7gO7H4HrGmtI0mkwqa8sXc6xCvmcA9ZvY0QZBG/ibB7UrfXn5yQ=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:25.463541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-91190603-79b5-4ab5-b294-d3d1e5b13fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Getting quotas for project 1cbdb481f9f84d8cabf7d597a49ff953. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:25.483768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-91190603-79b5-4ab5-b294-d3d1e5b13fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Getting quotas for user 8682b94d00cc441fa05e0978b1a56b45 and project 1cbdb481f9f84d8cabf7d597a49ff953. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:25.552981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-91190603-79b5-4ab5-b294-d3d1e5b13fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.141852 Jul 18 02:21:25.557100 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1004/1987] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:21:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:21:26.218399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:26.220205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:26.221662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:26.222799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:26.223570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:26.259534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.273937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.274321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.275039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.308641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:26.314171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:26.353455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Getting quotas for project 637a50800bab433ebff8bcc586b0b5bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:26.363888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.366391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.375854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:26.380425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:26.400061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Getting quotas for user 55d10a19e6a34995bc1187088e72a1f9 and project 637a50800bab433ebff8bcc586b0b5bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:26.454738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:21:26.466384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:21:26.484546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=76 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:26.642745 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd1978cd-70be-4fd0-9601-b5c201a61826 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761889 Jul 18 02:21:26.643907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 984/1988] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:21:26.938129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-282603074", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:27.154976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:28.331031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:28.382966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:28.386000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:28.388811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4fbb53c-5a7e-4754-bb06-82fd0d9ef1b2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 2.097060 Jul 18 02:21:28.408333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1005/1989] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:26 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:28.534520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:28.535895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:28.538341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:28.539460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:28.540147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:28.564624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:28.566206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:28.568702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:28.570234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:28.615931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Getting quotas for project 637a50800bab433ebff8bcc586b0b5bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:28.627724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Getting quotas for user 55d10a19e6a34995bc1187088e72a1f9 and project 637a50800bab433ebff8bcc586b0b5bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:28.656301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:21:28.661452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:21:28.695450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:28.806709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da5c63ba-7f31-42f6-9a0f-a56af92c1393 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873568 Jul 18 02:21:28.811025 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 985/1990] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:21:28.826374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e428b454-2edb-4e83-9110-74f83ca59786 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:28.827634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e428b454-2edb-4e83-9110-74f83ca59786 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:29.334437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e428b454-2edb-4e83-9110-74f83ca59786 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:29.348542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e428b454-2edb-4e83-9110-74f83ca59786 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1217 microversion: 2.1 time: 0.526848 Jul 18 02:21:29.349624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1006/1991] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:28 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:29.445043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:29.449508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:29.484606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:29.511361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:29.514213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:29.514849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.380322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:30.387635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:30.423193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.424393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.426314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:30.434550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:30.723694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:30.750813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-828cad15-a6f7-4d8d-ba2b-113d3482f5fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1221 microversion: 2.1 time: 0.380337 Jul 18 02:21:30.762522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1007/1992] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:30 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:31.404743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:31.449157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:31.453289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:31.463643 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c1f4017d-d5df-4fb0-9fdc-17d2554ff715 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 2.028023 Jul 18 02:21:31.465392 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 986/1993] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:29 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:31.789390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:31.790207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:31.797532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:31.815460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:31.819044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:31.829100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:31.833646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:32.153434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:32.170525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cb57999b-ba7a-4f66-9329-a41dd5aba7b1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1287 microversion: 2.1 time: 0.385856 Jul 18 02:21:32.172576 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1008/1994] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:31 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1287 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:32.484897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:32.486844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:32.513355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:32.515124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:32.516427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:32.520715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.202560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:33.203351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:33.222923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.227983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.232439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.238217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.248821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:33.269435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:33.271415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:33.272738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c5bb8e5-7a45-41f1-bf29-47e2d3a60064 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.792936 Jul 18 02:21:33.283860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 987/1995] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:32 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:33.329717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-aa4c4f41-5538-4108-8248-31160a84ac33 req-2c02dd03-0afc-4f38-b58d-678af2b32299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "name": "network-vif-unplugged", "status": "completed", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:33.347183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aa4c4f41-5538-4108-8248-31160a84ac33 req-2c02dd03-0afc-4f38-b58d-678af2b32299 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.347642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aa4c4f41-5538-4108-8248-31160a84ac33 req-2c02dd03-0afc-4f38-b58d-678af2b32299 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.406254 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-aa4c4f41-5538-4108-8248-31160a84ac33 req-2c02dd03-0afc-4f38-b58d-678af2b32299 service nova] Creating event network-vif-unplugged:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h1-849796-1 Jul 18 02:21:33.419324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-aa4c4f41-5538-4108-8248-31160a84ac33 req-2c02dd03-0afc-4f38-b58d-678af2b32299 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093831 Jul 18 02:21:33.424018 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 988/1996] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:33.611691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfc8b717-5a91-436c-86de-03b79b1c6ade"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:33.614448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:33.634850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.637356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.641112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:33.642457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:33.764627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:33.804787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d940131-d817-4eb5-b062-403b14f79367 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1275 microversion: 2.1 time: 0.607038 Jul 18 02:21:33.813466 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1009/1997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:33 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1275 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:34.315149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac979f8c-1f44-4719-8fd9-eae9e80e8d48 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "POST /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708446 Jul 18 02:21:34.316246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 989/1998] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:21:33 2022] POST /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:34.319272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:34.348215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:34.433645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:34.473350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:34.483066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:34.493656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:34.833099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:34.834180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:34.860622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:34.861121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:34.862229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:34.865863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:35.417937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.439767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca624823-e9c0-4516-b3a7-cbee00888923 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 0.611594 Jul 18 02:21:35.440645 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 990/1999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:34 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:35.446211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1414310688", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "968ca811-c61b-4b28-93f3-d3c0f3f23453"}, {"port": "1bb5c7e7-e428-4d94-9253-52e8ef2e2338", "tag": "port-1"}, {"port": "6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2", "tag": "port-2"}, {"uuid": "9c7a7d18-5c7f-40f8-9f8d-bd96d8fa2d5b", "tag": "net-1"}, {"uuid": "9c7a7d18-5c7f-40f8-9f8d-bd96d8fa2d5b"}, {"uuid": "69c127ec-b928-430f-9ea5-28e77f22c794", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "69c127ec-b928-430f-9ea5-28e77f22c794", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7a5d4e63-d729-4131-a9df-5f55d92174be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "45415f80-b5cd-4534-8c5e-82aef2b2c948", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "950b260b-cd34-4c32-a837-1392a6400ea6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1024878463"}], "key_name": "tempest-keypair-396196790", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:35.564317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.588664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.602618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:35.606168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88ba0467-3dc7-4e2b-ac39-fa31bb257371 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 1.308422 Jul 18 02:21:35.607218 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1010/2000] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:34 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:36.159071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] validate_networks() for [('968ca811-c61b-4b28-93f3-d3c0f3f23453', None, None, None, None, None), (None, None, '1bb5c7e7-e428-4d94-9253-52e8ef2e2338', None, None, None), (None, None, '6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2', None, None, None), ('9c7a7d18-5c7f-40f8-9f8d-bd96d8fa2d5b', None, None, None, None, None), ('9c7a7d18-5c7f-40f8-9f8d-bd96d8fa2d5b', None, None, None, None, None), ('69c127ec-b928-430f-9ea5-28e77f22c794', '10.2.2.100', None, None, None, None), ('69c127ec-b928-430f-9ea5-28e77f22c794', '10.2.2.200', None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:36.489398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:36.490176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:36.509857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.511211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:36.512904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:36.528072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:37.296663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:37.337516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc177053-c758-4b69-af67-3a36061215a8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 0.870639 Jul 18 02:21:37.339184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1011/2001] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:36 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:37.375498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:37.378347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:37.393183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:37.393647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:37.399601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:37.400347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.315211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:38.330275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:38.336059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:38.339439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be4915b8-4e6d-4724-9d7b-5c5ccb609da6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.997053 Jul 18 02:21:38.342054 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1012/2002] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:37 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:38.376268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:38.396902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:38.418814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.421526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.422953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:38.426741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:38.597189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:38.644816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=46 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:39.074687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:39.094656 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6abd1781-425e-4e58-a771-ad90143be1af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 0.731848 Jul 18 02:21:39.109404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1013/2003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:38 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:39.361080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:39.362006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:39.366107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=44 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:39.374353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.382537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:39.383762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:39.384517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:40.500189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:40.518034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:40.532369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:40.533681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d809b7d-27df-4154-bdd1-28f98c72d19f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 1.176828 Jul 18 02:21:40.551932 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1014/2004] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:39 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:40.567696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-442ce225-d670-444b-8682-62d6be277a3e req-4acad207-c020-40f1-ae6c-868159317eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb36d11-eea4-48cc-9680-e854c7e16ab5", "tag": "d421c541-4386-4e00-b959-ca13f1e84515"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:40.598378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-442ce225-d670-444b-8682-62d6be277a3e req-4acad207-c020-40f1-ae6c-868159317eec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:40.598841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-442ce225-d670-444b-8682-62d6be277a3e req-4acad207-c020-40f1-ae6c-868159317eec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:40.636594 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-442ce225-d670-444b-8682-62d6be277a3e req-4acad207-c020-40f1-ae6c-868159317eec service nova] Creating event network-changed:d421c541-4386-4e00-b959-ca13f1e84515 for instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 on n-h2-849796-1 Jul 18 02:21:40.652710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-442ce225-d670-444b-8682-62d6be277a3e req-4acad207-c020-40f1-ae6c-868159317eec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097774 Jul 18 02:21:40.653430 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1015/2005] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:40.663717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:40.664454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:40.691112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:40.692516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:40.693618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:40.706787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:42.192335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:42.234072 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2effb921-cd0d-4aa6-a4d5-cc1bb0ee3377 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 1.572150 Jul 18 02:21:42.248425 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1016/2006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:40 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:42.262388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:42.272542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:42.287169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:42.288097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:42.289483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:42.290375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.095389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:43.122023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:43.125598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:43.129402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-341cdb6a-dc11-4200-a58b-4396eeea78f0 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.875106 Jul 18 02:21:43.133387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1017/2007] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:42 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:43.462096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:43.482628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.487682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.507231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.512818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.589242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d74eb7d7-3c01-4d28-a5f0-cd0c84b277d8 tempest-AZV2TestJSON-202271441 tempest-AZV2TestJSON-202271441-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.453251 Jul 18 02:21:43.594240 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1018/2008] 10.222.0.67 () {58 vars in 1163 bytes} [Mon Jul 18 02:21:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:21:43.606727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c17f9cb2-6380-487b-85b7-df3da86c415e req-4479cd77-73d2-43cd-94de-be1809bf300e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:43.637872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c17f9cb2-6380-487b-85b7-df3da86c415e req-4479cd77-73d2-43cd-94de-be1809bf300e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.638236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c17f9cb2-6380-487b-85b7-df3da86c415e req-4479cd77-73d2-43cd-94de-be1809bf300e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.669482 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c17f9cb2-6380-487b-85b7-df3da86c415e req-4479cd77-73d2-43cd-94de-be1809bf300e service nova] Creating event network-changed:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:21:43.676718 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c17f9cb2-6380-487b-85b7-df3da86c415e req-4479cd77-73d2-43cd-94de-be1809bf300e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080718 Jul 18 02:21:43.677437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1019/2009] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:43.696467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:43.697569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:43.719254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.720028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:43.721099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:43.721742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:44.225761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:44.276194 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59c9de8b-12d8-46e9-b0ec-f00804cd7ec2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 0.586740 Jul 18 02:21:44.277710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1020/2010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:43 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:44.287058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:44.287745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:44.306835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:44.307331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:44.322565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:44.323591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:44.818053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:44.834696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:44.836419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:44.837865 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3bd79262-93b1-464b-b9e2-d1362d362c35 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1487 microversion: 2.25 time: 0.559089 Jul 18 02:21:44.852047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1021/2011] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:44 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1487 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:44.860123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1330429272", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "02468610-b7a9-4f9f-b82b-fcd8322cd0c8"}], "block_device_mapping_v2": [{"uuid": "fe9ec756-8955-466a-8fbf-424cb8925c52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:44.973974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] validate_networks() for [('02468610-b7a9-4f9f-b82b-fcd8322cd0c8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:21:45.424034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:46.015591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:46.016203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:46.017324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:46.018249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:46.019135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:46.059896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:46.061667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:46.063399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:46.064586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:46.144314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Getting quotas for project 1cbdb481f9f84d8cabf7d597a49ff953. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:46.176465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Getting quotas for user 8682b94d00cc441fa05e0978b1a56b45 and project 1cbdb481f9f84d8cabf7d597a49ff953. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:46.578930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:21:46.584303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7a5d4e63-d729-4131-a9df-5f55d92174be',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='45415f80-b5cd-4534-8c5e-82aef2b2c948',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='950b260b-cd34-4c32-a837-1392a6400ea6',volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:21:47.316116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3ad3f9c-bf08-4c9a-8b97-f5f3755b090e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.867194 Jul 18 02:21:47.316116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 991/2012] 10.222.0.67 () {62 vars in 1188 bytes} [Mon Jul 18 02:21:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 11870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:21:47.316116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:47.316952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:47.329570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.330353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.331254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.331772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.659785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:47.679908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fbb13417-42ec-425f-8388-16bf4063999b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 0.367919 Jul 18 02:21:47.694215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 992/2013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:47 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:47.701466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:47.702690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:47.710822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.711834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.712976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.714173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.933613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:21:47.934639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:21:47.935730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:21:47.937012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:21:47.937477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:21:47.959181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.959684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:47.960584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:47.965644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:48.024356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:21:48.043116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Getting quotas for user d2b97e560fcf4750b2aad92d6d37e611 and project 77f285a7129746c9b8bbb9cc80c7ea42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:21:48.139052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.161084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.170960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.173989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b195d59e-b665-48ba-af42-c518339da91f tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1477 microversion: 2.25 time: 0.476588 Jul 18 02:21:48.177157 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 993/2014] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:47 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:48.195667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:48.196348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:48.208268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:21:48.221700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe9ec756-8955-466a-8fbf-424cb8925c52',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:21:48.435999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.445706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.453783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:48.456638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3274e32-d58a-47a7-80b9-8fe6f414fc02 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1285 microversion: 2.32 time: 0.277435 Jul 18 02:21:48.459335 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 994/2015] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:48 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1285 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:48.482834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1511fcd1-42d2-40ab-81a0-17eab6591f26 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '.version_select at 0x7fab043e89d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:48.493322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1511fcd1-42d2-40ab-81a0-17eab6591f26 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.494286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1511fcd1-42d2-40ab-81a0-17eab6591f26 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:48.526860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1511fcd1-42d2-40ab-81a0-17eab6591f26 tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.059687 Jul 18 02:21:48.530081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 995/2016] 10.222.0.67 () {60 vars in 1183 bytes} [Mon Jul 18 02:21:48 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:48.550763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:48.551752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:48.567165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.567636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:48.568477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.568955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:48.940967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcbe107a-69a3-406d-a3c8-a26c03e40e8d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.079623 Jul 18 02:21:48.942167 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1022/2017] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:21:48.969303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:48.971695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:48.997664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:48.998752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.000736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:49.002651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.148628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] Lazy-loading 'services' on Instance uuid 27dde308-8251-4416-a75a-48482ee4fce7 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:21:49.204276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93813f3e-9fba-4bea-ae17-ede63dc70d2b tempest-LiveAutoBlockMigrationV225Test-1675116116 tempest-LiveAutoBlockMigrationV225Test-1675116116-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1970 microversion: 2.25 time: 0.658484 Jul 18 02:21:49.214232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 996/2018] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:48 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1970 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:49.238092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ed8410a-9b30-43b8-b5c8-2d0440f8a0f3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:49.246480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ed8410a-9b30-43b8-b5c8-2d0440f8a0f3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:49.486852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ed8410a-9b30-43b8-b5c8-2d0440f8a0f3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:49.513890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ed8410a-9b30-43b8-b5c8-2d0440f8a0f3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1053 microversion: 2.1 time: 0.291290 Jul 18 02:21:49.526936 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 997/2019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:49 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1053 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:49.540658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:49.542251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:49.561459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:49.562384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.563520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:49.564290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:49.680002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:21:50.094153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b851d55-60fb-435f-b39f-e52ba9cf6a5b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 204 len: 0 microversion: 2.25 time: 0.564854 Jul 18 02:21:50.103515 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 998/2020] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:21:49 2022] DELETE /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:21:50.138319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:50.145290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:50.174605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.175745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.180378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.208219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.594542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:50.629423 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0f5e9188-f4f6-4cbd-95d6-cc6b79a11053 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 1.672757 Jul 18 02:21:50.630831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1023/2021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:48 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:50.649367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:50.651532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:50.675448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.680357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.691256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.692447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.861337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:50.889977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:50.893594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:50.906128 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc55ace1-a51b-4202-988d-cef785fbb54e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1519 microversion: 2.32 time: 0.798575 Jul 18 02:21:50.920978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 999/2022] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:50 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1519 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:50.920978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:50.920978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:50.933235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.934018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:50.935051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:50.935966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:51.098502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:51.108334 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-286c819a-ce12-49be-b071-335bfa8d626a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1095 microversion: 2.1 time: 0.195657 Jul 18 02:21:51.108909 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1000/2023] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:50 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1095 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:51.317778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:51.333096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:51.338201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:51.341169 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31662cdf-338f-4992-a592-04da9d97e989 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1483 microversion: 2.25 time: 0.708515 Jul 18 02:21:51.342477 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1024/2024] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:50 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1483 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:51.653106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:51.654032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:51.672525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:51.676021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:51.679393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:51.680818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:51.771637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:51.997806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-85daac34-ff1c-4b95-b14c-c1b2e9315b48 req-ef857313-1a15-47ef-9a64-9ac2c728d005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb36d11-eea4-48cc-9680-e854c7e16ab5", "name": "network-vif-plugged", "status": "completed", "tag": "d421c541-4386-4e00-b959-ca13f1e84515"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:52.033637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-85daac34-ff1c-4b95-b14c-c1b2e9315b48 req-ef857313-1a15-47ef-9a64-9ac2c728d005 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.042550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-85daac34-ff1c-4b95-b14c-c1b2e9315b48 req-ef857313-1a15-47ef-9a64-9ac2c728d005 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.079177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-85daac34-ff1c-4b95-b14c-c1b2e9315b48 req-ef857313-1a15-47ef-9a64-9ac2c728d005 service nova] Creating event network-vif-plugged:d421c541-4386-4e00-b959-ca13f1e84515 for instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 on n-h2-849796-1 Jul 18 02:21:52.101797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-85daac34-ff1c-4b95-b14c-c1b2e9315b48 req-ef857313-1a15-47ef-9a64-9ac2c728d005 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.589008 Jul 18 02:21:52.103063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1001/2025] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:52.123283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:52.124095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:52.134968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.135484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.136331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.136786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.326903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.369364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.370813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.373323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-815f574a-3b68-44f6-b2af-5be2fdda8c05 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1593 microversion: 2.32 time: 0.268678 Jul 18 02:21:52.374640 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1002/2026] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:52 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1593 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:52.389158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:52.391868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:52.410786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.411360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.413769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.413769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.819887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:52.862891 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-919d3172-5eac-4d4f-ad59-31750250ffe0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1169 microversion: 2.1 time: 0.479906 Jul 18 02:21:52.865025 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1003/2027] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:52 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1169 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:52.896206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:52.897358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:52.923492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.924251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:52.925694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:52.926420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:53.030779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:53.049656 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c19ae405-2c3b-43cb-87f9-eb071bf2523e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 1.402272 Jul 18 02:21:53.050684 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1025/2028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:51 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:21:53.415579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:53.416819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:53.450913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:53.451761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:53.465187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:53.466422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.228376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.279025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.284009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.285289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3127048-0a8b-4538-a552-e124b7ae15cb tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1593 microversion: 2.32 time: 0.879944 Jul 18 02:21:54.286441 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1026/2029] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:53 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1593 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:54.293360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:54.294272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:54.303618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:54.304371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.305519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:54.306172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.433481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.475096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.476729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.478068 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c6f377c-979c-4c90-9a9a-0191e4a60805 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1483 microversion: 2.25 time: 1.605263 Jul 18 02:21:54.479666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1004/2030] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:52 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1483 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:54.485192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:54.494062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:54.507678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:54.508390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.509438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:54.510221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.911461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:54.925847 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ef7ad44-9e3f-4f4a-9d67-8dc330f56414 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 0.636178 Jul 18 02:21:54.928770 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1027/2031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:54 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:54.939771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-19b12b96-f936-454e-961d-b9529354f21c req-45824f2e-08d4-4292-80cb-e5524f2b53ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:54.956263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-19b12b96-f936-454e-961d-b9529354f21c req-45824f2e-08d4-4292-80cb-e5524f2b53ef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:54.957169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-19b12b96-f936-454e-961d-b9529354f21c req-45824f2e-08d4-4292-80cb-e5524f2b53ef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:54.976725 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-19b12b96-f936-454e-961d-b9529354f21c req-45824f2e-08d4-4292-80cb-e5524f2b53ef service nova] Creating event network-vif-plugged:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:21:54.998980 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-19b12b96-f936-454e-961d-b9529354f21c req-45824f2e-08d4-4292-80cb-e5524f2b53ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067602 Jul 18 02:21:55.002636 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1028/2032] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:55.412839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-27c43176-96ca-44b8-b496-5f5594286c28 req-ee259450-7813-49f0-826b-89e4b87d251b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dde308-8251-4416-a75a-48482ee4fce7", "name": "network-vif-deleted", "tag": "80dbfecc-4017-484c-922c-5f168f08d377"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:55.435380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-27c43176-96ca-44b8-b496-5f5594286c28 req-ee259450-7813-49f0-826b-89e4b87d251b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:55.441235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-27c43176-96ca-44b8-b496-5f5594286c28 req-ee259450-7813-49f0-826b-89e4b87d251b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:55.475991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-27c43176-96ca-44b8-b496-5f5594286c28 req-ee259450-7813-49f0-826b-89e4b87d251b service nova] Creating event network-vif-deleted:80dbfecc-4017-484c-922c-5f168f08d377 for instance 27dde308-8251-4416-a75a-48482ee4fce7 on n-h2-849796-1 Jul 18 02:21:55.483104 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-27c43176-96ca-44b8-b496-5f5594286c28 req-ee259450-7813-49f0-826b-89e4b87d251b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342092 Jul 18 02:21:55.484072 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1029/2033] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:21:55.489978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:55.491008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:55.499439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:55.499930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:55.501139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:55.501751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:55.935026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:55.966404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48e3823e-b7b0-4e32-99de-0c4ca6621a15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1317 microversion: 2.1 time: 1.484941 Jul 18 02:21:55.967527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1005/2034] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:54 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1317 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:55.985679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:55.986861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:56.014216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.015085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.016461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.017304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.101656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.126446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:56.149302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.156154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.158587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fb0888d-40a6-4486-8033-6c961b21e70f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1593 microversion: 2.32 time: 0.672112 Jul 18 02:21:56.159248 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1030/2035] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:55 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1593 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:56.175345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:56.186361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:56.200970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:56.202698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.203171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.204079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.204462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.554445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.580364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.582419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.584825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:56.593978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-86c6cd62-3f1a-42d5-8000-40dc400fdc99 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.617846 Jul 18 02:21:56.602759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1006/2036] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:55 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:56.609357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af4c8f1e-9cc3-4690-8c09-b2b41b71782b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 0.448514 Jul 18 02:21:56.610474 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1031/2037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:56 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:56.907128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b35de05d-85e6-4d33-a29a-ba07aff56df6 req-7d6e7d42-59ef-4553-b3fb-20951e1ef274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:56.928898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b35de05d-85e6-4d33-a29a-ba07aff56df6 req-7d6e7d42-59ef-4553-b3fb-20951e1ef274 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.929396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b35de05d-85e6-4d33-a29a-ba07aff56df6 req-7d6e7d42-59ef-4553-b3fb-20951e1ef274 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.959786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b35de05d-85e6-4d33-a29a-ba07aff56df6 req-7d6e7d42-59ef-4553-b3fb-20951e1ef274 service nova] Creating event network-changed:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h1-849796-1 Jul 18 02:21:56.972068 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b35de05d-85e6-4d33-a29a-ba07aff56df6 req-7d6e7d42-59ef-4553-b3fb-20951e1ef274 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223671 Jul 18 02:21:56.973538 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1007/2038] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:21:56.985994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:56.987346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:56.997119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:56.998057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:56.999661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.000416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.192383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:57.194046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:57.208330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.209185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.210332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.211022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.509173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.528290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.540985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:57.544182 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac867751-3ff5-4878-b55e-026f63116635 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1593 microversion: 2.32 time: 0.356041 Jul 18 02:21:57.548657 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1008/2039] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:57 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1593 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:57.657861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:57.659127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:57.674907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.679699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.680893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:57.681576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:57.991773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:58.079141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:58.177865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:58.202278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:58.207586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:58.224293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fc2644b-39d2-42c0-a095-d52db38b4c68 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.571172 Jul 18 02:21:58.225109 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1009/2040] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:57 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:21:58.249358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:58.250745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:58.268675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:58.281562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.284341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de6e1a7b-8429-4b41-86d9-daf0876e8976 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1467 microversion: 2.1 time: 1.303289 Jul 18 02:21:58.296021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.297697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.300178 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1032/2041] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:56 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1467 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:58.301283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.309425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:58.313661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:58.316662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:58.330507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.334000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.337283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.339616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.860686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:58.879243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10182bea-fed4-41e8-b54c-38119c6f2281 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1468 microversion: 2.1 time: 0.571642 Jul 18 02:21:58.880177 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1033/2042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:58 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1468 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:58.892854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:58.896140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:58.919812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.920294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:58.921171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:58.921634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.296737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.319254 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16cb09eb-b7f9-4269-94ac-012b5ac3506f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 1.092093 Jul 18 02:21:59.333668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1010/2043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:21:58 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:21:59.341346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-347925644"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:21:59.344188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:59.354662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:59.355815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.357182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:59.357857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.491994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.516290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.519168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.520433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcd7af63-9cf0-4970-9209-6af20b8c406b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1661 microversion: 2.32 time: 0.639472 Jul 18 02:21:59.534509 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1034/2044] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:58 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1661 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:21:59.540860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:21:59.542093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:21:59.559484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:59.560330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.561742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:21:59.562428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:21:59.749920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:21:59.917577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.952537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.961583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:21:59.966981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7d4921f-bd4a-438d-8c22-c704d079ee02 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.430923 Jul 18 02:21:59.974587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1035/2045] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:21:59 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:00.333994 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3bbde063-28bb-4e29-82c1-b50652ed920c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "POST /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7/action" status: 202 len: 0 microversion: 2.1 time: 0.997976 Jul 18 02:22:00.349551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:00.351466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:00.352914 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1011/2046] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:21:59 2022] POST /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:22:00.366590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5fd9c9a-ec29-44da-9bdb-3f1e585a319f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044b65e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:00.381310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.382419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:00.383821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.384647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:00.581811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5fd9c9a-ec29-44da-9bdb-3f1e585a319f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.222624 Jul 18 02:22:00.586046 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1012/2047] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:00 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:00.605523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:00.607341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:00.612357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:00.640477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.642684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:00.644422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:00.645756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:00.855209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:00.865983 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-754a9019-eac5-44c3-84c5-26d5c96c1981 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 0.527611 Jul 18 02:22:00.866859 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1036/2048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:00 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:01.011584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:01.012038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:01.029835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:01.031178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:01.033211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:01.034276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:01.128083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.162367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.165608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.167408 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a4ce4cc2-cba5-46d9-8b83-6aa7572a265d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.164663 Jul 18 02:22:01.169457 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1037/2049] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:01 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:01.280067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.306414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.308285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:01.309727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b395c6ac-038e-4d29-8ce0-70a676cc9dba tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1661 microversion: 2.32 time: 0.719279 Jul 18 02:22:01.311020 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1013/2050] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:00 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1661 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:01.609558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f16750a9-386b-40c3-b7b6-74127476dbbf tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab055c8310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:01.735841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f16750a9-386b-40c3-b7b6-74127476dbbf tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.132649 Jul 18 02:22:01.736802 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1038/2051] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:01 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:01.887894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:01.889342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:01.897476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:01.898259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:01.899308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:01.899949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.199927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:02.202702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:02.224446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:02.225005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.225872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:02.226330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.344440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.358408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.368351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.369866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d5e033f-0d96-41cf-88cf-d4a852fba052 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.174833 Jul 18 02:22:02.376274 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1039/2052] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:02 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:02.383315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:02.389466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:02.408395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:02.409300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.410398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:02.411079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:02.778341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.792207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.794398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:02.796064 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdc875ab-3f9b-4f6e-bf84-daafba3177a7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1661 microversion: 2.32 time: 0.418309 Jul 18 02:22:02.796982 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1040/2053] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:02 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1661 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:02.802202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e34ce711-c9ee-4c1e-9940-79a76b332229 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5a790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:02.898740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e34ce711-c9ee-4c1e-9940-79a76b332229 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.100370 Jul 18 02:22:02.899794 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1041/2054] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:02 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:03.056817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:03.068444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-77bd0f4b-1c7f-4eba-bba8-a86105206695 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 1.185299 Jul 18 02:22:03.069501 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1014/2055] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:01 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:03.401659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:03.403084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:03.416023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.418904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:03.420013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.421779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:03.531787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:03.544859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:03.547123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:03.549500 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcc48e16-760a-4f56-94c2-b9d20097e3bb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.152809 Jul 18 02:22:03.551019 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1042/2056] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:03 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:03.832858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:03.836512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:03.866359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.868723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:03.872070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:03.873623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:03.919356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95253a11-c470-46c6-9e5c-f483d9dd07b5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5aaf0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:04.053286 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95253a11-c470-46c6-9e5c-f483d9dd07b5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.138558 Jul 18 02:22:04.062252 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1043/2057] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:03 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:04.099980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:04.105177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:04.132956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:04.141918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.147104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:04.155338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.613589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.630292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d631574-d451-4575-afb6-822e5f657c89 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 0.538229 Jul 18 02:22:04.645026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1044/2058] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:04 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:04.660644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:04.664771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:04.684669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:04.685335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.687087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:04.689699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:04.770791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.795553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.800007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.805664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8a800b1-5df9-40e9-8793-d3814ed2f77f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1708 microversion: 2.32 time: 0.980333 Jul 18 02:22:04.807877 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1015/2059] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:03 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1708 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:04.909031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.921133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.925644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:04.930627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3a7c71e-a6c2-4a88-a237-a47ba6260922 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.284200 Jul 18 02:22:04.944468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1045/2060] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:04 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:05.077469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebe472da-fe69-45e1-a27e-d21c60cd950d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0443b0d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:05.174721 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ebe472da-fe69-45e1-a27e-d21c60cd950d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.103849 Jul 18 02:22:05.184182 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1016/2061] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:05 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:05.654653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:05.659648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:05.690102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.694085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:05.701141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.702261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:05.798021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:05.827640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:05.829409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:05.841980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.844727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:05.846105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:05.850098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:06.146237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.160516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95e7a3df-644f-4a55-a71b-328e97cad767 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 0.514230 Jul 18 02:22:06.173941 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1046/2062] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:05 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:06.179955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:06.181055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:06.191416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:06.192407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:06.193489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:06.194170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:06.555352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.577744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.582758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.586425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-98e12a05-b914-488e-902b-37b7a218a52f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1708 microversion: 2.32 time: 0.762654 Jul 18 02:22:06.608143 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1017/2063] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:05 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1708 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:06.619638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.625510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e32a4387-191c-4a09-b761-eee9762113eb tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044b6160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:06.637457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.644777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:06.648358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5bb37052-ecf6-469e-81d8-2c276cea3d28 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.473134 Jul 18 02:22:06.650277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1047/2064] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:06 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:06.731636 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e32a4387-191c-4a09-b761-eee9762113eb tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.120914 Jul 18 02:22:06.734541 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1018/2065] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:06 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:07.187089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:07.202984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:07.239484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.240336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:07.242502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.254157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:07.623387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:07.625702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:07.640044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.641065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:07.642782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:07.643690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:08.368257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.424197 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1b13855-e955-4cb7-bed9-01d6bf08d735 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 1.246937 Jul 18 02:22:08.471052 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1048/2066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:07 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:08.482135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:08.483198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:08.506931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:08.507517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:08.508374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:08.509106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:08.711053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.777845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.780855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.785433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe598065-8bcc-4b21-80a9-4d0de2689893 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.312806 Jul 18 02:22:08.814921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1049/2067] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:08 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:08.817849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.837794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fc371c5-5a22-42f5-a2a3-bf64f3480e28 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eeb310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:08.851962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.859678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:08.869338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17b528d5-711f-4cdd-ad89-54e2ddb814ae tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1755 microversion: 2.32 time: 1.246242 Jul 18 02:22:08.872502 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1019/2068] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:07 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1755 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:08.953827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fc371c5-5a22-42f5-a2a3-bf64f3480e28 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.137100 Jul 18 02:22:08.961511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1050/2069] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:08 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:09.489809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:09.491312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:09.512683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.513216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:09.514024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.530835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:09.833078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:09.834239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:09.865479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.866309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:09.867820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:09.887352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:10.058422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.077857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.093517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.095139 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd948ede-8735-4189-9d07-37437c6783a3 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.280548 Jul 18 02:22:10.096262 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1051/2070] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:09 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:10.101261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:10.103961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:10.125807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:10.126705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:10.127910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:10.128577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:10.614518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.655208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6179e45-50f5-45f0-8f1b-13f632f4eda2 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 1.175105 Jul 18 02:22:10.681316 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1020/2071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:09 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:10.715157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85f2a8c6-4a64-4dde-87c3-9f5723392119 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043ed040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:10.801820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.817062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.834690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:10.842866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45eb08c9-ff09-4e3b-b440-c85aaec67c32 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1755 microversion: 2.32 time: 0.745215 Jul 18 02:22:10.848738 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1052/2072] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:10 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1755 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:10.907456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85f2a8c6-4a64-4dde-87c3-9f5723392119 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.212968 Jul 18 02:22:10.913125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1021/2073] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:10 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:11.115191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:11.115785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:11.161529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.171248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.179387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.180542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.412271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:11.443230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:11.445445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:11.447057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e99aa79-f3d3-4e85-a0a4-9fe622e9573c tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.336942 Jul 18 02:22:11.451995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1053/2074] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:11 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:11.696342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:11.697634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:11.794497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.796562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.805295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.806647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.871262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:11.872716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:11.898966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.902335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:11.903418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:11.905594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:13.773876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:13.783418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:13.798475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:13.807684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:13.810297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28e7c0e5-fac5-44dc-b395-da962c777fa9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1802 microversion: 2.32 time: 1.945590 Jul 18 02:22:13.811991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1054/2075] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:11 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1802 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:13.827903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da55be47-80d8-475a-8232-822fb3709b15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5aca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:13.830050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a571a32f-6dd0-488d-af73-cb1d34337437 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1211 microversion: 2.1 time: 2.140177 Jul 18 02:22:13.831182 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1022/2076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:11 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1211 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:13.878527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:13.879909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:13.910190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:13.919048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:13.921464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:13.924700 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da55be47-80d8-475a-8232-822fb3709b15 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.111078 Jul 18 02:22:13.925562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:13.929044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1055/2077] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:13 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:13.941043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-357dcf61-3398-403f-8f59-ffc9b642cf4e req-dc69252a-67b6-47ba-b56b-507bd3492b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:13.973282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-357dcf61-3398-403f-8f59-ffc9b642cf4e req-dc69252a-67b6-47ba-b56b-507bd3492b8b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:13.974433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-357dcf61-3398-403f-8f59-ffc9b642cf4e req-dc69252a-67b6-47ba-b56b-507bd3492b8b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:13.996803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-357dcf61-3398-403f-8f59-ffc9b642cf4e req-dc69252a-67b6-47ba-b56b-507bd3492b8b service nova] Creating event network-vif-plugged:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:22:14.015218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-357dcf61-3398-403f-8f59-ffc9b642cf4e req-dc69252a-67b6-47ba-b56b-507bd3492b8b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080973 Jul 18 02:22:14.017571 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1056/2078] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:14.699950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:14.701982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:14.720104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:14.721764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:14.724292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:14.725737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:14.852465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:22:14.999476 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe1bebab-af73-40e5-bc60-861ba6198750 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 204 len: 0 microversion: 2.1 time: 0.313000 Jul 18 02:22:15.003952 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1057/2079] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:22:14 2022] DELETE /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:22:15.020375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:15.028155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:15.048671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.050170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:15.052339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.056478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:15.534384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:15.563823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:15.567148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:15.574370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ebe03575-bf77-4468-82b3-5c36e8e7f488 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1802 microversion: 2.32 time: 0.566798 Jul 18 02:22:15.582382 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1058/2080] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:15 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1802 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:15.596388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:15.617459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:15.636595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.637978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:15.639087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:15.641599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.149341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:16.199510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:16.214242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:16.223837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb35397f-570b-4d90-8e59-3ebfe12d8868 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 2.380087 Jul 18 02:22:16.239997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1023/2081] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:13 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:16.279522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:16.280746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21873d8c-7225-4c3e-b751-c56cc1a31c87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0443b1f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.290555 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-288c983b-d828-432b-99d6-622d854ea5f9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 0.706007 Jul 18 02:22:16.309148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1059/2082] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:15 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:16.329331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.330454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:16.358323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.359613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.364829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.366586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.530227 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21873d8c-7225-4c3e-b751-c56cc1a31c87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.275440 Jul 18 02:22:16.531926 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1024/2083] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:16.595783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.597715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:16.643854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.647565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.648851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.653811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.867889 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d0568c7-460b-4012-a698-ed45e1d4b443 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.324946 Jul 18 02:22:16.872791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1025/2084] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments => generated 197 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:16.900070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:16.905033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:16.937560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.941030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:16.944531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:16.945727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:17.443025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:17.497904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af89a73e-b377-449e-94e9-b417b81c4375 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1664 microversion: 2.1 time: 1.181887 Jul 18 02:22:17.505789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1060/2085] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1664 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:17.540547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:17.549751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:17.587488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:17.590609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:17.596587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:17.600301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:18.565265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:18.628253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:18.651511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:18.655414 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc12541e-c6d7-4396-b58e-342aa5f0c297 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1802 microversion: 2.32 time: 1.780891 Jul 18 02:22:18.656205 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1026/2086] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:16 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1802 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:18.676336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:18.679607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:18.695649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:18.696112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:18.697040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:18.698113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:19.628274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.693990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.698424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:19.709298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c6b8268-e8ad-486f-8456-40606106edcb tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 1.050596 Jul 18 02:22:19.736019 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1027/2087] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:18 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:19.793308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:19.796772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:19.847864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:19.848788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:19.856215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:19.857187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:21.199559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:21.214838 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f66aaed1-7a17-40b7-8a06-05d42417b89b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 1.476944 Jul 18 02:22:21.224774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1028/2088] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:19 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:21.247935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46506570-4c46-4dfa-9479-658fdc2f871e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0a7b9160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:21.524850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46506570-4c46-4dfa-9479-658fdc2f871e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.297895 Jul 18 02:22:21.545950 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1029/2089] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:21 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:21.565671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:21.567107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:21.591480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:21.595285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:21.599082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:21.601451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:21.948732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0bd1dd8f574aa6a257048c25281683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee26ae4bea4ceb9ba9ef71aa22bd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:21.965934 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5f57178-521d-4eeb-9df5-4d2b061d4d7c tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 200 len: 1597 microversion: 2.1 time: 0.418379 Jul 18 02:22:21.973201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1030/2090] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:21 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 1597 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:21.993351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:22.007296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:22.036105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.042166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.061317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:22.062403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:22.184552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:23.386356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.457568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.476492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.485570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27fb5b5b-573e-4126-93e3-b7dc3038630a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1849 microversion: 2.32 time: 1.507458 Jul 18 02:22:23.486659 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1031/2091] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:21 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1849 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:23.520084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:23.526190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:23.557388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:23.559046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:23.560395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:23.563169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:23.731405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.746698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.754155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:23.758973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9e310a1-4df1-4fb3-8f35-010c4d7c15c5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 0.267706 Jul 18 02:22:23.758973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1032/2092] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:23 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:24.270476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78e06f81-1b63-4a6c-b51a-fb88f831788c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Action: 'create', calling method: .version_select at 0x7fab0a7b95e0>, body: {"keypair": {"name": "tempest-keypair-1153864603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQWNnr71wZO8ZpSVbl4ClzFKR5BNh0UggQZEPJSYrZAh06oVSJadpKrU44L1O+bmp3RCLYblyAU4hVDJYRTGOlMSbzx83q/PGHLnnnKUvDPCnHXOWkP3KTcD+Tb5QC0Kw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:24.324413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-78e06f81-1b63-4a6c-b51a-fb88f831788c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for project 3023a58217a649d28186813b61d4afbf. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:24.346886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-78e06f81-1b63-4a6c-b51a-fb88f831788c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for user 4c24789267bf404a841b414eb1019d97 and project 3023a58217a649d28186813b61d4afbf. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:24.512522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78e06f81-1b63-4a6c-b51a-fb88f831788c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.750069 Jul 18 02:22:24.515694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1033/2093] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:24.529684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:24.531570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:24.546944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.548787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:24.551217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:24.552841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:25.546077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:25.591849 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e465e11e-437e-4404-b7d1-96c34501070b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 1.072976 Jul 18 02:22:25.592898 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1034/2094] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:24 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:26.249471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45523a8e-7474-4958-b47b-630a70c32b93 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Action: 'create', calling method: .version_select at 0x7fab044d8ee0>, body: {"keypair": {"name": "tempest-keypair-1562931593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9xfLzas9ugGmaqjD2d5V5G7s2XGjG117gE4ejgnSdUjrRY8O+pMoDfg7/Zt5LL+XFjqj/5qyvuxhd+TzwEqBtH39uNy5nPed3zacMrzDc1ddATF+6lGO25mQuB+Va95Q=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:26.335849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45523a8e-7474-4958-b47b-630a70c32b93 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:26.376081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45523a8e-7474-4958-b47b-630a70c32b93 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for user de515d451d7c40ce8e4f31ff9d5367b5 and project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:26.465497 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45523a8e-7474-4958-b47b-630a70c32b93 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.848677 Jul 18 02:22:26.477363 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1035/2095] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:22:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:26.487234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cffdd64c-d9d6-476d-9a7d-eebf4088cc53 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044d8700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.601384 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cffdd64c-d9d6-476d-9a7d-eebf4088cc53 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.121262 Jul 18 02:22:26.612243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1036/2096] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:26.632448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8fcdb519-9291-4617-a6d2-aa9059487609 req-cdb15cfc-a290-4425-a4c7-c6c5d23be27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c793a11-e110-416b-9617-a70fca7d2bfa", "name": "network-vif-deleted", "tag": "d0f42aee-47ae-4c56-a1ac-52a7afaa2525"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:26.691514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8fcdb519-9291-4617-a6d2-aa9059487609 req-cdb15cfc-a290-4425-a4c7-c6c5d23be27c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.692727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8fcdb519-9291-4617-a6d2-aa9059487609 req-cdb15cfc-a290-4425-a4c7-c6c5d23be27c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.750428 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8fcdb519-9291-4617-a6d2-aa9059487609 req-cdb15cfc-a290-4425-a4c7-c6c5d23be27c service nova] Creating event network-vif-deleted:d0f42aee-47ae-4c56-a1ac-52a7afaa2525 for instance 5c793a11-e110-416b-9617-a70fca7d2bfa on n-h1-849796-1 Jul 18 02:22:26.766265 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8fcdb519-9291-4617-a6d2-aa9059487609 req-cdb15cfc-a290-4425-a4c7-c6c5d23be27c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150962 Jul 18 02:22:26.772047 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1037/2097] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:26.784525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:26.790207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] [instance: 5c793a11-e110-416b-9617-a70fca7d2bfa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:26.807088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.808599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.811910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.813026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.846136 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] HTTP exception thrown: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Request method failure captured: Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa HTTP/1.1 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNbpOTwK93l9MTFUZlGbrvnWXZm750VuL7s5lUXP4ubI7EN9TCxi78_ULUjcNcl2LWMmhP4oFYqdcq__GFvcQmRHz4eevY2tlA8uTXf8s0mqZPn0eLtHZFYZcLP_J7l7xFndBbDbIfMw0eQ8Q2JqXcjTgxUCDhWK7Ozj7tcZ7aNQec Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 11ee26ae4bea4ceb9ba9ef71aa22bd08 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestFqdnHostnames-722296166 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/11ee26ae4bea4ceb9ba9ef71aa22bd08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_11ee26ae4bea4ceb9ba9ef71aa22bd08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/11ee26ae4bea4ceb9ba9ef71aa22bd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/11ee26ae4bea4ceb9ba9ef71aa22bd08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestFqdnHostnames-722296166 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 11ee26ae4bea4ceb9ba9ef71aa22bd08 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-722296166 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestFqdnHostnames-722296166-project Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 4e0bd1dd8f574aa6a257048c25281683 Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestFqdnHostnames-722296166-project Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '5c793a11-e110-416b-9617-a70fca7d2bfa'} Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:26.858034 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. Jul 18 02:22:26.867441 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:26.870604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Returning 404 to user: Instance 5c793a11-e110-416b-9617-a70fca7d2bfa could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:26.872408 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce44c2c4-66a2-48d2-abc0-d37d6ca0ea8d tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa" status: 404 len: 111 microversion: 2.1 time: 0.097696 Jul 18 02:22:26.873682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1038/2098] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/servers/5c793a11-e110-416b-9617-a70fca7d2bfa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:22:26.899652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-16f558f4-9d56-42e3-8a3d-0c255549b772 req-d67118c3-ef38-40c6-9368-78c8d02c768d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "1ba63a1c-8406-45b2-ade6-0a4a17c34c8b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:26.919982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-16f558f4-9d56-42e3-8a3d-0c255549b772 req-d67118c3-ef38-40c6-9368-78c8d02c768d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:26.921322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-16f558f4-9d56-42e3-8a3d-0c255549b772 req-d67118c3-ef38-40c6-9368-78c8d02c768d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:26.956109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-16f558f4-9d56-42e3-8a3d-0c255549b772 req-d67118c3-ef38-40c6-9368-78c8d02c768d service nova] Creating event network-changed:1ba63a1c-8406-45b2-ade6-0a4a17c34c8b for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:26.969256 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-16f558f4-9d56-42e3-8a3d-0c255549b772 req-d67118c3-ef38-40c6-9368-78c8d02c768d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089671 Jul 18 02:22:26.971995 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1039/2099] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:27.014032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:27.015869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:27.033539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:27.034843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:27.036768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:27.039277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:27.572869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:27.689433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:28.382355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:28.406872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:28.413639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:28.419234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac6e09f6-d1e9-456f-9ec8-feef3f887c9d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1870 microversion: 2.32 time: 1.429075 Jul 18 02:22:28.419850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1040/2100] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:26 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1870 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:28.461139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:28.461785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:28.499494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.499969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:28.506813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:28.507288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.254768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lazy-loading 'services' on Instance uuid e5eca075-975f-46cb-876e-e7b99d627940 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:22:29.608296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.647311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef60afc6-42d8-448c-8618-8e6a2285ea23 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments/dfc8b717-5a91-436c-86de-03b79b1c6ade" status: 202 len: 0 microversion: 2.1 time: 12.131636 Jul 18 02:22:29.653095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1061/2101] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:22:17 2022] DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments/dfc8b717-5a91-436c-86de-03b79b1c6ade => generated 0 bytes in 12146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:29.660393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.701641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:29.701966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:29.709438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:29.709802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96bda5c9-b409-4167-926d-5bf51c442a6a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 200 len: 1266 microversion: 2.25 time: 1.288186 Jul 18 02:22:29.729479 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1041/2102] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:28 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 1266 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:29.739693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-561b1dde-1805-4806-901d-c7a8fe5fbd73 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] Calling method '.version_select at 0x7fab043e8790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:29.757890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:29.764491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.775200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:29.781247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:29.831205 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-561b1dde-1805-4806-901d-c7a8fe5fbd73 tempest-ServersTestFqdnHostnames-722296166 tempest-ServersTestFqdnHostnames-722296166-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362270285" status: 202 len: 0 microversion: 2.1 time: 0.097934 Jul 18 02:22:29.839145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1042/2103] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362270285 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:22:29.866315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22992601-e269-4024-a73b-cf1ddac77c66 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04453ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:30.101864 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22992601-e269-4024-a73b-cf1ddac77c66 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.256153 Jul 18 02:22:30.105818 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1043/2104] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:29 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:30.126494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4e2860bd-4cda-4897-8165-813924c4a43d req-942ffcf9-dc9a-4d65-af9f-7358c565e9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "1bb5c7e7-e428-4d94-9253-52e8ef2e2338"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:30.173694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4e2860bd-4cda-4897-8165-813924c4a43d req-942ffcf9-dc9a-4d65-af9f-7358c565e9ae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.174499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4e2860bd-4cda-4897-8165-813924c4a43d req-942ffcf9-dc9a-4d65-af9f-7358c565e9ae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:30.223323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4e2860bd-4cda-4897-8165-813924c4a43d req-942ffcf9-dc9a-4d65-af9f-7358c565e9ae service nova] Creating event network-changed:1bb5c7e7-e428-4d94-9253-52e8ef2e2338 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:30.238490 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4e2860bd-4cda-4897-8165-813924c4a43d req-942ffcf9-dc9a-4d65-af9f-7358c565e9ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130089 Jul 18 02:22:30.240171 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1044/2105] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:30.261014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:30.262474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:30.276894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.277675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:30.279005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:30.279858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:31.192353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:31.263686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:31.278344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:31.283489 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d65456f8-7e6a-4ec3-b8a8-6f3809ce7b8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 1.036502 Jul 18 02:22:31.289468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1045/2106] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:30 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:31.311195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:31.321135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 27dde308-8251-4416-a75a-48482ee4fce7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:31.371009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:31.377889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:31.390285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:31.402830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:31.404030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:31.482729 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] HTTP exception thrown: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Request method failure captured: Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 HTTP/1.1 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MFsGdJg4Lq6pmBZeKDdiCQQZn_SbRkHtsnMTduX--tip8mqWBblnnDQpN0N0ysK_bV4YAtXl7RCIYAb00iXhenbE42AoXjMIwpDlk1_5T-CBiatLyQSi7-weWYlsNTKeUr4ScpN9LSizALI_fmxkpgaihteTRhAQTxSZ8K_vP3q2ac Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 2affc29a14f847a099dad6deaf668842 Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '27dde308-8251-4416-a75a-48482ee4fce7'} Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. Jul 18 02:22:31.491726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. Jul 18 02:22:31.505291 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:22:31.508993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Returning 404 to user: Instance 27dde308-8251-4416-a75a-48482ee4fce7 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:22:31.516536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09a6e1fa-5c36-437d-b8bc-1f8e834eacd6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7" status: 404 len: 111 microversion: 2.25 time: 0.221765 Jul 18 02:22:31.520316 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1046/2107] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:31 2022] GET /compute/v2.1/servers/27dde308-8251-4416-a75a-48482ee4fce7 => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:22:31.545971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5298fa3-898c-43d1-bf5c-e585e01460a7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043e8160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:31.736164 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5298fa3-898c-43d1-bf5c-e585e01460a7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.212839 Jul 18 02:22:31.738300 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1047/2108] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:31 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:32.316652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:32.324679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:32.346365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:32.347847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:32.350775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:32.352126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:32.492982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:32.532989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b24d663-86ff-4650-be48-aa952c054eb5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 2.866427 Jul 18 02:22:32.537459 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1062/2109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:29 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:32.752130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8c85c16-10e2-4156-89dd-fe7df7fc2e3d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0556c430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:32.919122 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8c85c16-10e2-4156-89dd-fe7df7fc2e3d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.171102 Jul 18 02:22:32.920171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1063/2110] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:32 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:33.292066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1263470760", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "01a21d71-f071-490d-8f2f-e9b46fc46ec1"}], "security_groups": [{"name": "tempest-securitygroup--438462810"}], "key_name": "tempest-keypair-1153864603", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:33.672618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] validate_networks() for [('01a21d71-f071-490d-8f2f-e9b46fc46ec1', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:22:34.552051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:34.590637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:34.605107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:34.608443 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a0a774fc-ab49-4beb-9267-9f6dfee87b18 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 2.302826 Jul 18 02:22:34.609859 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1048/2111] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:32 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:34.629488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:34.631159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:34.660309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:34.661457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:34.662969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:34.664034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:35.104166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:35.115580 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d992cc4-1a78-481a-8fa4-cecbfacae932 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 0.504088 Jul 18 02:22:35.116575 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1049/2112] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:34 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:35.123443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b2270ed3-6b60-4d36-8602-17b4f1978818 req-f7e89a38-1327-438a-a45e-93f17df57aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:35.137320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2270ed3-6b60-4d36-8602-17b4f1978818 req-f7e89a38-1327-438a-a45e-93f17df57aa9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:35.138050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2270ed3-6b60-4d36-8602-17b4f1978818 req-f7e89a38-1327-438a-a45e-93f17df57aa9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:35.189608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b2270ed3-6b60-4d36-8602-17b4f1978818 req-f7e89a38-1327-438a-a45e-93f17df57aa9 service nova] Creating event network-changed:6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:35.240441 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b2270ed3-6b60-4d36-8602-17b4f1978818 req-f7e89a38-1327-438a-a45e-93f17df57aa9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120595 Jul 18 02:22:35.241201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1050/2113] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:35.248705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4488bca5-885d-4905-9e07-ea5b86edfe21 req-2e4ad601-4af5-4368-859c-249b7bd44805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "name": "network-vif-plugged", "status": "completed", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:35.265534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4488bca5-885d-4905-9e07-ea5b86edfe21 req-2e4ad601-4af5-4368-859c-249b7bd44805 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:35.266002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4488bca5-885d-4905-9e07-ea5b86edfe21 req-2e4ad601-4af5-4368-859c-249b7bd44805 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:35.287989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4488bca5-885d-4905-9e07-ea5b86edfe21 req-2e4ad601-4af5-4368-859c-249b7bd44805 service nova] Creating event network-vif-plugged:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h1-849796-1 Jul 18 02:22:35.320802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4488bca5-885d-4905-9e07-ea5b86edfe21 req-2e4ad601-4af5-4368-859c-249b7bd44805 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073394 Jul 18 02:22:35.323846 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1051/2114] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:35.338192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b268842-0194-4b3f-8d67-36a2a4a335e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04430820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:35.458064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b268842-0194-4b3f-8d67-36a2a4a335e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.132444 Jul 18 02:22:35.459729 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1052/2115] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:35 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:35.642649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:35.644354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:35.669646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:35.670333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:35.672027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:35.672501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:36.413440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:36.454890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for project 3023a58217a649d28186813b61d4afbf. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:36.479698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for user 4c24789267bf404a841b414eb1019d97 and project 3023a58217a649d28186813b61d4afbf. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:36.524687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:22:36.526730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:22:36.527491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:22:36.530806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:22:36.531518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:22:36.556722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.564179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:36.565684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.569200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:36.647937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for project 3023a58217a649d28186813b61d4afbf. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:36.666139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Getting quotas for user 4c24789267bf404a841b414eb1019d97 and project 3023a58217a649d28186813b61d4afbf. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:36.691889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:22:36.700111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:22:36.824241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba277d22-5a96-4338-b3ea-96bdf6529c06 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.537407 Jul 18 02:22:36.833889 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1064/2116] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:22:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 3544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:22:36.839851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:36.851624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:36.873215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.875882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:36.880753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:36.881959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:37.132656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.174272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.177559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.180251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a355b449-e4de-42ac-b984-89e1dcebad2d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 1.541875 Jul 18 02:22:37.194311 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1053/2117] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:35 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:37.201537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8326abe7-e548-40e5-a53b-3f09eedbf544 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043e8700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:37.315144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8326abe7-e548-40e5-a53b-3f09eedbf544 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.119268 Jul 18 02:22:37.322885 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1054/2118] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:37 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:37.339194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4add9df5-6752-41b4-a230-7373cdcc8bf9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:37.344093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4add9df5-6752-41b4-a230-7373cdcc8bf9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:37.646997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4add9df5-6752-41b4-a230-7373cdcc8bf9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.661833 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4add9df5-6752-41b4-a230-7373cdcc8bf9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1278 microversion: 2.1 time: 0.335934 Jul 18 02:22:37.664834 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1055/2119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:37 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:37.792748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:37.832955 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2da7375-8dae-4a5f-8a40-d4394b818677 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1199 microversion: 2.1 time: 0.996957 Jul 18 02:22:37.842112 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1065/2120] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:36 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1199 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:37.983206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1666828527", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "1cccc682-bf56-4dff-bce1-ac6b2eb9b4ff"}], "security_groups": [{"name": "tempest-securitygroup--1183694160"}], "key_name": "tempest-keypair-1562931593", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:38.215414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:38.217388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:38.272449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:38.273254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:38.277907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:38.282151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:38.519887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] validate_networks() for [('1cccc682-bf56-4dff-bce1-ac6b2eb9b4ff', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:22:39.698813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:22:39.701111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:22:39.702475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:22:39.703845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:22:39.704967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:22:39.753628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:39.755126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:39.760843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:39.766513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:39.850472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:22:39.867133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for user de515d451d7c40ce8e4f31ff9d5367b5 and project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:22:39.907466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:22:39.914156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:22:39.922334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:39.987549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:39.998216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:40.012948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-672989d5-bbe8-44c9-8991-6f3f4ebdbb5c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 1.813791 Jul 18 02:22:40.058017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1066/2121] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:38 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:40.069218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb28cf0c-9f9c-472d-9b2c-9c9c9dbf5d87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5a790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:40.106500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b2e101d-3abd-47a6-92e2-9c73375a5632 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.133987 Jul 18 02:22:40.111515 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1056/2122] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:22:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:22:40.141551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e89e2a2b-e9bf-4a10-9380-109ede33bc02 req-c9f7d3dc-0261-4e92-8ec9-2e00947650d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "804f95d4-9cf9-4928-9668-8d25b51873f2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:40.183073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e89e2a2b-e9bf-4a10-9380-109ede33bc02 req-c9f7d3dc-0261-4e92-8ec9-2e00947650d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:40.184397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e89e2a2b-e9bf-4a10-9380-109ede33bc02 req-c9f7d3dc-0261-4e92-8ec9-2e00947650d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.238046 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb28cf0c-9f9c-472d-9b2c-9c9c9dbf5d87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.178520 Jul 18 02:22:40.239050 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1067/2123] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:40 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:40.250859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:40.283935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:40.291609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e89e2a2b-e9bf-4a10-9380-109ede33bc02 req-c9f7d3dc-0261-4e92-8ec9-2e00947650d9 service nova] Creating event network-changed:804f95d4-9cf9-4928-9668-8d25b51873f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:40.302960 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e89e2a2b-e9bf-4a10-9380-109ede33bc02 req-c9f7d3dc-0261-4e92-8ec9-2e00947650d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184448 Jul 18 02:22:40.304612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1057/2124] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:40.311748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:40.316385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.317093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:40.319441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:40.320150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:40.323332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.333519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:40.334293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.335695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:40.336487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:40.539521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:40.565332 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af0bd5ec-c429-43e7-b1a4-4a300f1fefea tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1336 microversion: 2.1 time: 0.318152 Jul 18 02:22:40.570520 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1068/2125] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:40 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1336 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:40.576337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cb29b3cc-567b-455e-921a-51ab426de1c9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:40.591522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cb29b3cc-567b-455e-921a-51ab426de1c9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:40.734655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cb29b3cc-567b-455e-921a-51ab426de1c9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:40.743208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cb29b3cc-567b-455e-921a-51ab426de1c9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1242 microversion: 2.1 time: 0.171453 Jul 18 02:22:40.752210 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1069/2126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:40 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:41.073125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:41.074170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:41.086417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.088611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:41.091045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.093075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:41.457788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:41.509895 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-34fb1adb-97d9-47c1-830d-5fcd6938efb3 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1382 microversion: 2.1 time: 1.196002 Jul 18 02:22:41.529206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1058/2127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:40 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1382 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:41.561486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d53da99-7e9e-4f56-bb09-d1dc8e8ed2ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044cf3a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:41.871310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d53da99-7e9e-4f56-bb09-d1dc8e8ed2ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.337317 Jul 18 02:22:41.877979 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1059/2128] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:41 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:41.922416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:41.926565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:41.971075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.971634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:41.972582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:41.985692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:42.730615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad8eb9ba-d6ef-48e3-8e01-b6eb402c43c7 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1533 microversion: 2.1 time: 0.846298 Jul 18 02:22:42.743975 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1060/2129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:41 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1533 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:42.772403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:42.780628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:42.833308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:42.834755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:42.843740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:42.848822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.217280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.262517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dec0b04-2ca5-4485-bd4d-469235fb003a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1336 microversion: 2.1 time: 0.493364 Jul 18 02:22:43.263425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1061/2130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:42 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1336 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:43.288061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:43.294955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:43.341523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.349902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.354799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.355922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.391260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.421204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.444667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.457654 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dff42e0e-c722-4053-b9b1-22e2d05b265f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 2.381710 Jul 18 02:22:43.460265 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1070/2131] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:41 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:22:43.472706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-974c1138-24da-4835-bef9-0bcbb9bbe61a req-ec933761-d6f3-42b1-8c16-13b078bb1b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "df68d20a-4518-4fc1-8770-f6dd7fe75468"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:43.529953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-974c1138-24da-4835-bef9-0bcbb9bbe61a req-ec933761-d6f3-42b1-8c16-13b078bb1b6a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.539401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-974c1138-24da-4835-bef9-0bcbb9bbe61a req-ec933761-d6f3-42b1-8c16-13b078bb1b6a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.586508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-974c1138-24da-4835-bef9-0bcbb9bbe61a req-ec933761-d6f3-42b1-8c16-13b078bb1b6a service nova] Creating event network-changed:df68d20a-4518-4fc1-8770-f6dd7fe75468 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:43.604464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-974c1138-24da-4835-bef9-0bcbb9bbe61a req-ec933761-d6f3-42b1-8c16-13b078bb1b6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141572 Jul 18 02:22:43.609030 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1071/2132] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:43.615603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:43.616858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:43.625891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.626690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.627885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:43.628641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:43.883302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:43.901941 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c6d7898-bb9a-4fd8-ba2f-825103aa55bd tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1312 microversion: 2.1 time: 0.635375 Jul 18 02:22:43.905429 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1062/2133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:43 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:43.928845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69e2b452-ffbe-4942-9129-762d1a394bf5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04464310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:44.070185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69e2b452-ffbe-4942-9129-762d1a394bf5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1452 microversion: 2.1 time: 0.160316 Jul 18 02:22:44.078655 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1063/2134] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:43 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:44.286580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:44.287611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:44.314956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.315628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:44.317225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:44.317225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.036506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.057060 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dddd6d59-d2cc-4c8b-ad5e-2c17daf02d7a tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1336 microversion: 2.1 time: 0.773725 Jul 18 02:22:45.107908 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1064/2135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:44 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1336 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:22:45.136066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.141132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:45.161209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.162269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.164271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.165968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.232086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:45.403446 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3442a02a-8d57-4b74-9da0-f97ec8d2abfa tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1533 microversion: 2.1 time: 1.792174 Jul 18 02:22:45.414064 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1072/2136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:43 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1533 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:45.443846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.445348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:45.494405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.497959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.502345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.507129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.674848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.703172 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea7e8370-29ff-4904-a9ad-f4864561bd98 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1300 microversion: 2.1 time: 0.286170 Jul 18 02:22:45.717797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1073/2137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1300 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:45.723549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6bac593-0d34-46fa-879e-6602ba434e95 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ea5430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.781141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.796653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6bac593-0d34-46fa-879e-6602ba434e95 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1461 microversion: 2.1 time: 0.077205 Jul 18 02:22:45.798220 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1074/2138] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1461 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:45.805939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.807861 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:22:45.807861 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:22:45.810113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.811277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.814395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.815121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.847563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.858817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:45.860177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1c038e8-605e-4d74-8e45-8db67a59f54c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.750547 Jul 18 02:22:45.860803 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1065/2139] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:45.865917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73135ff3-53d7-4762-b2fd-097660e1f76a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044d8d30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.874481 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b8cc046-10c1-41d1-801b-0e8dd0777f78 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074548 Jul 18 02:22:45.879221 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1075/2140] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:45.891029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-849796-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:45.896543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:45.914120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.916716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.933264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.934989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.937280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73135ff3-53d7-4762-b2fd-097660e1f76a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 200 len: 1461 microversion: 2.1 time: 0.072266 Jul 18 02:22:45.937962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1066/2141] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 1461 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:45.950431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:45.951066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:45.976159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.976734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:45.980109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:45.980109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:46.020585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lazy-loading 'flavor' on Instance uuid b452eee6-7260-482e-8bf3-7ddc06c08bae {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:22:46.039512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Going to try to live migrate instance to n-h2-849796-1 {{(pid=119439) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 02:22:46.692187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:46.713575 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e189d545-2cad-4b2c-9cc4-264d7207e027 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1481 microversion: 2.1 time: 0.766214 Jul 18 02:22:46.723548 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1067/2142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:45 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1481 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:46.729603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:46.730352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:46.742782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:46.743799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:46.744666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:46.745148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.628291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:47.657410 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39ac1796-85f3-4eb3-952d-f60e8b1198b8 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.941188 Jul 18 02:22:47.663227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1068/2143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:46 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:47.683820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:47.690277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:47.720791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.722109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:47.727159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:47.729462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:48.003811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:48.017170 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f755b45f-5411-4a7d-baa2-77575d8a4f48 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1300 microversion: 2.1 time: 0.350091 Jul 18 02:22:48.026024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1069/2144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:47 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:48.047563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:48.048216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:48.083524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:48.086469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:48.093798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:48.096327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.755729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:49.811182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:49.824594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:49.837749 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2af0fb38-1466-4c87-bd7e-421d671a3377 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 1.805891 Jul 18 02:22:49.844242 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1070/2145] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:48 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:49.857897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:49.861145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:49.872946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:49.878520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:49.880135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.882977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:49.885017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:49.904886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:50.740479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:50.781630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:50.790919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-130c378b-2d88-4534-abae-7c1ce1386a4e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1468 microversion: 2.1 time: 0.944195 Jul 18 02:22:50.799735 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1071/2146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:49 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1468 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:50.806178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-631750e0-edd0-47dd-a9ad-30e04e8c075b req-0899c1a9-0b68-4fa4-accd-21893969ebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "4f456121-fd6f-4052-a2bc-5c6324652c5f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:50.830193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-631750e0-edd0-47dd-a9ad-30e04e8c075b req-0899c1a9-0b68-4fa4-accd-21893969ebd3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.831715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-631750e0-edd0-47dd-a9ad-30e04e8c075b req-0899c1a9-0b68-4fa4-accd-21893969ebd3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:50.863162 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-631750e0-edd0-47dd-a9ad-30e04e8c075b req-0899c1a9-0b68-4fa4-accd-21893969ebd3 service nova] Creating event network-changed:4f456121-fd6f-4052-a2bc-5c6324652c5f for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:50.877497 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-631750e0-edd0-47dd-a9ad-30e04e8c075b req-0899c1a9-0b68-4fa4-accd-21893969ebd3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074758 Jul 18 02:22:50.882165 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1072/2147] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:50.888370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:50.895331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:50.912277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.913302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:50.915608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:50.917615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:51.532123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:51.546230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9efff47d-5059-4a99-bafd-5a3957f0f938 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.661423 Jul 18 02:22:51.554683 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1073/2148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:50 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:51.561414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-71d397d5-7ee3-487e-b300-d7f519276354 req-7859f30e-01b8-46a6-9494-d267538c11ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e42816f-af3e-4671-b698-75c92c627aeb", "tag": "05f964f7-cddb-427f-af7a-482415df8f85"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:51.601245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-71d397d5-7ee3-487e-b300-d7f519276354 req-7859f30e-01b8-46a6-9494-d267538c11ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:51.601664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-71d397d5-7ee3-487e-b300-d7f519276354 req-7859f30e-01b8-46a6-9494-d267538c11ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:51.635766 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-71d397d5-7ee3-487e-b300-d7f519276354 req-7859f30e-01b8-46a6-9494-d267538c11ee service nova] Creating event network-changed:05f964f7-cddb-427f-af7a-482415df8f85 for instance 1e42816f-af3e-4671-b698-75c92c627aeb on n-h2-849796-1 Jul 18 02:22:51.645636 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-71d397d5-7ee3-487e-b300-d7f519276354 req-7859f30e-01b8-46a6-9494-d267538c11ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088105 Jul 18 02:22:51.651758 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1074/2149] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:51.662564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:51.673294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:51.681924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:51.682700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:51.688900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:51.689814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.059670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:52.073494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de9e1ba4-19ff-4ede-a84c-7076f00e6cc5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.419861 Jul 18 02:22:52.087935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1075/2150] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:51 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:52.090085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3107d2d2-df9c-460a-ae2c-16943d174fa6 req-d85edf05-0e14-4f0f-af98-0e904c1d2bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:52.113355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3107d2d2-df9c-460a-ae2c-16943d174fa6 req-d85edf05-0e14-4f0f-af98-0e904c1d2bf2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.113972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3107d2d2-df9c-460a-ae2c-16943d174fa6 req-d85edf05-0e14-4f0f-af98-0e904c1d2bf2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.183660 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3107d2d2-df9c-460a-ae2c-16943d174fa6 req-d85edf05-0e14-4f0f-af98-0e904c1d2bf2 service nova] Creating event network-vif-unplugged:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:22:52.204062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0f2b9b9-1212-4ab2-96b4-e58afb749692 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae/action" status: 202 len: 0 microversion: 2.1 time: 6.313597 Jul 18 02:22:52.206208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3107d2d2-df9c-460a-ae2c-16943d174fa6 req-d85edf05-0e14-4f0f-af98-0e904c1d2bf2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123588 Jul 18 02:22:52.208390 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1076/2151] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:22:45 2022] POST /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae/action => generated 0 bytes in 6322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:22:52.210794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1076/2152] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:52.225964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:52.227830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:52.239101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.240955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.244043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.245290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.268482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1468632168"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:52.279102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:52.330372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.331020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.332475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:52.333298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:52.951128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:52.956813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:52.972952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:52.979174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45a84e9a-056a-49f3-a913-2833c438404b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.765343 Jul 18 02:22:52.985919 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1077/2153] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:52 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:52.999477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f462dd7-f3ee-4ef9-9c6f-e39e3d2a662c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "POST /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.773357 Jul 18 02:22:53.002523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1077/2154] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:22:52 2022] POST /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:22:53.012042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.012801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:53.013664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.015710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:53.022283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.022843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.025483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.026050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.041960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.042685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.044844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.046528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.130727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3da4046c-ace0-4189-ae5c-07d35fd8144a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142022 Jul 18 02:22:53.132710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1078/2155] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:22:52 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:53.138965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.140121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:53.148625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.151983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.153204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.154288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.639558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.649942 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8975187b-b1d9-4869-9a01-ff128f3fd3cf tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.514567 Jul 18 02:22:53.662441 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1079/2156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:53 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:53.670348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f2dccde8-07bf-428a-9637-9dcd91257754 req-3c7df755-e3ab-4fb7-ab99-10368e5ee342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:53.682127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f2dccde8-07bf-428a-9637-9dcd91257754 req-3c7df755-e3ab-4fb7-ab99-10368e5ee342 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.682834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f2dccde8-07bf-428a-9637-9dcd91257754 req-3c7df755-e3ab-4fb7-ab99-10368e5ee342 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.711021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:53.739294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f2dccde8-07bf-428a-9637-9dcd91257754 req-3c7df755-e3ab-4fb7-ab99-10368e5ee342 service nova] Creating event network-changed:a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:22:53.758366 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d04c385-d883-483f-baf0-a20abdb5c83c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.753397 Jul 18 02:22:53.763105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1078/2157] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:53 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:53.784881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d47b25c-3dcd-40e4-a206-1198d750ddaa tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5a8b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.787085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f2dccde8-07bf-428a-9637-9dcd91257754 req-3c7df755-e3ab-4fb7-ab99-10368e5ee342 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121244 Jul 18 02:22:53.788870 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1080/2158] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:53.802839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:53.807756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:53.826388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.828714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.832471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:53.833680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:53.916835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d47b25c-3dcd-40e4-a206-1198d750ddaa tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.151684 Jul 18 02:22:53.917927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1079/2159] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:53 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:54.024439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.029417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.057518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.063642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.070835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.074235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.577222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:54.616011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e155819-88cf-4608-bff2-bedf1c7d3c32 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.823570 Jul 18 02:22:54.628349 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1081/2160] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:53 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:54.647257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.652216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.689108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.690507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.708963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.708963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.845210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:54.858430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f6aff15-44f9-4717-a06a-1e38c0760574 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.234669 Jul 18 02:22:54.860157 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1082/2161] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments => generated 25 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:22:54.870667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:54.873673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:54.876050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d4d248f-dabb-4ffb-91fb-2310f4aa1124 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.858729 Jul 18 02:22:54.877264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1080/2162] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:54.884451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.898093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.906422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.906586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:54.907179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.908402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:54.909563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.913544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.925737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:54.946089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.954449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:54.957582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:54.962524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:55.830828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:55.855114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:55.866811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e96afd1a-87f9-4273-8ec5-ca22b892deca tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.988213 Jul 18 02:22:55.874319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1081/2163] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:55.879494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f98c484-bfb0-4a82-8c31-9631d70c4bbb tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb43a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:55.978448 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f98c484-bfb0-4a82-8c31-9631d70c4bbb tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.101950 Jul 18 02:22:55.979298 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1082/2164] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:55 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:55.985877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:55.995680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.013935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.014585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.015549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.016163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.077803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:56.125276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84ffc0ad-812f-4edd-b50a-416f9b44a18c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 1.259519 Jul 18 02:22:56.135273 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1083/2165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:54 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:56.168489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.171164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.195938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.197723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.198801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.205074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.217949 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0559f63d-6995-4846-a31d-5114608946f2 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.233184 Jul 18 02:22:56.231172 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1083/2166] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:22:55 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940/os-volume_attachments => generated 25 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:22:56.255138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-69da0040-3741-4690-a1ef-e935c4876f74 req-b3c9396f-f863-4573-b39d-dcc2101ed17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814984c0-2fe5-453e-aa2c-e595972987ed", "tag": "133c38e1-c5b5-472c-9d2d-3cc18274cdd1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:56.314162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-69da0040-3741-4690-a1ef-e935c4876f74 req-b3c9396f-f863-4573-b39d-dcc2101ed17d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.314841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-69da0040-3741-4690-a1ef-e935c4876f74 req-b3c9396f-f863-4573-b39d-dcc2101ed17d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.422884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-69da0040-3741-4690-a1ef-e935c4876f74 req-b3c9396f-f863-4573-b39d-dcc2101ed17d service nova] Creating event network-changed:133c38e1-c5b5-472c-9d2d-3cc18274cdd1 for instance 814984c0-2fe5-453e-aa2c-e595972987ed on n-h2-849796-1 Jul 18 02:22:56.438005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-69da0040-3741-4690-a1ef-e935c4876f74 req-b3c9396f-f863-4573-b39d-dcc2101ed17d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204576 Jul 18 02:22:56.440899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1084/2167] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:56.458505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.461899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.480026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.482901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.487499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.488457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:56.488854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.504245 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f65b82d4-5c30-477a-ac3f-159b2672512a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.363652 Jul 18 02:22:56.505034 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1084/2168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:56 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:56.515286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.515908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.531596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.532061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.533011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.533466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.565723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:56.571473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:22:56.753456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-286e40ce-61be-4229-8701-1fc3275a82f9 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 204 len: 0 microversion: 2.1 time: 0.245302 Jul 18 02:22:56.761079 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1085/2169] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:22:56 2022] DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:22:56.779621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:56.781923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:56.800075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.801388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:56.803961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:56.805064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:57.490323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:57.507245 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-003cc8b4-db72-459f-9890-9864bc79e856 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1680 microversion: 2.1 time: 0.740758 Jul 18 02:22:57.508357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1086/2170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:56 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1680 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:57.520707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:57.522268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:57.535996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:57.537337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:57.539272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:57.540439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:57.826431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:57.861703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64ed11d9-93ff-453f-a919-6dc9ef548d1b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.346406 Jul 18 02:22:57.876085 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1087/2171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:57 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:57.888814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-47cf7f2f-4c48-4f96-9c00-ae9640a38615 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04453dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:57.968654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:58.017523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:58.018731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-47cf7f2f-4c48-4f96-9c00-ae9640a38615 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.141320 Jul 18 02:22:58.023170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1088/2172] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:57 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:58.027075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:58.036765 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-070fe87b-f2a6-4273-8989-a22162bb676b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 1.590507 Jul 18 02:22:58.044704 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1085/2173] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:56 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:58.051393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:58.058062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:58.065451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:58.066446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:58.079164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.081399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.081628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:58.086501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.089019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.099882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.100455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.104878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.106140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.583148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:58.663667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50ae6e7d-0cf1-4d54-983a-cbb5d33d9a20 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.632351 Jul 18 02:22:58.677059 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1089/2174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:58 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:58.692247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:58.698459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:58.725464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.725464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.725464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.725944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.732570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:58.741897 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-737f18f4-d8fd-4557-8e7b-c13cd55fa4da tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.695257 Jul 18 02:22:58.746683 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1086/2175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:58 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:58.884866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:58.885912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:58.895483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.903494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:58.904902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:58.905773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.456909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.471994 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40ad5781-f9c3-40e4-958e-8273aecb2039 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.591095 Jul 18 02:22:59.477465 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1087/2176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:58 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:59.484263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6d23c52-7ae9-472d-bbc0-1793d920e555 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb41f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.511256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.533378 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61cc8963-42c1-4ddb-9745-06726acaf32e tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1680 microversion: 2.1 time: 0.860872 Jul 18 02:22:59.536199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1090/2177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:58 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1680 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:59.550280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.554141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:59.573247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:22:59.580864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6d23c52-7ae9-472d-bbc0-1793d920e555 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.102049 Jul 18 02:22:59.581509 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1088/2178] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:22:59 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:22:59.588789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.591041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.592135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.592760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.592994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-db95e7fb-3465-4327-973e-dd77e0258055 req-2e4d1578-0e0c-4ca6-9b24-c1591b3355e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e42816f-af3e-4671-b698-75c92c627aeb", "name": "network-vif-plugged", "status": "completed", "tag": "05f964f7-cddb-427f-af7a-482415df8f85"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:22:59.635146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db95e7fb-3465-4327-973e-dd77e0258055 req-2e4d1578-0e0c-4ca6-9b24-c1591b3355e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.635695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db95e7fb-3465-4327-973e-dd77e0258055 req-2e4d1578-0e0c-4ca6-9b24-c1591b3355e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.670633 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-db95e7fb-3465-4327-973e-dd77e0258055 req-2e4d1578-0e0c-4ca6-9b24-c1591b3355e8 service nova] Creating event network-vif-plugged:05f964f7-cddb-427f-af7a-482415df8f85 for instance 1e42816f-af3e-4671-b698-75c92c627aeb on n-h2-849796-1 Jul 18 02:22:59.687393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-db95e7fb-3465-4327-973e-dd77e0258055 req-2e4d1578-0e0c-4ca6-9b24-c1591b3355e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092489 Jul 18 02:22:59.688349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1089/2179] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:22:59.699939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.700674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:59.722534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.722534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.723296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.723755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.894276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.909263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.911560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:22:59.913209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f58bcd4-03d0-4d56-a7ed-c3146dca95fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.373936 Jul 18 02:22:59.913973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1091/2180] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:22:59 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:22:59.928979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:22:59.934035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:22:59.950405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.951554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:22:59.954235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:22:59.972439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.182557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.199311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5031887d-5a7f-4af9-81d1-cd20fa847c85 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.504871 Jul 18 02:23:00.211361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1090/2181] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:59 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:00.314075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:00.328830 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f964c92c-df1d-412f-b9a0-c94dcf2cc95e tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.412268 Jul 18 02:23:00.330390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1092/2182] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:22:59 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:00.498385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:00.502876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:00.512298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.512772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.513817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.514643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.564032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:00.564700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:00.578033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.578506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:00.579340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:00.579802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.054714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.067840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.084989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11ab0d35-2ac2-4518-a6c6-c342c2a8753f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.597601 Jul 18 02:23:01.100740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db4a3aca-2dcb-4205-b98f-1624f37f796a tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1680 microversion: 2.1 time: 0.540842 Jul 18 02:23:01.103610 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1091/2183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:00 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:01.104901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1093/2184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:00 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1680 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:01.128177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:01.128862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3248ef7c-53b9-4b38-b1db-f006e39fb03d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab05528f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:01.140815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:01.161375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.170883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.172315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.173261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.277389 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3248ef7c-53b9-4b38-b1db-f006e39fb03d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.171182 Jul 18 02:23:01.278517 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1092/2185] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:01 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:01.314977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:01.316169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:01.340271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.343904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.345576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.346373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.839783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.857093 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b61c57db-096b-4639-af61-4696bfad9a7d tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 0.574932 Jul 18 02:23:01.861504 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1093/2186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:01 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:01.877828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:01.879428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:01.902695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.906023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.908181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:01.912719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:01.913524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.943157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.956458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:01.957784 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea0e53dc-8cb9-4086-af39-e14b029e15ac tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.850381 Jul 18 02:23:01.958369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1094/2187] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:01 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:02.106220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:02.107205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:02.125745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.134783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:02.136029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.136888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:02.705085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:02.730567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05db801c-9c4c-4779-8b26-ba2b7bd62c4d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.617589 Jul 18 02:23:02.745036 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1095/2188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:02 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:02.768105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:02.768741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:02.788041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.788492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:02.789352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:02.790517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.041868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:03.060269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d09dbeb-da25-43ca-9026-61fd986edcde tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 1.197153 Jul 18 02:23:03.065110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1094/2189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:01 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:03.078319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08281edb-d731-4bc2-92d1-5fba69adadbd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f6ab80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:03.155773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08281edb-d731-4bc2-92d1-5fba69adadbd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.089211 Jul 18 02:23:03.164709 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1095/2190] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:03 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:03.182289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:03.182921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:03.193167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.193640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.194487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.194946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.414309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:03.438480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dec80032-dce4-4758-bbb3-587c05ac4301 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1680 microversion: 2.1 time: 0.691631 Jul 18 02:23:03.470686 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1096/2191] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:02 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1680 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:03.483323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:03.500212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:03.556446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.558535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:03.561073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:03.562849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:04.280952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:04.321744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:04.334042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:04.340741 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-02d8b7ec-fdf6-4e7b-ad88-f7271b2eb21e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 0.863744 Jul 18 02:23:04.362214 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1097/2192] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:03 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:04.380766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b34f359c-9957-4fe0-ae8b-f066ce010e7c req-3764839e-ca15-49f5-a01c-253d98ced77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb36d11-eea4-48cc-9680-e854c7e16ab5", "name": "network-vif-plugged", "status": "completed", "tag": "d421c541-4386-4e00-b959-ca13f1e84515"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:04.402422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b34f359c-9957-4fe0-ae8b-f066ce010e7c req-3764839e-ca15-49f5-a01c-253d98ced77e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:04.403693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b34f359c-9957-4fe0-ae8b-f066ce010e7c req-3764839e-ca15-49f5-a01c-253d98ced77e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:04.434349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b34f359c-9957-4fe0-ae8b-f066ce010e7c req-3764839e-ca15-49f5-a01c-253d98ced77e service nova] Creating event network-vif-plugged:d421c541-4386-4e00-b959-ca13f1e84515 for instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 on n-h2-849796-1 Jul 18 02:23:04.448126 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b34f359c-9957-4fe0-ae8b-f066ce010e7c req-3764839e-ca15-49f5-a01c-253d98ced77e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080318 Jul 18 02:23:04.450155 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1098/2193] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:04.467725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:04.469493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:04.500971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:04.503654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:04.505540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:04.506692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:05.001083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:05.031768 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2d7ff1c-b51d-4a61-83bd-65aca9ab67de tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.579262 Jul 18 02:23:05.036256 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1099/2194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:04 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:05.052602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:05.057106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:05.079323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:05.081046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:05.085822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:05.087522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:05.406890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:05.425217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-723a1a98-f1e8-4351-ac35-e2d43bde8a0b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.387378 Jul 18 02:23:05.437653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1100/2195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:05 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:05.445592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8adbc9b8-135c-40d6-ab1e-e849bc8a4959 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04561b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:05.598086 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8adbc9b8-135c-40d6-ab1e-e849bc8a4959 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.158280 Jul 18 02:23:05.598734 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1101/2196] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:05 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:05.610439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:05.611083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:05.643799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:05.653062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:05.653864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:05.654400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.170246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:06.188249 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32a790bb-e424-4efb-a516-dea8bf842281 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1403 microversion: 2.1 time: 3.019612 Jul 18 02:23:06.189062 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1096/2197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:03 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1403 bytes in 3024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:06.211290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:06.217629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:06.289475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.294606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.299551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.302082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.424252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:06.440444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-747d550e-2c59-462f-8969-5cac382ae9da tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1680 microversion: 2.1 time: 0.839954 Jul 18 02:23:06.445189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1102/2198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:05 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1680 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:06.462431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:06.463717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:06.480793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.481573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.484290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:06.486874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:06.508191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:07.669278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:07.744293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dc02e67-e1f0-45c1-8397-0268f2da6baa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.292341 Jul 18 02:23:07.750931 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1103/2199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:06 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:07.842316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:07.844984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:07.909280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.912628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:07.921941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:07.923400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:08.793988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.860814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.874667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:08.887735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c1ed972-6b90-4a84-86fb-c85286aac6b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1891 microversion: 2.32 time: 2.689712 Jul 18 02:23:08.902715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1097/2200] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:06 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1891 bytes in 2713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:08.919791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fec4e71d-6a0e-4e08-bb8f-1771c4917982 req-4b3eb04a-b660-41e9-9564-05ea9e3e7980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca075-975f-46cb-876e-e7b99d627940", "name": "network-vif-unplugged", "status": "completed", "tag": "866ba63d-f6a5-4950-a11c-4732fc33b586"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:08.949843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fec4e71d-6a0e-4e08-bb8f-1771c4917982 req-4b3eb04a-b660-41e9-9564-05ea9e3e7980 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:08.952278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fec4e71d-6a0e-4e08-bb8f-1771c4917982 req-4b3eb04a-b660-41e9-9564-05ea9e3e7980 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.001607 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fec4e71d-6a0e-4e08-bb8f-1771c4917982 req-4b3eb04a-b660-41e9-9564-05ea9e3e7980 service nova] Creating event network-vif-unplugged:866ba63d-f6a5-4950-a11c-4732fc33b586 for instance e5eca075-975f-46cb-876e-e7b99d627940 on n-h2-849796-1 Jul 18 02:23:09.021623 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fec4e71d-6a0e-4e08-bb8f-1771c4917982 req-4b3eb04a-b660-41e9-9564-05ea9e3e7980 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113750 Jul 18 02:23:09.022410 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1098/2201] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:09.042724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ee6f915-f9eb-4cb4-9a8a-a88b575ad00d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab059cc5e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:09.205074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ee6f915-f9eb-4cb4-9a8a-a88b575ad00d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.180363 Jul 18 02:23:09.224887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1099/2202] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:09 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:09.288631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:09.294299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:09.334375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:09.351706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.353119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.356436 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0da3d194-2d78-4188-a735-2ab89cc90cc2 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 1.583129 Jul 18 02:23:09.362154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.364693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.373893 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1104/2203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:07 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:09.408486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:09.410451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:09.478146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.484696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.486952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.488207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.847286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd9caa3ac3041bfafca9ef5c8c0a0be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0161712c03e4448396c227dea011c725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:09.867369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-891d1cad-dfe4-4e38-9ee6-523f8f18d97f tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 200 len: 1613 microversion: 2.1 time: 0.488152 Jul 18 02:23:09.887052 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1105/2204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:09 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 1613 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:09.904871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:09.921335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:09.938536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.941566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:09.949022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:09.951639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.147913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:10.597737 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-531f4eb7-521c-48fb-8978-6d5cd9c0687e tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 204 len: 0 microversion: 2.25 time: 0.701889 Jul 18 02:23:10.601471 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1106/2205] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:23:09 2022] DELETE /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:10.626727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:10.628178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:10.641596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.642402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.643941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:10.650820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:10.818975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:10.871217 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8fffc326-1362-4c14-a036-1086a6892ddd tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1590 microversion: 2.1 time: 1.641434 Jul 18 02:23:10.879739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1100/2206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:09 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1590 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:10.941625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a0e59d8c-8f87-4c34-9017-bd0c7b864dd9 req-a37256be-adbd-42e6-bcc0-bce3e480de36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca075-975f-46cb-876e-e7b99d627940", "name": "network-vif-deleted", "tag": "866ba63d-f6a5-4950-a11c-4732fc33b586"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:11.022850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a0e59d8c-8f87-4c34-9017-bd0c7b864dd9 req-a37256be-adbd-42e6-bcc0-bce3e480de36 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.028780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a0e59d8c-8f87-4c34-9017-bd0c7b864dd9 req-a37256be-adbd-42e6-bcc0-bce3e480de36 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.105965 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a0e59d8c-8f87-4c34-9017-bd0c7b864dd9 req-a37256be-adbd-42e6-bcc0-bce3e480de36 service nova] Creating event network-vif-deleted:866ba63d-f6a5-4950-a11c-4732fc33b586 for instance e5eca075-975f-46cb-876e-e7b99d627940 on n-h2-849796-1 Jul 18 02:23:11.142229 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a0e59d8c-8f87-4c34-9017-bd0c7b864dd9 req-a37256be-adbd-42e6-bcc0-bce3e480de36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258482 Jul 18 02:23:11.149955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1101/2207] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:11.168583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.169356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:11.191069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.191665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.197706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.199262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.222837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:11.243330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e39a25d6-c859-44ba-baca-6d69e2c3d811 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.636788 Jul 18 02:23:11.259082 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1107/2208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:10 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:11.317040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9126860-90e0-4727-ad0b-9785282db849 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0443b9d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.511909 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9126860-90e0-4727-ad0b-9785282db849 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.232510 Jul 18 02:23:11.515501 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1108/2209] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:11 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:11.534327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.534996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:11.564097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.564717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.566314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.567962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.949902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:11.962509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed3b461f-4e4c-4b5b-827a-46e413ff1348 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 0.440783 Jul 18 02:23:11.965084 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1109/2210] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:11 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:11.970714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:11.971347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:11.987708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.988179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:11.992693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:11.993580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.641530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:12.684841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:12.689078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:12.693214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-810c5b9e-8678-4a12-b0c2-aae4c46fb1dd tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1728 microversion: 2.25 time: 0.726451 Jul 18 02:23:12.696825 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1110/2211] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:11 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1728 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:12.724435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:12.725768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:12.739167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.740361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:12.744042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:12.764454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.000044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:13.037640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:13.063235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:13.073320 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d75bbc2-99c3-4815-9615-66e758ce86d2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.921535 Jul 18 02:23:13.076631 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1102/2212] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:11 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:13.114517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:13.115676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:13.143076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.147017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.152013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.156263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.202176 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] HTTP exception thrown: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Request method failure captured: Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 HTTP/1.1 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MLgD-ol5DT_nQ4fgpBz1zAGvkXsY15sKbOAXnqCkxc9815JwZGM0FvGRKH5blewWwyqaNpwZqBnPHSOIB1N0bydvk92ia546h7JNnQbvDvDoKjLNSBF7W2f21VL9wEIXm9ML_yOBAV3BJLfyhR5u9cUIL8WiuP8VgyGK1phmp-BuPs Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0161712c03e4448396c227dea011c725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0161712c03e4448396c227dea011c725"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: edd9caa3ac3041bfafca9ef5c8c0a0be Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e5eca075-975f-46cb-876e-e7b99d627940'} Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:13.206301 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:13.209662 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:13.213002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Returning 404 to user: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:13.214461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5bcf5f2-8096-459c-95b7-2f9b8ad8bc42 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 404 len: 111 microversion: 2.1 time: 0.134297 Jul 18 02:23:13.219819 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1103/2213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:13 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:23:13.227612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7aee9c05-faac-4853-979d-867dcd52074a req-f16490fc-8e07-446c-a312-98218f493c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814984c0-2fe5-453e-aa2c-e595972987ed", "name": "network-vif-plugged", "status": "completed", "tag": "133c38e1-c5b5-472c-9d2d-3cc18274cdd1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:13.239086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7aee9c05-faac-4853-979d-867dcd52074a req-f16490fc-8e07-446c-a312-98218f493c75 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.239969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7aee9c05-faac-4853-979d-867dcd52074a req-f16490fc-8e07-446c-a312-98218f493c75 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.273733 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7aee9c05-faac-4853-979d-867dcd52074a req-f16490fc-8e07-446c-a312-98218f493c75 service nova] Creating event network-vif-plugged:133c38e1-c5b5-472c-9d2d-3cc18274cdd1 for instance 814984c0-2fe5-453e-aa2c-e595972987ed on n-h2-849796-1 Jul 18 02:23:13.309397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7aee9c05-faac-4853-979d-867dcd52074a req-f16490fc-8e07-446c-a312-98218f493c75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085259 Jul 18 02:23:13.310458 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1104/2214] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:13.346494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9625ba92-1947-453b-ae9a-216db3919921 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.647447 Jul 18 02:23:13.347984 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1111/2215] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:23:12 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb/os-interface => generated 284 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:13.359333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:13.367403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:13.371854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f22774f5-6da7-4d90-afb1-037c911ffd31 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a0ee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:13.424459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.437405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.441881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.446610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.475411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f22774f5-6da7-4d90-afb1-037c911ffd31 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.125334 Jul 18 02:23:13.478757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1112/2216] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:13 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:13.496013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:13.497153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:13.552669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.558696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:13.563982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:13.569078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.127842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:14.140646 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcdae20f-d409-4bf9-b92e-bb172c44e6d6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.816407 Jul 18 02:23:14.143234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1105/2217] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:13 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:14.166172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5dd328ba-1099-422b-bcfb-391be4afbcc5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '.version_select at 0x7fab04eba4c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:14.199307 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5dd328ba-1099-422b-bcfb-391be4afbcc5 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100559741" status: 202 len: 0 microversion: 2.1 time: 0.054754 Jul 18 02:23:14.200221 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1106/2218] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100559741 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:23:14.206428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:14.207902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:14.223241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.226616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.231498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.236520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.692141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:14.702705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:14.737612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:14.751222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:14.757535 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3bd6cdb-b09f-47dc-b751-5c110d2bbd2d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1660 microversion: 2.25 time: 0.554202 Jul 18 02:23:14.772858 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1107/2219] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:14 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1660 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:14.794740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:14.798480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:14.831643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.833306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:14.840476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:14.845896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:15.894669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:15.936894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:15.940409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:15.963573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f632aff9-27ab-4fa8-9e78-d50dc0f859fe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.196876 Jul 18 02:23:15.977922 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1108/2220] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:14 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:15.997229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-175fb00a-382f-4c55-896e-20444f4727ed tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eeb160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:16.266616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:16.280578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-175fb00a-382f-4c55-896e-20444f4727ed tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.300582 Jul 18 02:23:16.291124 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1109/2221] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:15 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:16.307353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:16.314316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:16.317719 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-384ec93d-8d42-4050-80f6-2e410eab9950 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1368 microversion: 2.1 time: 2.837012 Jul 18 02:23:16.327164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1113/2222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:13 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1368 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:16.343289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:16.345402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:16.347859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:16.349237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:16.384814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:16.386306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:16.428028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:16.428916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:16.430508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:16.431479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.220972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:17.243118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:17.268762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:17.270884 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-673a9638-6878-4500-8902-419a20261608 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 200 len: 1660 microversion: 2.25 time: 0.941619 Jul 18 02:23:17.273566 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1114/2223] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:16 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 1660 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:17.292759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:17.304012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:17.322308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.329241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.331152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:17.331910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:17.862722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:17.877100 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55894b88-a7f8-4cf5-a578-0e50f008130e tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.584220 Jul 18 02:23:17.881418 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1110/2224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:16 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:17.896744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-087d9bfc-b3bb-4c17-be7b-2437313700b0 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ed9550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:18.049844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-087d9bfc-b3bb-4c17-be7b-2437313700b0 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.166684 Jul 18 02:23:18.054188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1111/2225] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:17 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:18.080407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:18.096565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:18.123954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:18.132609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:18.134970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:18.143567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:18.732305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:18.748062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba496e9f-c965-4b55-883f-5bdca5952710 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1557 microversion: 2.1 time: 0.689838 Jul 18 02:23:18.756098 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1112/2226] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:18 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1557 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:18.767334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-621f07f1-dd26-46c1-9e5e-08012b1ab706 req-2f500520-2f6c-4b53-bb5f-5a84a5686288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a4804-94ea-45b7-ac0e-fc714026de47", "name": "network-vif-deleted", "tag": "588bbb82-01cd-4f89-9dbe-fc29692ed5f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:18.785268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-621f07f1-dd26-46c1-9e5e-08012b1ab706 req-2f500520-2f6c-4b53-bb5f-5a84a5686288 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:18.786163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-621f07f1-dd26-46c1-9e5e-08012b1ab706 req-2f500520-2f6c-4b53-bb5f-5a84a5686288 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:18.843041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-621f07f1-dd26-46c1-9e5e-08012b1ab706 req-2f500520-2f6c-4b53-bb5f-5a84a5686288 service nova] Creating event network-vif-deleted:588bbb82-01cd-4f89-9dbe-fc29692ed5f4 for instance c28a4804-94ea-45b7-ac0e-fc714026de47 on n-h2-849796-1 Jul 18 02:23:18.866639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-621f07f1-dd26-46c1-9e5e-08012b1ab706 req-2f500520-2f6c-4b53-bb5f-5a84a5686288 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106584 Jul 18 02:23:18.871290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1113/2227] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:18.889603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:18.893864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: c28a4804-94ea-45b7-ac0e-fc714026de47] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:18.940301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:18.943037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:18.947742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:18.951277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.041492 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] HTTP exception thrown: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Request method failure captured: Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 HTTP/1.1 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFsGdJg4Lq6pmBZeKDdiCQQZn_SbRkHtsnMTduX--tip8mqWBblnnDQpN0N0ysK_bV4YAtXl7RCIYAb00iXhenbE42AoXjMIwpDlk1_5T-CBiatLyQSi7-weWYlsNTKeUr4ScpN9LSizALI_fmxkpgaihteTRhAQTxSZ8K_vP3q2ac Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2affc29a14f847a099dad6deaf668842 Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'c28a4804-94ea-45b7-ac0e-fc714026de47'} Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. Jul 18 02:23:19.045649 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Returning 404 to user: Instance c28a4804-94ea-45b7-ac0e-fc714026de47 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:19.053193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cff5c701-7a70-4374-a3d9-f2d1a4dde4c6 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47" status: 404 len: 111 microversion: 2.25 time: 0.175645 Jul 18 02:23:19.061432 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1114/2228] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:18 2022] GET /compute/v2.1/servers/c28a4804-94ea-45b7-ac0e-fc714026de47 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:23:19.071643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.076674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:19.093806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.094287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.095151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.095610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.318801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:19.387474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:19.400198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:19.402503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82368a8f-1b73-4907-991b-4ce0a5360324 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 2.123601 Jul 18 02:23:19.403527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1115/2229] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:17 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:19.453840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.455017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:19.516905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.518701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.522411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.528789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.577952 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40f3368d-59ad-4b0b-a159-6fbffd1ab848 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.515046 Jul 18 02:23:19.579067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1115/2230] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-interface => generated 284 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:19.585034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7670051-f57f-472a-babc-33da76182c1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '.version_select at 0x7fab055c8310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.629433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7670051-f57f-472a-babc-33da76182c1b tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407514903" status: 204 len: 0 microversion: 2.25 time: 0.048911 Jul 18 02:23:19.634820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1116/2231] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Jul 18 02:23:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407514903 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:19.645345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ced8fd42-7175-4916-acbf-260031d9be70 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb4790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.737079 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ced8fd42-7175-4916-acbf-260031d9be70 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.100869 Jul 18 02:23:19.739605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1117/2232] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:19.760261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:19.761254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:19.782275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.783039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:19.785604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:19.786633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:20.527282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:20.583390 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-590b3c0c-97a8-48f8-85b5-b215173ee386 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1590 microversion: 2.1 time: 0.836477 Jul 18 02:23:20.590079 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1118/2233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1590 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:20.606948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2d085268-a087-4255-946d-1c5bd4cb6643 req-3d718da4-89c9-4f4e-8cb8-e992f49296e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e42816f-af3e-4671-b698-75c92c627aeb", "tag": "05f964f7-cddb-427f-af7a-482415df8f85"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:20.662669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2d085268-a087-4255-946d-1c5bd4cb6643 req-3d718da4-89c9-4f4e-8cb8-e992f49296e1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:20.662669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2d085268-a087-4255-946d-1c5bd4cb6643 req-3d718da4-89c9-4f4e-8cb8-e992f49296e1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:20.743915 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2d085268-a087-4255-946d-1c5bd4cb6643 req-3d718da4-89c9-4f4e-8cb8-e992f49296e1 service nova] Creating event network-changed:05f964f7-cddb-427f-af7a-482415df8f85 for instance 1e42816f-af3e-4671-b698-75c92c627aeb on n-h2-849796-1 Jul 18 02:23:20.845238 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2d085268-a087-4255-946d-1c5bd4cb6643 req-3d718da4-89c9-4f4e-8cb8-e992f49296e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228508 Jul 18 02:23:20.847451 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1119/2234] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:20.903656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:20.907364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:20.952752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:20.955803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:20.958494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:20.963042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:21.052319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:21.066137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc543f96-32d0-4765-bd75-4bfbcb936744 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.643645 Jul 18 02:23:21.081357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1116/2235] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:19 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:21.093132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91347cfb-1eba-47f4-8375-b487736a076a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044538b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:22.224129 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-91347cfb-1eba-47f4-8375-b487736a076a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 1.135775 Jul 18 02:23:22.230842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:22.243508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1117/2236] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:21 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:22.275681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:22.279653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:22.332687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:22.336374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.340882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.346920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:22.349476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:22.354436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:22.382524 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08fa9874-7a8c-4b5d-8644-e32df4a22112 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.524425 Jul 18 02:23:22.403999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1120/2237] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:20 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:23.253260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db982d4f-f550-42f0-9b5b-27e83b6a070f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab059cc940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:23.479341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db982d4f-f550-42f0-9b5b-27e83b6a070f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.234443 Jul 18 02:23:23.494823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1121/2238] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:23 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:23.535180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:23.536359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:23.552465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:23.558832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:23.563081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:23.566815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:24.342868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:24.384064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:24.388269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:24.394263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96c445b6-21f3-49b0-b201-8eae6c7570a2 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.897061 Jul 18 02:23:24.401257 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1122/2239] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:23 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:24.503787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d01bb350-b52a-4c5a-a9a3-5ece8e96d70b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb4670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:24.617597 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d01bb350-b52a-4c5a-a9a3-5ece8e96d70b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.120995 Jul 18 02:23:24.624710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1123/2240] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:24 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:25.074038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:25.095552 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ca2399f-6d63-405a-b447-4f01b5d76d8b tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 2.849177 Jul 18 02:23:25.111711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1118/2241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:22 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:25.379873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:25.381564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:25.391079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:25.391900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:25.393933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:25.394635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:25.425354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:25.426404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:25.487773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:25.489161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:25.490525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:25.493969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:25.496712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:25.864758 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f12949ac-25ed-4397-be7b-ee1aa65bbb3a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 204 len: 0 microversion: 2.25 time: 0.488562 Jul 18 02:23:25.869383 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1124/2242] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:23:25 2022] DELETE /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:25.879965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4018ec53-cc13-476e-af5e-a874b65ffbde req-174f4df9-a80b-423e-9d99-3e8ebd65e233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814984c0-2fe5-453e-aa2c-e595972987ed", "tag": "133c38e1-c5b5-472c-9d2d-3cc18274cdd1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:25.901281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4018ec53-cc13-476e-af5e-a874b65ffbde req-174f4df9-a80b-423e-9d99-3e8ebd65e233 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:25.902638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4018ec53-cc13-476e-af5e-a874b65ffbde req-174f4df9-a80b-423e-9d99-3e8ebd65e233 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:25.925134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:25.938217 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4018ec53-cc13-476e-af5e-a874b65ffbde req-174f4df9-a80b-423e-9d99-3e8ebd65e233 service nova] Creating event network-changed:133c38e1-c5b5-472c-9d2d-3cc18274cdd1 for instance 814984c0-2fe5-453e-aa2c-e595972987ed on n-h2-849796-1 Jul 18 02:23:25.943920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:25.951376 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4018ec53-cc13-476e-af5e-a874b65ffbde req-174f4df9-a80b-423e-9d99-3e8ebd65e233 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078824 Jul 18 02:23:25.953669 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1125/2243] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:25.963623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:25.965018 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1209d2a6-9808-436e-bdea-49921554e04b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.546730 Jul 18 02:23:25.968767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a6d5edf-8358-4189-9e51-4540f3f86b69 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb45e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:25.974376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1119/2244] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:25 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:25.990573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:25.991370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:26.049358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.049358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.075714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.077480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.118985 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a6d5edf-8358-4189-9e51-4540f3f86b69 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.161911 Jul 18 02:23:26.136345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1126/2245] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:25 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:26.161483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:26.163008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:26.205565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.214615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.217523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:26.233244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:26.608121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:26.633111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:26.641363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:26.647603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50cbf7c5-d02d-40b7-84ab-e7a1950ed7f2 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1548 microversion: 2.25 time: 0.668762 Jul 18 02:23:26.651718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1120/2246] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:25 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1548 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:27.155348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:27.164653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8460366-2fac-4f9b-87d9-0865acaf8add tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.025828 Jul 18 02:23:27.178559 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1127/2247] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:26 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:27.189585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:27.190226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:27.212333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:27.219829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:27.224128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:27.225009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:27.228823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1720274557", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "44642c0d-43de-4f4e-8186-27e8f5c071fd"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:27.399441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] validate_networks() for [('44642c0d-43de-4f4e-8186-27e8f5c071fd', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:23:28.574186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.584399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.586609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:28.598436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf25f5ac-84a9-4b08-9340-52f719376b08 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.418512 Jul 18 02:23:28.602314 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1128/2248] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:27 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:28.611585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60c75a60-1cfd-472e-a9b8-387bd62f0c8b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb4b80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:28.831765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:23:28.834261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:23:28.835486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:23:28.837455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:23:28.838515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:23:28.888231 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60c75a60-1cfd-472e-a9b8-387bd62f0c8b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.284320 Jul 18 02:23:28.889862 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1129/2249] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:28 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:28.908207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:28.912330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:28.927820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:28.939221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.940054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.941198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.942228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.948890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.949770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:28.964868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:28.970947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.091047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Getting quotas for project 5d5c79c4e4334f408e221bb914027028. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:23:29.121327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Getting quotas for user c9759ccb30864ee1804e767ff082b3b8 and project 5d5c79c4e4334f408e221bb914027028. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:23:29.181123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:23:29.193646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:23:29.437668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d8a03fdb-0ba2-4624-9de8-c11d2966997f tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.741164 Jul 18 02:23:29.443548 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1121/2250] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:23:29.469982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:29.471504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:29.510765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.519811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.521552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:29.529911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:29.543986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:30.142912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.158033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dae442df-fee7-4dff-81b3-f96a136b0431 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.710988 Jul 18 02:23:30.158988 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1122/2251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:29 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:30.176078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5a5a967f-3332-4002-98ae-57824a74dc48 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:30.176637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5a5a967f-3332-4002-98ae-57824a74dc48 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:30.178775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:30.358986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a5a967f-3332-4002-98ae-57824a74dc48 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.373503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5a5a967f-3332-4002-98ae-57824a74dc48 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1217 microversion: 2.1 time: 0.212917 Jul 18 02:23:30.385389 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1123/2252] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:30 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:30.392340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:30.393331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:30.407639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:30.419463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:30.425738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:30.426724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:30.568723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.609194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.612450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:30.631495 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49b50592-9fdc-465d-98ad-fcf58bf3a82a tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1548 microversion: 2.25 time: 1.739877 Jul 18 02:23:30.632522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1130/2253] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:28 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1548 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:30.656578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c868738a-b437-4e72-9e93-b47c1bed2f71 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb4c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:30.819001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c868738a-b437-4e72-9e93-b47c1bed2f71 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.179695 Jul 18 02:23:30.826590 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1131/2254] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:30 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:30.873071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:30.880250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:30.969718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:30.971075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:30.973879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:30.976107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.064684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:31.079732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:31.082015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:31.088792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b311331f-8b7d-479e-b481-76c1c21cfc04 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.701468 Jul 18 02:23:31.100271 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1124/2255] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:30 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:31.111456 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] HTTP exception thrown: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Request method failure captured: Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 HTTP/1.1 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MLgD-ol5DT_nQ4fgpBz1zAGvkXsY15sKbOAXnqCkxc9815JwZGM0FvGRKH5blewWwyqaNpwZqBnPHSOIB1N0bydvk92ia546h7JNnQbvDvDoKjLNSBF7W2f21VL9wEIXm9ML_yOBAV3BJLfyhR5u9cUIL8WiuP8VgyGK1phmp-BuPs Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0161712c03e4448396c227dea011c725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0161712c03e4448396c227dea011c725"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: edd9caa3ac3041bfafca9ef5c8c0a0be Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e5eca075-975f-46cb-876e-e7b99d627940'} Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:31.128700 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Returning 404 to user: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:31.132516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86b19b93-db1e-4bfc-bc73-80ba0f52b65b tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 404 len: 111 microversion: 2.1 time: 0.298053 Jul 18 02:23:31.143828 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1132/2256] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:23:30 2022] DELETE /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 111 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:23:31.148961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:31.149787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] [instance: e5eca075-975f-46cb-876e-e7b99d627940] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:31.170096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.180515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:31.181360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.183936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.184912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:31.190397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.220430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.223391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.229062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.234492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.273170 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] HTTP exception thrown: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Request method failure captured: Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 HTTP/1.1 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MLgD-ol5DT_nQ4fgpBz1zAGvkXsY15sKbOAXnqCkxc9815JwZGM0FvGRKH5blewWwyqaNpwZqBnPHSOIB1N0bydvk92ia546h7JNnQbvDvDoKjLNSBF7W2f21VL9wEIXm9ML_yOBAV3BJLfyhR5u9cUIL8WiuP8VgyGK1phmp-BuPs Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0161712c03e4448396c227dea011c725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0161712c03e4448396c227dea011c725"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0161712c03e4448396c227dea011c725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 0161712c03e4448396c227dea011c725 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-944187498 Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: edd9caa3ac3041bfafca9ef5c8c0a0be Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-944187498-project Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'e5eca075-975f-46cb-876e-e7b99d627940'} Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:31.283618 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. Jul 18 02:23:31.291641 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:31.299362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] Returning 404 to user: Instance e5eca075-975f-46cb-876e-e7b99d627940 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:31.301865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-540e8279-4714-4ff3-86aa-b14ef1800876 tempest-AttachSCSIVolumeTestJSON-944187498 tempest-AttachSCSIVolumeTestJSON-944187498-project] 10.222.0.67 "GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940" status: 404 len: 111 microversion: 2.1 time: 0.157463 Jul 18 02:23:31.312802 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1125/2257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:31 2022] GET /compute/v2.1/servers/e5eca075-975f-46cb-876e-e7b99d627940 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:23:31.404590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:31.406597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:31.473783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.477425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.486704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:31.496066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:31.993818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.030186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba37a944-69f1-49e2-a8ec-c6c5f1dc1e91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1221 microversion: 2.1 time: 0.632718 Jul 18 02:23:32.041635 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1126/2258] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:31 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1221 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:32.047762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:32.049275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:32.058579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.059702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.061928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.063486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.176790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.182462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.183388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lazy-loading 'fault' on Instance uuid fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:23:32.298370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.349193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9209306a-6ead-4975-8d66-7cdd5c86efaf tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.169141 Jul 18 02:23:32.372526 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1133/2259] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:31 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:32.390688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-80d3850c-c2a0-4dd0-9308-8260900944bb req-09419408-ad99-4c66-adc0-8f1b46fb87ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ab048-9553-4d6d-86c1-f7b26cedf7e1", "name": "network-vif-deleted", "tag": "35e91e61-97e2-4639-a9a1-c84960f88e5a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:32.410259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80d3850c-c2a0-4dd0-9308-8260900944bb req-09419408-ad99-4c66-adc0-8f1b46fb87ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.411376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80d3850c-c2a0-4dd0-9308-8260900944bb req-09419408-ad99-4c66-adc0-8f1b46fb87ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.441887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-80d3850c-c2a0-4dd0-9308-8260900944bb req-09419408-ad99-4c66-adc0-8f1b46fb87ea service nova] Creating event network-vif-deleted:35e91e61-97e2-4639-a9a1-c84960f88e5a for instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 on n-h1-849796-1 Jul 18 02:23:32.456578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-80d3850c-c2a0-4dd0-9308-8260900944bb req-09419408-ad99-4c66-adc0-8f1b46fb87ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078326 Jul 18 02:23:32.458833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1134/2260] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:32.481314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef23be20-cf1d-4562-83fb-a16e617a67a5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb4280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:32.664693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.704026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.705949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:32.707245 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-355fb90b-93d8-4baf-b5b4-e5a23cf49381 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 200 len: 1352 microversion: 2.25 time: 0.664171 Jul 18 02:23:32.725615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef23be20-cf1d-4562-83fb-a16e617a67a5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.264007 Jul 18 02:23:32.731384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1127/2261] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:32 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 1352 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:32.733066 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1135/2262] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:32 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:32.746578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:32.752332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:32.782233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.782957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:32.783990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:32.784608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.084040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:33.090411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:33.158020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.163097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.170318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.177292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.783591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:33.831436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7b5df2e-5e15-48b4-a265-ffe4d298771d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1277 microversion: 2.1 time: 0.755562 Jul 18 02:23:33.849713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1136/2263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:33 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1277 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:33.878972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:33.881063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:33.912570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.914145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.917324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:33.918925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:33.933404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:34.204599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:34.282331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:34.286066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:34.288490 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de79d04c-cae4-4ebc-a70a-ca38a72fe9be tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.555451 Jul 18 02:23:34.290285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1128/2264] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:32 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:34.299129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:34.300536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: fc6ab048-9553-4d6d-86c1-f7b26cedf7e1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:34.313007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.319798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.326813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.337334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.402989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] HTTP exception thrown: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Request method failure captured: Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 HTTP/1.1 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MFsGdJg4Lq6pmBZeKDdiCQQZn_SbRkHtsnMTduX--tip8mqWBblnnDQpN0N0ysK_bV4YAtXl7RCIYAb00iXhenbE42AoXjMIwpDlk1_5T-CBiatLyQSi7-weWYlsNTKeUr4ScpN9LSizALI_fmxkpgaihteTRhAQTxSZ8K_vP3q2ac Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 2affc29a14f847a099dad6deaf668842 Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'fc6ab048-9553-4d6d-86c1-f7b26cedf7e1'} Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. Jul 18 02:23:34.413208 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. Jul 18 02:23:34.421062 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:23:34.423101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Returning 404 to user: Instance fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:34.427148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84011f6b-921f-49a5-af19-b08854108397 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1" status: 404 len: 111 microversion: 2.25 time: 0.134286 Jul 18 02:23:34.430810 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1129/2265] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:34 2022] GET /compute/v2.1/servers/fc6ab048-9553-4d6d-86c1-f7b26cedf7e1 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:23:34.458521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de71016c-6e34-4ae8-98ab-c7a4950814e2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0454e790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:34.639116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de71016c-6e34-4ae8-98ab-c7a4950814e2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.202821 Jul 18 02:23:34.647465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1130/2266] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:34 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:34.685402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:34.687347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:34.706532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.707517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.711608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:34.713421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:34.846494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:35.017975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.041822 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d50464b1-b961-4c7c-8c2f-32b26696b975 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.189708 Jul 18 02:23:35.046536 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1137/2267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:33 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:35.053057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ea59512f-7201-47f4-895f-db229ce862c7 req-2ea08cbb-ca0d-484a-869d-b9a001430644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "name": "network-vif-unplugged", "status": "completed", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:35.092366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ea59512f-7201-47f4-895f-db229ce862c7 req-2ea08cbb-ca0d-484a-869d-b9a001430644 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.093283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ea59512f-7201-47f4-895f-db229ce862c7 req-2ea08cbb-ca0d-484a-869d-b9a001430644 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.123495 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ea59512f-7201-47f4-895f-db229ce862c7 req-2ea08cbb-ca0d-484a-869d-b9a001430644 service nova] Creating event network-vif-unplugged:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h1-849796-1 Jul 18 02:23:35.136883 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ea59512f-7201-47f4-895f-db229ce862c7 req-2ea08cbb-ca0d-484a-869d-b9a001430644 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084432 Jul 18 02:23:35.140387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1138/2268] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:35.149860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:35.161262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:35.177095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.178099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.181168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.184820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.209124 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ceaca94e-b25b-4691-8dc5-0e6ac7f9463d tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "DELETE /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 204 len: 0 microversion: 2.25 time: 0.558685 Jul 18 02:23:35.210372 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1131/2269] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:23:34 2022] DELETE /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:23:35.234535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:35.240127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:35.278183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.278885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.285602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.286305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.380506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.394218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15fe1960-c195-4323-852a-b98ea9adef15 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1275 microversion: 2.1 time: 0.251892 Jul 18 02:23:35.409371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1139/2270] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:35 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:35.417656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:35.426040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:35.434354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.446634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.447838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:35.448478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:35.781285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.798029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.801606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:35.813624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26bfd1f3-9cf8-4d1b-9178-6e8e50317734 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1562 microversion: 2.25 time: 0.590087 Jul 18 02:23:35.814605 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1132/2271] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:35 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1562 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:35.827356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-277f781d-5d0a-4765-b522-befb86e97c31 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0454ec10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:35.908194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-277f781d-5d0a-4765-b522-befb86e97c31 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.092212 Jul 18 02:23:35.912828 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1133/2272] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:35 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:36.077725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:36.078794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:36.088424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:36.100245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.100879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.104942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.105812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.111302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:36.115461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:36.119431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d4ecfdc-757d-450a-b26f-98d7a153504c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.706357 Jul 18 02:23:36.130638 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1140/2273] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:35 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:36.412415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:36.416967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:36.434142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.443549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.444733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.446162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.804222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:36.821525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-480d07d7-b84e-4020-8a2f-3b3ab402e768 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.748330 Jul 18 02:23:36.834170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1134/2274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:36 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:36.839958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:36.840838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:36.851968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.852970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.855141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:36.856086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:36.984596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:37.009051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f802ee3-2b2a-406d-a527-0c110c026edc tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.598571 Jul 18 02:23:37.012448 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1141/2275] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:36 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:37.024242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c290ac38-ad24-4a20-88ae-8a42876ba6dc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eba430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:37.109147 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c290ac38-ad24-4a20-88ae-8a42876ba6dc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.093373 Jul 18 02:23:37.110615 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1142/2276] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:37 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:37.139120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:37.140138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:37.151560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.153725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.157575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.161944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.629314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:37.676631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:37.681623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2affc29a14f847a099dad6deaf668842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7d825a621a40dea844b3e2df794cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:37.683837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac6663d3-fc3f-4303-bd57-b9a30a44e8f5 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 200 len: 1562 microversion: 2.25 time: 0.847889 Jul 18 02:23:37.695425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1135/2277] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:36 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 1562 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:37.751186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8c0e5e41-a492-4f0b-bcf4-4734cbf8868e req-fabba32f-c742-4e96-b88b-8567934577ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:37.797908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8c0e5e41-a492-4f0b-bcf4-4734cbf8868e req-fabba32f-c742-4e96-b88b-8567934577ec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.802815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8c0e5e41-a492-4f0b-bcf4-4734cbf8868e req-fabba32f-c742-4e96-b88b-8567934577ec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.853377 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8c0e5e41-a492-4f0b-bcf4-4734cbf8868e req-fabba32f-c742-4e96-b88b-8567934577ec service nova] Creating event network-changed:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h1-849796-1 Jul 18 02:23:37.888040 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8c0e5e41-a492-4f0b-bcf4-4734cbf8868e req-fabba32f-c742-4e96-b88b-8567934577ec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172724 Jul 18 02:23:37.894229 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1136/2278] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:37.915466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:37.917925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:37.946721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.948490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:37.950623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:37.954812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:38.666983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:38.692381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:38.696155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:38.699378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9360aea-81b2-41a4-8310-c2725aa58255 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.564265 Jul 18 02:23:38.713829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1143/2279] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:37 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:38.733693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e6ee3403-5661-4ce2-b26d-cbe530678142 req-2980b96d-8b05-4002-a404-a50949dcf606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81553898-c387-4d5e-b539-effed146abfd", "name": "network-vif-deleted", "tag": "44142f21-1c0d-4bce-be55-52162adf374c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:38.754528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6ee3403-5661-4ce2-b26d-cbe530678142 req-2980b96d-8b05-4002-a404-a50949dcf606 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:38.755724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6ee3403-5661-4ce2-b26d-cbe530678142 req-2980b96d-8b05-4002-a404-a50949dcf606 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:38.785650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e6ee3403-5661-4ce2-b26d-cbe530678142 req-2980b96d-8b05-4002-a404-a50949dcf606 service nova] Creating event network-vif-deleted:44142f21-1c0d-4bce-be55-52162adf374c for instance 81553898-c387-4d5e-b539-effed146abfd on n-h1-849796-1 Jul 18 02:23:38.796752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e6ee3403-5661-4ce2-b26d-cbe530678142 req-2980b96d-8b05-4002-a404-a50949dcf606 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079532 Jul 18 02:23:38.798612 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1144/2280] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:38.811937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:38.816479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:38.837779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:38.838968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:38.840697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:38.841881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:39.042661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:39.186672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:39.225533 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c11e7bd-e739-481e-97e1-dfb71d3b85e8 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.327753 Jul 18 02:23:39.230839 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1137/2281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:37 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:39.260965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da6ca6e8-b24d-4053-8210-1faecbeac071 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04453dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:39.334742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:39.368829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5813908c-c4dd-4eff-ba83-d343a7512a3b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.563396 Jul 18 02:23:39.388181 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1145/2282] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:38 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:39.400969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:39.402187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] [instance: 81553898-c387-4d5e-b539-effed146abfd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:39.414017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.414879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:39.416593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.417534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:39.422548 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da6ca6e8-b24d-4053-8210-1faecbeac071 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.189140 Jul 18 02:23:39.450361 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1138/2283] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:39 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:39.455645 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] HTTP exception thrown: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Request method failure captured: Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd HTTP/1.1 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MFsGdJg4Lq6pmBZeKDdiCQQZn_SbRkHtsnMTduX--tip8mqWBblnnDQpN0N0ysK_bV4YAtXl7RCIYAb00iXhenbE42AoXjMIwpDlk1_5T-CBiatLyQSi7-weWYlsNTKeUr4ScpN9LSizALI_fmxkpgaihteTRhAQTxSZ8K_vP3q2ac Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.25 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0c7d825a621a40dea844b3e2df794cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0c7d825a621a40dea844b3e2df794cc9 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 2affc29a14f847a099dad6deaf668842 Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1477330360-project Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '81553898-c387-4d5e-b539-effed146abfd'} Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. Jul 18 02:23:39.460563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. Jul 18 02:23:39.464985 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:23:39.467242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] Returning 404 to user: Instance 81553898-c387-4d5e-b539-effed146abfd could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:23:39.467611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-528e2c0f-37fd-409b-b4da-c7a8c69af774 tempest-LiveAutoBlockMigrationV225Test-1477330360 tempest-LiveAutoBlockMigrationV225Test-1477330360-project] 10.222.0.67 "GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd" status: 404 len: 111 microversion: 2.25 time: 0.075042 Jul 18 02:23:39.468541 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1146/2284] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:39 2022] GET /compute/v2.1/servers/81553898-c387-4d5e-b539-effed146abfd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:23:39.745792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:39.758453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:39.767027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.767495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:39.769071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:39.769842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.165783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1234c178-7ee0-4ef4-90c5-5d14e71c5d3b req-d132eaee-bd0e-46fb-925e-9beb13219116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd732f5-0c86-415f-a8a0-df62c41a5540", "tag": "8f2c6141-002b-4bb6-8a0d-0c06d4fc3941"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:40.235932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1234c178-7ee0-4ef4-90c5-5d14e71c5d3b req-d132eaee-bd0e-46fb-925e-9beb13219116 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.244490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1234c178-7ee0-4ef4-90c5-5d14e71c5d3b req-d132eaee-bd0e-46fb-925e-9beb13219116 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.340149 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1234c178-7ee0-4ef4-90c5-5d14e71c5d3b req-d132eaee-bd0e-46fb-925e-9beb13219116 service nova] Creating event network-changed:8f2c6141-002b-4bb6-8a0d-0c06d4fc3941 for instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 on n-h1-849796-1 Jul 18 02:23:40.365918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:40.373802 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1234c178-7ee0-4ef4-90c5-5d14e71c5d3b req-d132eaee-bd0e-46fb-925e-9beb13219116 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240154 Jul 18 02:23:40.374436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1147/2285] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:40.402732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:40.406126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:40.422817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.427658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.429643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.430618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.810420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:40.837070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:40.839415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:40.850880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7965a03f-9058-483f-88d9-f2935bff0d8f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.121646 Jul 18 02:23:40.853847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1139/2286] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:39 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:40.859291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:40.861774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:40.878313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.879154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:40.880196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:40.880871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.357649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:41.371750 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79bfed4f-10f5-4809-a6dc-18206cc0a7a2 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.516270 Jul 18 02:23:41.373627 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1140/2287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:40 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:41.383935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf750415-80c5-428c-b785-ba8358db1e92 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab043e8790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:41.467403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf750415-80c5-428c-b785-ba8358db1e92 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.092230 Jul 18 02:23:41.473091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1141/2288] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:41 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:41.638121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:41.656669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-357ebed7-65c2-423f-8444-068efa73a317 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 1.280895 Jul 18 02:23:41.668362 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1148/2289] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:40 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:41.850117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-04aa3e25-57cc-4175-a4ff-3fb126f01015 req-385948ab-cbd1-4ac3-870e-7251a3c22173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "1ba63a1c-8406-45b2-ade6-0a4a17c34c8b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:41.896653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:41.897242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-04aa3e25-57cc-4175-a4ff-3fb126f01015 req-385948ab-cbd1-4ac3-870e-7251a3c22173 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:41.897868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-04aa3e25-57cc-4175-a4ff-3fb126f01015 req-385948ab-cbd1-4ac3-870e-7251a3c22173 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.903297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:41.926391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:41.926852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.931155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:41.931667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:41.936790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-04aa3e25-57cc-4175-a4ff-3fb126f01015 req-385948ab-cbd1-4ac3-870e-7251a3c22173 service nova] Creating event network-vif-plugged:1ba63a1c-8406-45b2-ade6-0a4a17c34c8b for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:41.948106 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-04aa3e25-57cc-4175-a4ff-3fb126f01015 req-385948ab-cbd1-4ac3-870e-7251a3c22173 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102276 Jul 18 02:23:41.953332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1142/2290] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:42.413689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:42.420151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:42.429076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.431506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.432692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.433412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.787551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:42.798589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54ba7a8b-302f-444c-9534-2b968480e160 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.403173 Jul 18 02:23:42.810110 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1143/2291] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:42 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:42.816009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38817bc7-c6ad-4b1b-b485-5285d036d2cc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044cf4c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:42.886992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38817bc7-c6ad-4b1b-b485-5285d036d2cc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.060726 Jul 18 02:23:42.886992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1144/2292] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:42 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:42.886992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:42.886992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:42.891673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.892453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.893547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:42.894239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:42.936627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:42.961244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:43.032887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:43.039113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:43.041599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7084815b-11b5-47ea-9f0d-fff375a39126 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.158707 Jul 18 02:23:43.059409 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1149/2293] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:41 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:23:43.328403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:43.349304 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cbca6384-b021-4089-a08b-864d078c16dc tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.473473 Jul 18 02:23:43.351710 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1145/2294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:42 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:43.825223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:43.827285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:43.846431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:43.847916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.850177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:43.852254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:43.891865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6fc852b-465d-4990-ae4a-39831ddfbd7c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04593940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:44.046558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6fc852b-465d-4990-ae4a-39831ddfbd7c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1453 microversion: 2.1 time: 0.162896 Jul 18 02:23:44.049670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1146/2295] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:43 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:44.081551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:44.083382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:44.101007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.102678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.104393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.105534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.496742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.530010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-481128ef-0738-4010-b1a3-b20a82136d51 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.715128 Jul 18 02:23:44.535394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1150/2296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:43 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:44.555917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:44.559241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:44.588543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.589799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.591456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:44.594886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:44.660337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.672556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.674555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:44.675883 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15da8f8f-fc64-4e10-86ed-0db7c0291713 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.607643 Jul 18 02:23:44.676571 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1147/2297] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:44 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:45.077708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-532ecff0-1987-4a90-84c5-31a81853371c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04611a60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.149468 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-532ecff0-1987-4a90-84c5-31a81853371c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1462 microversion: 2.1 time: 0.084807 Jul 18 02:23:45.150639 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1148/2298] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:45.162859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51376853-65e9-4cee-adb6-5388436be7af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a0670>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.231399 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51376853-65e9-4cee-adb6-5388436be7af tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 200 len: 1462 microversion: 2.1 time: 0.072594 Jul 18 02:23:45.239885 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1149/2299] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:45.246370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.247137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:45.254043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.254504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.255332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.255786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.410839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.434886 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2ba2894-3366-4a6e-8c52-8ea4f24df79d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.896883 Jul 18 02:23:45.437071 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1151/2300] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:44 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:45.488230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:45.499014 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c771a2ac-3cf6-4d50-921f-7a3a90f452b7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1480 microversion: 2.1 time: 0.257873 Jul 18 02:23:45.499643 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1150/2301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1480 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:45.562021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.562987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:45.570529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.571149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.572093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.572654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.702284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:45.706570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:45.720798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.722516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:45.724354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:45.725238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.224128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:46.231041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:46.246042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:46.249789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:46.253360 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8f770d3-ed0a-4f20-8797-e427941df495 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.559756 Jul 18 02:23:46.255075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1151/2302] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:23:46.285631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5e693d09-08ad-444f-9403-fc1883ea0bbf req-77795a41-35bb-48d3-b96b-df4d021e3870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:46.292911 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c394dfa-59f8-4d98-956e-34c93b65cb4e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.735231 Jul 18 02:23:46.293957 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1152/2303] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:45 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:46.308332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5e693d09-08ad-444f-9403-fc1883ea0bbf req-77795a41-35bb-48d3-b96b-df4d021e3870 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.309556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5e693d09-08ad-444f-9403-fc1883ea0bbf req-77795a41-35bb-48d3-b96b-df4d021e3870 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.341962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5e693d09-08ad-444f-9403-fc1883ea0bbf req-77795a41-35bb-48d3-b96b-df4d021e3870 service nova] Creating event network-vif-plugged:a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:46.354718 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5e693d09-08ad-444f-9403-fc1883ea0bbf req-77795a41-35bb-48d3-b96b-df4d021e3870 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096905 Jul 18 02:23:46.357384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1152/2304] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:46.473776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:46.477362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:46.493402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.495707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.497747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.498993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.531281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:46.532724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:46.548455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.549698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.551438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.552688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.887549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:46.901359 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c1321b1f-b430-4c42-bc60-c80c881aea19 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1467 microversion: 2.1 time: 0.385225 Jul 18 02:23:46.902039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1153/2305] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:46 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1467 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:46.932338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1810590493"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:46.933853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:46.947272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.948003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:46.949059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:46.949721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.169299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:47.182092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9afadc1f-c223-423e-8b2d-4a697a2ab290 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.721081 Jul 18 02:23:47.192056 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1153/2306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:46 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:47.296030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:47.296799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:47.309663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.311175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.313227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.314540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.347134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a8ddddb-11b9-4e7a-92cc-905f67e13e4b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "POST /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7/action" status: 202 len: 0 microversion: 2.1 time: 0.417655 Jul 18 02:23:47.348850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1154/2307] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:23:46 2022] POST /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 02:23:47.359541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-12eafa2a-acce-4f62-ab79-cc2223de75a3 req-ec2a6087-27ae-4aa4-86ea-4d0ff625c649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "name": "network-vif-unplugged", "status": "completed", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:47.374253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-12eafa2a-acce-4f62-ab79-cc2223de75a3 req-ec2a6087-27ae-4aa4-86ea-4d0ff625c649 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.374642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-12eafa2a-acce-4f62-ab79-cc2223de75a3 req-ec2a6087-27ae-4aa4-86ea-4d0ff625c649 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.388283 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-12eafa2a-acce-4f62-ab79-cc2223de75a3 req-ec2a6087-27ae-4aa4-86ea-4d0ff625c649 service nova] Creating event network-vif-unplugged:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h1-849796-1 Jul 18 02:23:47.394195 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-12eafa2a-acce-4f62-ab79-cc2223de75a3 req-ec2a6087-27ae-4aa4-86ea-4d0ff625c649 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043443 Jul 18 02:23:47.394862 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1155/2308] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:47.402930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:47.404121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:47.411855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.412603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.414306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:47.415082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:47.693114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:47.707232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0450b48-52ae-4a6d-85ab-984f85b8ed8a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.310088 Jul 18 02:23:47.709093 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1156/2309] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:47 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:47.736707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a18d0f9-c76a-463a-bc8d-f8a224a89085 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044158b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:47.820900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a18d0f9-c76a-463a-bc8d-f8a224a89085 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.091296 Jul 18 02:23:47.822666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1157/2310] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:47 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:48.174223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:48.191401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:48.196144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:48.203590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:48.204230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:48.208993 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b7dc0dd-e5b5-4e5d-b9f3-71a10a7323ec tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.905049 Jul 18 02:23:48.213219 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1154/2311] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:47 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:23:48.220812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:48.221306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:48.222139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:48.224875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:48.448195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "804f95d4-9cf9-4928-9668-8d25b51873f2"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "4f456121-fd6f-4052-a2bc-5c6324652c5f"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "df68d20a-4518-4fc1-8770-f6dd7fe75468"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:48.466039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:48.466511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:48.483023 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Creating event network-vif-plugged:804f95d4-9cf9-4928-9668-8d25b51873f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:48.483544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Creating event network-vif-plugged:4f456121-fd6f-4052-a2bc-5c6324652c5f for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:48.484059 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] Creating event network-vif-plugged:df68d20a-4518-4fc1-8770-f6dd7fe75468 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:48.500086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-953d3113-cb63-4f37-899d-38b97324dd75 req-079606db-cdf8-4f02-a2cf-c353123af660 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.062669 Jul 18 02:23:48.502266 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1155/2312] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:48.598951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:48.627052 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb601751-0488-4f89-a729-94591e8006e5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.429149 Jul 18 02:23:48.638676 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1158/2313] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:48 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:48.737471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:48.739576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:48.760595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:48.761587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:48.764417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:48.767445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:48.837778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76692954-f4d2-4c32-b185-08a1bcbd4e45 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04464310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:48.928326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-76692954-f4d2-4c32-b185-08a1bcbd4e45 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.096744 Jul 18 02:23:48.938391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1159/2314] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:48 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:49.235602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:49.236304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:49.249122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.249582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.250388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.250841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.317305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:49.365302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b46739d5-aa83-4424-aab5-6016413bd76a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.639853 Jul 18 02:23:49.377522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1156/2315] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:48 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:49.646081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:49.646739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:49.672398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.672398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:49.672683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:49.672911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:50.003340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:50.019199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:50.026297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:50.036806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11e9cb92-0f7f-489c-9e82-f754a1a94f16 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.809152 Jul 18 02:23:50.037794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1160/2316] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:49 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:50.055108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9055c32-44c8-484b-9aff-d566d14ac082 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04415dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:50.112439 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9055c32-44c8-484b-9aff-d566d14ac082 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.069796 Jul 18 02:23:50.113239 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1161/2317] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:50 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:50.272462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:50.286679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73e7ece5-f33a-4c2a-afca-959e11e7001f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.642907 Jul 18 02:23:50.289177 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1157/2318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:49 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:50.383508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:50.384512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:50.403503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:50.404740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:50.407799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:50.410062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:50.565139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "1bb5c7e7-e428-4d94-9253-52e8ef2e2338"}, {"server_uuid": "2bb36d11-eea4-48cc-9680-e854c7e16ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "d421c541-4386-4e00-b959-ca13f1e84515"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-plugged", "status": "completed", "tag": "6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:50.587156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:50.587875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:50.592499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:50.608765 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Creating event network-vif-plugged:1bb5c7e7-e428-4d94-9253-52e8ef2e2338 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:50.609627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Creating event network-vif-unplugged:d421c541-4386-4e00-b959-ca13f1e84515 for instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 on n-h2-849796-1 Jul 18 02:23:50.610266 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] Creating event network-vif-plugged:6bf6b6a2-a9d2-4cd8-a486-e9035b9501f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:50.624180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9f585b00-ea5d-4d05-9d9e-a737b5f28320 req-b32c11fb-a869-4252-a310-fcc3cb38376a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.072126 Jul 18 02:23:50.626809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1158/2319] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:51.060777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:51.061703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:51.072324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.072825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.074546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.075022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.204619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.221048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c2665dbd-f32c-4704-bc6b-cd0dd236a51e tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.841290 Jul 18 02:23:51.222500 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1162/2320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:50 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:51.232506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d458a112-7356-4b70-b1ca-8d11a49cda6f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04561dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:51.319163 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d458a112-7356-4b70-b1ca-8d11a49cda6f tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.094647 Jul 18 02:23:51.321113 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1163/2321] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:51 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:51.327724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:51.328656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:51.337343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.338461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.339300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:51.339744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:51.609557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.636974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.673413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.685709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:51.697401 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fec64f46-fee0-411e-86c0-7d8909f3448d tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 0.642521 Jul 18 02:23:51.700745 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-501fc2d4-d0f1-47db-9488-86cc3a6d13f1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1392 microversion: 2.1 time: 0.377756 Jul 18 02:23:51.702292 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1159/2322] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:51 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:23:51.718793 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1164/2323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:51 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:52.256783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.258583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:52.272041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.273545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.275218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.276319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.339148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a621cc1-56a0-405c-b8f2-1935d6f9ebd1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04453af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.437677 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a621cc1-56a0-405c-b8f2-1935d6f9ebd1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.103029 Jul 18 02:23:52.438863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1165/2324] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:52.657059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-566fef7b-dece-4871-9ffd-e905034c3a0a req-2519bc5a-436c-4371-a057-79df67375f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd732f5-0c86-415f-a8a0-df62c41a5540", "name": "network-vif-plugged", "status": "completed", "tag": "8f2c6141-002b-4bb6-8a0d-0c06d4fc3941"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:52.667778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-566fef7b-dece-4871-9ffd-e905034c3a0a req-2519bc5a-436c-4371-a057-79df67375f52 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.668483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-566fef7b-dece-4871-9ffd-e905034c3a0a req-2519bc5a-436c-4371-a057-79df67375f52 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.683138 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-566fef7b-dece-4871-9ffd-e905034c3a0a req-2519bc5a-436c-4371-a057-79df67375f52 service nova] Creating event network-vif-plugged:8f2c6141-002b-4bb6-8a0d-0c06d4fc3941 for instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 on n-h1-849796-1 Jul 18 02:23:52.691219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-566fef7b-dece-4871-9ffd-e905034c3a0a req-2519bc5a-436c-4371-a057-79df67375f52 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038163 Jul 18 02:23:52.692469 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1166/2325] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:52.702323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:52.713178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0b7bb15-3444-4460-81a7-9c0df7ec9aec tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.465908 Jul 18 02:23:52.723631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.723841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1160/2326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:52.724309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:52.732394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.732697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.733763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.734234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.740916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:52.743403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:52.751809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.752683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:52.754190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:52.754826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.062918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.073064 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e8ba9ff-efe3-4c7f-949f-b258b2afde85 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1382 microversion: 2.1 time: 0.343390 Jul 18 02:23:53.082229 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1161/2327] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1382 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:53.102169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-14ee6b96-a803-44e8-93ea-510dab408c7d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '.version_select at 0x7fab04ed9f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:53.105486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14ee6b96-a803-44e8-93ea-510dab408c7d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.106018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14ee6b96-a803-44e8-93ea-510dab408c7d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.134708 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-14ee6b96-a803-44e8-93ea-510dab408c7d tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.040162 Jul 18 02:23:53.135905 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1162/2328] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:23:53 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:53.147728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:53.148609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:53.164193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.165079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.166089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.166704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.679998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.715917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.723373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:53.728183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54cdf0d8-41a3-438b-ab9f-62999a4946ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1879 microversion: 2.32 time: 1.006351 Jul 18 02:23:53.751836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1167/2329] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:52 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1879 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:53.766832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-392330df-8466-4326-9ed6-8f03074964f4 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045cb5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:53.906112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-392330df-8466-4326-9ed6-8f03074964f4 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.152123 Jul 18 02:23:53.911449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1168/2330] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:53 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:53.918100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:53.923452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:53.940159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.940912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.941994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:53.945544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:53.949702 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4510b568-d01e-4480-8cd3-77c619d781d6 tempest-LiveMigrationTest-959940284 tempest-LiveMigrationTest-959940284-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1533 microversion: 2.1 time: 0.798352 Jul 18 02:23:53.957952 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1163/2331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:53 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1533 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:54.021113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:54.022136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:54.044230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.052358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.060626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.062702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.099211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:23:54.253766 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf769dfd-e287-4483-9857-1068705e470c tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 204 len: 0 microversion: 2.1 time: 0.242926 Jul 18 02:23:54.262913 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1164/2332] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:23:54 2022] DELETE /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:23:54.278192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:54.279756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:54.294737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.295540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.297040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.297828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.409766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:54.455670 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e55119e-46a5-40d4-8cae-97097031677b tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1317 microversion: 2.1 time: 0.541480 Jul 18 02:23:54.461190 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1169/2333] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:53 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:54.767753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:54.769234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:54.790399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.791255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.794708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:54.795598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:54.899562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:54.933462 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bd773ea-7211-42ee-aa8b-5921781b1b76 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1388 microversion: 2.1 time: 0.663463 Jul 18 02:23:54.950069 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1165/2334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:54 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1388 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:54.964101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7afa16d6-a578-4eda-974d-7b1396d04eb6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab055c8ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:55.143593 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7afa16d6-a578-4eda-974d-7b1396d04eb6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.191467 Jul 18 02:23:55.144687 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1166/2335] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:54 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:55.475159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:55.476230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:55.478983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:55.489504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:55.489968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.499795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:55.500519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.506226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:55.516633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:55.526441 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dacdcc26-8bdf-4be8-b7c0-7816b712ef88 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2834 microversion: 2.32 time: 0.770429 Jul 18 02:23:55.544230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1170/2336] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:23:54 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2834 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:55.571864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:55.574707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:55.591069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:55.592240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.594228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:55.595062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.907986 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52287792-82b6-4dc5-81f8-1870170bb3e3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.346388 Jul 18 02:23:55.920443 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1171/2337] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:23:55 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0/os-interface => generated 1832 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:23:55.928229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-61cc12b4-9de8-49bd-ab9c-58aebb90deb4 req-2f821cd9-83b6-4515-9a04-071170fbf4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-plugged", "status": "completed", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:55.943108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-61cc12b4-9de8-49bd-ab9c-58aebb90deb4 req-2f821cd9-83b6-4515-9a04-071170fbf4db service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:55.944132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-61cc12b4-9de8-49bd-ab9c-58aebb90deb4 req-2f821cd9-83b6-4515-9a04-071170fbf4db service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:55.951224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:55.984753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-61cc12b4-9de8-49bd-ab9c-58aebb90deb4 req-2f821cd9-83b6-4515-9a04-071170fbf4db service nova] Creating event network-vif-plugged:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:23:56.018612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-61cc12b4-9de8-49bd-ab9c-58aebb90deb4 req-2f821cd9-83b6-4515-9a04-071170fbf4db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095328 Jul 18 02:23:56.029579 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1172/2338] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:56.039994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.041227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.060797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.063109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.065146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.066273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.242404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:56.272709 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90b019a8-24ac-4ae4-8563-6c0f3fb4d8b8 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1506 microversion: 2.1 time: 0.798786 Jul 18 02:23:56.273898 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1167/2339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:55 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:23:56.285336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e97c7f6-a6f4-417b-b5fe-9a26c494d5c6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb40d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.394427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e97c7f6-a6f4-417b-b5fe-9a26c494d5c6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.117806 Jul 18 02:23:56.402652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1168/2340] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:56 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:56.408182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.409393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.420718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.421226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.422062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.422522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.472077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:56.473295 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66117361-0c59-42dd-b824-a544f97370e7 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/os-instance-actions/req-d8a03fdb-0ba2-4624-9de8-c11d2966997f" status: 200 len: 313 microversion: 2.1 time: 0.069102 Jul 18 02:23:56.474265 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1169/2341] 10.222.0.67 () {58 vars in 1418 bytes} [Mon Jul 18 02:23:56 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/os-instance-actions/req-d8a03fdb-0ba2-4624-9de8-c11d2966997f => generated 313 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:56.493901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:56.495932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.503355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.503994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.505112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.505741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.637359 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26b53ffc-038b-4221-85bc-450be03b4d35 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "POST /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/action" status: 202 len: 0 microversion: 2.1 time: 0.143783 Jul 18 02:23:56.642115 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1170/2342] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:23:56 2022] POST /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:23:56.655936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:56.657234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:56.669877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.671218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.673619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:56.675159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:56.714018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:56.730943 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cc4b496-94a9-4bfc-ab03-0c9386d3d94f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1388 microversion: 2.1 time: 0.699735 Jul 18 02:23:56.731524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1173/2343] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:56 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1388 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:57.420212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c5e1975-b197-469a-9aa4-01d6bc042255 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0459d5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:57.504496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c5e1975-b197-469a-9aa4-01d6bc042255 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.096510 Jul 18 02:23:57.505438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1174/2344] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:57 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:57.511719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:57.526801 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0dc85c0-95bd-4b7a-8ce1-3dcea0d4b919 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1508 microversion: 2.1 time: 0.877256 Jul 18 02:23:57.527682 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1171/2345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:56 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:57.766831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:57.771773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:57.811869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6a22660d-7b12-422e-b07f-a86fad5cb52d req-0b8efd84-a3be-42b7-86f3-7757d6aca2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b452eee6-7260-482e-8bf3-7ddc06c08bae", "name": "network-vif-deleted", "tag": "3b3d6b19-0562-409f-8a18-2450a8e7b601"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:57.823915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.834533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.840763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.845837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.859057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6a22660d-7b12-422e-b07f-a86fad5cb52d req-0b8efd84-a3be-42b7-86f3-7757d6aca2c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:57.866960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6a22660d-7b12-422e-b07f-a86fad5cb52d req-0b8efd84-a3be-42b7-86f3-7757d6aca2c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:57.959411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6a22660d-7b12-422e-b07f-a86fad5cb52d req-0b8efd84-a3be-42b7-86f3-7757d6aca2c0 service nova] Creating event network-vif-deleted:3b3d6b19-0562-409f-8a18-2450a8e7b601 for instance b452eee6-7260-482e-8bf3-7ddc06c08bae on n-h2-849796-1 Jul 18 02:23:57.993874 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6a22660d-7b12-422e-b07f-a86fad5cb52d req-0b8efd84-a3be-42b7-86f3-7757d6aca2c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187753 Jul 18 02:23:57.997195 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1172/2346] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:23:58.182189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:58.193722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9f281d6-83e9-4fb7-82f5-35f3652ff04f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.441064 Jul 18 02:23:58.195501 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1175/2347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:57 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:58.527966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb3005c7-4d23-4565-b258-a9df22042598 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0591a3a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:58.547583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:58.548322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:58.565046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:58.565530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:58.566385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:58.570960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:58.662565 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb3005c7-4d23-4565-b258-a9df22042598 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.142415 Jul 18 02:23:58.666140 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1173/2348] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:58 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:59.164828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4c7856ff-b326-4826-8601-a7c7c06ddb2b req-a976a1d1-61f2-4f73-bd44-305a642cb595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "tag": "1ba63a1c-8406-45b2-ade6-0a4a17c34c8b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:23:59.217268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:59.218007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:23:59.235078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c7856ff-b326-4826-8601-a7c7c06ddb2b req-a976a1d1-61f2-4f73-bd44-305a642cb595 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.235652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c7856ff-b326-4826-8601-a7c7c06ddb2b req-a976a1d1-61f2-4f73-bd44-305a642cb595 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.267953 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-333ee44f-cce9-4a0e-96b3-f5bdb2afbeee tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1508 microversion: 2.1 time: 0.725374 Jul 18 02:23:59.282874 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1176/2349] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:58 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1508 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:59.297781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:59.307148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:23:59.310480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4c7856ff-b326-4826-8601-a7c7c06ddb2b req-a976a1d1-61f2-4f73-bd44-305a642cb595 service nova] Creating event network-changed:1ba63a1c-8406-45b2-ade6-0a4a17c34c8b for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:23:59.325829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4c7856ff-b326-4826-8601-a7c7c06ddb2b req-a976a1d1-61f2-4f73-bd44-305a642cb595 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165609 Jul 18 02:23:59.329989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.330508 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1174/2350] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:23:59.340123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.344409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:23:59.347115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:23:59.681624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4c9f26c-d361-488a-8d4d-b9ae7300ae3a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ed9dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:23:59.780590 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4c9f26c-d361-488a-8d4d-b9ae7300ae3a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.084843 Jul 18 02:23:59.781708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1175/2351] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:23:59 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:23:59.865715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:23:59.883544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0292ee2-d1b9-4550-90b1-36c550f278a5 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.598865 Jul 18 02:23:59.884507 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1177/2352] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:23:59 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:00.308518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:00.316376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:00.400551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.401035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:00.412832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.414420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:00.795799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8381efd-15cb-46c2-a065-df1e05a75534 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045bb9d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:00.946904 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8381efd-15cb-46c2-a065-df1e05a75534 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.155093 Jul 18 02:24:00.954272 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1178/2353] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:00 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:00.968071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:00.969345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:00.979561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:00.988733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.989764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:00.990821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:00.992441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.117758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:01.142982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f793701-9556-4b7c-9298-57168dc46c54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.177431 Jul 18 02:24:01.148226 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1179/2354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:00 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:01.325588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:01.334847 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-217d7113-ac96-41dd-9e30-f7b606a8912d tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1506 microversion: 2.1 time: 1.038430 Jul 18 02:24:01.357922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '.version_select at 0x7fab045ce1f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:01.358774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:01.361087 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1176/2355] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:00 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1506 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:01.377637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.378427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.379440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.380234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.476280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e51af5c2-81c2-4aa7-bb56-0c0035064452 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.122862 Jul 18 02:24:01.477361 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1180/2356] 10.222.0.67 () {58 vars in 1295 bytes} [Mon Jul 18 02:24:01 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540/os-instance-actions => generated 611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:01.489903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:01.490674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:01.509884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.510702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.511689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.513798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.590989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:01.714074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:01.836866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03e0eca3-a4dd-42f8-bfbf-9b19e1a7aa76 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 204 len: 0 microversion: 2.1 time: 0.349635 Jul 18 02:24:01.840556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1177/2357] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:01 2022] DELETE /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:01.846700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:01.847340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:01.856957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.857805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.858831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:01.859278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:01.964603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcac4bbc-2106-4433-9c10-84e6ff706269 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ed9dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:02.054621 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcac4bbc-2106-4433-9c10-84e6ff706269 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.095157 Jul 18 02:24:02.055646 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1178/2358] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:01 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:02.174320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:02.175302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:02.204818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.206276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:02.210058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:02.212154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:02.240150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:02.254855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d82a43cf-df2b-4ebd-a876-a9913e05b07a tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1512 microversion: 2.1 time: 0.411154 Jul 18 02:24:02.270009 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1181/2359] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:01 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:02.408556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:02.421641 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a204eb6-30cc-4fd3-b093-b5f62ca466a1 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.252188 Jul 18 02:24:02.427326 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1179/2360] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:02 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:03.073883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab536028-aabd-47a6-9343-9b7c70b97776 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045bbaf0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.175886 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab536028-aabd-47a6-9343-9b7c70b97776 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.109543 Jul 18 02:24:03.176688 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1182/2361] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:03.276701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.277625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:03.291133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.296119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.297298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.302980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.454886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:03.457330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:03.481471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.482674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.486861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:03.488742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:03.717404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:03.742693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ecf43086-2d7f-4dc3-8c97-0db1e174b6c9 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.296433 Jul 18 02:24:03.751993 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1183/2362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:03.852496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:03.895018 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4c3817a-3005-4c48-ad36-fbe509e91b91 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1512 microversion: 2.1 time: 0.622899 Jul 18 02:24:03.901758 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1180/2363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:03 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:04.201053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b1532d3-7811-4b34-858c-5fa70bfc9cb1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab044cf700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:04.303488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b1532d3-7811-4b34-858c-5fa70bfc9cb1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.109311 Jul 18 02:24:04.307706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1184/2364] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:04 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:04.774000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:04.775262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:04.797600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.798456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.800073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.800958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.928783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:04.931142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:04.970278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.971165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:04.981885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:04.982733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.114560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:05.131933 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1664ced-76af-42e7-9c35-d2e5c8147879 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.375414 Jul 18 02:24:05.133250 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1181/2365] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:04 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:05.253247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9759ccb30864ee1804e767ff082b3b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5c79c4e4334f408e221bb914027028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:05.277103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-509e8b80-e86a-4572-a113-31bf89da2cc0 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 200 len: 1470 microversion: 2.1 time: 0.356544 Jul 18 02:24:05.279860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1185/2366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:04 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:05.327742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60cfd408-36bc-45b0-b2e9-e11b7f64ba51 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e45820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:05.405691 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60cfd408-36bc-45b0-b2e9-e11b7f64ba51 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.082855 Jul 18 02:24:05.407322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1182/2367] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:05 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:05.439931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b39bf705-9c33-4835-818c-3190d8675c09 req-5678943f-5e05-4f1b-b862-aba71ad13a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd732f5-0c86-415f-a8a0-df62c41a5540", "name": "network-vif-deleted", "tag": "8f2c6141-002b-4bb6-8a0d-0c06d4fc3941"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:05.471699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b39bf705-9c33-4835-818c-3190d8675c09 req-5678943f-5e05-4f1b-b862-aba71ad13a9d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:05.473911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b39bf705-9c33-4835-818c-3190d8675c09 req-5678943f-5e05-4f1b-b862-aba71ad13a9d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:05.513937 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b39bf705-9c33-4835-818c-3190d8675c09 req-5678943f-5e05-4f1b-b862-aba71ad13a9d service nova] Creating event network-vif-deleted:8f2c6141-002b-4bb6-8a0d-0c06d4fc3941 for instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 on n-h1-849796-1 Jul 18 02:24:05.526276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b39bf705-9c33-4835-818c-3190d8675c09 req-5678943f-5e05-4f1b-b862-aba71ad13a9d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104341 Jul 18 02:24:05.529614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1186/2368] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:06.170342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:06.171657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:06.199376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.199846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.208669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.209184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.300954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:06.301985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] [instance: 3dd732f5-0c86-415f-a8a0-df62c41a5540] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:06.357559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.363119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.369964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:06.373339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:06.460618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] HTTP exception thrown: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Request method failure captured: Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 HTTP/1.1 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MQe2BRdNDV9-ww6YLKwmPsjOdJAJBIV6BrBOYEJLo5UtyCxG_YJ8Es5ncmDdz4dk0Z3hfTsIxjj9GrYB4WcfNeTheLQFZsBE9s_y53W1QF3eJh_5Z6a_wxflQn1FMNQ9ZKwkbDad5pkkkiKb4rN6BYygQivcr-xmqXk1DlBu3q7YM0 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5d5c79c4e4334f408e221bb914027028 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-InstanceActionsTestJSON-1952878408 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5d5c79c4e4334f408e221bb914027028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5d5c79c4e4334f408e221bb914027028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5d5c79c4e4334f408e221bb914027028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5d5c79c4e4334f408e221bb914027028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-InstanceActionsTestJSON-1952878408 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5d5c79c4e4334f408e221bb914027028 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1952878408 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-InstanceActionsTestJSON-1952878408-project Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: c9759ccb30864ee1804e767ff082b3b8 Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-InstanceActionsTestJSON-1952878408-project Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3dd732f5-0c86-415f-a8a0-df62c41a5540'} Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:06.474395 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] Returning 404 to user: Instance 3dd732f5-0c86-415f-a8a0-df62c41a5540 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:06.482052 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8d5cfa1b-093c-4cd3-aa1e-aee53c80e136 tempest-InstanceActionsTestJSON-1952878408 tempest-InstanceActionsTestJSON-1952878408-project] 10.222.0.67 "GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540" status: 404 len: 111 microversion: 2.1 time: 0.185392 Jul 18 02:24:06.483650 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1187/2369] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:06 2022] GET /compute/v2.1/servers/3dd732f5-0c86-415f-a8a0-df62c41a5540 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:06.508957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b103e2a8-0fcb-4591-a45c-40fb0ac74c6a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab046028b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:06.534593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:06.572858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5feccdc1-2572-475c-81ae-0146ff100a71 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.401931 Jul 18 02:24:06.574579 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1183/2370] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:06 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:06.638325 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b103e2a8-0fcb-4591-a45c-40fb0ac74c6a tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.151561 Jul 18 02:24:06.639544 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1188/2371] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:06 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:07.593268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:07.598557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:07.653197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.656145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.657381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:07.668221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:07.682387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdcee29a-fd76-4d43-a034-da85a3e1b9e5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045b6940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:07.944059 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdcee29a-fd76-4d43-a034-da85a3e1b9e5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.270862 Jul 18 02:24:07.945847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1189/2372] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:07 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:08.369608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:08.384013 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3e3355e-089f-4768-a915-e1580948ca2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1184 microversion: 2.1 time: 0.795289 Jul 18 02:24:08.389820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1184/2373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:07 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1184 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:08.965973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d118bec-ab77-472b-a001-d7edf42365ec tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e49940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:09.131957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d118bec-ab77-472b-a001-d7edf42365ec tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.171392 Jul 18 02:24:09.136564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1185/2374] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:08 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:09.327703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53299710-23f3-43d7-ac75-5b3c6d6cc316 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab04602310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:09.409573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:09.414144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:09.423763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.429811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.440166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.441372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.589093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53299710-23f3-43d7-ac75-5b3c6d6cc316 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee" status: 200 len: 371 microversion: 2.1 time: 0.720292 Jul 18 02:24:09.603359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1190/2375] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:24:08 2022] GET /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee => generated 371 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:09.638456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Action: 'update', calling method: .version_select at 0x7fab045a9820>, body: {"quota_set": {"ram": "5120"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:09.750709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.751554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.752441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lazy-loading 'fault' on Instance uuid b452eee6-7260-482e-8bf3-7ddc06c08bae {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:24:09.978886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.979629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:09.981189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:09.983373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:10.250025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:10.276897 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f15d61ef-df46-432e-9562-9e9c64adc084 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 200 len: 1143 microversion: 2.1 time: 0.871929 Jul 18 02:24:10.279296 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1186/2376] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:09 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 1143 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:10.289318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f31af6b-28a7-43b9-b1a8-26466f9fd315 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e45af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:10.311522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d97bf92-036c-4c87-8504-e2fe9164c8d6 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee" status: 200 len: 328 microversion: 2.1 time: 0.702390 Jul 18 02:24:10.313598 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1191/2377] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:24:09 2022] PUT /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee => generated 328 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:10.331126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9348c6b-e744-4898-84a1-10a9a5aa12d1 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:10.353206 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9348c6b-e744-4898-84a1-10a9a5aa12d1 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee" status: 202 len: 0 microversion: 2.1 time: 0.027281 Jul 18 02:24:10.354246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1192/2378] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:24:10 2022] DELETE /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:10.364061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d62c5723-dbc2-42e8-a9d7-1c08248666ee tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab045b6ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:10.417278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f31af6b-28a7-43b9-b1a8-26466f9fd315 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.136191 Jul 18 02:24:10.418897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1187/2379] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:10 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:10.537317 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d62c5723-dbc2-42e8-a9d7-1c08248666ee tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee" status: 200 len: 371 microversion: 2.1 time: 0.177839 Jul 18 02:24:10.539543 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1193/2380] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:24:10 2022] GET /compute/v2.1/os-quota-sets/aa7f37f7d32c49ac8a796d8bc618d9ee => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:10.931822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd1d4b7-f4e1-438d-8819-b960d358fd3e tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab04ea2700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:11.296575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:11.297537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: b452eee6-7260-482e-8bf3-7ddc06c08bae] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:11.363963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.365168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:11.367331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:11.369723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:11.376080 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bd1d4b7-f4e1-438d-8819-b960d358fd3e tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.447914 Jul 18 02:24:11.385316 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1188/2381] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:24:10 2022] GET /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d/defaults => generated 371 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:11.414914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] HTTP exception thrown: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Request method failure captured: Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae HTTP/1.1 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHz5ejlnpNRMxzOo2Jt_NpTy7WHhgXcAVM4JIr6MUIwrh9-MSw6p97AopNaN14Qddm3bkIsIeYT3e7JaiYrdEZEI9St8a-IqfojkG7bbK52EDRbS6-MOtxNlOIBgmLEMAf3VC_WJbuItqOUrX4M56P0t6R2plf100of-TBsUrrR1Xs Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d2b97e560fcf4750b2aad92d6d37e611 Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b452eee6-7260-482e-8bf3-7ddc06c08bae'} Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:11.419786 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. Jul 18 02:24:11.426079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:11.430754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Returning 404 to user: Instance b452eee6-7260-482e-8bf3-7ddc06c08bae could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:11.433544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1aafe149-2cf4-4aa7-81d2-ee4d535bad84 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae" status: 404 len: 111 microversion: 2.1 time: 0.141899 Jul 18 02:24:11.435684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1194/2382] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:11 2022] GET /compute/v2.1/servers/b452eee6-7260-482e-8bf3-7ddc06c08bae => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:24:11.441904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17c3e609-8dbc-47a3-b295-597077ab694d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5aa60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:11.582014 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17c3e609-8dbc-47a3-b295-597077ab694d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.153329 Jul 18 02:24:11.586829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1189/2383] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:11 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:12.252166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Action: 'update', calling method: .version_select at 0x7fab046028b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:12.548413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:12.549586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:12.550679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:12.553816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:12.605554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21d2af57-d8b4-45f9-a722-06959c8c446d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e459d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:12.651834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7448af1b-10f0-49b4-931d-a4dfc8009fa3 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e" status: 200 len: 328 microversion: 2.1 time: 0.403034 Jul 18 02:24:12.652785 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1195/2384] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:24:12 2022] PUT /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e => generated 328 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:12.668230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab045b6af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:12.817862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21d2af57-d8b4-45f9-a722-06959c8c446d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.217226 Jul 18 02:24:12.829783 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1190/2385] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:12 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:13.002232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.004175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.006911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.008242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.071583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41f22362-9312-451f-9ded-054e77ef25d5 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e/detail" status: 200 len: 916 microversion: 2.1 time: 0.407645 Jul 18 02:24:13.074836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1196/2386] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:24:12 2022] GET /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e/detail => generated 916 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:13.567947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Action: 'update', calling method: .version_select at 0x7fab04e8bca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:13.847833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9132f589-c91b-40cd-87fd-18d6799631de tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04415940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:13.877048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.878477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.883710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:13.889590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:13.978392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9132f589-c91b-40cd-87fd-18d6799631de tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.140376 Jul 18 02:24:13.984037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1197/2387] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:13 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:14.032418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.056098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.057339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:14.057962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:14.426452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-687b621c-76ba-4c84-8171-ba70d47a3a1a tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e?user_id=91955e805dd3410abf3298de6302adf9" status: 200 len: 328 microversion: 2.1 time: 0.894816 Jul 18 02:24:14.442368 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1191/2388] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:24:13 2022] PUT /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e?user_id=91955e805dd3410abf3298de6302adf9 => generated 328 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:14.447663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-975e4a2f-48b8-49d1-84e7-99b19f7ec9d8 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab04602550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:14.679538 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-975e4a2f-48b8-49d1-84e7-99b19f7ec9d8 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e?user_id=91955e805dd3410abf3298de6302adf9" status: 200 len: 370 microversion: 2.1 time: 0.234296 Jul 18 02:24:14.681390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1198/2389] 10.222.0.67 () {58 vars in 1322 bytes} [Mon Jul 18 02:24:14 2022] GET /compute/v2.1/os-quota-sets/708e2ddf26bf47fb9f04ee4656888e0e?user_id=91955e805dd3410abf3298de6302adf9 => generated 370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:15.002488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16094ea9-03a5-47cf-9779-a87e11aada70 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb44c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:15.133358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16094ea9-03a5-47cf-9779-a87e11aada70 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.131198 Jul 18 02:24:15.138275 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1192/2390] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:14 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:15.986685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16888d6c-12b4-4039-9345-8be8b2f47ad9 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Calling method '.version_select at 0x7fab0da97d30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:16.152958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22900044-7b33-4655-ae8f-bb58b8e7a2fe tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e45040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:16.249658 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22900044-7b33-4655-ae8f-bb58b8e7a2fe tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.101416 Jul 18 02:24:16.278282 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1193/2391] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:16 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:16.770792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16888d6c-12b4-4039-9345-8be8b2f47ad9 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.788009 Jul 18 02:24:16.773508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1199/2392] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:24:15 2022] GET /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d/defaults => generated 371 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:16.784409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Action: 'update', calling method: .version_select at 0x7fab04e45550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:16.978197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:16.981344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:16.983390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:16.988659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:17.269740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e28c786-94fb-4f23-be72-d44f44d51f59 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a04c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:17.506217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e28c786-94fb-4f23-be72-d44f44d51f59 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.243408 Jul 18 02:24:17.516065 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1200/2393] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:17 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:18.047870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15879309-94a7-42f8-abc2-244b5c05e2c4 tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d" status: 200 len: 329 microversion: 2.1 time: 1.263353 Jul 18 02:24:18.059838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1194/2394] 10.222.0.67 () {60 vars in 1262 bytes} [Mon Jul 18 02:24:16 2022] PUT /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d => generated 329 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:18.066819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Action: 'update', calling method: .version_select at 0x7fab0454ea60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:18.397926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:18.399533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:18.405035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:18.406250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:18.531337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7d2faf3-6e23-4cac-bdf6-1c559af8a143 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ea2af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:18.676813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7d2faf3-6e23-4cac-bdf6-1c559af8a143 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.153411 Jul 18 02:24:18.677752 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1195/2395] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:18 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:18.953931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:UPDATE=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:19.600221 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4915096-8a28-46e7-9c63-edaa17715f4f tempest-QuotasAdminTestJSON-559303364 tempest-QuotasAdminTestJSON-559303364-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d" status: 200 len: 329 microversion: 2.1 time: 1.537951 Jul 18 02:24:19.600879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1201/2396] 10.222.0.67 () {60 vars in 1262 bytes} [Mon Jul 18 02:24:18 2022] PUT /compute/v2.1/os-quota-sets/5f14936465e641a8baf874cb953c262d => generated 329 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:19.697958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a86417a-56a7-41e6-8409-c4ddfc635b0e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e45280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:19.857218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a86417a-56a7-41e6-8409-c4ddfc635b0e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.169125 Jul 18 02:24:19.858137 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1196/2397] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:19 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:20.877837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c8db44c-46b3-4bd9-9ee4-4a9ee62c2dc5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045ce790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:21.079487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c8db44c-46b3-4bd9-9ee4-4a9ee62c2dc5 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.212301 Jul 18 02:24:21.096762 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1202/2398] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:20 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:21.503956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:21.504871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:21.560160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.563293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:21.565822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:21.566678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:21.830546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:22.111267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1664791998", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "cc961fa4-53ad-43f0-b036-d186e7700255"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:22.273590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] validate_networks() for [('cc961fa4-53ad-43f0-b036-d186e7700255', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:24:22.470528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c924ec44-6cf8-4d48-8bdd-b5ae4e5283c0 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 204 len: 0 microversion: 2.1 time: 0.973851 Jul 18 02:24:22.472267 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1197/2399] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:21 2022] DELETE /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 0 bytes in 978 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:22.501260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-012e145b-e264-4525-8f91-5edc05ab726d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04ed90d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:22.769427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-012e145b-e264-4525-8f91-5edc05ab726d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.286366 Jul 18 02:24:22.776522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1198/2400] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:22 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:22.808853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:22.810385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:22.831531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=15 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:22.875805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:22.880205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:22.885658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:22.891955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.761080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:23.762380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:23.763315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:23.764101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:23.765070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:23.837634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:23.839163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.843471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:23.845651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:23.896101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:23.925768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for user 927f29b5f43d405ca9d3fed68e53cdb1 and project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:23.928557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:23.948622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0857f14-ec73-4f80-9b52-ec91d6aa0e2f tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1668 microversion: 2.1 time: 1.173455 Jul 18 02:24:23.951239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1199/2401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:22 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1668 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:23.966945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a275a586-b22c-4677-bfdc-f5cba79cb063 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eb49d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.020202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:24.042428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:24.180378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a275a586-b22c-4677-bfdc-f5cba79cb063 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.225377 Jul 18 02:24:24.181838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1200/2402] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:23 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:24.346311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-626565c5-57bc-4d28-a4e8-43d3bc37dfe9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713274 Jul 18 02:24:24.364344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f905ee2-20b0-40f2-bbb9-5e3168f818b8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.365108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f905ee2-20b0-40f2-bbb9-5e3168f818b8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:24.371039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1203/2403] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:24:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:24:24.970537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:24.971573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:25.008747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:25.011525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:25.017889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:25.021377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:25.737189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f905ee2-20b0-40f2-bbb9-5e3168f818b8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:25.814013 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f905ee2-20b0-40f2-bbb9-5e3168f818b8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1208 microversion: 2.1 time: 1.451266 Jul 18 02:24:25.820470 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1201/2404] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:24 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1208 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:25.873672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e74b3459-5988-4d8d-a560-455681ec06e3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e8baf0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:25.936587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:25.948239 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b906f52-0368-422c-bb69-9338bf4f7676 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1668 microversion: 2.1 time: 0.982860 Jul 18 02:24:25.948745 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1204/2405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:24 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1668 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:26.152224 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e74b3459-5988-4d8d-a560-455681ec06e3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.326106 Jul 18 02:24:26.172622 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1202/2406] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:25 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:26.848413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:26.849894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:26.874386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:26.877801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:26.879175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:26.884053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:26.889463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=77 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:26.987779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:26.990205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:27.005906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.015585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.019389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:27.020659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:27.093127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=7 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:27.213123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:27.307901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4ae522f-f3e6-46df-8609-26d51de4ef2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1260 microversion: 2.1 time: 0.453780 Jul 18 02:24:27.308656 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1205/2407] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:26 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1260 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:27.323813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13c8d1e6-0ceb-4aae-b3d7-5c7acf4710f8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045b6040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:27.501101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13c8d1e6-0ceb-4aae-b3d7-5c7acf4710f8 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.190966 Jul 18 02:24:27.501698 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1206/2408] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:27 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:27.614636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:27.624788 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f342242-710c-4211-a3fc-9101dfab377a tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1600 microversion: 2.1 time: 0.653253 Jul 18 02:24:27.625411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1203/2409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:26 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1600 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:27.999841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-16cd0473-917e-4ebc-b1b4-625999f26a87 req-07d0a7f5-74bf-4c89-bd77-70c9aaba4f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bc5640-2b9b-4f06-a04c-63ff38508a2b", "name": "network-vif-deleted", "tag": "12c0c7e5-bed1-4cec-868e-22ebe94e6c13"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:28.026656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-16cd0473-917e-4ebc-b1b4-625999f26a87 req-07d0a7f5-74bf-4c89-bd77-70c9aaba4f2e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.038076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-16cd0473-917e-4ebc-b1b4-625999f26a87 req-07d0a7f5-74bf-4c89-bd77-70c9aaba4f2e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.062117 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-16cd0473-917e-4ebc-b1b4-625999f26a87 req-07d0a7f5-74bf-4c89-bd77-70c9aaba4f2e service nova] Creating event network-vif-deleted:12c0c7e5-bed1-4cec-868e-22ebe94e6c13 for instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b on n-h2-849796-1 Jul 18 02:24:28.071458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-16cd0473-917e-4ebc-b1b4-625999f26a87 req-07d0a7f5-74bf-4c89-bd77-70c9aaba4f2e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076251 Jul 18 02:24:28.086981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1207/2410] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:28.345009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:28.346332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:28.361026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.361755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.365208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.369289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.517574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf4e3d0d-735b-470b-96cb-a0c70527bedd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04602dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:28.735315 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf4e3d0d-735b-470b-96cb-a0c70527bedd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.223313 Jul 18 02:24:28.735922 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1208/2411] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:28 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:28.747960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:28.748759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:28.761503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.762738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.763697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:28.764127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:28.833484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:28.846391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0fe8693f-f1cd-4ae3-92ca-4e3be7f20e6b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1266 microversion: 2.1 time: 0.505901 Jul 18 02:24:28.856872 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1204/2412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:28 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:29.008345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.011745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.017978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lazy-loading 'fault' on Instance uuid 31bc5640-2b9b-4f06-a04c-63ff38508a2b {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:24:29.515820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:29.562207 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-df841e97-88e7-47ab-b559-2932d76ac541 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 200 len: 1325 microversion: 2.1 time: 0.816649 Jul 18 02:24:29.563426 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1209/2413] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:28 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 1325 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:29.748798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-406e5c88-dc33-4e00-82e8-58cca450ffb7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e49430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:29.882834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-406e5c88-dc33-4e00-82e8-58cca450ffb7 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.137862 Jul 18 02:24:29.886024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:29.888413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:29.909349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1205/2414] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:29 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:29.923552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.928508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:29.935623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:29.938809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.582646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:30.583505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 31bc5640-2b9b-4f06-a04c-63ff38508a2b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:30.593732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:30.610556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.611586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:30.612182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:30.676324 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] HTTP exception thrown: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Request method failure captured: Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b HTTP/1.1 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHz5ejlnpNRMxzOo2Jt_NpTy7WHhgXcAVM4JIr6MUIwrh9-MSw6p97AopNaN14Qddm3bkIsIeYT3e7JaiYrdEZEI9St8a-IqfojkG7bbK52EDRbS6-MOtxNlOIBgmLEMAf3VC_WJbuItqOUrX4M56P0t6R2plf100of-TBsUrrR1Xs Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d2b97e560fcf4750b2aad92d6d37e611 Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '31bc5640-2b9b-4f06-a04c-63ff38508a2b'} Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:30.680657 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. Jul 18 02:24:30.685340 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:30.690663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Returning 404 to user: Instance 31bc5640-2b9b-4f06-a04c-63ff38508a2b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:30.693366 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38074ade-5dcd-4f80-81b7-2976993ebeaa tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b" status: 404 len: 111 microversion: 2.1 time: 0.114813 Jul 18 02:24:30.706331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1206/2415] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:30 2022] GET /compute/v2.1/servers/31bc5640-2b9b-4f06-a04c-63ff38508a2b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:30.717557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cb9d2a0a-a0b9-4b90-baef-6d0297ed2573 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '.version_select at 0x7fab04e8bee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:30.777431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cb9d2a0a-a0b9-4b90-baef-6d0297ed2573 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845830473" status: 202 len: 0 microversion: 2.1 time: 0.061074 Jul 18 02:24:30.778869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1207/2416] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:24:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845830473 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:30.913533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3853e90-411f-4555-ba86-7b9813135049 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e45ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:31.001937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e3853e90-411f-4555-ba86-7b9813135049 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.094025 Jul 18 02:24:31.008842 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1208/2417] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:30 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:31.136352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:31.145659 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79b45c7f-2a86-414a-9337-14fd28e8beb6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 1.273820 Jul 18 02:24:31.147673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1210/2418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:29 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:32.017030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39fe466b-8039-43ee-bddb-d8188476f6f2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab05944d30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.103855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39fe466b-8039-43ee-bddb-d8188476f6f2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.091586 Jul 18 02:24:32.121773 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1209/2419] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:32.167309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.168022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:32.194245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.194511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.195493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.195974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.199501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:32.729169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.731392 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:32.731392 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:24:32.733112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.734322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.739826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.741120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.785378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:32.801820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6d4b312-e838-4aee-962f-b147941b540e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.639246 Jul 18 02:24:32.802427 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1210/2420] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:32.816006 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1c9417a-607f-413e-9e2a-f5c037e40b76 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.709407 Jul 18 02:24:32.817063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1211/2421] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:32.829951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.833770 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:32.833770 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:32.836843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.839607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.845041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.851714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.958127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ceca46a-7247-4c1b-9cee-fb7201d90631 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.133277 Jul 18 02:24:32.964240 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1211/2422] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:32.979383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:32.981084 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:32.981084 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:24:32.982772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.983536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:32.987434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:32.989152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.095458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7067bce4-3771-47de-9492-bb3d78d69ba1 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.120513 Jul 18 02:24:33.109370 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1212/2423] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:33.125664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.128055 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:33.128055 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:33.134338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b58975a4-78d5-4b2f-b92f-93852f12425c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab046baa60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.142288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.143092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.145159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.146320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.224438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e2e6c04-3095-4f31-90d4-b77401692f59 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-849796-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.115094 Jul 18 02:24:33.228550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1212/2424] 10.222.0.67 () {58 vars in 1193 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/os-services?host=n-d-849796-1&binary=xxx => generated 16 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:24:33.248412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.250998 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:33.250998 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:33.255198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.256607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.258860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.263100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.348444 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d5c1f7a-2d8c-4bc4-853e-759100986960 tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.104516 Jul 18 02:24:33.349887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1213/2425] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/os-services => generated 944 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:33.426403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.432945 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:33.432945 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:33.434862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.439822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.441209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b58975a4-78d5-4b2f-b92f-93852f12425c tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.317209 Jul 18 02:24:33.442520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.451174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.452590 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1213/2426] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:33.522986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cbb123b6-c564-432b-8ffd-92883eefe9fb tempest-ServicesAdminNegativeTestJSON-1882680816 tempest-ServicesAdminNegativeTestJSON-1882680816-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.104897 Jul 18 02:24:33.558637 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1214/2427] 10.222.0.67 () {58 vars in 1197 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:24:33.833803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:33.835167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:33.907781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.908567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.923854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:33.925435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:33.976387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=66 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:34.025143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a91175d-feae-4af7-b7aa-1909426ca91b tempest-ServicesAdminNegativeTestJSON-890657643 tempest-ServicesAdminNegativeTestJSON-890657643-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:34.028869 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:34.028869 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:24:34.032069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a91175d-feae-4af7-b7aa-1909426ca91b tempest-ServicesAdminNegativeTestJSON-890657643 tempest-ServicesAdminNegativeTestJSON-890657643-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e57ab47ef8104ebcbfb28acf599e8c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884f06ba7fc74562866e857c4cb6c2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a91175d-feae-4af7-b7aa-1909426ca91b tempest-ServicesAdminNegativeTestJSON-890657643 tempest-ServicesAdminNegativeTestJSON-890657643-project] Request method failure captured: Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRdfODo2GWdag0Fo3cW63o6wkeq5GNxgpTii7qX2sBKYPEo3KvreA_AEoSq6npuapehIMRMjbfPT08UGOmj6sc7r-Ntaqo0NZR8sF-ptXGN-5Y_dsk96N375L17Iyw3o2zuyR6naRpuYEYMqzuB0tLUmqtFKpzrDGHkVGnY8dx_WtA Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 884f06ba7fc74562866e857c4cb6c2e4 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-890657643 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/884f06ba7fc74562866e857c4cb6c2e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_884f06ba7fc74562866e857c4cb6c2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/884f06ba7fc74562866e857c4cb6c2e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/884f06ba7fc74562866e857c4cb6c2e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-890657643 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 884f06ba7fc74562866e857c4cb6c2e4 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-890657643 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServicesAdminNegativeTestJSON-890657643-project Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: e57ab47ef8104ebcbfb28acf599e8c19 Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-890657643-project Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: action_args: {} Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:34.066110 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:34.078997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:34.086091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a91175d-feae-4af7-b7aa-1909426ca91b tempest-ServicesAdminNegativeTestJSON-890657643 tempest-ServicesAdminNegativeTestJSON-890657643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:34.090240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a91175d-feae-4af7-b7aa-1909426ca91b tempest-ServicesAdminNegativeTestJSON-890657643 tempest-ServicesAdminNegativeTestJSON-890657643-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.556158 Jul 18 02:24:34.099424 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1214/2428] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 568 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:34.481800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf20338f-8a81-4497-a288-33773ec51b83 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04a6c940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:34.581490 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf20338f-8a81-4497-a288-33773ec51b83 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.128018 Jul 18 02:24:34.582707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1215/2429] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:34 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:34.607605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-150c2a42-fe4b-4734-a012-105fef7df8c4 req-61b8b9f2-b859-4e64-8d53-bdb84bdadb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421978c4-4f6a-4cec-9c46-518ae92112c3", "tag": "5ad21d59-c411-4a18-b08d-8d1b240beb29"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:34.639806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-150c2a42-fe4b-4734-a012-105fef7df8c4 req-61b8b9f2-b859-4e64-8d53-bdb84bdadb2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:34.640789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-150c2a42-fe4b-4734-a012-105fef7df8c4 req-61b8b9f2-b859-4e64-8d53-bdb84bdadb2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:34.679168 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-150c2a42-fe4b-4734-a012-105fef7df8c4 req-61b8b9f2-b859-4e64-8d53-bdb84bdadb2c service nova] Creating event network-changed:5ad21d59-c411-4a18-b08d-8d1b240beb29 for instance 421978c4-4f6a-4cec-9c46-518ae92112c3 on n-h1-849796-1 Jul 18 02:24:34.708371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-150c2a42-fe4b-4734-a012-105fef7df8c4 req-61b8b9f2-b859-4e64-8d53-bdb84bdadb2c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100247 Jul 18 02:24:34.714696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1216/2430] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:34.948265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:34.982487 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11b19b64-aadb-4a60-8640-1398850f4c5e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 1.150970 Jul 18 02:24:34.993711 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1215/2431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:33 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:35.624721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a83dc6f7-56a8-4f7d-8f1c-ff8492a5aa77 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04602700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:35.865337 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a83dc6f7-56a8-4f7d-8f1c-ff8492a5aa77 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1453 microversion: 2.1 time: 0.268478 Jul 18 02:24:35.882146 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1217/2432] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:35 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1453 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:36.018237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:36.019466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:36.023812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=48 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:36.062409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:36.063607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:36.080011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:36.081417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:36.895853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72f3dbf8-5100-40e8-a974-7e51d73a6132 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a9160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.014095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72f3dbf8-5100-40e8-a974-7e51d73a6132 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1462 microversion: 2.1 time: 0.127691 Jul 18 02:24:37.028194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1218/2433] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:36 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1462 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:37.048386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.049707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:37.070210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.071136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.072718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.073746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.129930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:37.144145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:37.151119 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea534ee8-40e3-4ada-8ad4-aa072a052297 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 1.132721 Jul 18 02:24:37.153782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1216/2434] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:36 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:37.175859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6063d8d8-f86a-4e73-8d85-a67f1f9e00fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e458b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.398497 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6063d8d8-f86a-4e73-8d85-a67f1f9e00fd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 200 len: 1462 microversion: 2.1 time: 0.242700 Jul 18 02:24:37.407906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1217/2435] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 1462 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:37.423179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.424402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:37.435845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.436638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dff4e6bc-46c2-4bc8-a3db-5d64bc9c363d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 204 len: 0 microversion: 2.1 time: 0.405357 Jul 18 02:24:37.437984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.438294 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1219/2436] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:37 2022] DELETE /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:37.439867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.440563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.457708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:37.466705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:37.487878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.498128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.499529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:37.500316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:37.852292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:37.864966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f04af6cd-b1cc-4c3e-863a-691c0897f58d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1481 microversion: 2.1 time: 0.446213 Jul 18 02:24:37.877654 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1218/2437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1481 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:38.185823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:38.188597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:38.205114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.206482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.208619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.209602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.410357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:38.424062 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-23ac957b-bb5f-44ba-8c4e-8039329707ec tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1482 microversion: 2.1 time: 0.978354 Jul 18 02:24:38.425841 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1220/2438] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:37 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1482 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:38.601577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:38.629989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5849427d-7537-49c8-bd26-066a6daf91d6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.453357 Jul 18 02:24:38.631905 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1219/2439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:38 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:38.904394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:38.909071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:38.933728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.935116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:38.937710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:38.938698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.293239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:39.312664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-254a08db-7214-4bfc-8537-703e246e5412 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1468 microversion: 2.1 time: 0.426173 Jul 18 02:24:39.313309 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1221/2440] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:38 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1468 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:39.346548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e55fb4ba-8c92-4c67-9618-92ea803bc708 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04f5a940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:39.454139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:39.460219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:39.481333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.482799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.484662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.485863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.648408 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e55fb4ba-8c92-4c67-9618-92ea803bc708 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?changes-since=2022-07-18T02%3A21%3A22Z" status: 200 len: 1903 microversion: 2.1 time: 0.309163 Jul 18 02:24:39.664941 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1220/2441] 10.222.0.67 () {58 vars in 1198 bytes} [Mon Jul 18 02:24:39 2022] GET /compute/v2.1/images?changes-since=2022-07-18T02%3A21%3A22Z => generated 1903 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:39.677241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:39.678087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:39.695466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.695937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:39.696794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:39.697348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:40.047114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:40.063926 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1995a888-3bc0-4bad-8372-fb486fcfa710 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.398701 Jul 18 02:24:40.065085 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1221/2442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:39 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:40.074430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f0098c8-6a97-4e87-b8af-780359953646 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04eab280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.098442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:40.123908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-246e1cee-8ea7-4f0f-8b1e-29bef66a9936 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1482 microversion: 2.1 time: 0.680727 Jul 18 02:24:40.134967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1222/2443] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:39 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1482 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:40.350211 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f0098c8-6a97-4e87-b8af-780359953646 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2083531329" status: 200 len: 485 microversion: 2.1 time: 0.282695 Jul 18 02:24:40.355637 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1222/2444] 10.222.0.67 () {58 vars in 1230 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2083531329 => generated 485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:40.379394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-00221107-2a94-4b04-a0c2-9a48034008b4 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a98b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.638424 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-00221107-2a94-4b04-a0c2-9a48034008b4 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?server=5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 957 microversion: 2.1 time: 0.268675 Jul 18 02:24:40.655144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1223/2445] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/images?server=5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 957 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:40.680536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aab86af2-ddc3-4404-98b6-d026ccc1a178 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0459dee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.850805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aab86af2-ddc3-4404-98b6-d026ccc1a178 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 485 microversion: 2.1 time: 0.174411 Jul 18 02:24:40.861342 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1224/2446] 10.222.0.67 () {58 vars in 1316 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 485 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:40.873688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38364081-4eb4-45cd-afc2-d72b75c07a2e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab046028b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:40.914705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1932818988", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "b26a3fb4-ffa6-48f0-9d99-d1b7f5babbf9"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:41.020478 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38364081-4eb4-45cd-afc2-d72b75c07a2e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 485 microversion: 2.1 time: 0.152935 Jul 18 02:24:41.022877 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1225/2447] 10.222.0.67 () {58 vars in 1302 bytes} [Mon Jul 18 02:24:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 485 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:24:41.041355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd90119a-f3f4-4a18-a3bc-07162f3e0c17 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a0040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:41.093702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] validate_networks() for [('b26a3fb4-ffa6-48f0-9d99-d1b7f5babbf9', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:24:41.327501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd90119a-f3f4-4a18-a3bc-07162f3e0c17 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.291731 Jul 18 02:24:41.331074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1226/2448] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:24:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:41.339009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:41.340088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:41.371087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:41.374257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:41.379379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:41.384010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.007259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:42.028908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb09e65f-25c8-46be-abed-518271d3c6c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.695859 Jul 18 02:24:42.030280 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1227/2449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:41 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:42.040705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:42.042379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:42.056536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.058195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.060234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.061429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.147774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.149303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.151260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lazy-loading 'fault' on Instance uuid 4ef48022-cee6-4b7e-b266-50eff1f1afc4 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:24:42.319154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:42.344179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28c46b65-e748-4527-ab02-7d2577c21184 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 200 len: 1299 microversion: 2.1 time: 0.311886 Jul 18 02:24:42.344791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1228/2450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:42 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:42.361603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65bc5d75-364e-4ec1-9599-f0d12bf955bd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04602dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:42.493476 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65bc5d75-364e-4ec1-9599-f0d12bf955bd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.135627 Jul 18 02:24:42.494311 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1229/2451] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:24:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:42.499319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-373ee2a5-6fc4-4893-9c4e-44a67e13047d req-dc7aad51-59cc-44a6-8d4f-a05f1af364f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef48022-cee6-4b7e-b266-50eff1f1afc4", "name": "network-vif-deleted", "tag": "690e17a5-c514-409f-b66e-bccaf009b9dc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:42.519161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-373ee2a5-6fc4-4893-9c4e-44a67e13047d req-dc7aad51-59cc-44a6-8d4f-a05f1af364f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.520071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-373ee2a5-6fc4-4893-9c4e-44a67e13047d req-dc7aad51-59cc-44a6-8d4f-a05f1af364f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.551071 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-373ee2a5-6fc4-4893-9c4e-44a67e13047d req-dc7aad51-59cc-44a6-8d4f-a05f1af364f4 service nova] Creating event network-vif-deleted:690e17a5-c514-409f-b66e-bccaf009b9dc for instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 on n-h1-849796-1 Jul 18 02:24:42.571687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-373ee2a5-6fc4-4893-9c4e-44a67e13047d req-dc7aad51-59cc-44a6-8d4f-a05f1af364f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075557 Jul 18 02:24:42.579588 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1230/2452] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.602732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e71f006d-c0c5-4303-9cd5-78143e810cab req-81b90e8b-e0e8-4d94-8d0b-bdddc09da2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:42.647873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e71f006d-c0c5-4303-9cd5-78143e810cab req-81b90e8b-e0e8-4d94-8d0b-bdddc09da2c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.650819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e71f006d-c0c5-4303-9cd5-78143e810cab req-81b90e8b-e0e8-4d94-8d0b-bdddc09da2c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.683390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e71f006d-c0c5-4303-9cd5-78143e810cab req-81b90e8b-e0e8-4d94-8d0b-bdddc09da2c7 service nova] Creating event network-vif-unplugged:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:24:42.695709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e71f006d-c0c5-4303-9cd5-78143e810cab req-81b90e8b-e0e8-4d94-8d0b-bdddc09da2c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109552 Jul 18 02:24:42.698007 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1231/2453] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.713261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f53e000f-48b9-4efe-b7f2-ddda104d4a27 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04602a60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:42.836088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:24:42.836865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:24:42.837034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:24:42.837447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:24:42.837870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:24:42.849365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.850172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.851046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:42.851929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:42.864916 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f53e000f-48b9-4efe-b7f2-ddda104d4a27 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.164620 Jul 18 02:24:42.868167 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1232/2454] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:42 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:42.893222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Getting quotas for project 662600ddb33b4a3aa08050ac741097e4. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:42.900179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f05c157f-1760-478b-9899-f57d9769bcbd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045ce700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:42.905187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Getting quotas for user fe46e2756309434c8ce234fe2d19071e and project 662600ddb33b4a3aa08050ac741097e4. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:42.933664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Going to run 3 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:24:42.938500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:43.015890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:43.027500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=ea84787b-d65f-4917-b906-667f533ca43e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:43.122676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=66e9162d-74a6-438e-b3c2-3122081c0727,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:24:43.213212 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f05c157f-1760-478b-9899-f57d9769bcbd tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?changes-since=2022-07-18T02%3A21%3A16Z" status: 200 len: 6329 microversion: 2.1 time: 0.334609 Jul 18 02:24:43.214849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1233/2455] 10.222.0.67 () {58 vars in 1219 bytes} [Mon Jul 18 02:24:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-18T02%3A21%3A16Z => generated 6329 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.225576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.227806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.238222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11,nova_api:UPDATE=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:43.273237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.277446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.279352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.280471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.377216 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2f8c3e2-52a3-4baf-92db-97355690291f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.905652 Jul 18 02:24:43.378787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1223/2456] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:24:43.387296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f653423-f4e8-4368-b7cb-d8e930830a4d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e451f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.526175 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f653423-f4e8-4368-b7cb-d8e930830a4d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2083531329" status: 200 len: 665 microversion: 2.1 time: 0.145619 Jul 18 02:24:43.529327 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1224/2457] 10.222.0.67 () {58 vars in 1251 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2083531329 => generated 665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:43.538498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.540473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 4ef48022-cee6-4b7e-b266-50eff1f1afc4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.551689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.553010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.554375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.556246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.578370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] HTTP exception thrown: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Request method failure captured: Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 HTTP/1.1 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MHz5ejlnpNRMxzOo2Jt_NpTy7WHhgXcAVM4JIr6MUIwrh9-MSw6p97AopNaN14Qddm3bkIsIeYT3e7JaiYrdEZEI9St8a-IqfojkG7bbK52EDRbS6-MOtxNlOIBgmLEMAf3VC_WJbuItqOUrX4M56P0t6R2plf100of-TBsUrrR1Xs Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d2b97e560fcf4750b2aad92d6d37e611 Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '4ef48022-cee6-4b7e-b266-50eff1f1afc4'} Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:43.580055 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Returning 404 to user: Instance 4ef48022-cee6-4b7e-b266-50eff1f1afc4 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d283d52-75a6-43c2-9726-1dcb78347fef tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4" status: 404 len: 111 microversion: 2.1 time: 0.051346 Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1225/2458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers/4ef48022-cee6-4b7e-b266-50eff1f1afc4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:43.592050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.595769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:43.596241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:24:43.619940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:43.629919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ecd423b-e204-4e1f-a249-2fee9d550ff6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.413121 Jul 18 02:24:43.636710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.637576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.639096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.639839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.641086 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1234/2459] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.648790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dec5ac54-6c23-4cdc-9338-57ff0ea245f2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0459dee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.738234 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a9441ef-4f57-4231-89a3-20edbcd90006 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.154046 Jul 18 02:24:43.750510 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1226/2460] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers => generated 1018 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.761069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.762455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.773856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dec5ac54-6c23-4cdc-9338-57ff0ea245f2 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1465 microversion: 2.1 time: 0.130989 Jul 18 02:24:43.775039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1235/2461] 10.222.0.67 () {58 vars in 1337 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1465 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.775603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.777147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.778914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:43.780462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:43.780669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-505f216e-3624-4876-8b7a-1d37d0855f4d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:43.781375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-505f216e-3624-4876-8b7a-1d37d0855f4d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:43.831845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:43.865623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-505f216e-3624-4876-8b7a-1d37d0855f4d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:43.876168 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-505f216e-3624-4876-8b7a-1d37d0855f4d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1223 microversion: 2.1 time: 0.099473 Jul 18 02:24:43.877862 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1236/2462] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:43.899544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf4402d1-7943-4cb9-add4-7fb2098b1554 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045ce5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.005039 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79a6f3e9-597e-4329-8643-c21431895dc6 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 204 len: 0 microversion: 2.1 time: 0.252092 Jul 18 02:24:44.008110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1227/2463] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:43 2022] DELETE /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:44.041429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf4402d1-7943-4cb9-add4-7fb2098b1554 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1465 microversion: 2.1 time: 0.150743 Jul 18 02:24:44.054221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1237/2464] 10.222.0.67 () {58 vars in 1323 bytes} [Mon Jul 18 02:24:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:44.055476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.057566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:44.075035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.076102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.077685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.078209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.247445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Action: 'update', calling method: .version_select at 0x7fab05944d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:44.250695 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:44.250695 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:44.261096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.267992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.279082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.279797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.283914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:44.294342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26e897b9-4729-47e5-b39d-5b0c9aba8b54 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1498 microversion: 2.1 time: 0.249629 Jul 18 02:24:44.295441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] HTTP exception thrown: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.295725 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1238/2465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1498 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:44.301698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-afd4b55e-702a-445d-965b-e1ff6a037003 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab0459d700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Request method failure captured: Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 HTTP/1.1 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 56 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRru9A7Yw44kz9GKbfjpUkNu-6dyMJ6RCJ54FhVMH9Ib9zcURvFitwNln7tj-0SfH97tV4rbSxhyakFMNO7d8iv5qQ6q8BFZ4QiscimDOIRCcE5nbGkd9Ra0l0TkdCm9T0iGB9UoPwe2p2q0535Fbt2FiUqSdFprG_0yc0sUKZ33Ow Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a0ef7bb0b29a451da8154c30c22c330e Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: exception: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd473b9fe-682d-4aa1-a80c-05646ce1bfc7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:44.310337 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.315653 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.317661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Returning 404 to user: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:44.318964 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ced7119b-7a22-43ed-af6c-9521158dc41d tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7" status: 404 len: 110 microversion: 2.53 time: 0.307412 Jul 18 02:24:44.319844 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1228/2466] 10.222.0.67 () {62 vars in 1308 bytes} [Mon Jul 18 02:24:44 2022] PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 => generated 110 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:24:44.334444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Action: 'update', calling method: .version_select at 0x7fab04e49ca0>, body: {"status": "disabled"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:44.337463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.338045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.344691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.345434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.353419 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] HTTP exception thrown: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Request method failure captured: Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 HTTP/1.1 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 22 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRru9A7Yw44kz9GKbfjpUkNu-6dyMJ6RCJ54FhVMH9Ib9zcURvFitwNln7tj-0SfH97tV4rbSxhyakFMNO7d8iv5qQ6q8BFZ4QiscimDOIRCcE5nbGkd9Ra0l0TkdCm9T0iGB9UoPwe2p2q0535Fbt2FiUqSdFprG_0yc0sUKZ33Ow Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a0ef7bb0b29a451da8154c30c22c330e Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: {"status": "disabled"} Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: exception: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd473b9fe-682d-4aa1-a80c-05646ce1bfc7', 'body': {'status': 'disabled'}} Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:44.355431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.359785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.366372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Returning 404 to user: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:44.367647 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e05060a8-9ed9-49d6-b0d5-82db8ca1e687 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7" status: 404 len: 110 microversion: 2.53 time: 0.040490 Jul 18 02:24:44.369033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1229/2467] 10.222.0.67 () {62 vars in 1308 bytes} [Mon Jul 18 02:24:44 2022] PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:24:44.390576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Action: 'update', calling method: .version_select at 0x7fab04ea2dc0>, body: {"status": "enabled"} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:44.398781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.399646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.415567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.416440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.426638 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] HTTP exception thrown: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Request method failure captured: Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 HTTP/1.1 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 21 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRru9A7Yw44kz9GKbfjpUkNu-6dyMJ6RCJ54FhVMH9Ib9zcURvFitwNln7tj-0SfH97tV4rbSxhyakFMNO7d8iv5qQ6q8BFZ4QiscimDOIRCcE5nbGkd9Ra0l0TkdCm9T0iGB9UoPwe2p2q0535Fbt2FiUqSdFprG_0yc0sUKZ33Ow Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dd94b9457fd481db661d9f6b141fef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2dd94b9457fd481db661d9f6b141fef6 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808 Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a0ef7bb0b29a451da8154c30c22c330e Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: {"status": "enabled"} Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: exception: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd473b9fe-682d-4aa1-a80c-05646ce1bfc7', 'body': {'status': 'enabled'}} Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:24:44.430805 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Returning 404 to user: Service d473b9fe-682d-4aa1-a80c-05646ce1bfc7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5aae5c98-e8ce-4bff-9a84-0c8cc2b82822 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7" status: 404 len: 110 microversion: 2.53 time: 0.053714 Jul 18 02:24:44.439297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1230/2468] 10.222.0.67 () {62 vars in 1308 bytes} [Mon Jul 18 02:24:44 2022] PUT /compute/v2.1/os-services/d473b9fe-682d-4aa1-a80c-05646ce1bfc7 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:24:44.452033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.454437 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:44.454437 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:44.458206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.460351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.463864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.464861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.487919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-afd4b55e-702a-445d-965b-e1ff6a037003 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.190106 Jul 18 02:24:44.495376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1239/2469] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:44.536143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e15cfd1-1c65-4231-bc47-deec498d33df tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045a9940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.542324 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90ba92a4-0fb0-48f9-9545-98b911a44994 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.097098 Jul 18 02:24:44.545839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1231/2470] 10.222.0.67 () {60 vars in 1177 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:44.605237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.613248 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:44.613248 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:44.621108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.622218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.624070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.625182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.699464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b471cda-b237-4c8e-a07f-4a604a3ee821 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.131552 Jul 18 02:24:44.702381 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1232/2471] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:44.728717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.733815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:44.736177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e15cfd1-1c65-4231-bc47-deec498d33df tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.206411 Jul 18 02:24:44.737500 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1240/2472] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:44.753099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.753099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.753099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.753099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.771902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:44.779746 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:44.779746 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:24:44.782250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.792413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.794730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:44.796019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:44.923982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4372ecf6-4709-43c1-a903-d89e5fe95095 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.168774 Jul 18 02:24:44.925131 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1241/2473] 10.222.0.67 () {60 vars in 1177 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:44.938236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-705d5246-4254-4f8d-a682-4b6ac4391e34 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab045ceee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.090853 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-705d5246-4254-4f8d-a682-4b6ac4391e34 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef" status: 200 len: 784 microversion: 2.1 time: 0.163833 Jul 18 02:24:45.092061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1242/2474] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef => generated 784 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:45.107344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.108242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:45.121422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.122113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.123111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.125731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.130975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.140196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba995e17-9438-4b39-ab60-c308521eaa28 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 0.434591 Jul 18 02:24:45.147805 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1233/2475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:44 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.158149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.159586 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:45.159586 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:45.160894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.164282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.166079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.170930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.231001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d9ea453c-81d6-47ba-a404-09e26b9cd726 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-849796-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.081708 Jul 18 02:24:45.235303 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1234/2476] 10.222.0.67 () {60 vars in 1234 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/os-services?host=n-d-849796-1&binary=xxx => generated 16 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.245705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-059c54a8-4a09-42fb-9497-7b876198058d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e48940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.398360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.430598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-059c54a8-4a09-42fb-9497-7b876198058d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.193776 Jul 18 02:24:45.442088 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1235/2477] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.442386 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51b5a769-a467-4917-85d1-758ad0f83718 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1227 microversion: 2.1 time: 0.339343 Jul 18 02:24:45.442386 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1243/2478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1227 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.455874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.458057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2b5f0421-1b2b-450e-942f-33a5debb09cc req-a8f47cf7-b29f-4576-a9a6-c93aedcfe170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421978c4-4f6a-4cec-9c46-518ae92112c3", "name": "network-vif-plugged", "status": "completed", "tag": "5ad21d59-c411-4a18-b08d-8d1b240beb29"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:45.460744 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:45.460744 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:24:45.463209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.465505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.468976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.471182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.482616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2b5f0421-1b2b-450e-942f-33a5debb09cc req-a8f47cf7-b29f-4576-a9a6-c93aedcfe170 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.483077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2b5f0421-1b2b-450e-942f-33a5debb09cc req-a8f47cf7-b29f-4576-a9a6-c93aedcfe170 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.497890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:45.512106 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2b5f0421-1b2b-450e-942f-33a5debb09cc req-a8f47cf7-b29f-4576-a9a6-c93aedcfe170 service nova] Creating event network-vif-plugged:5ad21d59-c411-4a18-b08d-8d1b240beb29 for instance 421978c4-4f6a-4cec-9c46-518ae92112c3 on n-h1-849796-1 Jul 18 02:24:45.520493 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2b5f0421-1b2b-450e-942f-33a5debb09cc req-a8f47cf7-b29f-4576-a9a6-c93aedcfe170 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084091 Jul 18 02:24:45.521782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1236/2479] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:45.527727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.534474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:45.554114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.554898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.556145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.557251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.560356 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51f528c9-519a-4742-91c5-1017d932648e tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.117433 Jul 18 02:24:45.564986 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1244/2480] 10.222.0.67 () {60 vars in 1177 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:45.572052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1798bd0e-2921-4c89-beba-2109fb4c2ea1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab046baee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.900411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:45.909171 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2ae8239-edca-48c9-9f7a-b4c03f2715ad tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1498 microversion: 2.1 time: 0.385871 Jul 18 02:24:45.925105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1237/2481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:45.931067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:45.932640 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:45.932640 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:45.946326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.947117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.948239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:45.948877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:45.985499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:46.042443 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-857b3731-8e61-4ce0-a3a3-cb49b295efb7 tempest-ServicesAdminNegativeV253TestJSON-378382808 tempest-ServicesAdminNegativeV253TestJSON-378382808-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.098466 Jul 18 02:24:46.058130 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1238/2482] 10.222.0.67 () {60 vars in 1238 bytes} [Mon Jul 18 02:24:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:46.376642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f9d18b3-a562-4db3-93f0-50860d4a5728 tempest-ServicesAdminNegativeV253TestJSON-1378126074 tempest-ServicesAdminNegativeV253TestJSON-1378126074-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:46.378079 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:24:46.378079 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:24:46.379373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4f9d18b3-a562-4db3-93f0-50860d4a5728 tempest-ServicesAdminNegativeV253TestJSON-1378126074 tempest-ServicesAdminNegativeV253TestJSON-1378126074-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '87a37e0e514c4454ba5e214b661d188c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6178ad5426e74e8c82ebaf8f531d73ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f9d18b3-a562-4db3-93f0-50860d4a5728 tempest-ServicesAdminNegativeV253TestJSON-1378126074 tempest-ServicesAdminNegativeV253TestJSON-1378126074-project] Request method failure captured: Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRqGhnH9b7w7bjqmtrqC_kOdSpNoAy-GJiQ6ZeZVumUC2IhlQuUGDiYMalcx2dcgZe0lST3k87s1PcFntbBi9twekvJ5PcLJGgNclXQehAetQK4TcbhB9xD8lwllR_cpjEjRidNoTAmzwfdzfoo9YGArmaE1q-wgSzf5n0yBFdyamo Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.53 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6178ad5426e74e8c82ebaf8f531d73ef Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1378126074 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6178ad5426e74e8c82ebaf8f531d73ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6178ad5426e74e8c82ebaf8f531d73ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6178ad5426e74e8c82ebaf8f531d73ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6178ad5426e74e8c82ebaf8f531d73ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1378126074 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6178ad5426e74e8c82ebaf8f531d73ef Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1378126074 Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1378126074-project Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 87a37e0e514c4454ba5e214b661d188c Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1378126074-project Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:46.386033 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f9d18b3-a562-4db3-93f0-50860d4a5728 tempest-ServicesAdminNegativeV253TestJSON-1378126074 tempest-ServicesAdminNegativeV253TestJSON-1378126074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:46.390214 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f9d18b3-a562-4db3-93f0-50860d4a5728 tempest-ServicesAdminNegativeV253TestJSON-1378126074 tempest-ServicesAdminNegativeV253TestJSON-1378126074-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.327322 Jul 18 02:24:46.395294 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1239/2483] 10.222.0.67 () {60 vars in 1177 bytes} [Mon Jul 18 02:24:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:24:46.411120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:46.411775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:46.445586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.446278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.447152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.447605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.691461 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1798bd0e-2921-4c89-beba-2109fb4c2ea1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f" status: 204 len: 0 microversion: 2.1 time: 1.124957 Jul 18 02:24:46.692689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1245/2484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:45 2022] DELETE /compute/v2.1/images/55e36241-53f6-4f82-9aa2-9d6fb11b053f => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:46.703297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:46.703975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:46.732281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.734093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:46.742775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:46.746602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:47.096682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:47.113245 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dca77d6-ee4c-42b1-aa99-22c591c6ea56 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1283 microversion: 2.1 time: 0.416870 Jul 18 02:24:47.114394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1246/2485] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:46 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1283 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:47.124583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-421efd11-52eb-4b1c-9236-cde2e0d4d4fc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04a6cd30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:47.982676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:48.003613 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3ff4780-5454-488e-948c-189051d202fb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1308 microversion: 2.1 time: 1.606952 Jul 18 02:24:48.014757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1240/2486] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:46 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1308 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:48.031273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-992f8828-2cf9-45de-a980-0896fb037487 req-26d5262f-63ab-459d-9545-853285239644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9848647e-8e1c-4e17-83a6-8c5877cad694", "name": "network-vif-deleted", "tag": "8f4dfa76-cdb7-4a21-b6e5-2550f11776f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:48.057945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-992f8828-2cf9-45de-a980-0896fb037487 req-26d5262f-63ab-459d-9545-853285239644 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.058823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-992f8828-2cf9-45de-a980-0896fb037487 req-26d5262f-63ab-459d-9545-853285239644 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.070328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:48.092799 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-992f8828-2cf9-45de-a980-0896fb037487 req-26d5262f-63ab-459d-9545-853285239644 service nova] Creating event network-vif-deleted:8f4dfa76-cdb7-4a21-b6e5-2550f11776f4 for instance 9848647e-8e1c-4e17-83a6-8c5877cad694 on n-h1-849796-1 Jul 18 02:24:48.102656 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-992f8828-2cf9-45de-a980-0896fb037487 req-26d5262f-63ab-459d-9545-853285239644 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082968 Jul 18 02:24:48.103691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1241/2487] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:48.119480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:48.124515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:48.150237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.150896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.157245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.158056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.313647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.314748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.315755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lazy-loading 'fault' on Instance uuid 9848647e-8e1c-4e17-83a6-8c5877cad694 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:24:48.439828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b97e560fcf4750b2aad92d6d37e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f285a7129746c9b8bbb9cc80c7ea42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:48.452544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5fd23e45-30c1-4c04-9574-11df8eeb586d tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 200 len: 1300 microversion: 2.1 time: 0.347343 Jul 18 02:24:48.455549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1242/2488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:48 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 1300 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:48.498909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:48.521009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:48.524668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Searching by: {'deleted': False, 'project_id': '3023a58217a649d28186813b61d4afbf'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:24:48.546467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.547620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.549527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.550779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.633226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:24:48.760958 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-421efd11-52eb-4b1c-9236-cde2e0d4d4fc tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8" status: 204 len: 0 microversion: 2.1 time: 1.641505 Jul 18 02:24:48.761702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1247/2489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:47 2022] DELETE /compute/v2.1/images/73d00bec-4963-4289-89e9-d9d91bbe93b8 => generated 0 bytes in 1645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:48.771215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:48.773466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:48.784694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e8898ff-aa78-4c4c-89d5-07179726b052 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.317740 Jul 18 02:24:48.790348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1243/2490] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:24:48 2022] GET /compute/v2.1/servers => generated 340 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:48.808630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.809495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.810348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:48.813715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:48.825550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa8884d0-c499-4938-a071-0a813c28a97d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04e891f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:49.453603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:49.468015 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f149b58-613d-460e-848f-303a3418ed90 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1281 microversion: 2.1 time: 0.703740 Jul 18 02:24:49.486450 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1248/2491] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:48 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1281 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:49.501631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:49.521889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:49.525223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Searching by: {'deleted': False, 'project_id': '3023a58217a649d28186813b61d4afbf'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:24:49.571354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:49.574840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:49.576843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:49.583077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:49.660389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:24:49.814315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:49.842564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:49.844509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.211484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa8884d0-c499-4938-a071-0a813c28a97d tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2" status: 204 len: 0 microversion: 2.1 time: 1.410301 Jul 18 02:24:50.212563 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1244/2492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:48 2022] DELETE /compute/v2.1/images/01bd5889-a627-45f2-8798-c943017e02b2 => generated 0 bytes in 1413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:50.227400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:50.231316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:50.286340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.287833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.289605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.290782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.552115 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0096ebc-104f-4123-b23d-f726be3674e9 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.063205 Jul 18 02:24:50.566737 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1249/2493] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:24:49 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:50.596227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:50.602776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] [instance: 9848647e-8e1c-4e17-83a6-8c5877cad694] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:50.634602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.635445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.636888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.637771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.683841 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] HTTP exception thrown: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Request method failure captured: Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 HTTP/1.1 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MHz5ejlnpNRMxzOo2Jt_NpTy7WHhgXcAVM4JIr6MUIwrh9-MSw6p97AopNaN14Qddm3bkIsIeYT3e7JaiYrdEZEI9St8a-IqfojkG7bbK52EDRbS6-MOtxNlOIBgmLEMAf3VC_WJbuItqOUrX4M56P0t6R2plf100of-TBsUrrR1Xs Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/77f285a7129746c9b8bbb9cc80c7ea42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 77f285a7129746c9b8bbb9cc80c7ea42 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-LiveMigrationTest-1806605159 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d2b97e560fcf4750b2aad92d6d37e611 Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-LiveMigrationTest-1806605159-project Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9848647e-8e1c-4e17-83a6-8c5877cad694'} Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:50.686825 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. Jul 18 02:24:50.690508 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:24:50.694263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] Returning 404 to user: Instance 9848647e-8e1c-4e17-83a6-8c5877cad694 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:50.695216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a210f08f-5767-4d27-9e9a-2152d7e92e68 tempest-LiveMigrationTest-1806605159 tempest-LiveMigrationTest-1806605159-project] 10.222.0.67 "GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694" status: 404 len: 111 microversion: 2.1 time: 0.126904 Jul 18 02:24:50.695813 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1250/2494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:50 2022] GET /compute/v2.1/servers/9848647e-8e1c-4e17-83a6-8c5877cad694 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:50.712242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:50.714511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:50.736312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.738892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.742119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:50.744837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:50.832492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:51.070631 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee16a945-1c3e-4c29-94ba-99dc8c1be56e tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 204 len: 0 microversion: 2.1 time: 0.372831 Jul 18 02:24:51.071948 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1251/2495] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:50 2022] DELETE /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:51.078383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.082236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.098431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.101661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.111411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.112364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.214682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:51.231862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73a18a81-5c95-4a04-b592-e1a49924df03 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1488 microversion: 2.1 time: 1.017515 Jul 18 02:24:51.243353 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1245/2496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:50 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1488 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:51.256876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9e39e6c-c977-4717-a1a1-638dc6a15c80 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.276806 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9e39e6c-c977-4717-a1a1-638dc6a15c80 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031888 Jul 18 02:24:51.278765 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1246/2497] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:24:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:51.297594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.298622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.317698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.318383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.319346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.321349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.508027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:51.539507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8899c5fe-8c6f-479b-9a17-949c51c5a578 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.460579 Jul 18 02:24:51.541655 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1252/2498] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:51 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:51.559169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:51.560309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.574170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.581451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.582446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.584431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.693293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:51.708155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bc88d46-98fd-4ff5-9b6a-d6309675ab2f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3/action" status: 202 len: 0 microversion: 2.1 time: 0.163538 Jul 18 02:24:51.712674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1253/2499] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:24:51 2022] POST /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:24:51.716695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.717236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c088995c-b679-41eb-9967-fe2e10955e87 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1473 microversion: 2.1 time: 0.430636 Jul 18 02:24:51.729728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.729986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.730428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.730684 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1247/2500] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:51 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:51.731414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.732028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.736484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.737649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.746901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.747443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.748651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.749612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.787963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:51.934016 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8bf5e89-5670-4ef3-a7f5-d302d96cc27b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 204 len: 0 microversion: 2.1 time: 0.222396 Jul 18 02:24:51.938748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1254/2501] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:51 2022] DELETE /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:51.946672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:51.948531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:51.989376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.990329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:51.991582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:51.992385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.069858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:52.089748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-56bec4b0-6205-4e44-8a2b-c1d7726d49e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1493 microversion: 2.1 time: 0.357484 Jul 18 02:24:52.092662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1248/2502] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:51 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:52.232382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8776da9e-944c-405e-bad1-d4139e270f21 req-bf00e3e0-40b4-4449-9ba3-85596ccdb98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea84787b-d65f-4917-b906-667f533ca43e", "tag": "39dc1b7a-51ad-4334-aa96-912f86a4e511"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:52.248209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8776da9e-944c-405e-bad1-d4139e270f21 req-bf00e3e0-40b4-4449-9ba3-85596ccdb98b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:52.248550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8776da9e-944c-405e-bad1-d4139e270f21 req-bf00e3e0-40b4-4449-9ba3-85596ccdb98b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.275424 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8776da9e-944c-405e-bad1-d4139e270f21 req-bf00e3e0-40b4-4449-9ba3-85596ccdb98b service nova] Creating event network-changed:39dc1b7a-51ad-4334-aa96-912f86a4e511 for instance ea84787b-d65f-4917-b906-667f533ca43e on n-h2-849796-1 Jul 18 02:24:52.281701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8776da9e-944c-405e-bad1-d4139e270f21 req-bf00e3e0-40b4-4449-9ba3-85596ccdb98b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053654 Jul 18 02:24:52.287398 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1249/2503] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:52.571879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:52.575656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:52.623598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:52.628307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.632374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:52.634766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:52.924916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:53.056107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.070924 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5360bce-8841-4436-bfb6-736563a5e927 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1715 microversion: 2.1 time: 1.130531 Jul 18 02:24:53.071545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1255/2504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:51 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1715 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:53.081114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.082390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:53.083033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:53.090939 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-14305aff-3cf6-4281-b381-99eaf1a0afee tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.535312 Jul 18 02:24:53.105071 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1250/2505] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:52 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:53.105391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.105391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.105391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.105391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.105980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:53.118782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:53.128332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.128332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.130023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.133041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.596190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.611870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.617269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:53.620807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b31836d-f6cc-4ee2-9ad5-c115ede8877c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2952 microversion: 2.32 time: 0.522553 Jul 18 02:24:53.623254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1251/2506] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:24:53 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2952 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:53.643934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:53.644571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:53.666041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.666498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:53.667329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:53.668607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.023283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:54.031742 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-402278c2-3869-4099-ad80-708849eda86b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 200 len: 1473 microversion: 2.1 time: 0.407869 Jul 18 02:24:54.035450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1252/2507] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:53 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:54.042895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:54.044544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:54.079235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.080056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.087880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.100970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.267310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:54.278357 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88ea9dad-b636-41b7-997f-240a209ac12b tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1473 microversion: 2.1 time: 1.205256 Jul 18 02:24:54.282879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1256/2508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:53 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1473 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:54.303372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1622182334"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:54.314807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:54.347510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.347895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.353624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:54.354286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:54.890025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:54.937428 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-abaf0b55-873e-4674-814b-8d5c3ad03e57 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3/action" status: 202 len: 0 microversion: 2.1 time: 0.648577 Jul 18 02:24:54.944281 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1257/2509] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:24:54 2022] POST /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:24:54.963880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:54.970321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:55.004464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.005698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.010407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.011459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.061878 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a4ffc02-a97e-4526-92f5-cc95e5249c97 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0/os-interface" status: 200 len: 1832 microversion: 2.32 time: 1.024736 Jul 18 02:24:55.062948 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1253/2510] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:24:54 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0/os-interface => generated 1832 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:24:55.077293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:55.079789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:55.094046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.095002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.096087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.096887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.892250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:55.903235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:55.904052 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a6c67c0-9907-41c4-abf5-d6ece816e239 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1715 microversion: 2.1 time: 0.962745 Jul 18 02:24:55.918060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1258/2511] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:54 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1715 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:55.918060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b3fdf9e-0ad0-423c-bb08-38e36a0067dc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04664b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:55.929790 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55f50905-ab5a-439e-8ed7-0e9f9fbba18b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.856440 Jul 18 02:24:55.930973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1254/2512] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:55 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:55.941605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a996539-4464-4289-b650-f6e2f2c22c55"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:55.943770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:55.952670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.953955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.955279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:55.955967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:55.999480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b3fdf9e-0ad0-423c-bb08-38e36a0067dc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.091050 Jul 18 02:24:56.008957 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1259/2513] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:55 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:56.015020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:56.016333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:56.025828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.026498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.027553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.028077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.564510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0f70eeed-14ea-4713-9660-ab675d3be7a7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "POST /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631335 Jul 18 02:24:56.568252 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1255/2514] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:24:55 2022] POST /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:56.614724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d41ccca2-ed2f-4228-ac68-9994b3b0559f tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab04f5a940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:56.689607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:56.722326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d41ccca2-ed2f-4228-ac68-9994b3b0559f tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540" status: 200 len: 637 microversion: 2.1 time: 0.151627 Jul 18 02:24:56.724747 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1256/2515] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:56 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540 => generated 637 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:56.734289 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb873fdc-79dd-4d1f-ae6b-a90b4f729a39 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 200 len: 1473 microversion: 2.1 time: 0.722918 Jul 18 02:24:56.735846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-87c7cdc2-b9a7-48d4-af94-fc29625a8039 req-3fb0ae06-a1e1-4400-b93d-080ff87d3ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e9162d-74a6-438e-b3c2-3122081c0727", "tag": "e359219b-8526-422e-bf4d-57ebf5a5bddb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:56.736221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1260/2516] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:56 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 1473 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:56.747723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f01022bd-d507-4238-b45b-d804313305ba req-54bdb1c9-3dfc-409c-9457-3f896ba03103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacac7dc-23af-4f15-b620-940136961b1d", "tag": "5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:56.765509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-87c7cdc2-b9a7-48d4-af94-fc29625a8039 req-3fb0ae06-a1e1-4400-b93d-080ff87d3ec6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.765984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-87c7cdc2-b9a7-48d4-af94-fc29625a8039 req-3fb0ae06-a1e1-4400-b93d-080ff87d3ec6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.785827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f01022bd-d507-4238-b45b-d804313305ba req-54bdb1c9-3dfc-409c-9457-3f896ba03103 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.788647 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-87c7cdc2-b9a7-48d4-af94-fc29625a8039 req-3fb0ae06-a1e1-4400-b93d-080ff87d3ec6 service nova] Creating event network-changed:e359219b-8526-422e-bf4d-57ebf5a5bddb for instance 66e9162d-74a6-438e-b3c2-3122081c0727 on n-h1-849796-1 Jul 18 02:24:56.792778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f01022bd-d507-4238-b45b-d804313305ba req-54bdb1c9-3dfc-409c-9457-3f896ba03103 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.807819 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-87c7cdc2-b9a7-48d4-af94-fc29625a8039 req-3fb0ae06-a1e1-4400-b93d-080ff87d3ec6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077244 Jul 18 02:24:56.808466 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1257/2517] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:56.815801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64f6174c-4ad4-4d13-9091-628f273835db tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04e053a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:56.846567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f01022bd-d507-4238-b45b-d804313305ba req-54bdb1c9-3dfc-409c-9457-3f896ba03103 service nova] Creating event network-changed:5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5 for instance aacac7dc-23af-4f15-b620-940136961b1d on n-h2-849796-1 Jul 18 02:24:56.871249 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f01022bd-d507-4238-b45b-d804313305ba req-54bdb1c9-3dfc-409c-9457-3f896ba03103 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132414 Jul 18 02:24:56.877077 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1261/2518] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:56.877987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-64f6174c-4ad4-4d13-9091-628f273835db tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:56.886422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-64f6174c-4ad4-4d13-9091-628f273835db tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:56.930845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:56.931895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:56.950682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.951145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:56.954326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:56.957834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.307636 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64f6174c-4ad4-4d13-9091-628f273835db tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.496441 Jul 18 02:24:57.308661 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1258/2519] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:24:56 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:24:57.319131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:57.320393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:57.330385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.331403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.332527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:57.334457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:57.992299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:58.003231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f8776a8-3d93-4a1c-a123-1c6090b20e53 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1715 microversion: 2.1 time: 1.076845 Jul 18 02:24:58.016013 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1262/2520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:56 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1715 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:24:58.022169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c564cc9c-0719-4ca1-9cd5-c8b1c3092ccd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0459da60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.093489 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c564cc9c-0719-4ca1-9cd5-c8b1c3092ccd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.075773 Jul 18 02:24:58.094397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1263/2521] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:58.126182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22a51a1f-9867-4198-8831-c13dade2c5bf tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab045b6310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.460131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:58.509427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e2f18ea-84bf-49a3-a544-4232a3150d9b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 1.198917 Jul 18 02:24:58.514290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1259/2522] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:57 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:58.528890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.529564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 2bb36d11-eea4-48cc-9680-e854c7e16ab5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:58.546248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.546718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.547743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.547993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.573927 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] HTTP exception thrown: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Request method failure captured: Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 HTTP/1.1 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MObSMZ1-r0WI3RzJewDokVR23wxRgBCP2Zeya0mtwZzptNTzmMXMnL0yHr34bDEOvNHa4ZzaefTvcTk2jhepEsWTe_GRFJXzqVrkPiinw1pDwZPhGfXz5B6oa2tAhj09fJxQyKIl1KxWh8fR_pxkZHcG-brB3A-ka5yzsd1Fkdeq6k Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 637a50800bab433ebff8bcc586b0b5bd Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 637a50800bab433ebff8bcc586b0b5bd Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListImageFiltersTestJSON-721890551-project Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 55d10a19e6a34995bc1187088e72a1f9 Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListImageFiltersTestJSON-721890551-project Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2bb36d11-eea4-48cc-9680-e854c7e16ab5'} Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:24:58.575937 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. Jul 18 02:24:58.579997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:24:58.584134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Returning 404 to user: Instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:24:58.586113 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fdd14fc-b60f-4965-99bc-d494fd3bb7c9 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5" status: 404 len: 111 microversion: 2.1 time: 0.069925 Jul 18 02:24:58.587450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1260/2523] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/servers/2bb36d11-eea4-48cc-9680-e854c7e16ab5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:24:58.597040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.597910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:58.600808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:58.617567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.618975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.620503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:58.621371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:58.765467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22a51a1f-9867-4198-8831-c13dade2c5bf tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "DELETE /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.669673 Jul 18 02:24:58.766121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1264/2524] 10.222.0.67 () {58 vars in 1295 bytes} [Mon Jul 18 02:24:58 2022] DELETE /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_version => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:24:58.770707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:24:58.788009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9efcfb27-7ed1-431a-a612-ba95b1a07ec6 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab047ccf70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:58.896908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9efcfb27-7ed1-431a-a612-ba95b1a07ec6 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 37 microversion: 2.1 time: 0.122740 Jul 18 02:24:58.898041 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1265/2525] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:24:58 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 37 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:24:58.922824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef59f555-a54b-4e8b-a7a3-1da3bb4bab7a tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab045a9ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:58.935649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:59.022848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ef59f555-a54b-4e8b-a7a3-1da3bb4bab7a tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:24:59.034358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ef59f555-a54b-4e8b-a7a3-1da3bb4bab7a tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:24:59.048219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62789d18-93a5-4655-8d90-01508ac85289 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 204 len: 0 microversion: 2.1 time: 0.453884 Jul 18 02:24:59.053800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1261/2526] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:24:58 2022] DELETE /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:24:59.067082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-95cdb2b9-781d-4d74-ba50-dbc220706043 req-9e6a51d7-d028-4d7e-b212-2482b4b26253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb36d11-eea4-48cc-9680-e854c7e16ab5", "name": "network-vif-deleted", "tag": "d421c541-4386-4e00-b959-ca13f1e84515"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:24:59.078974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-95cdb2b9-781d-4d74-ba50-dbc220706043 req-9e6a51d7-d028-4d7e-b212-2482b4b26253 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.079942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-95cdb2b9-781d-4d74-ba50-dbc220706043 req-9e6a51d7-d028-4d7e-b212-2482b4b26253 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.101193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-95cdb2b9-781d-4d74-ba50-dbc220706043 req-9e6a51d7-d028-4d7e-b212-2482b4b26253 service nova] Creating event network-vif-deleted:d421c541-4386-4e00-b959-ca13f1e84515 for instance 2bb36d11-eea4-48cc-9680-e854c7e16ab5 on n-h2-849796-1 Jul 18 02:24:59.143206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-95cdb2b9-781d-4d74-ba50-dbc220706043 req-9e6a51d7-d028-4d7e-b212-2482b4b26253 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079796 Jul 18 02:24:59.144220 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1262/2527] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:24:59.157245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.158239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.179739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.181120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.182924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.183585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.439790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:24:59.448648 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5abc42b-33e5-46fa-b7cc-dd6e06a0b910 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1648 microversion: 2.1 time: 0.302953 Jul 18 02:24:59.468807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1263/2528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1648 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:59.473954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.474873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.487738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.488595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.489592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.490924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.610183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:24:59.847294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef59f555-a54b-4e8b-a7a3-1da3bb4bab7a tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.935877 Jul 18 02:24:59.847949 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1266/2529] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:24:58 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:24:59.857277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b03598dd-0602-4c66-8ed9-4b2e403303d4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04602310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.939147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b03598dd-0602-4c66-8ed9-4b2e403303d4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.089913 Jul 18 02:24:59.939765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1267/2530] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:24:59.953240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:24:59.954173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:24:59.963883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.964658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:24:59.965702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:24:59.966351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.291358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.306767 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5a34a59-f9c5-46cd-9502-f63c578973e1 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 0.835574 Jul 18 02:25:00.308059 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1264/2531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:00.329419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-319e6f5e-1466-488d-871a-583ee4c230e1 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab04e49ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.398026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-319e6f5e-1466-488d-871a-583ee4c230e1 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.088342 Jul 18 02:25:00.406648 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1265/2532] 10.222.0.67 () {58 vars in 1289 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_distro => generated 33 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:00.413450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d80a2f5d-729c-4647-816a-3f5ac875ee35 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04e48af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:00.504803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d80a2f5d-729c-4647-816a-3f5ac875ee35 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:00.527064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d80a2f5d-729c-4647-816a-3f5ac875ee35 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:00.632320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.672399 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ac9acf2-59b6-4df1-afd7-f6c3abf4ac67 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.724862 Jul 18 02:25:00.682633 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1268/2533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:24:59 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:00.705487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:00.712041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:00.744891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.745394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.746272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:00.746731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:00.860236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:00.873567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e6917a6b-b1c8-4344-a0a9-c96ddbbd0e7b tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1648 microversion: 2.1 time: 0.182837 Jul 18 02:25:00.881037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1269/2534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1648 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:00.953774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7de2cbf-836a-4e69-a4d7-da176cc22cd0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab046d6160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.034546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f7de2cbf-836a-4e69-a4d7-da176cc22cd0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.084573 Jul 18 02:25:01.041007 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1270/2535] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:00 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:01.080116 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d80a2f5d-729c-4647-816a-3f5ac875ee35 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.671937 Jul 18 02:25:01.082317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1266/2536] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:00 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:01.091885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4ae5973-c0c8-4534-9a9b-c1a3ebf2e692 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab045cb1f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.151935 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4ae5973-c0c8-4534-9a9b-c1a3ebf2e692 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.064656 Jul 18 02:25:01.153332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1271/2537] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:01.163555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-314e4827-971e-41d3-863b-3722e6df67a2 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04e50dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:01.239474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b3cc218f-a8cf-4398-b9e0-83982b059403 req-35c959df-bfd8-42b1-9e07-efda15f5fbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e42816f-af3e-4671-b698-75c92c627aeb", "name": "network-vif-deleted", "tag": "05f964f7-cddb-427f-af7a-482415df8f85"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:01.270012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-314e4827-971e-41d3-863b-3722e6df67a2 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:01.274724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b3cc218f-a8cf-4398-b9e0-83982b059403 req-35c959df-bfd8-42b1-9e07-efda15f5fbcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.275244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b3cc218f-a8cf-4398-b9e0-83982b059403 req-35c959df-bfd8-42b1-9e07-efda15f5fbcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.291381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-314e4827-971e-41d3-863b-3722e6df67a2 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:01.317446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b3cc218f-a8cf-4398-b9e0-83982b059403 req-35c959df-bfd8-42b1-9e07-efda15f5fbcd service nova] Creating event network-vif-deleted:05f964f7-cddb-427f-af7a-482415df8f85 for instance 1e42816f-af3e-4671-b698-75c92c627aeb on n-h2-849796-1 Jul 18 02:25:01.333939 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b3cc218f-a8cf-4398-b9e0-83982b059403 req-35c959df-bfd8-42b1-9e07-efda15f5fbcd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097984 Jul 18 02:25:01.336482 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1272/2538] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:01.348541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.349921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:01.368577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.370728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.371578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.372039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.783472 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-314e4827-971e-41d3-863b-3722e6df67a2 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.624206 Jul 18 02:25:01.785304 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1267/2539] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:01 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:01.791161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:01.791820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:01.822514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.823072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:01.823953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:01.824415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.141063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:02.154754 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-542eacfc-916d-4bb9-b86e-4c88cef298f0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.367856 Jul 18 02:25:02.156207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1268/2540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.163039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c4a4766-7988-42c2-be3a-c574490a380b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04d84940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:02.269747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6c4a4766-7988-42c2-be3a-c574490a380b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:02.291100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6c4a4766-7988-42c2-be3a-c574490a380b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:02.379115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:02.395255 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c2257d74-99d9-4d59-9659-5ad6bf201127 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 1.056270 Jul 18 02:25:02.398274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1273/2541] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:01 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.406260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.408388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:02.418742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.419524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.421669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.422355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.517353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:02.518759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:02.521978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lazy-loading 'fault' on Instance uuid 1e42816f-af3e-4671-b698-75c92c627aeb {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:02.746762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:02.769433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a209c9f0-1119-4462-be1c-81ac593b775c tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1368 microversion: 2.1 time: 0.368478 Jul 18 02:25:02.791362 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1274/2542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.807405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a429572c-583e-4865-9172-e73ffb07e69c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab046d6310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:02.898232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a429572c-583e-4865-9172-e73ffb07e69c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.103147 Jul 18 02:25:02.906356 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1275/2543] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:02.944870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c4a4766-7988-42c2-be3a-c574490a380b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 64 microversion: 2.1 time: 0.786840 Jul 18 02:25:02.945735 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1269/2544] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:02 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 64 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:02.962865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa4e6712-55ae-4b35-ae98-7f08b4288c3b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab047aeaf0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:03.059236 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa4e6712-55ae-4b35-ae98-7f08b4288c3b tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 64 microversion: 2.1 time: 0.106022 Jul 18 02:25:03.060881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1276/2545] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:25:02 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 64 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:03.074276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-422aa4b7-10a5-4195-b05a-5cd3f5240caa tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04dc2af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:03.147458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-422aa4b7-10a5-4195-b05a-5cd3f5240caa tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:03.154330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-422aa4b7-10a5-4195-b05a-5cd3f5240caa tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:03.185230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:03.189043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:03.258472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.259370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.260914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.261752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.639245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-422aa4b7-10a5-4195-b05a-5cd3f5240caa tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 0.569043 Jul 18 02:25:03.643983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1270/2546] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:03 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:03.650059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8df5bfcc-d421-44a7-a6dc-da94177db089 req-ed090fea-ccd7-44a6-ab35-537f37209df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421978c4-4f6a-4cec-9c46-518ae92112c3", "name": "network-vif-plugged", "status": "completed", "tag": "5ad21d59-c411-4a18-b08d-8d1b240beb29"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:03.679274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8df5bfcc-d421-44a7-a6dc-da94177db089 req-ed090fea-ccd7-44a6-ab35-537f37209df5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.680141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8df5bfcc-d421-44a7-a6dc-da94177db089 req-ed090fea-ccd7-44a6-ab35-537f37209df5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.727283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8df5bfcc-d421-44a7-a6dc-da94177db089 req-ed090fea-ccd7-44a6-ab35-537f37209df5 service nova] Creating event network-vif-plugged:5ad21d59-c411-4a18-b08d-8d1b240beb29 for instance 421978c4-4f6a-4cec-9c46-518ae92112c3 on n-h1-849796-1 Jul 18 02:25:03.737657 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8df5bfcc-d421-44a7-a6dc-da94177db089 req-ed090fea-ccd7-44a6-ab35-537f37209df5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095001 Jul 18 02:25:03.742673 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1271/2547] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:03.755898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:03.757424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:03.776455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.777416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.778929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:03.779951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:03.978987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:03.993480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a679855c-a27f-429f-a9a8-b3b4bb8c89e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.824045 Jul 18 02:25:03.995213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1277/2548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:03 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:04.002947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45a96412-4988-48a2-9679-a2ce0d8beb88 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update', calling method: .version_select at 0x7fab046d6ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:04.090901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:04.101476 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e5450a6-dea7-4b87-8584-2289900171b6 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 0.355720 Jul 18 02:25:04.103624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1272/2549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:03 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:04.109310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:04.109991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:04.122166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:04.124033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.128502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:04.128822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.129843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.130547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.136591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45a96412-4988-48a2-9679-a2ce0d8beb88 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:04.164433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45a96412-4988-48a2-9679-a2ce0d8beb88 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:04.220796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:04.226916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:04.229658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lazy-loading 'fault' on Instance uuid 1e42816f-af3e-4671-b698-75c92c627aeb {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:04.341797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:04.369203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe040f80-4da2-4ef0-9e30-53df9c227381 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1368 microversion: 2.1 time: 0.264213 Jul 18 02:25:04.378804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1273/2550] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:04 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:04.398003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-652898ae-38c9-4f0b-ab84-a100ae7636a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ed9dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:04.504297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-652898ae-38c9-4f0b-ab84-a100ae7636a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.124505 Jul 18 02:25:04.505865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1274/2551] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:04 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:05.015259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.015986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:05.052295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.059120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.061877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.063586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.304696 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45a96412-4988-48a2-9679-a2ce0d8beb88 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.305902 Jul 18 02:25:05.305944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1278/2552] 10.222.0.67 () {60 vars in 1312 bytes} [Mon Jul 18 02:25:03 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata/os_version => generated 31 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:05.324956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.330108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:05.360818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.362089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.366026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.369153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.649134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.683111 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2af18bb2-d4a3-4bde-a3b4-7be9a3e6f75c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.675064 Jul 18 02:25:05.684339 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1275/2553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:05.703073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87b43be8-5c9d-4f76-8c34-7840fcf84842 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab04dc2940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.767970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:05.784080 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3703db85-8380-4900-8040-9e1ee6d26793 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 0.476177 Jul 18 02:25:05.796962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1279/2554] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:05.804408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.805267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:05.812958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.813438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.814281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.814741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.883941 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87b43be8-5c9d-4f76-8c34-7840fcf84842 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 58 microversion: 2.1 time: 0.197300 Jul 18 02:25:05.884791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1276/2555] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 58 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:05.916278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-400cb754-f761-4529-9eb2-f834438579fd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04da3af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:05.918827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:05.920742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:05.921266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lazy-loading 'fault' on Instance uuid 1e42816f-af3e-4671-b698-75c92c627aeb {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:06.042076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-400cb754-f761-4529-9eb2-f834438579fd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.155768 Jul 18 02:25:06.044026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1277/2556] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:06.051194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e831ab9-68b9-4669-ac26-f6404f0f2786 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'update_all', calling method: .version_select at 0x7fab04eba700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:06.139938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c24789267bf404a841b414eb1019d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3023a58217a649d28186813b61d4afbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:06.152301 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a1409c8-e694-4634-8bd2-2877501bf9fb tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 200 len: 1368 microversion: 2.1 time: 0.354027 Jul 18 02:25:06.154403 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1280/2557] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:05 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:06.179663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4e831ab9-68b9-4669-ac26-f6404f0f2786 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:06.192427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4e831ab9-68b9-4669-ac26-f6404f0f2786 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:06.701409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:06.702104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:06.718663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:06.719124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:06.726410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:06.727340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.164648 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e831ab9-68b9-4669-ac26-f6404f0f2786 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 61 microversion: 2.1 time: 1.116833 Jul 18 02:25:07.165799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1278/2558] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:25:06 2022] PUT /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 61 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:07.185011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:07.194440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:07.287123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:07.288959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.299625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:07.301795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:07.412502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:07.425488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e665bee-8b52-483c-80b4-d78bfb55530d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.725940 Jul 18 02:25:07.433599 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1281/2559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:06 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:07.439394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-216bb961-1e55-4ab0-b06c-ac0157cd84c7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0556e8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:07.543396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-216bb961-1e55-4ab0-b06c-ac0157cd84c7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.108359 Jul 18 02:25:07.544748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1282/2560] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:07 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:07.560859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17033fd8-1f03-4093-af41-4ab441604908 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Action: 'create', calling method: .version_select at 0x7fab045ce0d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:07.634798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:07.654042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-17033fd8-1f03-4093-af41-4ab441604908 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:07.667065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-17033fd8-1f03-4093-af41-4ab441604908 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Getting quotas for user 605926da76f14dc7a68af229168fd243 and project 4d82f1546ba148edbc89917960696c96. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:08.155075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:08.182808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f07094a9-339d-4942-9b42-7e11787caf47 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 1.014661 Jul 18 02:25:08.198580 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1279/2561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:07 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:08.207061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.208840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] [instance: 1e42816f-af3e-4671-b698-75c92c627aeb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:08.234182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.252335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.259897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.271621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.403360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] HTTP exception thrown: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Request method failure captured: Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb HTTP/1.1 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MPdKJoG61mrpyVoNAavMVLDdNTwRoNAJNZ51hpue1ZXE7CxzXVdICDXjVFZ4h3S_qyyV7wW9giAdTyqKf9CP3F__UvxTwrjkFNg97MVj021J2bgrB6RqcDbwkJUCfY_gk58vO9SLTog6GJgc8IAhuw_3pg9_dGLUe9t6hu8gtfB8Vg Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 3023a58217a649d28186813b61d4afbf Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestManualDisk-146488538 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3023a58217a649d28186813b61d4afbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3023a58217a649d28186813b61d4afbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3023a58217a649d28186813b61d4afbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3023a58217a649d28186813b61d4afbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestManualDisk-146488538 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 3023a58217a649d28186813b61d4afbf Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestManualDisk-146488538 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestManualDisk-146488538-project Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 4c24789267bf404a841b414eb1019d97 Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestManualDisk-146488538-project Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1e42816f-af3e-4671-b698-75c92c627aeb'} Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:08.407823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:08.419222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Returning 404 to user: Instance 1e42816f-af3e-4671-b698-75c92c627aeb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:08.424974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f9ecfaa4-9314-4a9e-855b-0cad6da38f3f tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb" status: 404 len: 111 microversion: 2.1 time: 0.224077 Jul 18 02:25:08.426808 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1280/2562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:08 2022] GET /compute/v2.1/servers/1e42816f-af3e-4671-b698-75c92c627aeb => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:08.467413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6095f053-d40b-46c2-b579-e350d3c8e9e6 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] Calling method '.version_select at 0x7fab04da3c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.469226 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17033fd8-1f03-4093-af41-4ab441604908 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "POST /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 85 microversion: 2.1 time: 0.922958 Jul 18 02:25:08.470206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1283/2563] 10.222.0.67 () {60 vars in 1280 bytes} [Mon Jul 18 02:25:07 2022] POST /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 85 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:08.483320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.483974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:08.500746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.501442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.502111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:08.502652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:08.524261 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6095f053-d40b-46c2-b579-e350d3c8e9e6 tempest-ServersTestManualDisk-146488538 tempest-ServersTestManualDisk-146488538-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153864603" status: 202 len: 0 microversion: 2.1 time: 0.088769 Jul 18 02:25:08.526588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1281/2564] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153864603 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:08.543398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bb92af0-1c43-4b82-af80-1344434b5bf5 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] Calling method '.version_select at 0x7fab04eb4310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:08.693816 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bb92af0-1c43-4b82-af80-1344434b5bf5 tempest-ImagesMetadataTestJSON-2057135424 tempest-ImagesMetadataTestJSON-2057135424-project] 10.222.0.67 "GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata" status: 200 len: 85 microversion: 2.1 time: 0.156210 Jul 18 02:25:08.699258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1282/2565] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:25:08 2022] GET /compute/v2.1/images/cae64a0a-74c9-422e-88c9-90b7d5a17540/metadata => generated 85 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:08.752561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c807227-eb59-425d-b11f-ecffd4c84f86 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04dc2430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:09.575957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c807227-eb59-425d-b11f-ecffd4c84f86 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.870320 Jul 18 02:25:09.577110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1283/2566] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:08 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:09.620434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:09.623679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3e2fe2eb-dc20-45a4-bb18-4eecef207659 req-fc525b52-4a89-4b42-a87a-570088a7b48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9162d-74a6-438e-b3c2-3122081c0727", "name": "network-vif-plugged", "status": "completed", "tag": "e359219b-8526-422e-bf4d-57ebf5a5bddb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:09.681178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3e2fe2eb-dc20-45a4-bb18-4eecef207659 req-fc525b52-4a89-4b42-a87a-570088a7b48c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.681961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3e2fe2eb-dc20-45a4-bb18-4eecef207659 req-fc525b52-4a89-4b42-a87a-570088a7b48c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.682287 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94153a42-55cf-4c07-82f0-53aa616990d3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 1.201731 Jul 18 02:25:09.684716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1284/2567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:08 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:09.720309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:09.722171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:09.743960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.745516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.748692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:09.750169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:09.780186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3e2fe2eb-dc20-45a4-bb18-4eecef207659 req-fc525b52-4a89-4b42-a87a-570088a7b48c service nova] Creating event network-vif-plugged:e359219b-8526-422e-bf4d-57ebf5a5bddb for instance 66e9162d-74a6-438e-b3c2-3122081c0727 on n-h1-849796-1 Jul 18 02:25:09.809185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3e2fe2eb-dc20-45a4-bb18-4eecef207659 req-fc525b52-4a89-4b42-a87a-570088a7b48c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214544 Jul 18 02:25:09.811171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1284/2568] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:10.424028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:10.450770 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20d8a48e-5e05-4adb-a3f4-450dd33341ad tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1474 microversion: 2.1 time: 0.746664 Jul 18 02:25:10.461135 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1285/2569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:09 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1474 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:10.615171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1e88715-dd99-48a7-9e2d-19a66ad8f4c3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04e8bb80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:10.716012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:10.719161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:10.733981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:10.735321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:10.738562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:10.740241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:10.779821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1e88715-dd99-48a7-9e2d-19a66ad8f4c3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.189249 Jul 18 02:25:10.782169 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1285/2570] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:10 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:10.852898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e8f5ec7b-02de-43ba-a05e-a8c4f48b492d req-6cc662a8-ae18-40be-a0eb-69ffcd201b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161cf64-9330-4f34-b62b-dc880be3d5c7", "name": "network-vif-deleted", "tag": "95134936-f1fa-4a40-a8a5-83c4413ed2f4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:10.890306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e8f5ec7b-02de-43ba-a05e-a8c4f48b492d req-6cc662a8-ae18-40be-a0eb-69ffcd201b11 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:10.890813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e8f5ec7b-02de-43ba-a05e-a8c4f48b492d req-6cc662a8-ae18-40be-a0eb-69ffcd201b11 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:10.936203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e8f5ec7b-02de-43ba-a05e-a8c4f48b492d req-6cc662a8-ae18-40be-a0eb-69ffcd201b11 service nova] Creating event network-vif-deleted:95134936-f1fa-4a40-a8a5-83c4413ed2f4 for instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 on n-h2-849796-1 Jul 18 02:25:10.959602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e8f5ec7b-02de-43ba-a05e-a8c4f48b492d req-6cc662a8-ae18-40be-a0eb-69ffcd201b11 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113080 Jul 18 02:25:10.973386 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1286/2571] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:11.474446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:11.475776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:11.506634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.507448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.526303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.527160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.627973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:11.639372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.640171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.641063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lazy-loading 'fault' on Instance uuid 5161cf64-9330-4f34-b62b-dc880be3d5c7 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:11.667811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-615812f9-a589-44cc-ac8e-f49b1d56159f tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.956115 Jul 18 02:25:11.690938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1286/2572] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:10 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:11.803287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37577af8-2611-47a2-b306-de3ed38277da tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04561ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:11.846668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d10a19e6a34995bc1187088e72a1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637a50800bab433ebff8bcc586b0b5bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:11.874370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abcf1cfc-2430-41de-8fb1-49a38b69b114 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 200 len: 1308 microversion: 2.1 time: 0.408429 Jul 18 02:25:11.875008 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1287/2573] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:11 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:11.898662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea84787b-d65f-4917-b906-667f533ca43e", "name": "network-vif-plugged", "status": "completed", "tag": "39dc1b7a-51ad-4334-aa96-912f86a4e511"}, {"server_uuid": "aacac7dc-23af-4f15-b620-940136961b1d", "name": "network-vif-plugged", "status": "completed", "tag": "5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:11.927659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:11.928428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:11.939884 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37577af8-2611-47a2-b306-de3ed38277da tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.144138 Jul 18 02:25:11.949420 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1287/2574] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:11 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:11.980280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] Creating event network-vif-plugged:39dc1b7a-51ad-4334-aa96-912f86a4e511 for instance ea84787b-d65f-4917-b906-667f533ca43e on n-h2-849796-1 Jul 18 02:25:11.982926 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] Creating event network-vif-plugged:5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5 for instance aacac7dc-23af-4f15-b620-940136961b1d on n-h2-849796-1 Jul 18 02:25:12.005402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3acae95c-c72d-4448-8158-b15c521b15a3 req-79db9df7-7f4f-46ec-abb1-bbc2838384d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117161 Jul 18 02:25:12.007007 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1288/2575] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:12.728201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:12.730635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:12.753955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.754825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.756813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.768698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.894308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:12.896489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] [instance: 5161cf64-9330-4f34-b62b-dc880be3d5c7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:12.912292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.919842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.924263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:12.925000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:12.960183 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] HTTP exception thrown: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Request method failure captured: Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 HTTP/1.1 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MObSMZ1-r0WI3RzJewDokVR23wxRgBCP2Zeya0mtwZzptNTzmMXMnL0yHr34bDEOvNHa4ZzaefTvcTk2jhepEsWTe_GRFJXzqVrkPiinw1pDwZPhGfXz5B6oa2tAhj09fJxQyKIl1KxWh8fR_pxkZHcG-brB3A-ka5yzsd1Fkdeq6k Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 637a50800bab433ebff8bcc586b0b5bd Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/637a50800bab433ebff8bcc586b0b5bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 637a50800bab433ebff8bcc586b0b5bd Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-721890551 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListImageFiltersTestJSON-721890551-project Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 55d10a19e6a34995bc1187088e72a1f9 Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListImageFiltersTestJSON-721890551-project Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5161cf64-9330-4f34-b62b-dc880be3d5c7'} Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:12.962309 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. Jul 18 02:25:12.966454 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:12.970807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Returning 404 to user: Instance 5161cf64-9330-4f34-b62b-dc880be3d5c7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:12.971973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4651904-c45e-4c65-9463-727049d897f3 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7" status: 404 len: 111 microversion: 2.1 time: 0.082538 Jul 18 02:25:12.992988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1289/2576] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:12 2022] GET /compute/v2.1/servers/5161cf64-9330-4f34-b62b-dc880be3d5c7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:12.998553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfe760c6-9c82-49a3-878d-6d57d7cb260a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04e1e940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:13.171511 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfe760c6-9c82-49a3-878d-6d57d7cb260a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.177011 Jul 18 02:25:13.172516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1290/2577] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:12 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:13.180351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00859fe8-9a08-4a11-95af-5421dd672856 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04d73040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:13.288678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:13.304435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-08851868-5a7e-4e5d-b7f2-a4d8407cc533 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.583397 Jul 18 02:25:13.305430 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1288/2578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:12 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:14.192845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-532f917e-93eb-4866-8864-89518bfc1630 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04a6c8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:14.294618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00859fe8-9a08-4a11-95af-5421dd672856 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac" status: 204 len: 0 microversion: 2.1 time: 1.120171 Jul 18 02:25:14.296366 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1291/2579] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:13 2022] DELETE /compute/v2.1/images/a8645d63-62a5-42ec-ab1a-629b52b471ac => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:14.316395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ec47332-3772-4d44-84c5-cdaa9a1900ab tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04d71310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:15.530418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ec47332-3772-4d44-84c5-cdaa9a1900ab tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423" status: 204 len: 0 microversion: 2.1 time: 1.227691 Jul 18 02:25:15.536729 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1292/2580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:14 2022] DELETE /compute/v2.1/images/a6510757-47c3-4876-a81d-b5fbb4dfe423 => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:25:15.538107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:15.538674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:15.580209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-532f917e-93eb-4866-8864-89518bfc1630 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 1.395008 Jul 18 02:25:15.589827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:15.590128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1289/2581] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:14 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:15.590257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:15.597388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:15.598007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.134160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:16.168638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1178a674-d822-4880-a0bf-c3fc33712235"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:16.175645 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9de5aa92-2734-4d59-9e2b-7e1a0467924b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1323 microversion: 2.1 time: 0.642911 Jul 18 02:25:16.180451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:16.190953 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1293/2582] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:15 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:16.207731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.219795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5bab37de-b71b-45ab-a250-6fa8d72ada98 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] Calling method '.version_select at 0x7fab04dc6040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:16.220684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.230309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:16.231663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:16.260775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=24 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:16.261967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:16.541139 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] HTTP exception thrown: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Request method failure captured: Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments/4a996539-4464-4289-b650-f6e2f2c22c55 HTTP/1.1 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 74 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MPd8jqMDUbvPciCZsB-RtjYbXfSbqZT6NNYY-KEyhwMeaGhr0gcXVjV-JiYTdwkXCsz9BluTg2BEN9IB-NgqbJiUBpHECA5SxkJNSMvFycVMDzMnN3LkLLLoMvKlX7gU8Oc-qNzV2CiHNQwvncwbN1L5s5JrSYqB51hPePeb4hmhc8 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dd216ac16983485a8f68ab19f5c51bcc Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dd216ac16983485a8f68ab19f5c51bcc Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesAdminNegativeTest-1225538729-project-admin Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0490e8c70a5a46029b61427813027c35 Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesAdminNegativeTest-1225538729-project-admin Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: {"volumeAttachment": {"volumeId": "1178a674-d822-4880-a0bf-c3fc33712235"}} Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: exception: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': '814984c0-2fe5-453e-aa2c-e595972987ed', 'id': '4a996539-4464-4289-b650-f6e2f2c22c55', 'body': {'volumeAttachment': {'volumeId': '1178a674-d822-4880-a0bf-c3fc33712235'}}} Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. (HTTP 404) (Request-ID: req-eba784e7-4035-4324-9157-44a710586b8a) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:25:16.597987 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:16.612727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Returning 400 to user: Volume 1178a674-d822-4880-a0bf-c3fc33712235 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:16.623820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52d2a114-87db-4b3a-a824-4d3241b9bc30 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments/4a996539-4464-4289-b650-f6e2f2c22c55" status: 400 len: 107 microversion: 2.1 time: 1.026277 Jul 18 02:25:16.626099 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1290/2583] 10.222.0.67 () {60 vars in 1432 bytes} [Mon Jul 18 02:25:15 2022] PUT /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments/4a996539-4464-4289-b650-f6e2f2c22c55 => generated 107 bytes in 1041 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:16.655707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fcb70eb0-1de2-4f6d-82f6-80fadc1af6ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab046d6e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:17.251238 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5bab37de-b71b-45ab-a250-6fa8d72ada98 tempest-ListImageFiltersTestJSON-721890551 tempest-ListImageFiltersTestJSON-721890551-project] 10.222.0.67 "DELETE /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3" status: 204 len: 0 microversion: 2.1 time: 1.058051 Jul 18 02:25:17.252712 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1294/2584] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:16 2022] DELETE /compute/v2.1/images/8d2cbed6-8de3-4337-8fad-3d5d8f7fdbd3 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:17.259958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:17.261746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:17.280329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.283268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.285832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.288323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.388692 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fcb70eb0-1de2-4f6d-82f6-80fadc1af6ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.759057 Jul 18 02:25:17.390604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1291/2585] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:16 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:17.407398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:17.408218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:17.424639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.425986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.427465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:17.427937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:17.684711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=7 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:18.253145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lazy-loading 'services' on Instance uuid 814984c0-2fe5-453e-aa2c-e595972987ed {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:25:18.514308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21aeaf75-cdb2-410e-940d-89a163144f69 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "DELETE /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments/4a996539-4464-4289-b650-f6e2f2c22c55" status: 202 len: 0 microversion: 2.1 time: 1.259269 Jul 18 02:25:18.516809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1295/2586] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:25:17 2022] DELETE /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments/4a996539-4464-4289-b650-f6e2f2c22c55 => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:25:18.524152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6840607-f887-4c88-b219-9ba8abdd7f74 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ea2af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:18.684914 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6840607-f887-4c88-b219-9ba8abdd7f74 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.166160 Jul 18 02:25:18.686623 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1296/2587] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:18 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:18.701936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:18.703565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:18.743746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:18.744331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:18.745367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:18.746070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:18.792568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a9b918a-8417-44de-bbd2-37d6be691fe3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103100 Jul 18 02:25:18.793920 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1297/2588] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:18 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:19.278026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:19.291699 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44dc8168-8628-4452-b1a0-cb0621488949 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 200 len: 1515 microversion: 2.1 time: 1.898121 Jul 18 02:25:19.296964 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1292/2589] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:17 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 1515 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:19.322708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.324232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:19.336352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.344480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.345559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.346269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.704610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ab4f7ee-d3d9-49c7-b111-a45177a5cdef tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f78550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.848707 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ab4f7ee-d3d9-49c7-b111-a45177a5cdef tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.147780 Jul 18 02:25:19.849774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1293/2590] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:19.874147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:19.875230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:19.926588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.929176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:19.930067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:19.936115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:20.039166 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2c3c691-d11f-48b7-8cde-7daa742e8b58 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186354 Jul 18 02:25:20.045755 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1294/2591] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:20.893891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7b6028c-eb0f-49f2-8c1f-a1d8bba03d7b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab055c1940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:21.023394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:21.055803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b0a5d30-7d72-45e8-bd0d-d32d7bfba5f1 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 200 len: 1516 microversion: 2.1 time: 1.732735 Jul 18 02:25:21.057253 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1298/2592] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:19 2022] GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 1516 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:21.067850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:21.070305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:21.078498 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7b6028c-eb0f-49f2-8c1f-a1d8bba03d7b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.216009 Jul 18 02:25:21.079250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1295/2593] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:20 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:21.084481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.085234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:21.087499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.088532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:21.094729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:21.095376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:21.135422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:21.149860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.156068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:21.160337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:21.160587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16380898-5249-407e-a848-78dec15b8abf tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100967 Jul 18 02:25:21.168421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1299/2594] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:21 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:21.169687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.096184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a877c222-ef0e-4912-8d65-51721866ade7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ea5f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:22.139009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:22.152868 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2c2f07b-39c6-462d-be3d-fc98ed9494cd tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 200 len: 1515 microversion: 2.1 time: 1.060840 Jul 18 02:25:22.155603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1296/2595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:21 2022] GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 1515 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:22.180445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:22.182700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:22.208584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a877c222-ef0e-4912-8d65-51721866ade7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.115632 Jul 18 02:25:22.219177 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1300/2596] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:22 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:22.248212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:22.249957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:22.259941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.261087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.262245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.262934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.289600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.290115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.296337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.296851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.383784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42984095-353d-4608-a38c-1f931521cc18 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160593 Jul 18 02:25:22.384739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1301/2597] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:22 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:22.407170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:22.839679 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5cd5f5fe-1da4-496a-92e3-ea5db8dc4d71 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 204 len: 0 microversion: 2.1 time: 0.666469 Jul 18 02:25:22.847071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1297/2598] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:22 2022] DELETE /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:22.855773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:22.856348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:22.876834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.877352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:22.878205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:22.878661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.227602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96c28a90-9351-4cad-a1fe-a6bb663324a8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04561ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:23.354457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96c28a90-9351-4cad-a1fe-a6bb663324a8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.131228 Jul 18 02:25:23.356900 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1298/2599] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:23 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:23.401780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:23.404284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:23.426176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.428738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.430187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:23.434347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:23.528082 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5a7f8d1-312b-42f7-ba91-cbccfe36e8c0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130559 Jul 18 02:25:23.529097 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1299/2600] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:23 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:23.628640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:23.639403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dae83545-cd2f-40cb-8d00-f7818edfd066 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 200 len: 1521 microversion: 2.1 time: 0.787702 Jul 18 02:25:23.640024 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1302/2601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:22 2022] GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:24.372711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b473be0c-445c-444d-a893-6d641f042e3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab045a91f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:24.463856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b473be0c-445c-444d-a893-6d641f042e3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.097976 Jul 18 02:25:24.474133 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1300/2602] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:24 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:24.547972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:24.550820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:24.589854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.591064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.592649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.596664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.661939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:24.670589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:24.734057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.734940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.736295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:24.737125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:24.814947 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-995d7ac1-e34c-46ff-9914-016bd12d69a0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274704 Jul 18 02:25:24.819075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1303/2603] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:24 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:25.480421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7584d23f-330d-4f50-8e9c-ad6a02e1ec5a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f5aee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:25.571626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7584d23f-330d-4f50-8e9c-ad6a02e1ec5a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.096408 Jul 18 02:25:25.578936 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1304/2604] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:25 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:25.830791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:25.831824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:25.871809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:25.874443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:25.875947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:25.876830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:25.962762 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40105834-7567-4c05-9e9c-a0d5a412cf8d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136419 Jul 18 02:25:25.963403 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1305/2605] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:25 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:25:26.401229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-79230f8a-fd03-45b7-a8a4-0082b7cbb537 req-76f39321-0adb-42fc-a6aa-9e3347373e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea84787b-d65f-4917-b906-667f533ca43e", "name": "network-vif-deleted", "tag": "39dc1b7a-51ad-4334-aa96-912f86a4e511"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:26.451659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-79230f8a-fd03-45b7-a8a4-0082b7cbb537 req-76f39321-0adb-42fc-a6aa-9e3347373e38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.455669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-79230f8a-fd03-45b7-a8a4-0082b7cbb537 req-76f39321-0adb-42fc-a6aa-9e3347373e38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.535742 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-79230f8a-fd03-45b7-a8a4-0082b7cbb537 req-76f39321-0adb-42fc-a6aa-9e3347373e38 service nova] Creating event network-vif-deleted:39dc1b7a-51ad-4334-aa96-912f86a4e511 for instance ea84787b-d65f-4917-b906-667f533ca43e on n-h2-849796-1 Jul 18 02:25:26.549337 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-79230f8a-fd03-45b7-a8a4-0082b7cbb537 req-76f39321-0adb-42fc-a6aa-9e3347373e38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150626 Jul 18 02:25:26.551020 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1306/2606] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:26.588015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:26.589205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cc316e08-d4da-480c-b6a9-478ecfcd0881 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f5aa60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:26.607946 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb8ceb5c-1387-4294-94e0-1d645bfec4ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 200 len: 1521 microversion: 2.1 time: 1.953878 Jul 18 02:25:26.617162 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1301/2607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:24 2022] GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 1521 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:26.795773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cc316e08-d4da-480c-b6a9-478ecfcd0881 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.213144 Jul 18 02:25:26.797627 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1307/2608] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:26 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:26.976406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:26.977769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:26.993042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.994035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:26.996672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:26.998311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.093347 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3982825c-dc0a-42b1-8acd-c7ecf1eb3068 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122327 Jul 18 02:25:27.101472 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1302/2609] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:26 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:27.632518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:27.633586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:27.654930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.656726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.659573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.661853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.711867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] HTTP exception thrown: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e HTTP/1.1 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ea84787b-d65f-4917-b906-667f533ca43e'} Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:27.713844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 404 to user: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:27.717739 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5fa7c00-29f2-4e32-807a-ddb8f9b5f400 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 404 len: 111 microversion: 2.1 time: 0.091701 Jul 18 02:25:27.723947 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1308/2610] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:27 2022] GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:27.730348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:27.736020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:27.739675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:27.755296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.757211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.762581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:27.763476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:27.811959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d460834c-019e-49c3-8475-f0bcf640394a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f5a700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:27.978877 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d460834c-019e-49c3-8475-f0bcf640394a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.171464 Jul 18 02:25:27.986011 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1309/2611] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:27 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:28.029695 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-18f437f2-79b8-4e6f-856c-18d1f814553d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.303482 Jul 18 02:25:28.031302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1303/2612] 10.222.0.67 () {58 vars in 1229 bytes} [Mon Jul 18 02:25:27 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:25:28.044878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-798bb368-eab1-4f3c-be9a-4f52f13b0963 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-798bb368-eab1-4f3c-be9a-4f52f13b0963 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:25:28.058588 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-798bb368-eab1-4f3c-be9a-4f52f13b0963 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-798bb368-eab1-4f3c-be9a-4f52f13b0963 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025780 Jul 18 02:25:28.073715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1310/2613] 10.222.0.67 () {58 vars in 1181 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:28.086837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.097765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:28.106484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.107454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:28.109518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:28.137128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.137640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.138506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.139436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.140550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.142482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.143657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.146131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.241622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:28.304190 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-618c88db-4c1a-495f-bbe2-c701693a877b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200245 Jul 18 02:25:28.316869 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4e8291e-e15e-4c22-b9ab-59350802a9e0 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.238685 Jul 18 02:25:28.326179 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1311/2614] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:28.327535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1304/2615] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers => generated 683 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:28.342983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.360370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:28.361366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.servers [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Removing options 'limit' from query {{(pid=119439) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:25:28.374027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:28.385503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.390191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.392023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.397248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.525769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:28.618208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f67e0a2-5014-4190-a29b-01940d04a75d tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.282641 Jul 18 02:25:28.628475 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1312/2616] 10.222.0.67 () {58 vars in 1143 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:28.633348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be5420fd-a728-47d8-a7cd-76f1d42362d2 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be5420fd-a728-47d8-a7cd-76f1d42362d2 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: action_args: {} Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi '-1' Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:25:28.636794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be5420fd-a728-47d8-a7cd-76f1d42362d2 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be5420fd-a728-47d8-a7cd-76f1d42362d2 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009398 Jul 18 02:25:28.644417 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1305/2617] 10.222.0.67 () {58 vars in 1141 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:28.657595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e237e08-6c99-4b88-9ed0-eb0dead589f9 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e237e08-6c99-4b88-9ed0-eb0dead589f9 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: action_args: {} Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'testing' Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 18 02:25:28.676432 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e237e08-6c99-4b88-9ed0-eb0dead589f9 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:28.682498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e237e08-6c99-4b88-9ed0-eb0dead589f9 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.035535 Jul 18 02:25:28.691297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1313/2618] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:25:28.702483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-761fa7aa-35eb-469b-9b1e-2508ec4045e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.707363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-761fa7aa-35eb-469b-9b1e-2508ec4045e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:28.712522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-761fa7aa-35eb-469b-9b1e-2508ec4045e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:28.759873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.servers [None req-761fa7aa-35eb-469b-9b1e-2508ec4045e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Flavor 'non_existing_flavor' could not be found {{(pid=119440) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 18 02:25:28.765697 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-761fa7aa-35eb-469b-9b1e-2508ec4045e7 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.067770 Jul 18 02:25:28.774724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1306/2619] 10.222.0.67 () {58 vars in 1177 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:28.788294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:28.809405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:28.823222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:28.850316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.854381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.856117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:28.863521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:28.995125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-368945b8-e359-44fc-af5e-796c895326f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05b38b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.113306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-368945b8-e359-44fc-af5e-796c895326f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.122080 Jul 18 02:25:29.115455 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1307/2620] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:29.258709 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f903ad59-a0a2-434f-a3c2-c1bccdef6b0c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.483299 Jul 18 02:25:29.268340 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1314/2621] 10.222.0.67 () {58 vars in 1173 bytes} [Mon Jul 18 02:25:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:29.279957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.284127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:29.284830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:29.311940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.313264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.315530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.326704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.335504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.337678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:29.376017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.376383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.382965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.383610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.524125 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-703c9379-5b53-4575-9819-ae3bb311c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195861 Jul 18 02:25:29.528847 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1315/2622] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:29 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:29.644897 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-187dd344-9de3-4bb3-a94a-2f6f2a570e40 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.372399 Jul 18 02:25:29.651861 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1308/2623] 10.222.0.67 () {58 vars in 1183 bytes} [Mon Jul 18 02:25:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:29.663780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:29.672188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:29.674918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:29.695203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.696029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.699900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:29.700902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:29.841620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:30.105190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.130761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa3947b3-9c9b-448c-87f1-709f4e533cbe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043e8160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:30.131474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.132254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.243743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa3947b3-9c9b-448c-87f1-709f4e533cbe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.118497 Jul 18 02:25:30.245752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1309/2624] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:30 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:30.549056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:30.550697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:30.588454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.590220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.592195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.601907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.748860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10b23a18-7f29-4a36-9ac0-dc5ca8f26ea1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212100 Jul 18 02:25:30.751723 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1310/2625] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:30 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:30.837559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3a7d79a-eba8-4c65-b164-fa81b17edff3 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.179852 Jul 18 02:25:30.838789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1316/2626] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:25:29 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:30.878984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-369e9c91-c146-4a45-a415-3fb1322ff011 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:30.883137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-369e9c91-c146-4a45-a415-3fb1322ff011 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.884206 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-369e9c91-c146-4a45-a415-3fb1322ff011 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011305 Jul 18 02:25:30.894625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1311/2627] 10.222.0.67 () {58 vars in 1177 bytes} [Mon Jul 18 02:25:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:30.905365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:30.925634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:30.928622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Searching by: {'deleted': False, 'project_id': '662600ddb33b4a3aa08050ac741097e4'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:25:30.960826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.962106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:30.963935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:30.977214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.076038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:25:31.203483 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b180eb27-bd0a-40ad-b657-bd7b448fcd23 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.305880 Jul 18 02:25:31.210056 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1317/2628] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:25:30 2022] GET /compute/v2.1/servers => generated 683 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:31.231044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.233142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:31.275732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fd5ec69-d3e1-4149-9d78-3030018d97d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ea54c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.287892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.295284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.297419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.309131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.380254 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] HTTP exception thrown: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e HTTP/1.1 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ea84787b-d65f-4917-b906-667f533ca43e'} Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:31.388584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:31.395001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:31.399118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 404 to user: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:31.408553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ec3d7f7-2c1b-411b-8335-bc44a9bd4735 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 404 len: 111 microversion: 2.1 time: 0.182696 Jul 18 02:25:31.410491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1312/2629] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:31 2022] DELETE /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:31.485157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fd5ec69-d3e1-4149-9d78-3030018d97d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.228730 Jul 18 02:25:31.485994 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1318/2630] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:31 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:31.502144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.506838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:31.530572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.532317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.538032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.541624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.649711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:31.899525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a802fa3-cf3c-4fc6-bc78-13c6b751890a tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 204 len: 0 microversion: 2.1 time: 0.412045 Jul 18 02:25:31.906650 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1319/2631] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:31 2022] DELETE /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:31.928910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.930100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:31.967492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.967986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:31.978166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a47014c-4533-4e5e-b382-d0b5c9158648 tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] Calling method '.version_select at 0x7fab0459d700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:31.979116 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:25:31.979116 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:25:31.993089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:31.993949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.017703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a47014c-4533-4e5e-b382-d0b5c9158648 tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.604334 Jul 18 02:25:32.025699 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1313/2632] 10.222.0.67 () {60 vars in 1225 bytes} [Mon Jul 18 02:25:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:25:32.032325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:32.033208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:32.043394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.044227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.045498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.046089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.097326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-adee84ab-d0cd-4062-bf80-f9c4c11e2234 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188715 Jul 18 02:25:32.101764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1320/2633] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:31 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:32.108367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa46fb5e-d72a-408c-a304-2e1f36ab3849 tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] Action: 'update', calling method: .version_select at 0x7fab04e054c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:32.112429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:32.118532 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:25:32.118532 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:25:32.385281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:32.406752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5d12128-e9d5-4e4b-92eb-1973e6a269ae tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 204 len: 0 microversion: 2.1 time: 0.376664 Jul 18 02:25:32.406752 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1314/2634] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:32 2022] DELETE /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:32.431538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:32.431538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: ea84787b-d65f-4917-b906-667f533ca43e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:32.435133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa46fb5e-d72a-408c-a304-2e1f36ab3849 tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.326054 Jul 18 02:25:32.443324 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1321/2635] 10.222.0.67 () {62 vars in 1246 bytes} [Mon Jul 18 02:25:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:25:32.452354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.453025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.454145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.457248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.530254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13e43fcb-6618-43ec-a81b-8ae71886aa5d tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] Calling method '.version_select at 0x7fab04dc65e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:32.533929 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:25:32.533929 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:25:32.552343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] HTTP exception thrown: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e HTTP/1.1 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ea84787b-d65f-4917-b906-667f533ca43e'} Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:32.555813 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. Jul 18 02:25:32.560802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:32.580078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 404 to user: Instance ea84787b-d65f-4917-b906-667f533ca43e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:32.581022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46dcd61f-32be-4137-aec3-2c3c40c2e38e tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e" status: 404 len: 111 microversion: 2.1 time: 0.168201 Jul 18 02:25:32.586675 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1315/2636] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:32 2022] GET /compute/v2.1/servers/ea84787b-d65f-4917-b906-667f533ca43e => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:32.607159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13e43fcb-6618-43ec-a81b-8ae71886aa5d tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.160341 Jul 18 02:25:32.608944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4cb72419-3748-49f1-bee5-ab4806f29545 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05297af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:32.610111 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1322/2637] 10.222.0.67 () {60 vars in 1225 bytes} [Mon Jul 18 02:25:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:25:32.647059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:32.649009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:32.656872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.657520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.658454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:32.659502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:32.795817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4cb72419-3748-49f1-bee5-ab4806f29545 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.207417 Jul 18 02:25:32.809417 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1316/2638] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:32 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:32.825639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36833047-3ee0-465e-a2e7-1d6329252aab tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] Action: 'update', calling method: .version_select at 0x7fab045cea60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:32.830930 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:25:32.830930 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:25:33.128222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36833047-3ee0-465e-a2e7-1d6329252aab tempest-QuotaClassesAdmin257Test-1885382183 tempest-QuotaClassesAdmin257Test-1885382183-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.314671 Jul 18 02:25:33.130492 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1317/2639] 10.222.0.67 () {62 vars in 1246 bytes} [Mon Jul 18 02:25:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:25:33.188835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:33.190001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:33.202189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:33.204555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:33.215232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:33.219047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:33.219917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:33.220389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:33.222505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee9798b5-cb1a-407f-800d-c5897958f8aa tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 200 len: 1522 microversion: 2.1 time: 0.608380 Jul 18 02:25:33.237924 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1323/2640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:32 2022] GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:33.329033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc9062ef-7792-4777-98b3-6c55159d34d1 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196191 Jul 18 02:25:33.342024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1318/2641] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:33 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:33.821173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aba9b821-95fd-4641-9e92-c646d9e7a80b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f5a5e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:33.956088 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aba9b821-95fd-4641-9e92-c646d9e7a80b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1412 microversion: 2.1 time: 0.145434 Jul 18 02:25:33.956995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1324/2642] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:33 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:34.274188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:34.274824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:34.293721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.294516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:34.295536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.296169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:34.351248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:34.358571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:34.360072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:34.386094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.389543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:34.391138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:34.397735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:34.610440 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9553ecf3-9f18-4658-b606-132447c555fb tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245943 Jul 18 02:25:34.615865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1325/2643] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:34 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:34.976058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-99144287-9c82-419f-a977-ef6729d0c7cc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ea2700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:35.079819 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-99144287-9c82-419f-a977-ef6729d0c7cc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1421 microversion: 2.1 time: 0.111074 Jul 18 02:25:35.087564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1326/2644] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:34 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:35.101305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59959989-d6e4-40d3-a180-c05ed37f160b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f6aca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:35.196502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59959989-d6e4-40d3-a180-c05ed37f160b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 200 len: 1421 microversion: 2.1 time: 0.101036 Jul 18 02:25:35.199202 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1327/2645] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:25:35 2022] GET /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:35.221109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1b5d8dc-9897-42d8-8e2f-a038f6f76afa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f6a430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:35.514321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:35.533451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4117d3cc-12ca-4b40-9656-e220b93b706c tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 200 len: 1522 microversion: 2.1 time: 1.263558 Jul 18 02:25:35.538468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1319/2646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:34 2022] GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 1522 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:35.632424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:35.641454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:35.687300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:35.693519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:35.698014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:35.698794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:35.879996 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a47c39f-a8aa-4be4-a802-c3f4bb2ab830 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.254316 Jul 18 02:25:35.884507 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1320/2647] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:25:35 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed/os-volume_attachments => generated 25 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:25:36.345321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-663307330", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "1cccc682-bf56-4dff-bce1-ac6b2eb9b4ff"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:36.496630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] validate_networks() for [('1cccc682-bf56-4dff-bce1-ac6b2eb9b4ff', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:25:37.092661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1b5d8dc-9897-42d8-8e2f-a038f6f76afa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 204 len: 0 microversion: 2.1 time: 1.880431 Jul 18 02:25:37.093504 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1328/2648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:35 2022] DELETE /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 0 bytes in 1885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:37.110326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:37.149079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:37.176694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:37.177611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:37.181267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:37.186033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:38.526342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe46e2756309434c8ce234fe2d19071e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662600ddb33b4a3aa08050ac741097e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:38.544889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ed62bc3-4fae-463f-b55c-9d6e88de082b tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 200 len: 1480 microversion: 2.1 time: 1.450438 Jul 18 02:25:38.555947 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1329/2649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:37 2022] GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 1480 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:38.565635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:38.567675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:38.588527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:38.590952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:38.591986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:38.596425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:38.679757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:25:39.025216 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-075bf125-d50e-45fa-a070-26e01715157e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 204 len: 0 microversion: 2.1 time: 0.467664 Jul 18 02:25:39.025923 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1330/2650] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:25:38 2022] DELETE /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:25:39.046737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4a25bcc8-f193-4f73-9659-c0a7a54c8947 req-03189a61-f2d5-4bee-8a5e-c6d15214d741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9162d-74a6-438e-b3c2-3122081c0727", "name": "network-vif-deleted", "tag": "e359219b-8526-422e-bf4d-57ebf5a5bddb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:39.063816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a25bcc8-f193-4f73-9659-c0a7a54c8947 req-03189a61-f2d5-4bee-8a5e-c6d15214d741 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.065894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a25bcc8-f193-4f73-9659-c0a7a54c8947 req-03189a61-f2d5-4bee-8a5e-c6d15214d741 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.083789 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4a25bcc8-f193-4f73-9659-c0a7a54c8947 req-03189a61-f2d5-4bee-8a5e-c6d15214d741 service nova] Creating event network-vif-deleted:e359219b-8526-422e-bf4d-57ebf5a5bddb for instance 66e9162d-74a6-438e-b3c2-3122081c0727 on n-h1-849796-1 Jul 18 02:25:39.091094 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4a25bcc8-f193-4f73-9659-c0a7a54c8947 req-03189a61-f2d5-4bee-8a5e-c6d15214d741 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063157 Jul 18 02:25:39.093819 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1331/2651] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:39.103345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b646240f-7f33-4c37-bd71-4accc48c5098 req-74047d4b-2372-4048-91e1-b9b9f5ccfba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacac7dc-23af-4f15-b620-940136961b1d", "name": "network-vif-deleted", "tag": "5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:39.115196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b646240f-7f33-4c37-bd71-4accc48c5098 req-74047d4b-2372-4048-91e1-b9b9f5ccfba2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.116037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b646240f-7f33-4c37-bd71-4accc48c5098 req-74047d4b-2372-4048-91e1-b9b9f5ccfba2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.131118 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b646240f-7f33-4c37-bd71-4accc48c5098 req-74047d4b-2372-4048-91e1-b9b9f5ccfba2 service nova] Creating event network-vif-deleted:5e2569f6-d6a1-43bd-9b78-b87b7ef23ce5 for instance aacac7dc-23af-4f15-b620-940136961b1d on n-h2-849796-1 Jul 18 02:25:39.137936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b646240f-7f33-4c37-bd71-4accc48c5098 req-74047d4b-2372-4048-91e1-b9b9f5ccfba2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041175 Jul 18 02:25:39.139228 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1332/2652] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:39.147468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f557d3a5-d56a-4f81-a8af-ee53e2231a72 req-f802968a-8778-47b7-87a0-fb1921bf2b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421978c4-4f6a-4cec-9c46-518ae92112c3", "name": "network-vif-unplugged", "status": "completed", "tag": "5ad21d59-c411-4a18-b08d-8d1b240beb29"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:39.158514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f557d3a5-d56a-4f81-a8af-ee53e2231a72 req-f802968a-8778-47b7-87a0-fb1921bf2b27 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.159336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f557d3a5-d56a-4f81-a8af-ee53e2231a72 req-f802968a-8778-47b7-87a0-fb1921bf2b27 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.175137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f557d3a5-d56a-4f81-a8af-ee53e2231a72 req-f802968a-8778-47b7-87a0-fb1921bf2b27 service nova] Creating event network-vif-unplugged:5ad21d59-c411-4a18-b08d-8d1b240beb29 for instance 421978c4-4f6a-4cec-9c46-518ae92112c3 on n-h1-849796-1 Jul 18 02:25:39.188829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f557d3a5-d56a-4f81-a8af-ee53e2231a72 req-f802968a-8778-47b7-87a0-fb1921bf2b27 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047564 Jul 18 02:25:39.190577 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1333/2653] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:39.212687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1561438087", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "cc961fa4-53ad-43f0-b036-d186e7700255"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:39.306388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] validate_networks() for [('cc961fa4-53ad-43f0-b036-d186e7700255', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:25:39.445523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:39.446733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:39.447463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:39.448054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:39.448735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:39.451787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:39.475001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.475725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.477080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.479246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.559918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:39.587430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Getting quotas for user de515d451d7c40ce8e4f31ff9d5367b5 and project 85158a5ab74d45ce9692f81398d3c3d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:39.650109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:25:39.681821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:25:39.823435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc4d44ff-53c9-493d-bbdb-5e3e3848c1db tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.489521 Jul 18 02:25:39.825126 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1321/2654] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:25:39.836103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:39.837232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: 66e9162d-74a6-438e-b3c2-3122081c0727] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:39.852967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.853454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.854395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:39.854738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:39.901670 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] HTTP exception thrown: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 HTTP/1.1 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '66e9162d-74a6-438e-b3c2-3122081c0727'} Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:39.906379 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. Jul 18 02:25:39.916080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:39.920596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 404 to user: Instance 66e9162d-74a6-438e-b3c2-3122081c0727 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:39.922219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bad24aff-8043-4dea-912d-78cedadeb2cc tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727" status: 404 len: 111 microversion: 2.1 time: 0.094717 Jul 18 02:25:39.923552 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1322/2655] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:39 2022] GET /compute/v2.1/servers/66e9162d-74a6-438e-b3c2-3122081c0727 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:39.965214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-400d8d70-c02f-4c30-b1d6-a3f9ba013995 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:39.968907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-400d8d70-c02f-4c30-b1d6-a3f9ba013995 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:40.324268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-400d8d70-c02f-4c30-b1d6-a3f9ba013995 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:40.342613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-400d8d70-c02f-4c30-b1d6-a3f9ba013995 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1217 microversion: 2.1 time: 0.414817 Jul 18 02:25:40.344290 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1323/2656] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:39 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1217 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:40.359771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:40.360414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] [instance: aacac7dc-23af-4f15-b620-940136961b1d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:40.377697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:40.383364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:40.388275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:40.389551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:40.430153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] HTTP exception thrown: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Request method failure captured: Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d HTTP/1.1 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRoUcJvOPibfG8YjyTGijaaprlPVzc3YkkCFp-iqJCD_juSU1JkOza24brb4RrBNA-6OXcARiiGfU_SRRtiH3VdF5MuE1vLgmCzjSKvkOhBziHNgn8iIEFxc_iCxUsZ8nPRpqFieEHXPDkrqzVS285JwdSqpspS7fQ82yT8pT5_i9k Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/662600ddb33b4a3aa08050ac741097e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 662600ddb33b4a3aa08050ac741097e4 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089716888 Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe46e2756309434c8ce234fe2d19071e Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServersNegativeTestJSON-2089716888-project Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'aacac7dc-23af-4f15-b620-940136961b1d'} Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:40.437482 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. Jul 18 02:25:40.443652 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:40.446146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] Returning 404 to user: Instance aacac7dc-23af-4f15-b620-940136961b1d could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:40.449685 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fadbcf3-884e-499c-ad31-c74bae73c598 tempest-ListServersNegativeTestJSON-2089716888 tempest-ListServersNegativeTestJSON-2089716888-project] 10.222.0.67 "GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d" status: 404 len: 111 microversion: 2.1 time: 0.100200 Jul 18 02:25:40.450655 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1324/2657] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:40 2022] GET /compute/v2.1/servers/aacac7dc-23af-4f15-b620-940136961b1d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:41.001047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:41.039095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:41.040166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:41.041341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:41.042609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:41.043516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:41.082245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.084242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.089063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.093778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.163720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:41.174308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for user 927f29b5f43d405ca9d3fed68e53cdb1 and project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:41.215581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:25:41.226706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:25:41.368450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:41.371008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e8df07a-8c99-48a0-ae8b-9f17cb6f98f7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166800 Jul 18 02:25:41.371888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:41.373126 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1334/2658] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:25:41.393770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f96ca63-7d52-4e3f-b3a2-171c9909ea36 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:41.397163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.397885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.399462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:41.399790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f96ca63-7d52-4e3f-b3a2-171c9909ea36 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:41.400273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:41.697570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2f96ca63-7d52-4e3f-b3a2-171c9909ea36 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:41.718696 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f96ca63-7d52-4e3f-b3a2-171c9909ea36 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1208 microversion: 2.1 time: 0.337747 Jul 18 02:25:41.719687 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1335/2659] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:41 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1208 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:25:41.892400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:41.923368 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0ce2252b-8e13-45d4-b33c-793fdd604139 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1213 microversion: 2.1 time: 0.564063 Jul 18 02:25:41.932117 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1325/2660] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:41 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1213 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:42.742646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:42.743577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:42.770494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:42.780502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:42.781647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:42.785688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:42.954478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:42.956545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:43.023065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.034203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.041502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:43.045645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:43.192711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:43.210187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2c920d7c-5427-43c8-a123-234fd5265e87 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1212 microversion: 2.1 time: 0.471740 Jul 18 02:25:43.211489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1336/2661] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:42 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1212 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:44.028699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Calling method '.version_select at 0x7fab05bb8d30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:44.233983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:25:44.234907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Neutron security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:25:44.236035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] HTTP exception thrown: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.236035 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Request method failure captured: Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-groups/e1a2601e-2a5b-47e9-8c75-de730c45bb23 HTTP/1.1 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MSmMXFowLWfygxZX8JG8Yv5k5e2IAlVCj4rYTO5b18FnP9r3p1GbTaT4X96KXuui6L1C_QJszUB8KphtSIrMFA3MHV5N04CNT_D4VoiK5uIdVt2UTWrwcI3g7a1wr4VzhJ_gkJfLEp2NYuhloUCRfx_XrWhIdPRC8gtP-M3pfdmQrc Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f41b5b8bb09142e99038a0e003b02880 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e1a2601e-2a5b-47e9-8c75-de730c45bb23'} Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:25:44.240090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] Jul 18 02:25:44.243532 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:44.247141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Returning 404 to user: Security group e1a2601e-2a5b-47e9-8c75-de730c45bb23 does not exist Jul 18 02:25:44.247141 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-5ca37e2d-f62b-46ff-bd0a-833c7060baef'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:44.248048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e37bc0f-4f02-4ffc-a8f1-530174d15d1f tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/e1a2601e-2a5b-47e9-8c75-de730c45bb23" status: 404 len: 194 microversion: 2.1 time: 1.035316 Jul 18 02:25:44.252618 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1337/2662] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:43 2022] DELETE /compute/v2.1/os-security-groups/e1a2601e-2a5b-47e9-8c75-de730c45bb23 => generated 194 bytes in 1039 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:44.279441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:44.280074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:44.308082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:44.326878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:44.328270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:44.329038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:44.751123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:44.794204 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e608bab0-ba63-4fb8-858a-e36bc75593a5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1266 microversion: 2.1 time: 0.541175 Jul 18 02:25:44.797570 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1338/2663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:44 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1266 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:44.810453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa0f96e6-d4c6-4615-b782-e27369104eab tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011304 Jul 18 02:25:44.812670 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1339/2664] 10.222.0.67 () {58 vars in 1163 bytes} [Mon Jul 18 02:25:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:25:44.839461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:44.917239 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-351da653-a0fc-4715-a860-9c7a9546cdc3 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1275 microversion: 2.1 time: 1.957889 Jul 18 02:25:44.931465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1326/2665] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:42 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1275 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:44.965500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ebc539cd-fbb2-45d8-b52f-44185cb30ad8 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Calling method '.version_select at 0x7fab049dff70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:45.057394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-935134600", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:45.222218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:45.223527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:45.225493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:45.226357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:45.230173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:45.260749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:45.262878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:45.266421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:45.267166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:45.334868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Getting quotas for project 70217adf78d94a809101da5d623241c2. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:45.351106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Getting quotas for user 7c173c4ec32c41bdb78696874daf0f9d and project 70217adf78d94a809101da5d623241c2. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:45.392616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:25:45.397671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:25:45.503106 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ac4bbfe-72ac-4b4d-a07e-4d525ee01880 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.688048 Jul 18 02:25:45.503769 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1340/2666] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:25:45.538338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:45.539657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:46.039789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:46.078099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:46.089712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:46.137841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fe6f1e9-ccc8-4ad1-99ee-17f7146af9c9 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "PUT /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1358 microversion: 2.75 time: 0.610991 Jul 18 02:25:46.138680 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1341/2667] 10.222.0.67 () {62 vars in 1296 bytes} [Mon Jul 18 02:25:45 2022] PUT /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:46.151718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:46.152839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:46.176848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:46.181456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:46.183332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:46.187840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:46.485985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:46.499178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63c4ce75-7b2f-4dea-9575-7c2e33e29b59 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1266 microversion: 2.1 time: 0.359166 Jul 18 02:25:46.506069 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1342/2668] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:46 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:46.517618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:46.518817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:46.533868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:46.534337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:46.543254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:46.545149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:47.324394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:47.352595 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c50f8b24-6770-4186-877d-3aed6df3a96d tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.844848 Jul 18 02:25:47.353883 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1343/2669] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:46 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:47.382548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:47.383352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:47.411058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:47.411730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:47.421019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:47.421543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:47.963995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:47.994241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:47.996258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:48.024618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bdef8b8-884d-457a-8a21-82fecb24cbca tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1410 microversion: 2.75 time: 0.669192 Jul 18 02:25:48.027550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1344/2670] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:47 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1410 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:48.033157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.034041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.069969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.070735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.071783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.072498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.273223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:48.277058 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ebc539cd-fbb2-45d8-b52f-44185cb30ad8 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 3.321168 Jul 18 02:25:48.277860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1327/2671] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:25:44 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 3323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:48.291834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Calling method '.version_select at 0x7fab049a1430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.299046 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b264e560-fb8c-4f68-86d0-29b8bd1ddd18 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1266 microversion: 2.1 time: 0.269623 Jul 18 02:25:48.300607 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1345/2672] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:48 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:48.377156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:48.378239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:48.397182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.398005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:48.399531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:48.400324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.313013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.327746 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8abbe0e8-a9b6-4598-a6a0-36f878691dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.958675 Jul 18 02:25:49.329686 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1346/2673] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:48 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:49.340617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-de8760ff-97eb-4c47-94f5-200bfa899fbe req-43e63f76-ea45-49c4-8f25-4f047ef463a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421978c4-4f6a-4cec-9c46-518ae92112c3", "name": "network-vif-deleted", "tag": "5ad21d59-c411-4a18-b08d-8d1b240beb29"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:49.368829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de8760ff-97eb-4c47-94f5-200bfa899fbe req-43e63f76-ea45-49c4-8f25-4f047ef463a1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:49.370235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de8760ff-97eb-4c47-94f5-200bfa899fbe req-43e63f76-ea45-49c4-8f25-4f047ef463a1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.397184 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-de8760ff-97eb-4c47-94f5-200bfa899fbe req-43e63f76-ea45-49c4-8f25-4f047ef463a1 service nova] Creating event network-vif-deleted:5ad21d59-c411-4a18-b08d-8d1b240beb29 for instance 421978c4-4f6a-4cec-9c46-518ae92112c3 on n-h1-849796-1 Jul 18 02:25:49.408856 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-de8760ff-97eb-4c47-94f5-200bfa899fbe req-43e63f76-ea45-49c4-8f25-4f047ef463a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076295 Jul 18 02:25:49.410608 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1347/2674] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:49.422678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:49.429037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:49.446929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:49.454298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.455796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:49.456614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.511855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:49.683168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.718816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.732305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:49.776529 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23367668-a30f-4266-9bb0-c6cfca3afe2a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1416 microversion: 2.75 time: 0.363563 Jul 18 02:25:49.784345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1348/2675] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:49 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1416 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:49.794484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:49.795510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:49.815175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:49.822496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:49.828291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:49.830693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.265667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:50.292848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac0b587b-7fb0-4fc6-9069-4c9b910f0c7a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 0.504755 Jul 18 02:25:50.293983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1349/2676] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:49 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:50.334061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:50.395159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08dbe3bc-a7c1-40c8-9aa0-0f3899efa88e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Action: 'create', calling method: .version_select at 0x7fab0556cd30>, body: {"keypair": {"name": "tempest-keypair-963145363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkB2YEoElRJ/fMFysnq/u65R0kVOCulDl1BY3JgXTs3YjnetiWQRUZmqd9IbcZ0xVb/j3k11c2wKiGkhTOSxJyJeYI6FBVr6mdXZ5Rip79GqbrQdyvzMuvuD2V8DvXlAQ=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:50.425353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-08dbe3bc-a7c1-40c8-9aa0-0f3899efa88e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for project 62e644dea14a4d249db4e89e158f6107. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:25:50.440128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-08dbe3bc-a7c1-40c8-9aa0-0f3899efa88e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for user e08a03788c1a4fd2981ca862916c7b67 and project 62e644dea14a4d249db4e89e158f6107. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:25:50.448702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:50.500675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08dbe3bc-a7c1-40c8-9aa0-0f3899efa88e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204237 Jul 18 02:25:50.505359 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1350/2677] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:25:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:50.533899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3dae38e5-fae7-44cd-a19a-b414d92641d3 req-1351b10f-4f14-4b83-9829-5f3c82d00a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110b26f4-d34d-4f97-aee0-c219974d5e94", "tag": "d9c863bf-81d0-4087-beef-9b17b988ee2c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:50.582623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3dae38e5-fae7-44cd-a19a-b414d92641d3 req-1351b10f-4f14-4b83-9829-5f3c82d00a0b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.583545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3dae38e5-fae7-44cd-a19a-b414d92641d3 req-1351b10f-4f14-4b83-9829-5f3c82d00a0b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.598282 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3dae38e5-fae7-44cd-a19a-b414d92641d3 req-1351b10f-4f14-4b83-9829-5f3c82d00a0b service nova] Creating event network-changed:d9c863bf-81d0-4087-beef-9b17b988ee2c for instance 110b26f4-d34d-4f97-aee0-c219974d5e94 on n-h2-849796-1 Jul 18 02:25:50.604597 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3dae38e5-fae7-44cd-a19a-b414d92641d3 req-1351b10f-4f14-4b83-9829-5f3c82d00a0b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096475 Jul 18 02:25:50.605629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1351/2678] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:50.612053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:50.613198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:50.631674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.639719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.640839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.641443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.675674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:25:50.678011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 18 02:25:50.678011 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Request method failure captured: Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/c2002563-6a50-432a-a855-e37a160e7ada HTTP/1.1 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MSmMXFowLWfygxZX8JG8Yv5k5e2IAlVCj4rYTO5b18FnP9r3p1GbTaT4X96KXuui6L1C_QJszUB8KphtSIrMFA3MHV5N04CNT_D4VoiK5uIdVt2UTWrwcI3g7a1wr4VzhJ_gkJfLEp2NYuhloUCRfx_XrWhIdPRC8gtP-M3pfdmQrc Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: f41b5b8bb09142e99038a0e003b02880 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: exception: Insufficient rights for removing default security group. Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'c2002563-6a50-432a-a855-e37a160e7ada'} Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:25:50.680341 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0ee1c900-c63c-4738-9e09-782dc1c8b439'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3fad9f77-b86d-4d9f-8cea-97d22dc4d480 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c2002563-6a50-432a-a855-e37a160e7ada" status: 400 len: 182 microversion: 2.1 time: 2.396662 Jul 18 02:25:50.688494 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1328/2679] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:25:48 2022] DELETE /compute/v2.1/os-security-groups/c2002563-6a50-432a-a855-e37a160e7ada => generated 182 bytes in 2401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:25:50.710573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Calling method '.version_select at 0x7fab045b6280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:50.718827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:50.938691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:25:50.939665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Neutron security group 59fab315-3cfe-447f-be21-e54597fa2e79 not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:25:50.940554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] HTTP exception thrown: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.940554 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Request method failure captured: Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-security-groups/59fab315-3cfe-447f-be21-e54597fa2e79 HTTP/1.1 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MSmMXFowLWfygxZX8JG8Yv5k5e2IAlVCj4rYTO5b18FnP9r3p1GbTaT4X96KXuui6L1C_QJszUB8KphtSIrMFA3MHV5N04CNT_D4VoiK5uIdVt2UTWrwcI3g7a1wr4VzhJ_gkJfLEp2NYuhloUCRfx_XrWhIdPRC8gtP-M3pfdmQrc Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: f41b5b8bb09142e99038a0e003b02880 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '59fab315-3cfe-447f-be21-e54597fa2e79'} Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:25:50.944185 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] Jul 18 02:25:50.947697 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:25:50.952475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Returning 404 to user: Security group 59fab315-3cfe-447f-be21-e54597fa2e79 does not exist Jul 18 02:25:50.952475 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-7c0dd1a2-b4f7-4b9d-b668-b6e57772c986'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:50.953718 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b03a16b-b20c-4aaa-af0f-b3f0ff5f481a tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/59fab315-3cfe-447f-be21-e54597fa2e79" status: 404 len: 194 microversion: 2.1 time: 0.255608 Jul 18 02:25:50.954667 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1329/2680] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:25:50 2022] GET /compute/v2.1/os-security-groups/59fab315-3cfe-447f-be21-e54597fa2e79 => generated 194 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:50.967189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:50.967998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:50.985949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.986575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:50.987572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:50.988149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.318924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.337753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b9200a3-b097-409c-9ee4-58d8248a7ec6 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.730420 Jul 18 02:25:51.338721 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1352/2681] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:50 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:51.344372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Action: 'update', calling method: .version_select at 0x7fab04f6a5e0>, body: {"security_group": {"name": "tempest-sg-331810437", "description": "tempest-description-1790558573"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:51.382632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.395761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.401502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:51.411955 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f05fc7d9-33ab-436f-826b-8ed1328d420a tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1416 microversion: 2.75 time: 0.454957 Jul 18 02:25:51.414160 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1330/2682] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:50 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1416 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:51.420864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:51.423410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:51.434271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:51.435574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.436160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:25:51.437092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Neutron security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:25:51.437651 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] HTTP exception thrown: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.437651 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.438652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:51.439336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Request method failure captured: Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: request: PUT /compute/v2.1/os-security-groups/73f9bf15-0d72-49d5-95de-b3666b1addb2 HTTP/1.1 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 101 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MSmMXFowLWfygxZX8JG8Yv5k5e2IAlVCj4rYTO5b18FnP9r3p1GbTaT4X96KXuui6L1C_QJszUB8KphtSIrMFA3MHV5N04CNT_D4VoiK5uIdVt2UTWrwcI3g7a1wr4VzhJ_gkJfLEp2NYuhloUCRfx_XrWhIdPRC8gtP-M3pfdmQrc Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b70c15494c4847e28ee4e1a4d539d852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b70c15494c4847e28ee4e1a4d539d852 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-821652352 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f41b5b8bb09142e99038a0e003b02880 Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-821652352-project Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: {"security_group": {"name": "tempest-sg-331810437", "description": "tempest-description-1790558573"}} Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '73f9bf15-0d72-49d5-95de-b3666b1addb2', 'body': {'security_group': {'name': 'tempest-sg-331810437', 'description': 'tempest-description-1790558573'}}} Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:25:51.439727 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] Returning 404 to user: Security group 73f9bf15-0d72-49d5-95de-b3666b1addb2 does not exist Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-e8bb625e-c2cb-42db-ad32-ec39018a9bbb'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b2e1b579-c9ff-48e8-877a-cc3bf9eee388 tempest-SecurityGroupsNegativeTestJSON-821652352 tempest-SecurityGroupsNegativeTestJSON-821652352-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/73f9bf15-0d72-49d5-95de-b3666b1addb2" status: 404 len: 194 microversion: 2.1 time: 0.101370 Jul 18 02:25:51.444513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1353/2683] 10.222.0.67 () {60 vars in 1289 bytes} [Mon Jul 18 02:25:51 2022] PUT /compute/v2.1/os-security-groups/73f9bf15-0d72-49d5-95de-b3666b1addb2 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:25:52.356980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:52.357999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:52.374904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.375743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:52.376917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:52.378046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.378697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:52.393112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d3ee245-ea00-4ee6-a711-4b74ba1a6fcd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 0.977370 Jul 18 02:25:52.394060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1331/2684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:51 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:52.449637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:52.449967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:52.494037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.501864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:52.505177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:52.508585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:52.747982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:52.763018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:52.768667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:52.783067 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7574e1ce-b4e4-43f2-8db7-cabc32aa4653 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1416 microversion: 2.75 time: 0.337700 Jul 18 02:25:52.785840 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1332/2685] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:52 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1416 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:25:53.059763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cfffe474-d736-4965-8af8-e1285e3f5825 req-a3788ae9-94c9-4d8f-8277-102b197ad4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fb7154-5239-40f6-b79d-99a38d02777c", "tag": "d1b5c46e-3ed0-4025-b756-48c1824c2034"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:53.108064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cfffe474-d736-4965-8af8-e1285e3f5825 req-a3788ae9-94c9-4d8f-8277-102b197ad4f3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.110011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cfffe474-d736-4965-8af8-e1285e3f5825 req-a3788ae9-94c9-4d8f-8277-102b197ad4f3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.125587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:53.134462 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9c33de0-3a21-4e68-b796-896bbe351b5c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.782971 Jul 18 02:25:53.141488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cfffe474-d736-4965-8af8-e1285e3f5825 req-a3788ae9-94c9-4d8f-8277-102b197ad4f3 service nova] Creating event network-changed:d1b5c46e-3ed0-4025-b756-48c1824c2034 for instance 60fb7154-5239-40f6-b79d-99a38d02777c on n-h1-849796-1 Jul 18 02:25:53.144123 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1354/2686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:52 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:53.150963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cfffe474-d736-4965-8af8-e1285e3f5825 req-a3788ae9-94c9-4d8f-8277-102b197ad4f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100323 Jul 18 02:25:53.152747 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1333/2687] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:25:53.412498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:53.413494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:53.428868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.429381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.430233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.430695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.808694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:53.812135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:53.821997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.822798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:53.823998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:53.824722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.116556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:54.172705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:54.177952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:54.208304 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fbdb492-f373-40d3-895f-7e28bca7c8d6 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1437 microversion: 2.75 time: 0.399972 Jul 18 02:25:54.210954 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1334/2688] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:53 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1437 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:25:54.231796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:54.234659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:54.263950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.270954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.274618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.276690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.544808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:54.556589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4d54b69-a40f-4922-8fd4-07969e038369 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 1.148405 Jul 18 02:25:54.568033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1355/2689] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:53 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:54.576122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:25:54.577942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:54.592138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.601406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.602518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.602872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.802353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:25:54.803020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:25:54.804456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:25:54.805070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:25:54.805625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:25:54.922045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:54.939783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.942675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:54.943735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:54.946804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:55.134969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.168221 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-683be368-2cf0-4b37-9090-6a6216fd8350 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.945170 Jul 18 02:25:55.170495 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1335/2690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:54 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:55.295919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:25:55.334955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.371363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.383605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.407580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b79de952-d0a0-4583-8bd3-3b7eeb5245c1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "POST /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd/action" status: 202 len: 1494 microversion: 2.75 time: 0.837838 Jul 18 02:25:55.425523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1356/2691] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:25:54 2022] POST /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd/action => generated 1494 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:25:55.466592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:55.469415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:55.487410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:55.488666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:55.490524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:55.491620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:55.583591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:55.587176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:55.621031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:55.622694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:55.625700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:55.626841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:55.724908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.763310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.773076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:55.789907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5b3e324-b7f9-49b5-ada2-d05821627ec2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.349695 Jul 18 02:25:55.791715 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1336/2692] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:55 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:56.223054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:56.227291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:56.251549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.252396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:56.254943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.256117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:56.887344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:56.900144 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52133c64-03e2-40c9-8e0c-7d62ac4105f9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 1.328115 Jul 18 02:25:56.903101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1357/2693] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:55 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:56.909239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:56.911208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:56.929757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.930629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:56.933905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:56.943834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:57.002855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:57.040470 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93358a9e-3211-4b0e-9200-569df80b3f54 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.840663 Jul 18 02:25:57.051613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1337/2694] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:56 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:57.170727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:57.181548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:57.183279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:57.199525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4161cbc-8774-48fc-a0ea-e8e874330497 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.294401 Jul 18 02:25:57.199982 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1358/2695] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:56 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:57.926708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:57.929318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:57.952915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:57.954487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:57.956215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:57.958330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:58.077797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:58.079113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:58.116502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:58.117381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:58.119115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:58.120349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:58.380294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:58.399949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d908b923-6a15-45ea-8ee0-ebe9d041b28c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 0.480831 Jul 18 02:25:58.401254 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1338/2696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:57 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:58.421512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:58.425789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:58.466881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:58.468169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:58.470097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:58.472780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:58.613067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:58.625374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:58.627496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:58.635744 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3af7387d-90fe-4705-821a-0aa0de6e2955 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.232249 Jul 18 02:25:58.636602 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1339/2697] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:58 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:25:58.845293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:58.875018 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f71ebd95-749b-466e-b7e2-02f222b11ef0 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.811450 Jul 18 02:25:58.896214 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1359/2698] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:58 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:59.440434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:59.443248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:59.472326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.478151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.480390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.481242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.677508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:59.681463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:59.717244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.718431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.720078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.721223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.791637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:25:59.812755 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9a53f6f-37f3-41a2-9d6f-1f423409687f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 0.395832 Jul 18 02:25:59.814894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1340/2699] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:59 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:25:59.893948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:25:59.895958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:25:59.903237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.903915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:25:59.904853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:25:59.905451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:00.011324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:00.054325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:00.055950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:00.064820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-caa845c9-a6a4-4d5a-9fa8-3e0b9195cc40 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.398741 Jul 18 02:26:00.084947 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1360/2700] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:25:59 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:00.153116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:00.163218 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40450287-1f08-4ed4-8813-ccef63d58dcc tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.273730 Jul 18 02:26:00.164292 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1341/2701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:25:59 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:00.840113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:00.841875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:00.845160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=32,nova_cell0:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:00.866620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:00.867182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:00.868009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:00.868467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:01.089187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:01.090469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:01.111800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.112893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:01.115106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.115776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:01.159984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:01.322364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:01.340534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:01.343604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:01.355494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45344814-dc86-4e68-953a-e58ff635d5b0 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.270878 Jul 18 02:26:01.356792 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1342/2702] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:01 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:01.366861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:01.368819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:01.385281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.386415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:01.388294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:01.389563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:02.008986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:02.049228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68199fc0-efb9-4bd3-a3a7-1cfbf7a7a5ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.685185 Jul 18 02:26:02.069662 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1343/2703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:01 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:02.080292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-38091769-06e2-4f5f-80d0-188d9fd1d600 req-950dd7ce-bd73-486b-9cb6-c8f71df206bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb7154-5239-40f6-b79d-99a38d02777c", "name": "network-vif-plugged", "status": "completed", "tag": "d1b5c46e-3ed0-4025-b756-48c1824c2034"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:02.099331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38091769-06e2-4f5f-80d0-188d9fd1d600 req-950dd7ce-bd73-486b-9cb6-c8f71df206bb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:02.100870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38091769-06e2-4f5f-80d0-188d9fd1d600 req-950dd7ce-bd73-486b-9cb6-c8f71df206bb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:02.130346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-38091769-06e2-4f5f-80d0-188d9fd1d600 req-950dd7ce-bd73-486b-9cb6-c8f71df206bb service nova] Creating event network-vif-plugged:d1b5c46e-3ed0-4025-b756-48c1824c2034 for instance 60fb7154-5239-40f6-b79d-99a38d02777c on n-h1-849796-1 Jul 18 02:26:02.147563 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-38091769-06e2-4f5f-80d0-188d9fd1d600 req-950dd7ce-bd73-486b-9cb6-c8f71df206bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071732 Jul 18 02:26:02.157774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1344/2704] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:02.384036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:02.395345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:02.432630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:02.437315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:02.442345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:02.446514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:02.711028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:02.764639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-feb77196-0084-4e2d-aaa8-b92026df673f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 1.914965 Jul 18 02:26:02.774921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1361/2705] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:00 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:02.848485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:02.871991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:02.876115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:02.890203 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a97f9b6-7e5b-49cd-9605-98704e251422 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.515922 Jul 18 02:26:02.892128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1345/2706] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:02 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:03.104294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:03.109005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:03.149324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:03.150570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:03.153245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:03.154107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:03.801956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:03.802901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:03.840657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:03.842178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:03.857061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:03.858068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:03.987883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.002303 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f970e406-d99b-40ab-9e53-7d3ac683c3fe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.926291 Jul 18 02:26:04.007618 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1362/2707] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:03 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:04.024761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:04.026954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:04.043467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:04.058583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:04.060008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:04.060825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:04.224101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.225715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.237503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de95dca6-c623-4a85-acdf-50ab49d3e54f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1308 microversion: 2.1 time: 0.454633 Jul 18 02:26:04.245068 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1346/2708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:03 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:04.245300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.245300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:04.258555 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07f908bf-bce2-438e-bece-064257b6df1f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.248967 Jul 18 02:26:04.259173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1363/2709] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:04 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:04.749641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-345596205", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "09ae6f6b-278d-4531-9670-3e303e448b66"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:04.943934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] validate_networks() for [('09ae6f6b-278d-4531-9670-3e303e448b66', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:26:05.027534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:05.028389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:05.042692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:05.044795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:05.046546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:05.049997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:05.828299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:05.873843 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62f75a81-8ee5-4923-a7c8-02ddd1dd549a tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.847519 Jul 18 02:26:05.885796 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1364/2710] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:05 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:05.933990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:05.938791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:06.014278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.015445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.016733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.017441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.507488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:06.543608 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fac6eb51-e3d5-497b-bac6-305f993d7539 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1487 microversion: 2.1 time: 0.651695 Jul 18 02:26:06.544560 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1365/2711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:05 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:06.570949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:06.571998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:06.589558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.599850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.602653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.605661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.718037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:06.729820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:06.732183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:06.739622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c166921-d3f2-43be-8a65-681cf77634b1 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.193260 Jul 18 02:26:06.740950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1366/2712] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:06 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:06.761382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23d17a66-233b-484e-bff1-5942bb7f3163 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:06.779455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d17a66-233b-484e-bff1-5942bb7f3163 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.780648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d17a66-233b-484e-bff1-5942bb7f3163 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.903006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:06.903844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:06.904684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:06.905223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:06.905805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:06.923591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.927116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.929586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:06.931128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:06.948549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23d17a66-233b-484e-bff1-5942bb7f3163 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Going to try to stop instance {{(pid=119439) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:26:06.962964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:06.982895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Getting quotas for project 1d722c616b8e4b90b7ee226cc9234074. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:06.999004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Getting quotas for user 7c80df681dca46e49b71c4307e01192c and project 1d722c616b8e4b90b7ee226cc9234074. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:07.034506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:26:07.039068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:07.090691 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23d17a66-233b-484e-bff1-5942bb7f3163 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c/action" status: 202 len: 0 microversion: 2.1 time: 0.342663 Jul 18 02:26:07.098479 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1367/2713] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:26:06 2022] POST /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:26:07.120248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84c9ba05-c594-474d-8cec-b0072f07dab3 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.877279 Jul 18 02:26:07.121528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1347/2714] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2882 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:26:07.123228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:07.124355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:07.136990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:07.138433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:07.155710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.157984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.159763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.162426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.163003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.163691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.166612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.171862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.479561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.495115 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-54bc4a10-58b0-47fa-981c-ee6d732e04ac tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.392025 Jul 18 02:26:07.495955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1368/2715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:07 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:07.502353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:07.503186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:07.673599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.710427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.730461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.734563 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4127d939-f88c-4642-851b-99667275b575 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1258 microversion: 2.21 time: 0.236599 Jul 18 02:26:07.736996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1369/2716] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:07 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:07.781783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:07.784128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:07.797519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.800328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.802176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:07.804233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:07.971213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.985275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:07.987354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:08.001059 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35f7a843-d0d0-413c-a593-349841459f4d tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.229920 Jul 18 02:26:08.003532 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1370/2717] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:07 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:08.293392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:08.304418 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89709ebb-b2c0-4f9e-94b7-51e20ef5a146 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 1.180636 Jul 18 02:26:08.305523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1348/2718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:07 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:08.311406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6964d353-74f7-40d0-bd56-e8d621bb9757 req-85332358-79bb-405c-a374-8c3c9d726c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110b26f4-d34d-4f97-aee0-c219974d5e94", "name": "network-vif-plugged", "status": "completed", "tag": "d9c863bf-81d0-4087-beef-9b17b988ee2c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:08.377489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6964d353-74f7-40d0-bd56-e8d621bb9757 req-85332358-79bb-405c-a374-8c3c9d726c4a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.384670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6964d353-74f7-40d0-bd56-e8d621bb9757 req-85332358-79bb-405c-a374-8c3c9d726c4a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.447442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6964d353-74f7-40d0-bd56-e8d621bb9757 req-85332358-79bb-405c-a374-8c3c9d726c4a service nova] Creating event network-vif-plugged:d9c863bf-81d0-4087-beef-9b17b988ee2c for instance 110b26f4-d34d-4f97-aee0-c219974d5e94 on n-h2-849796-1 Jul 18 02:26:08.471694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6964d353-74f7-40d0-bd56-e8d621bb9757 req-85332358-79bb-405c-a374-8c3c9d726c4a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196410 Jul 18 02:26:08.480505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1371/2719] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:08.514684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:08.515598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:08.535616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.541633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.542846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.544709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.758437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:08.759803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:08.775149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.780615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.781904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.782807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.045623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.059091 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2793fc69-6fcb-4d0b-a0c3-7fb136c42633 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 0.549163 Jul 18 02:26:09.074012 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1349/2720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:08 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:09.087885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:09.088521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:09.112811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.113628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.116316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.117086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.329949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.342128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.348418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.349966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81b16171-34cd-4093-bedd-ac6a42ac0ebd tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1254 microversion: 2.21 time: 0.598481 Jul 18 02:26:09.350589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1372/2721] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:08 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1254 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:09.366565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:09.367202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:09.376065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.376428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.377532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:09.379085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:09.540306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.584412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.601675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.606682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:09.628188 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5e6c02a7-e31f-4422-a53a-eedbf1c22673 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.552818 Jul 18 02:26:09.634684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1350/2722] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:09 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:09.859599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:09.897491 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e38010a7-546a-4955-9d14-47284873aa3e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.530529 Jul 18 02:26:09.899589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1373/2723] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:09 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:10.078650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:10.079784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:10.094989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.095477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.096334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.099322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.370755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:10.371671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:10.387560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.391568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.393477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.394246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.652328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:10.670784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:10.683135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:10.684684 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c62afa30-e824-4fa9-a405-1a6babe7c643 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1316 microversion: 2.21 time: 0.319458 Jul 18 02:26:10.685525 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1374/2724] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:10 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:10.703114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:10.706290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:10.714944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.716727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.717984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:10.718637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:10.968625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:10.989102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:11.001114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:11.028889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c3fd2c2-e4a6-4f2f-8382-eb6d71e83689 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.340907 Jul 18 02:26:11.040972 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1375/2725] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:10 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:11.046159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:11.047010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:11.067134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:11.068021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:11.069031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:11.081571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:11.948608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:11.974730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a761937-4c88-4e66-8721-ece85c077248 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.943516 Jul 18 02:26:11.979555 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1376/2726] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:11 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:12.010821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:12.024208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:12.075539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:12.081175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:12.083847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:12.085120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:12.173657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.187311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-569501a5-cfe5-4e1d-9568-663647c82473 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1317 microversion: 2.1 time: 2.109930 Jul 18 02:26:12.192089 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1351/2727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:10 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1317 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:12.203736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:12.204381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:12.220091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:12.220823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:12.223576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:12.226878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:12.433817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.490722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.493905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.496026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-616deb25-ee9a-4dc1-afb0-13e38f5646fb tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1316 microversion: 2.21 time: 0.503804 Jul 18 02:26:12.497091 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1377/2728] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:11 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:12.540375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.556316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.570708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:12.617203 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35612cde-9214-42ba-96dd-363adc32c254 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.420108 Jul 18 02:26:12.619692 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1352/2729] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:12 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:13.003857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:13.004971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:13.024402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.028818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.030765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.031662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.208289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:13.208857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:13.220883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.228264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.231679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.232159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.536819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:13.558395 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39647593-24db-4550-8950-cd740b864bc3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.561610 Jul 18 02:26:13.563822 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1378/2730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:12 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:13.604116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:13.610109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:13.636271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.642173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:13.646030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:13.653668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:14.384270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:14.409269 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-892b558d-aeca-4755-9cf8-d028e1688369 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1506 microversion: 2.1 time: 1.207119 Jul 18 02:26:14.411588 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1353/2731] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:13 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1506 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:14.459549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:14.465427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:14.516301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:14.517130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:14.521755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:14.533936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:15.155743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.179971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.188757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.226820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb7d2cd8-649e-4ab9-bc11-ce37c34f378f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.807154 Jul 18 02:26:15.231337 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1354/2732] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:14 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:15.280061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:15.281992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:15.304838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:15.310346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:15.313168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:15.314443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:15.438353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.465721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.469455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.475932 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3ae84a6-4bed-4b22-97c5-40c62bfde2ee tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 1.909061 Jul 18 02:26:15.493476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1379/2733] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:13 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:15.919017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:15.982911 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb91327c-9095-4df7-8acd-5d76b36310a4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.727198 Jul 18 02:26:15.991696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1355/2734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:15 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:16.276987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:16.277955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:16.288252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.289805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.291267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.291990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.480780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:16.502047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:16.507801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:16.529827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:16.548442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:16.553130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.576526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.579045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:16.585182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:16.604832 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-69349eb8-43d7-4937-a42f-895a01900a99 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.328563 Jul 18 02:26:16.612158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1380/2735] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:16 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:16.954588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:17.026734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:17.033735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:17.040601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:17.071017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.072137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.078250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.082210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.116363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.130875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.135015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.142298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c5bc311e-0bb9-46bd-bb25-4be44312f344 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 0.646027 Jul 18 02:26:17.150503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1356/2736] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:16 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:17.340516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2caa1d4d-fb68-4e6c-b0e2-0528a115c898 req-3cb0e21a-f233-4edb-9649-11cde00a9d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe31f7a-84e8-4fcd-af94-3b635636a5fa", "tag": "617f3613-dd7e-46e8-9aef-f554bf29e23e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:17.358561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2caa1d4d-fb68-4e6c-b0e2-0528a115c898 req-3cb0e21a-f233-4edb-9649-11cde00a9d8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.359308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2caa1d4d-fb68-4e6c-b0e2-0528a115c898 req-3cb0e21a-f233-4edb-9649-11cde00a9d8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.398186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2caa1d4d-fb68-4e6c-b0e2-0528a115c898 req-3cb0e21a-f233-4edb-9649-11cde00a9d8d service nova] Creating event network-changed:617f3613-dd7e-46e8-9aef-f554bf29e23e for instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa on n-h1-849796-1 Jul 18 02:26:17.426335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2caa1d4d-fb68-4e6c-b0e2-0528a115c898 req-3cb0e21a-f233-4edb-9649-11cde00a9d8d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079351 Jul 18 02:26:17.426335 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1357/2737] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:26:17.588744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d76429e1-3eb7-4291-a801-97f4e45c6597"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:17.590012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:17.606896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.607355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.608167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.608613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.695444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:17.751339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] HTTP exception thrown: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. Jul 18 02:26:17.755778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Request method failure captured: Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94/os-volume_attachments/cc023465-14e0-42dc-b8d7-ca1c3bf89afa HTTP/1.1 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 74 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MPd8jqMDUbvPciCZsB-RtjYbXfSbqZT6NNYY-KEyhwMeaGhr0gcXVjV-JiYTdwkXCsz9BluTg2BEN9IB-NgqbJiUBpHECA5SxkJNSMvFycVMDzMnN3LkLLLoMvKlX7gU8Oc-qNzV2CiHNQwvncwbN1L5s5JrSYqB51hPePeb4hmhc8 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dd216ac16983485a8f68ab19f5c51bcc Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd216ac16983485a8f68ab19f5c51bcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dd216ac16983485a8f68ab19f5c51bcc Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1225538729 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesAdminNegativeTest-1225538729-project-admin Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0490e8c70a5a46029b61427813027c35 Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesAdminNegativeTest-1225538729-project-admin Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: {"volumeAttachment": {"volumeId": "d76429e1-3eb7-4291-a801-97f4e45c6597"}} Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: exception: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': '110b26f4-d34d-4f97-aee0-c219974d5e94', 'id': 'cc023465-14e0-42dc-b8d7-ca1c3bf89afa', 'body': {'volumeAttachment': {'volumeId': 'd76429e1-3eb7-4291-a801-97f4e45c6597'}}} Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. (HTTP 404) (Request-ID: req-0d70724f-11ed-4780-b99a-23b0539029af) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:26:17.760691 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. Jul 18 02:26:17.771773 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:17.783456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] Returning 404 to user: Volume cc023465-14e0-42dc-b8d7-ca1c3bf89afa could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:17.785434 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-77677b46-f186-409f-ab98-d2f2deaaba55 tempest-VolumesAdminNegativeTest-1225538729 tempest-VolumesAdminNegativeTest-1225538729-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94/os-volume_attachments/cc023465-14e0-42dc-b8d7-ca1c3bf89afa" status: 404 len: 109 microversion: 2.1 time: 0.201195 Jul 18 02:26:17.786289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1358/2738] 10.222.0.67 () {60 vars in 1432 bytes} [Mon Jul 18 02:26:17 2022] PUT /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94/os-volume_attachments/cc023465-14e0-42dc-b8d7-ca1c3bf89afa => generated 109 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:17.802836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-662ed3db-f89d-449e-85db-64c832d2a20f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.787712 Jul 18 02:26:17.803836 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1381/2739] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:17 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:17.812497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:17.817386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:17.833340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.834727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:17.837144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:17.838444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.166389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:18.167204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:18.182070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.182588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.183451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.183902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.601716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:18.653145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:18.657847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:18.677740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-87be9f7f-c7f7-4103-9633-4afa893a4867 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.888797 Jul 18 02:26:18.679400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1359/2740] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:17 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:18.842803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:18.843742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:18.888575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.889981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:18.895286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:18.896431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:19.146945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.173728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.188777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.191884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29b22690-e221-4b43-ada8-16efd2f3627f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 1.036364 Jul 18 02:26:19.193033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1382/2741] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:18 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:19.714721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:19.715351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:19.721623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.729541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:19.730391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:19.731632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:19.732253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:19.740789 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc63a76e-5d10-4b78-9e29-6320d850368d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.910040 Jul 18 02:26:19.741557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1360/2742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:18 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:19.890632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.908817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.912104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:19.929444 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb8aca8b-15aa-4bf4-af4a-82a2c74908ab tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.218540 Jul 18 02:26:19.945975 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1383/2743] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:19 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:20.225220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:20.226200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:20.227694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1029827391", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "db26e511-b904-4fda-853b-6243a3b0dcf4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:20.244902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.245405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.246859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.252100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.314491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] validate_networks() for [('db26e511-b904-4fda-853b-6243a3b0dcf4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:26:20.728548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:20.751092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:20.754800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:20.758032 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee38c1aa-5d3a-4ea5-9f8c-b197cedde6e6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 0.537098 Jul 18 02:26:20.760318 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1384/2744] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:20 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:20.786805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:20.791400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:20.812060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:20.825527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.827299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.831187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:20.833022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:20.845905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:21.238796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:21.255879 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ec9c8f5-9c08-409d-81e8-c9055bff2fa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.493263 Jul 18 02:26:21.257961 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1385/2745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:20 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:21.268697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:21.271194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:21.317384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.318247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.320898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.321757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.545827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:21.584532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:21.589860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:21.604114 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5dc79bb3-6017-499d-86ff-0f316765aa83 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1446 microversion: 2.75 time: 0.343889 Jul 18 02:26:21.605935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1386/2746] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:21 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1446 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:21.783633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:21.784866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:21.825989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.826914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:21.833487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:21.835799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:22.268337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:22.291049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:22.309311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:22.320337 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c875231-1126-4dce-bbfb-690e8c1747d0 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 0.540168 Jul 18 02:26:22.327507 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1387/2747] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:21 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:22.343254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:22.347741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:22.372827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.374162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:22.376264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.379347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:22.910258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:22.942122 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4333bf2-a7a1-44eb-af51-5bf69d7bae24 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.611835 Jul 18 02:26:22.950447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1388/2748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:22 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:22.976124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:22.977743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:22.994561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.996213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:22.997168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:22.997628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.184125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.229246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.238631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.248181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:23.250291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:23.251964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:23.257310 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c135b8eb-9449-4f35-9edb-0f396aa4f3ee tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1452 microversion: 2.75 time: 0.304064 Jul 18 02:26:23.258935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1389/2749] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:22 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:23.261103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:23.263086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:23.339106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:23.347922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:23.350161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:23.354748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.361462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:23.366127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.381871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:23.387609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.391652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:23.400197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:23.454622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Getting quotas for project 453cc938c2de43c6a86c0383041f8487. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:23.472392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Getting quotas for user 41d2936926b746d28f3706bf2f01a294 and project 453cc938c2de43c6a86c0383041f8487. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:23.512120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:26:23.515806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:23.666542 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c81079d2-b191-422b-add8-4fff3ecb6336 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.532355 Jul 18 02:26:23.668708 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1361/2750] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:26:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:26:23.698589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4eac833e-076b-41de-bd48-4f72da895326 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:23.701240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4eac833e-076b-41de-bd48-4f72da895326 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:23.837298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.849266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.860748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:23.864008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bac8155-730d-409b-93e2-ae71dfa62c64 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 0.522328 Jul 18 02:26:23.868500 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1390/2751] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:23 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:23.963899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:23.966699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.016165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.018901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.022084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.024484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.065529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4eac833e-076b-41de-bd48-4f72da895326 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:24.079522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4eac833e-076b-41de-bd48-4f72da895326 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1217 microversion: 2.1 time: 0.399121 Jul 18 02:26:24.088390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1362/2752] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:23 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1217 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:24.115377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.116418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.138813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.139181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.140051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.140504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.208497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:24.230629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:26:24.439630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:24.453938 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-020f74b8-f992-4117-94a1-c085dc2502d9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.493623 Jul 18 02:26:24.455707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1391/2753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:23 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:24.462786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.466155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.494365 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-474ec766-254f-44ff-a2a1-d114f260f219 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "DELETE /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 204 len: 0 microversion: 2.1 time: 0.403439 Jul 18 02:26:24.496831 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1363/2754] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:26:24 2022] DELETE /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:26:24.508372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.509411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.510562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.511561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.522513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.531803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.575338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.576147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.583394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.585974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.657532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:24.689991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:24.705846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:24.736340 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ac0902f-eb65-4abb-b9ec-c5b7d3d1f76e tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1452 microversion: 2.75 time: 0.275842 Jul 18 02:26:24.753723 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1392/2755] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:24 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1452 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:24.886899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:24.887643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:24.926366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.928791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:24.932242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:24.933800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.361368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:25.391183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e145d60a-d558-4827-b6d5-6cff28500dbe tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1512 microversion: 2.1 time: 0.887622 Jul 18 02:26:25.391958 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1364/2756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:24 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1512 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:25.402316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:25.414664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:25.435004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.435801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.437375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.438023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.492866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:25.510797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:25.515143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:25.518430 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da644329-e6c5-4fce-b9e2-336b27cb4c6e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 0.636014 Jul 18 02:26:25.522425 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1393/2757] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:24 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:25.537547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:25.538533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:25.552569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.553618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.555022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.555801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.768499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:25.791330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6969ceae-331f-4f2c-b625-de7e97ad2017 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1213 microversion: 2.1 time: 0.397956 Jul 18 02:26:25.795519 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1365/2758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:25 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1213 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:25.823953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:25.830718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:25.851004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.852769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.854290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:25.859845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:25.966839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.000491 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5569c2f8-aca6-48ec-a8dd-6ada707adbda tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.474236 Jul 18 02:26:26.002070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1394/2759] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:25 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:26.149834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.180390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.182416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.196832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-440c11bd-b71e-4813-b9a5-a44b5cc43eae tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1452 microversion: 2.75 time: 0.399175 Jul 18 02:26:26.197692 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1366/2760] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:25 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1452 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:26.414770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:26.427015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:26.446064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.447514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.449527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.458305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.544868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:26.546759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:26.576766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.577708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.581610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.584180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.780091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:26.792191 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22184efb-c9c7-4391-820f-f967a054d7e4 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1512 microversion: 2.1 time: 0.385129 Jul 18 02:26:26.793644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1395/2761] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:26 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:26.831876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:26.834361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:26.851763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.859205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:26.860441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:26.864870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.000905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.019993 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9136ffa2-3328-4820-a242-e9ba83a3f9b1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1275 microversion: 2.1 time: 0.191190 Jul 18 02:26:27.030394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1396/2762] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:26 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:27.037028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:27.037942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:27.047428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.048195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.051982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.052723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.634487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.677121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.702276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.706794 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc20c0f6-d288-41af-b73f-9a63ac53b74d tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 1.166144 Jul 18 02:26:27.707855 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1367/2763] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:26 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:27.748207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:27.751053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:27.771318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.773800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.774810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:27.777594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:27.949918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.963938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.965636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.982367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:27.987463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6c79bf5-da47-489a-ad4f-b55cfbe47b73 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1452 microversion: 2.75 time: 0.266338 Jul 18 02:26:27.988068 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1368/2764] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:27 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:28.003613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:28.009642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:28.012651 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35461eb1-86fe-40dd-b00c-1e8ae120dd90 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.980016 Jul 18 02:26:28.014279 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1397/2765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:27 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:28.032082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.035644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.043222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.047468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.060965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5ae1fe62-6295-4350-9ff9-70d4394926d6 req-16eb8f6a-f902-400e-8d67-16f03114b8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe31f7a-84e8-4fcd-af94-3b635636a5fa", "name": "network-vif-plugged", "status": "completed", "tag": "617f3613-dd7e-46e8-9aef-f554bf29e23e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:28.131224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5ae1fe62-6295-4350-9ff9-70d4394926d6 req-16eb8f6a-f902-400e-8d67-16f03114b8ac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.134281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5ae1fe62-6295-4350-9ff9-70d4394926d6 req-16eb8f6a-f902-400e-8d67-16f03114b8ac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.201633 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5ae1fe62-6295-4350-9ff9-70d4394926d6 req-16eb8f6a-f902-400e-8d67-16f03114b8ac service nova] Creating event network-vif-plugged:617f3613-dd7e-46e8-9aef-f554bf29e23e for instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa on n-h1-849796-1 Jul 18 02:26:28.239657 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5ae1fe62-6295-4350-9ff9-70d4394926d6 req-16eb8f6a-f902-400e-8d67-16f03114b8ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193165 Jul 18 02:26:28.247426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1398/2766] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:28.275214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:28.289612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:28.359194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.359961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.361364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.362098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.733608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:28.756086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a3717d9-358c-42b4-bb27-a552ee648b01 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1275 microversion: 2.1 time: 0.506341 Jul 18 02:26:28.757209 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1399/2767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:28 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1275 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:28.794864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:28.795802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:28.813578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.817400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.818895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:28.819676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:28.924492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:28.968422 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-778286ac-b2e6-4cdd-aa5e-4028b4b524c7 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1512 microversion: 2.1 time: 0.971864 Jul 18 02:26:28.990549 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1369/2768] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:27 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1512 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:29.038845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:29.040234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:29.062624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.063873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.066250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.067602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.483390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.530913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.533291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.540485 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92638e0b-77bc-4e8c-8b07-6f314b9e6e01 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1452 microversion: 2.75 time: 0.514084 Jul 18 02:26:29.541561 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1370/2769] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:29 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1452 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:29.547673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:29.548599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:29.556531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.557372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.558395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:29.559027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:29.897065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.931054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.942085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.952882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4570594-23af-4eaf-88cc-29a04e17574b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1358 microversion: 2.21 time: 1.169853 Jul 18 02:26:29.958838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1400/2770] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:28 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1358 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:29.967419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:29.973978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:29.991414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:29.999848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.000413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.005720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59cfa039-7353-44fb-8720-a231203cdcde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.462774 Jul 18 02:26:30.006341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1371/2771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:29 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:30.009133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.010282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.025082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:30.025969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:30.033734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.034215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.035825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.036288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.358072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:30.371908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fc280e0-f672-434f-9b6d-1e099263712b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 200 len: 1512 microversion: 2.1 time: 0.353011 Jul 18 02:26:30.385216 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1372/2772] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:30 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:30.570085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:30.571037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:30.584903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.589459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.594778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.597539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.853538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:30.873947 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd6cd777-7968-4aeb-a035-2dc9ddc7a95d tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.912955 Jul 18 02:26:30.875585 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1401/2773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:29 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:30.922065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3d46e8f0-3df0-4a5c-bb30-aa6fed56650b req-66e40c86-62cc-4c39-9e67-ee75d7c55197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110b26f4-d34d-4f97-aee0-c219974d5e94", "name": "network-vif-deleted", "tag": "d9c863bf-81d0-4087-beef-9b17b988ee2c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:30.953114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3d46e8f0-3df0-4a5c-bb30-aa6fed56650b req-66e40c86-62cc-4c39-9e67-ee75d7c55197 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:30.963623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3d46e8f0-3df0-4a5c-bb30-aa6fed56650b req-66e40c86-62cc-4c39-9e67-ee75d7c55197 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:30.977591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.009569 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3d46e8f0-3df0-4a5c-bb30-aa6fed56650b req-66e40c86-62cc-4c39-9e67-ee75d7c55197 service nova] Creating event network-vif-deleted:d9c863bf-81d0-4087-beef-9b17b988ee2c for instance 110b26f4-d34d-4f97-aee0-c219974d5e94 on n-h2-849796-1 Jul 18 02:26:31.026174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.031296 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3d46e8f0-3df0-4a5c-bb30-aa6fed56650b req-66e40c86-62cc-4c39-9e67-ee75d7c55197 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152410 Jul 18 02:26:31.033918 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1402/2774] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:31.039424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.056864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:31.058690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:31.096570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a301fd58-4d2a-434e-9efc-b0ab0abb28dc tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1437 microversion: 2.75 time: 0.528106 Jul 18 02:26:31.107194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1373/2775] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:30 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1437 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:31.120442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:31.136390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:31.138984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.142546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.147203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.149096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.170854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:31.175240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.182819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.193941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.194858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.584969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.621859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.627498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.629037 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7523dd4e-7466-44dc-8fdf-d3d54be5912b tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1552 microversion: 2.21 time: 0.592836 Jul 18 02:26:31.638964 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1403/2776] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:31 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1552 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:31.847727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:31.886756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06ac1d74-46c8-43fd-b6a6-d66a42787446 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.777631 Jul 18 02:26:31.894090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1374/2777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:31 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:31.920840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:31.927965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 110b26f4-d34d-4f97-aee0-c219974d5e94] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:31.956566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.960906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:31.967060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:31.968638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.004787 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] HTTP exception thrown: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Request method failure captured: Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 HTTP/1.1 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MPLqjVmDoa2qnk0AQD7ULWn-FM5o71GU67B8GfngAE3dhJyTQtdkExKOJw7W3b4PJDQg8ZaXlAYaA64ob1DUkb7o3XlIGl83nEg2_8-0K3FrOkVAWn5LgaH2awF2GYs78DUjTmMMdS2XI4Ynb5LChanFuAJKrcYPIrLnTU6QNrz4mk Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 85158a5ab74d45ce9692f81398d3c3d3 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 85158a5ab74d45ce9692f81398d3c3d3 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesAdminNegativeTest-827788139-project Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: de515d451d7c40ce8e4f31ff9d5367b5 Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesAdminNegativeTest-827788139-project Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '110b26f4-d34d-4f97-aee0-c219974d5e94'} Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:32.010348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. Jul 18 02:26:32.022764 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:32.025853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Returning 404 to user: Instance 110b26f4-d34d-4f97-aee0-c219974d5e94 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:32.041662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:32.047455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81c889b8-3698-4de4-8315-d58e716e3b04 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94" status: 404 len: 111 microversion: 2.1 time: 0.143078 Jul 18 02:26:32.057644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:32.060338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1375/2778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:31 2022] GET /compute/v2.1/servers/110b26f4-d34d-4f97-aee0-c219974d5e94 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:32.079070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:32.080123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:32.096455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.098333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.100132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.103918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.113499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.114001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.119521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.120024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.213556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:26:32.350385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:32.350953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:32.353716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:32.354592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:32.368438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:32.617346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:32.640306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.647100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.648417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.649975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.747786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-647a3437-0216-4e4d-80bc-ccdd9a085ca8 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 204 len: 0 microversion: 2.21 time: 0.683883 Jul 18 02:26:32.749567 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1376/2779] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:26:32 2022] DELETE /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:26:32.758271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:32.772831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:32.787777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.788353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.789379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:32.792762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:32.807036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:33.243350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:33.255850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fbb19ab8-8469-42a2-bc75-29a6efbfef28 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.503952 Jul 18 02:26:33.258061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1377/2780] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:32 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:33.268787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:33.270496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:33.288185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:33.303005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:33.305885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:33.306359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:33.424473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:33.502510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:33.568720 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75699b52-47e3-4ec8-abe3-6c9849f059bf tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd/action" status: 202 len: 1940 microversion: 2.75 time: 1.924734 Jul 18 02:26:33.570114 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1404/2781] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:26:31 2022] POST /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd/action => generated 1940 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:26:33.584088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:33.589332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:33.605451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:33.606045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:33.607221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:33.608058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:33.887163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:33.918425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79084ac6-d969-403f-a85f-d8bf678ea9be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.343156 Jul 18 02:26:33.930548 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1405/2782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:33 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:33.967225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:33.976279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:34.030418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.035878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.041031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.051110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.091046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:34.577257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:34.660084 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ebe3578-f5ea-48d1-b251-7e7466b06779 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.711624 Jul 18 02:26:34.680019 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1406/2783] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:33 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:34.689987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:34.704780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:34.710489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ee274c6a-24a5-49f7-97c3-6b22e61f3ae1 req-b5a7d2fc-6b7a-4d46-a194-5e315bdea734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e4fe07-6694-45f7-8384-cdb7e339a768", "tag": "bdef6022-b40a-45f7-bf06-004d2ed0dbfc"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:34.712720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:34.714268 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c2faf9de-851d-4dad-bc8c-4c2110a9278a tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1558 microversion: 2.21 time: 1.455058 Jul 18 02:26:34.715318 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1378/2784] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:33 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1558 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:34.720703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:34.721394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:34.724735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:34.746135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee274c6a-24a5-49f7-97c3-6b22e61f3ae1 req-b5a7d2fc-6b7a-4d46-a194-5e315bdea734 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.746789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee274c6a-24a5-49f7-97c3-6b22e61f3ae1 req-b5a7d2fc-6b7a-4d46-a194-5e315bdea734 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.766876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.767536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.769470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.771290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.794181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ee274c6a-24a5-49f7-97c3-6b22e61f3ae1 req-b5a7d2fc-6b7a-4d46-a194-5e315bdea734 service nova] Creating event network-changed:bdef6022-b40a-45f7-bf06-004d2ed0dbfc for instance 07e4fe07-6694-45f7-8384-cdb7e339a768 on n-h1-849796-1 Jul 18 02:26:34.841214 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ee274c6a-24a5-49f7-97c3-6b22e61f3ae1 req-b5a7d2fc-6b7a-4d46-a194-5e315bdea734 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142988 Jul 18 02:26:34.848862 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1407/2785] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:34.952559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:34.957907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:34.976211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.977183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:34.979505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:34.981826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:35.347170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:35.363486 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be369c72-138d-41a4-bf75-71a6ef253da4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.418778 Jul 18 02:26:35.373341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1408/2786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:34 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:35.700830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:35.702014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:35.716522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:35.717069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:35.717917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:35.718377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:35.958717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:36.029164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-843f70dd-4477-49b8-b13b-5b0bf59f2498 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.330873 Jul 18 02:26:36.031577 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1409/2787] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:35 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:26:36.038433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:36.039067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:36.061548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.062287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.063322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.063985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.364543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:36.378231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:36.380019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:36.381440 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-234d90b6-8eed-4b2a-9ba4-6816e82731b6 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1558 microversion: 2.21 time: 0.349030 Jul 18 02:26:36.382456 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1410/2788] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:36 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1558 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:36.488538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-989063025", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:36.567031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:36.603765 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4191c036-4262-4374-92ff-416d89d28052 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 1.886847 Jul 18 02:26:36.604891 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1379/2789] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:34 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:36.635929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:36.637549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:36.655486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.656693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.658409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:36.661514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:36.664193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:26:37.498923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:37.512879 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8ebd5a9-efa4-472f-893a-2e315176a14b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1497 microversion: 2.1 time: 0.885000 Jul 18 02:26:37.514219 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1380/2790] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:36 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1497 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:37.534823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:37.541471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:37.570615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:37.572859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:37.578059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:37.579160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:37.964422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:37.966222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:37.967365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:37.968598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:37.969675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:38.006532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.007356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.008966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.022326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.045648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:38.098008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:38.106291 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e3f43c3-6553-4ec3-ad72-54790c0efd9b tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.578911 Jul 18 02:26:38.107864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1381/2791] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:37 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:38.117237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f4af2b39-23a8-4d79-b8ab-5156eb8523f9 req-17bcdbdc-fea5-4e62-b74d-1f2058481d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe31f7a-84e8-4fcd-af94-3b635636a5fa", "name": "network-vif-deleted", "tag": "617f3613-dd7e-46e8-9aef-f554bf29e23e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:38.123963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:38.158216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f4af2b39-23a8-4d79-b8ab-5156eb8523f9 req-17bcdbdc-fea5-4e62-b74d-1f2058481d3f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.163456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f4af2b39-23a8-4d79-b8ab-5156eb8523f9 req-17bcdbdc-fea5-4e62-b74d-1f2058481d3f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.174197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:26:38.189570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:38.241347 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f4af2b39-23a8-4d79-b8ab-5156eb8523f9 req-17bcdbdc-fea5-4e62-b74d-1f2058481d3f service nova] Creating event network-vif-deleted:617f3613-dd7e-46e8-9aef-f554bf29e23e for instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa on n-h1-849796-1 Jul 18 02:26:38.251941 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f4af2b39-23a8-4d79-b8ab-5156eb8523f9 req-17bcdbdc-fea5-4e62-b74d-1f2058481d3f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141956 Jul 18 02:26:38.255172 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1382/2792] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:38.267718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.269595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.285806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.287807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.289034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.290197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.380400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.389071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.390059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lazy-loading 'fault' on Instance uuid bbe31f7a-84e8-4fcd-af94-3b635636a5fa {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:38.438041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da4bb5db-e51b-480e-a219-4bc071dbd450 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053936 Jul 18 02:26:38.451872 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1411/2793] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:26:38.486673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.493343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.518572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.520018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.522655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.527216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.557272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:38.577850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:38.584379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:38.587115 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39afb59f-f238-494a-8db7-e33c38688737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1348 microversion: 2.21 time: 0.329607 Jul 18 02:26:38.590637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1383/2794] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1348 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:38.600826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5c96008-6f1b-41f1-8e48-a0be8c6d8951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.602447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5c96008-6f1b-41f1-8e48-a0be8c6d8951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.773196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5c96008-6f1b-41f1-8e48-a0be8c6d8951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:38.830073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5c96008-6f1b-41f1-8e48-a0be8c6d8951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1214 microversion: 2.1 time: 0.237184 Jul 18 02:26:38.839338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1384/2795] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:38.882738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:38.887839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:38.935713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.939663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:38.957192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:38.960044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.170403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:39.208278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d992e5e1-a56c-4c40-a465-db5a42f536d1 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.749038 Jul 18 02:26:39.211444 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1412/2796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:39.226222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:39.228048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:39.245834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.263691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.266843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.268163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.311183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:39.338628 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ffcd946f-f10e-4bd7-ac3b-8d4866d40ba2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 200 len: 1474 microversion: 2.1 time: 0.495492 Jul 18 02:26:39.339626 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1385/2797] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:38 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 1474 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:39.371964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-655051926"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:39.378409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:39.402245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.402954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.411495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.412653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.466514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:39.523356 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d526a395-a826-41f9-abb6-04b4aeac9d00 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.308286 Jul 18 02:26:39.535102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1413/2798] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:39 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:39.570796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:39.571276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:39.593848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.594562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.599416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:39.600259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:39.689589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:26:39.972517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f404e998-694d-4898-a86c-d1bc352b93aa tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "DELETE /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 204 len: 0 microversion: 2.1 time: 0.405096 Jul 18 02:26:39.974297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1414/2799] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:26:39 2022] DELETE /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:26:39.984574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:39.985440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.017877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.019181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.020601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.021095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.104848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:40.129293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.131057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.131825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lazy-loading 'fault' on Instance uuid bbe31f7a-84e8-4fcd-af94-3b635636a5fa {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:40.138336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:40.239842 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-702af058-0e87-4012-975a-8e6bb7d4241e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c/action" status: 202 len: 0 microversion: 2.1 time: 0.874061 Jul 18 02:26:40.240613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1386/2800] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:26:39 2022] POST /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 02:26:40.256504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-506cf4f7-4b09-4e69-a364-adc401009e78 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.258578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-506cf4f7-4b09-4e69-a364-adc401009e78 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.287387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.357121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.374991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c80df681dca46e49b71c4307e01192c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d722c616b8e4b90b7ee226cc9234074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.377348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-237935fd-05a5-4d85-bb83-784e14b10207 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 200 len: 1348 microversion: 2.21 time: 0.401539 Jul 18 02:26:40.396968 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1415/2801] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:39 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 1348 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:40.396968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.396968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.414937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.415404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.416233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.416694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.438584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-506cf4f7-4b09-4e69-a364-adc401009e78 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.449816 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-506cf4f7-4b09-4e69-a364-adc401009e78 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1214 microversion: 2.1 time: 0.204156 Jul 18 02:26:40.450575 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1387/2802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:40.456318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.457329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.467233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.467805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.468753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.469347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.806958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:40.823252 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d42e8100-113f-4081-b8da-02a7361fa4c5 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1682 microversion: 2.1 time: 0.436637 Jul 18 02:26:40.834502 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1416/2803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1682 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:40.842045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a948efa5-a1ff-4dbb-acc0-efec580247c9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05e2d040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.967215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a948efa5-a1ff-4dbb-acc0-efec580247c9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.131315 Jul 18 02:26:40.974900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1417/2804] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:40.980057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:40.981258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:40.989081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.990070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:40.991409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:40.992159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.154785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:41.230092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21e46549-6806-4c1c-a48f-6627b6894f38 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.241334 Jul 18 02:26:41.232084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1418/2805] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:41.400608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:41.424176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:41.431570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:41.454134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30002c11-070b-41af-833d-00783b683576 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 1.001751 Jul 18 02:26:41.468175 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1388/2806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:40 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:41.497075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:41.497803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:41.505413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.506124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.506945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.512398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.514704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.518892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.519858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.523165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.608186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] HTTP exception thrown: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Request method failure captured: Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa HTTP/1.1 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MS7Gl1-Tuszspu84AJUEoLlbIb04y1akj2hEsBhH1rDLjDegAuL2yxzO-vlh9vAL3B1vK8ATuW3bnpGM_bYEMlCfsT0lCu9809t1Otvncw-2vpVRcSMZ0gzqdoCTGkfCtUMhCmXfgFpdjnQ-cETudQZyle8LAOk4p8xd5ah5okxD1o Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7c80df681dca46e49b71c4307e01192c Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'bbe31f7a-84e8-4fcd-af94-3b635636a5fa'} Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:41.618256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:41.628835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:41.635877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Returning 404 to user: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:41.638254 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd770e75-de97-4400-bcaa-34aee0206126 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 404 len: 111 microversion: 2.21 time: 0.221282 Jul 18 02:26:41.644334 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1419/2807] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:26:41.670157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '.version_select at 0x7fab05648e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:41.681987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:41.701762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.702845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.708644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.710268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.735401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:41.749930 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-87a8bd46-97fc-4611-975e-02038b5ad7a8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1210 microversion: 2.1 time: 0.268972 Jul 18 02:26:41.755356 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1389/2808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1210 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:41.846013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:41.847268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:41.862683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.870477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.871525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:41.874521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:41.961795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19e3e807-eb12-4755-9729-a852889ef80e tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.303840 Jul 18 02:26:41.977727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1420/2809] 10.222.0.67 () {60 vars in 1336 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa/os-instance-actions => generated 611 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:26:41.991063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27dcc035-f6b2-4158-be55-132cb4b024c0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab055dd5e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.100611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27dcc035-f6b2-4158-be55-132cb4b024c0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.119892 Jul 18 02:26:42.101957 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1421/2810] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:42.122428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.123337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.135971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.136676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.138102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.139561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.165173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] HTTP exception thrown: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Request method failure captured: Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa HTTP/1.1 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MS7Gl1-Tuszspu84AJUEoLlbIb04y1akj2hEsBhH1rDLjDegAuL2yxzO-vlh9vAL3B1vK8ATuW3bnpGM_bYEMlCfsT0lCu9809t1Otvncw-2vpVRcSMZ0gzqdoCTGkfCtUMhCmXfgFpdjnQ-cETudQZyle8LAOk4p8xd5ah5okxD1o Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7c80df681dca46e49b71c4307e01192c Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'bbe31f7a-84e8-4fcd-af94-3b635636a5fa'} Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:42.167241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.171884 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.174182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Returning 404 to user: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:42.176077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba86ff7e-db0b-4008-bfc7-c477d50d7737 tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 404 len: 111 microversion: 2.21 time: 0.071369 Jul 18 02:26:42.177016 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1422/2811] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:26:42 2022] DELETE /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:26:42.187234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.188381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] [instance: bbe31f7a-84e8-4fcd-af94-3b635636a5fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.196816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.197642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.198650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.199307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.218958 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] HTTP exception thrown: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Request method failure captured: Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa HTTP/1.1 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MS7Gl1-Tuszspu84AJUEoLlbIb04y1akj2hEsBhH1rDLjDegAuL2yxzO-vlh9vAL3B1vK8ATuW3bnpGM_bYEMlCfsT0lCu9809t1Otvncw-2vpVRcSMZ0gzqdoCTGkfCtUMhCmXfgFpdjnQ-cETudQZyle8LAOk4p8xd5ah5okxD1o Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.21 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d722c616b8e4b90b7ee226cc9234074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 1d722c616b8e4b90b7ee226cc9234074 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1853229302 Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7c80df681dca46e49b71c4307e01192c Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsV221TestJSON-1853229302-project Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'bbe31f7a-84e8-4fcd-af94-3b635636a5fa'} Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.221041 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. Jul 18 02:26:42.228109 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:42.230142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] Returning 404 to user: Instance bbe31f7a-84e8-4fcd-af94-3b635636a5fa could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:42.231218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5698a46-2d87-4415-8b98-732a708b2a2f tempest-InstanceActionsV221TestJSON-1853229302 tempest-InstanceActionsV221TestJSON-1853229302-project] 10.222.0.67 "GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa" status: 404 len: 111 microversion: 2.21 time: 0.049566 Jul 18 02:26:42.235392 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1423/2812] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:42 2022] GET /compute/v2.1/servers/bbe31f7a-84e8-4fcd-af94-3b635636a5fa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:26:42.253510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:42.255433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.256280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.273056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.273708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.274682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.275791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.276639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5d5b7a1-1a60-4410-b779-1aed9bf540a9 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1682 microversion: 2.1 time: 0.434970 Jul 18 02:26:42.277744 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1390/2813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:41 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:42.500744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.505194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.515406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.517070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.520719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.525771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.580077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:42.652901 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86006844-dabf-4c9c-81ef-cde4af316920 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.404729 Jul 18 02:26:42.655148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1424/2814] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:42 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:42.785320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:42.786212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:42.802589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.803522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.812467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:42.817791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:42.863621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:42.876572 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3e9b248-8b18-4f2a-a845-8cf5c674c878 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.379622 Jul 18 02:26:42.878360 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1391/2815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:42 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:43.112094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:43.117555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f6e78cf-6dca-4461-868b-edd1e77c82f1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab047654c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:43.134453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5a20b02-92ab-4d1d-a0ff-fa79a6f2bf11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1284 microversion: 2.1 time: 0.354893 Jul 18 02:26:43.135989 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1425/2816] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:42 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1284 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:43.202050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f6e78cf-6dca-4461-868b-edd1e77c82f1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.089727 Jul 18 02:26:43.202576 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1392/2817] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:43 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:43.310209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:43.310836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:43.319208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.320715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.321645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.322087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.679412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:43.681312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:43.691247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.693321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.694702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.695731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.844549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:43.868350 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-25044b84-eead-40e7-98bb-dc4962f933f3 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.195933 Jul 18 02:26:43.882184 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1393/2818] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:43 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:43.889993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:43.899838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00be8f9b-a568-42d6-91fb-14f2b537a539 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1682 microversion: 2.1 time: 0.593687 Jul 18 02:26:43.901998 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1426/2819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:43 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1682 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:43.916493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:43.917431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:43.924975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.925898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:43.927130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:43.927769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.090571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:44.110928 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2092dad6-be79-4064-a95c-e2bfe4db69bd tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.198510 Jul 18 02:26:44.113106 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1394/2820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:43 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:44.176257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.179168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:44.188996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.189771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.193172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.193759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.225025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e6b8f49-ee62-49b9-91c8-a0498bba8618 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a7b5160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.333430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e6b8f49-ee62-49b9-91c8-a0498bba8618 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.116358 Jul 18 02:26:44.334357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1395/2821] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:44.469596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:44.489402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d16e1a19-6354-4b80-83a2-c7d8c92498e6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1272 microversion: 2.1 time: 0.327888 Jul 18 02:26:44.490459 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1427/2822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1272 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:44.891204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.892167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:44.914107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.917104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.919975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.921370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:44.923497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:44.929259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.941493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.942595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:44.943447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:44.943902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.025932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:45.103571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:45.116418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a19cd50d-5e75-4a8b-9da6-7ee660535828 tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1614 microversion: 2.1 time: 0.200300 Jul 18 02:26:45.120188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1428/2823] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1614 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:45.130314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-32b41395-da07-4beb-a339-2bfd6d5ad13f req-d4c6740e-fdd3-4ab0-8764-0817ead7c109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e4fe07-6694-45f7-8384-cdb7e339a768", "name": "network-vif-plugged", "status": "completed", "tag": "bdef6022-b40a-45f7-bf06-004d2ed0dbfc"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:45.160082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-32b41395-da07-4beb-a339-2bfd6d5ad13f req-d4c6740e-fdd3-4ab0-8764-0817ead7c109 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:45.161101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-32b41395-da07-4beb-a339-2bfd6d5ad13f req-d4c6740e-fdd3-4ab0-8764-0817ead7c109 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.176574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:45.187067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-32b41395-da07-4beb-a339-2bfd6d5ad13f req-d4c6740e-fdd3-4ab0-8764-0817ead7c109 service nova] Creating event network-vif-plugged:bdef6022-b40a-45f7-bf06-004d2ed0dbfc for instance 07e4fe07-6694-45f7-8384-cdb7e339a768 on n-h1-849796-1 Jul 18 02:26:45.197987 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-32b41395-da07-4beb-a339-2bfd6d5ad13f req-d4c6740e-fdd3-4ab0-8764-0817ead7c109 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073072 Jul 18 02:26:45.200065 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1429/2824] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:45.213307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:45.215550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:45.232328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:45.233934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.236041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:45.238123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.259314 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc1cb799-6c54-419b-96bd-e762c278d8e5 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.363389 Jul 18 02:26:45.274932 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1396/2825] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:44 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:45.356046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a86bd65e-d286-4523-b9e1-8c9ccf69409c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04771940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:45.530117 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a86bd65e-d286-4523-b9e1-8c9ccf69409c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.184076 Jul 18 02:26:45.552328 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1397/2826] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:45 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:45.563225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:45.566024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:45.579296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:45.579987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.581944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:45.582679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:45.835810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:45.847691 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30f6109f-980e-4614-80dd-1b6530eb7dfe tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.293820 Jul 18 02:26:45.848550 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1398/2827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:45 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:46.153776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:46.155155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:46.160562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:46.176133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6cdbabf1-407a-4f07-89bc-01a77c10cab3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.972635 Jul 18 02:26:46.179629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.180586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.181548 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1430/2828] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:45 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:46.191579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.191579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.295015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:46.296080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:46.311413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.313372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.316162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.318392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.400873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:46.443929 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb0b1ffd-99bc-4bcc-a6d6-07217fada59f tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1614 microversion: 2.1 time: 0.295635 Jul 18 02:26:46.445974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1399/2829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:46 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1614 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:46.560859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e8f69d6a-c720-4b85-bbae-cf3f5c0673d1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab047ea5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:46.619802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:46.672387 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e8f69d6a-c720-4b85-bbae-cf3f5c0673d1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.122327 Jul 18 02:26:46.677951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1400/2830] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:46 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:46.726439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a38d781-112a-4311-9fdf-dd8c1aac9679 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.434065 Jul 18 02:26:46.729420 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1431/2831] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:46 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:46.879509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:46.880690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:46.883093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4ef89133-acee-4ffb-aba9-0f981b71fcbf req-514e71b3-3ca7-422e-b769-2a337ae9aede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814984c0-2fe5-453e-aa2c-e595972987ed", "name": "network-vif-deleted", "tag": "133c38e1-c5b5-472c-9d2d-3cc18274cdd1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:46.925931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.926894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.928412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.929265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:46.940966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4ef89133-acee-4ffb-aba9-0f981b71fcbf req-514e71b3-3ca7-422e-b769-2a337ae9aede service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:46.962228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4ef89133-acee-4ffb-aba9-0f981b71fcbf req-514e71b3-3ca7-422e-b769-2a337ae9aede service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.004618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4ef89133-acee-4ffb-aba9-0f981b71fcbf req-514e71b3-3ca7-422e-b769-2a337ae9aede service nova] Creating event network-vif-deleted:133c38e1-c5b5-472c-9d2d-3cc18274cdd1 for instance 814984c0-2fe5-453e-aa2c-e595972987ed on n-h2-849796-1 Jul 18 02:26:47.015556 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4ef89133-acee-4ffb-aba9-0f981b71fcbf req-514e71b3-3ca7-422e-b769-2a337ae9aede service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146811 Jul 18 02:26:47.016841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1432/2832] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:26:47.206556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.207616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:47.244473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.246663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.247622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.251976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.348501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:47.366353 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a1ed68c-b3b1-429b-a86d-31ab6c46e30d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.501092 Jul 18 02:26:47.381572 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1401/2833] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:46 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:47.401220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f97eadb8-3230-4da4-bc7d-fee045a9b2ee req-8f340b5e-cf42-46ec-bde0-766478ce0b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb7154-5239-40f6-b79d-99a38d02777c", "name": "network-vif-plugged", "status": "completed", "tag": "d1b5c46e-3ed0-4025-b756-48c1824c2034"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:47.433626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f97eadb8-3230-4da4-bc7d-fee045a9b2ee req-8f340b5e-cf42-46ec-bde0-766478ce0b54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.434311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f97eadb8-3230-4da4-bc7d-fee045a9b2ee req-8f340b5e-cf42-46ec-bde0-766478ce0b54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.461688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f97eadb8-3230-4da4-bc7d-fee045a9b2ee req-8f340b5e-cf42-46ec-bde0-766478ce0b54 service nova] Creating event network-vif-plugged:d1b5c46e-3ed0-4025-b756-48c1824c2034 for instance 60fb7154-5239-40f6-b79d-99a38d02777c on n-h1-849796-1 Jul 18 02:26:47.476380 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f97eadb8-3230-4da4-bc7d-fee045a9b2ee req-8f340b5e-cf42-46ec-bde0-766478ce0b54 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087971 Jul 18 02:26:47.478253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1402/2834] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:47.489683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.491598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:47.504895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.505853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.508027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.509234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.616454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.616454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.617254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lazy-loading 'fault' on Instance uuid 814984c0-2fe5-453e-aa2c-e595972987ed {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:47.705574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de515d451d7c40ce8e4f31ff9d5367b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85158a5ab74d45ce9692f81398d3c3d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:47.715656 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8977983-c830-4528-879e-f714cbedcb7c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 200 len: 1332 microversion: 2.1 time: 0.235376 Jul 18 02:26:47.716734 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1403/2835] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:47.722945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d997561-1c4b-49f2-8c3c-13855ff941a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043af280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.884301 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d997561-1c4b-49f2-8c3c-13855ff941a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.165628 Jul 18 02:26:47.885852 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1404/2836] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:47.899479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:47.900715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:47.911799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.913036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.913765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:47.914458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:47.958553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:47.971988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8441c3d-9de5-4cf6-a68b-39d8e4d70780 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1317 microversion: 2.1 time: 0.770535 Jul 18 02:26:47.985650 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1433/2837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1317 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:48.021064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2027815692", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bd1e5a05-05d2-4fdf-8c19-4cfb664a0b91"}], "security_groups": [{"name": "tempest-securitygroup--788228727"}], "key_name": "tempest-keypair-963145363", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d7e9396d-5b53-4bf8-b797-97f1951e76e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:48.068464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:48.076904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:48.121858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d83931a3-7e1f-4054-bc0c-8cd6b4f76bbe tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.233677 Jul 18 02:26:48.124075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1405/2838] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:47 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:48.149323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:48.423936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:48.431657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:48.469481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:48.494947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:48.496412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:48.496905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:48.511203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] validate_networks() for [('bd1e5a05-05d2-4fdf-8c19-4cfb664a0b91', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:26:49.002045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:49.026562 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-515d744b-e948-434c-bf6e-af8db7e39c7b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.645299 Jul 18 02:26:49.040840 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1406/2839] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:48 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:49.059711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:49.070146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] [instance: 814984c0-2fe5-453e-aa2c-e595972987ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:49.098693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.113558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.117609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.127270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.210044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] HTTP exception thrown: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Request method failure captured: Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed HTTP/1.1 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MPLqjVmDoa2qnk0AQD7ULWn-FM5o71GU67B8GfngAE3dhJyTQtdkExKOJw7W3b4PJDQg8ZaXlAYaA64ob1DUkb7o3XlIGl83nEg2_8-0K3FrOkVAWn5LgaH2awF2GYs78DUjTmMMdS2XI4Ynb5LChanFuAJKrcYPIrLnTU6QNrz4mk Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 85158a5ab74d45ce9692f81398d3c3d3 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85158a5ab74d45ce9692f81398d3c3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 85158a5ab74d45ce9692f81398d3c3d3 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-827788139 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesAdminNegativeTest-827788139-project Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: de515d451d7c40ce8e4f31ff9d5367b5 Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesAdminNegativeTest-827788139-project Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '814984c0-2fe5-453e-aa2c-e595972987ed'} Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:49.226408 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Returning 404 to user: Instance 814984c0-2fe5-453e-aa2c-e595972987ed could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:49.231479 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b8b95f3-ee78-45b9-a5eb-27c176b6739b tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed" status: 404 len: 111 microversion: 2.1 time: 0.186331 Jul 18 02:26:49.240423 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1407/2840] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/servers/814984c0-2fe5-453e-aa2c-e595972987ed => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:49.269119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa781b5e-e9a4-4746-8175-9031ae33041f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a7b9940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:49.380992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa781b5e-e9a4-4746-8175-9031ae33041f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.137398 Jul 18 02:26:49.382357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1408/2841] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:49.403861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:49.405528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:49.422601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.424716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.427537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:49.428641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:49.937635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:49.973606 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5c04cc07-e612-48a2-a2b5-e5277469a8f3 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1506 microversion: 2.1 time: 0.575747 Jul 18 02:26:49.986811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1409/2842] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:50.008602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:50.012044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:50.064910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.075225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.077597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.078770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.384263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:50.437395 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-878bdefa-759b-4a53-845e-a1c14e275b04 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.445648 Jul 18 02:26:50.452963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1410/2843] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:49 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:50.468114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1bf029d7-1e82-4eb0-ab3e-c20534d7176c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] Calling method '.version_select at 0x7fab07de31f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:50.473270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:50.507023 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1bf029d7-1e82-4eb0-ab3e-c20534d7176c tempest-VolumesAdminNegativeTest-827788139 tempest-VolumesAdminNegativeTest-827788139-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562931593" status: 202 len: 0 microversion: 2.1 time: 0.064507 Jul 18 02:26:50.508408 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1411/2844] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562931593 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:26:50.528915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for project 62e644dea14a4d249db4e89e158f6107. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:50.540474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-74f511e0-6f85-43e0-a508-b789363009fe req-8c6ae721-952b-4e8a-9ea8-36a8eb74d0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d042b93d-9a21-41d5-8adb-8e1f68e3f086", "tag": "a540a1fd-c2b7-4734-b87d-4bf94cfb25ff"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:50.583149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-74f511e0-6f85-43e0-a508-b789363009fe req-8c6ae721-952b-4e8a-9ea8-36a8eb74d0f0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.587069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for user e08a03788c1a4fd2981ca862916c7b67 and project 62e644dea14a4d249db4e89e158f6107. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:50.590416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-74f511e0-6f85-43e0-a508-b789363009fe req-8c6ae721-952b-4e8a-9ea8-36a8eb74d0f0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.660891 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-74f511e0-6f85-43e0-a508-b789363009fe req-8c6ae721-952b-4e8a-9ea8-36a8eb74d0f0 service nova] Creating event network-changed:a540a1fd-c2b7-4734-b87d-4bf94cfb25ff for instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 on n-h2-849796-1 Jul 18 02:26:50.678762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:26:50.679151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-74f511e0-6f85-43e0-a508-b789363009fe req-8c6ae721-952b-4e8a-9ea8-36a8eb74d0f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169395 Jul 18 02:26:50.680261 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1412/2845] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:50.684729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:26:50.685711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:26:50.689167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:26:50.693160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:26:50.694313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:50.696392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:50.733690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.734540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.736468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.737554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.741812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.745441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.748667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.748889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.845840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for project 62e644dea14a4d249db4e89e158f6107. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:26:50.876410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Getting quotas for user e08a03788c1a4fd2981ca862916c7b67 and project 62e644dea14a4d249db4e89e158f6107. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:26:50.881987 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aec4cce6-0958-471e-a32d-7b589d0da756 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips" status: 200 len: 109 microversion: 2.1 time: 0.199336 Jul 18 02:26:50.889671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1413/2846] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:26:50 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips => generated 109 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:50.911253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:50.916849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:50.943536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.944399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:50.950312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:50.951102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.176685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:26:51.179302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7e9396d-5b53-4bf8-b797-97f1951e76e0',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:26:51.415881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:51.446842 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f13f73e-a092-4244-aeec-c173d13ef165 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.555429 Jul 18 02:26:51.458404 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1414/2847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:50 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:51.477514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1734e5c8-f72d-4c76-9a94-a7b8ce2202f0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0454e820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:51.584914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1734e5c8-f72d-4c76-9a94-a7b8ce2202f0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.112477 Jul 18 02:26:51.589643 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1415/2848] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:51 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:51.598216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:51.607737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-582723a0-d21d-467b-bf71-1d739a18f5cc tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.620380 Jul 18 02:26:51.609686 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1434/2849] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:26:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 3623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:26:51.616346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:51.617404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:51.621599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:51.626581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.627912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.629017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.630875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.653606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.660855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.662165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:51.665918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:51.767792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d2e46fa-8bfa-4415-ac7a-c9f4c76c7830 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips" status: 200 len: 109 microversion: 2.1 time: 0.174552 Jul 18 02:26:51.785446 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1416/2850] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:26:51 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips => generated 109 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:51.790767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-23ea5448-2e63-45ba-997e-d8cb5a1df283 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:51.805297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-23ea5448-2e63-45ba-997e-d8cb5a1df283 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:52.063263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-23ea5448-2e63-45ba-997e-d8cb5a1df283 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:52.093940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-23ea5448-2e63-45ba-997e-d8cb5a1df283 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1121 microversion: 2.1 time: 0.298637 Jul 18 02:26:52.095140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1417/2851] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:51 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1121 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:52.107867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:52.108778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:52.126357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.127142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.128890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.129938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.228544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:52.279209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e1e8e8d-ba82-4466-a90d-3ca9f94547b8 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips/tempest-ServerAddressesTestJSON-1077374141-network" status: 200 len: 94 microversion: 2.1 time: 0.181260 Jul 18 02:26:52.299881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1418/2852] 10.222.0.67 () {58 vars in 1400 bytes} [Mon Jul 18 02:26:52 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768/ips/tempest-ServerAddressesTestJSON-1077374141-network => generated 94 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:26:52.303845 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d753523-4ede-4c5e-9299-608910b6e83f tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.692343 Jul 18 02:26:52.304884 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1435/2853] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:51 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:52.347128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:52.354739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:52.398258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.400008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.404462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.407045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.469238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:52.473490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:52.573920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.580340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.582077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:52.582893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:52.625675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:26:52.776076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:52.852839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9cbc4d9a-514e-40fc-8b5a-35ed21a51a2e tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "DELETE /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 204 len: 0 microversion: 2.1 time: 0.544920 Jul 18 02:26:52.855043 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1419/2854] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:26:52 2022] DELETE /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:26:52.881448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f85c085-72dc-477a-a690-f1204e3870ff tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab047ea700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:53.030697 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f85c085-72dc-477a-a690-f1204e3870ff tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.172289 Jul 18 02:26:53.033243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1420/2855] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:52 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:53.040117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:53.041602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:53.077288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.077756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.078793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.079437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.328729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:53.343628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:53.348764 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-596e7466-1221-47d9-b162-6a1c25b1abce tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.888336 Jul 18 02:26:53.362416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1436/2856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:52 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:53.372030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:53.372915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:53.413418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.414284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.415863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.416706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.609528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:53.623267 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd2df802-8632-46bf-9dca-e67369b28dcf tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1163 microversion: 2.1 time: 0.258756 Jul 18 02:26:53.636730 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1437/2857] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:53 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1163 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:53.646187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:53.646835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:53.665499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.666220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.667228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:53.667862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:53.828508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:53.875010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf4a4269-6359-44af-9030-4448a9ca6acb tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.236461 Jul 18 02:26:53.876916 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1438/2858] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:53 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:54.013905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:54.026504 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3bd2088a-1bc7-446a-b8eb-09cba3782ff9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1512 microversion: 2.1 time: 0.991203 Jul 18 02:26:54.027144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1421/2859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:53 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1512 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:54.048884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2b26155-dede-40a5-be63-773dbbc79b3f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab056248b0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:54.123855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d2b26155-dede-40a5-be63-773dbbc79b3f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.079182 Jul 18 02:26:54.125285 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1439/2860] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:54 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:54.371300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:54.371300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:54.390203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:54.391908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:54.395889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:54.396985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:54.645707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:54.646499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:54.668402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:54.668872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:54.669765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:54.670223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:55.460280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:55.474218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4cda88d-7d21-482f-b4fc-c38b74adfe04 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1219 microversion: 2.1 time: 0.834221 Jul 18 02:26:55.475335 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1440/2861] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:54 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1219 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:55.486062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:55.488169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:55.498969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:55.499865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:55.501017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:55.503583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:55.688382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:55.709775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:55.718467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4220480a-12ca-4b97-9642-a113ba0542be tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 1.353990 Jul 18 02:26:55.722137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1422/2862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:54 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:55.728039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:55.729045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:55.739369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:26:55.742613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:55.746454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:55.747969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:55.748748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:55.807091 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d331158e-5ff2-4b44-8396-fdc52f8ec0e4 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.330099 Jul 18 02:26:55.823406 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1441/2863] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:55 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:55.843234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9985224a-6a7b-4718-abf5-f570715d1100 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f5a3a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:55.894273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9985224a-6a7b-4718-abf5-f570715d1100 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.068762 Jul 18 02:26:55.895010 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1442/2864] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:55 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:56.340676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:56.385650 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6406cb2d-c433-4695-83ed-edfc5295dec9 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1512 microversion: 2.1 time: 0.656775 Jul 18 02:26:56.387928 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1423/2865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:55 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:56.500418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:56.503839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:56.520073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.521607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.523455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.524730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.741118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:56.742760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:56.766715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:56.774533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.776994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.778295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.779174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.822787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-025d5b13-d2b4-4637-8211-312832d2aa74 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1219 microversion: 2.1 time: 0.333066 Jul 18 02:26:56.827249 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1443/2866] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:56 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1219 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:56.869946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:56.871755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:56.888049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.889631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:56.891646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:56.892680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.337819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:57.353404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd71c782-c28b-4adc-bd2c-c1197e273e3a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.618244 Jul 18 02:26:57.355076 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1424/2867] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:56 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:26:57.370228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74d6a88e-d51f-46c4-ac1a-87f96bce9223 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043e0820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:57.465621 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74d6a88e-d51f-46c4-ac1a-87f96bce9223 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.109234 Jul 18 02:26:57.466543 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1425/2868] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:57 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:57.641368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:57.704615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-526e41d8-f6a2-42c5-872d-fb1ab5817839 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.858603 Jul 18 02:26:57.720999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1444/2869] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:56 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:57.720999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:57.720999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:57.734755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.735675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.739802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.742154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.835476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.836439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.836439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lazy-loading 'fault' on Instance uuid 07e4fe07-6694-45f7-8384-cdb7e339a768 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:57.952682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d198b6ff-f10b-4fe3-bd13-01bd9e2810b2 req-50ddebd2-7c4b-4446-920b-01fbe0b2572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e4fe07-6694-45f7-8384-cdb7e339a768", "name": "network-vif-deleted", "tag": "bdef6022-b40a-45f7-bf06-004d2ed0dbfc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:26:57.976313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d198b6ff-f10b-4fe3-bd13-01bd9e2810b2 req-50ddebd2-7c4b-4446-920b-01fbe0b2572f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:57.977192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d198b6ff-f10b-4fe3-bd13-01bd9e2810b2 req-50ddebd2-7c4b-4446-920b-01fbe0b2572f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:57.998261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d198b6ff-f10b-4fe3-bd13-01bd9e2810b2 req-50ddebd2-7c4b-4446-920b-01fbe0b2572f service nova] Creating event network-vif-deleted:bdef6022-b40a-45f7-bf06-004d2ed0dbfc for instance 07e4fe07-6694-45f7-8384-cdb7e339a768 on n-h1-849796-1 Jul 18 02:26:58.008668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d198b6ff-f10b-4fe3-bd13-01bd9e2810b2 req-50ddebd2-7c4b-4446-920b-01fbe0b2572f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.540524 Jul 18 02:26:58.015283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1426/2870] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:58.029569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:58.032167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:58.074178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.082579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.085358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.086247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.273878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d2936926b746d28f3706bf2f01a294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453cc938c2de43c6a86c0383041f8487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:58.281595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:58.288076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05281e90-ef69-4a61-b6d9-d787cf516f29 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 200 len: 1307 microversion: 2.1 time: 0.573962 Jul 18 02:26:58.289017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1445/2871] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:57 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:58.351153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a97e739-2540-4121-8625-03752f7a211a tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1237 microversion: 2.1 time: 0.297885 Jul 18 02:26:58.358934 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1427/2872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:58 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1237 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:58.374443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:58.375222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:58.389382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.390044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.392494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.394350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.490903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7753a90c-913f-4b61-a88b-bb4d213484c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a5a2700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:58.650175 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7753a90c-913f-4b61-a88b-bb4d213484c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.167752 Jul 18 02:26:58.670826 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1428/2873] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:58 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:58.763002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:58.765171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:58.797673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.800166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:58.807952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:58.813068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:59.211478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:59.224379 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2893f6d6-9ef8-40e9-a82f-1092ad25862b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.856217 Jul 18 02:26:59.226480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1446/2874] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:58 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:59.312731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:59.313966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] [instance: 07e4fe07-6694-45f7-8384-cdb7e339a768] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:59.334198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:59.343797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:59.346930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:59.352069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:59.366309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:26:59.408315 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] HTTP exception thrown: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Request method failure captured: Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 HTTP/1.1 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTLWVFo1R74yuKTlnWcRF2ZApX9Ba7Mn5quYLCrN4ZK-WNTJ3nGkw1hGVIco6QH8F5eUfKbwNdsYXA9vwu0JSMDReVAHzfGzfnBI1MXa1FF0LwTCSBExcReLFGlNjXVvpdUuiyE8KAvelTc160pbIDTZvPar2EhRWlmcsOW_vvgu54 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 453cc938c2de43c6a86c0383041f8487 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerAddressesTestJSON-1754538036 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/453cc938c2de43c6a86c0383041f8487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_453cc938c2de43c6a86c0383041f8487"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/453cc938c2de43c6a86c0383041f8487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/453cc938c2de43c6a86c0383041f8487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerAddressesTestJSON-1754538036 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 453cc938c2de43c6a86c0383041f8487 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1754538036 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerAddressesTestJSON-1754538036-project Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 41d2936926b746d28f3706bf2f01a294 Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerAddressesTestJSON-1754538036-project Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '07e4fe07-6694-45f7-8384-cdb7e339a768'} Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:26:59.420569 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] Returning 404 to user: Instance 07e4fe07-6694-45f7-8384-cdb7e339a768 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:26:59.427298 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8bc91029-2b50-4c91-84df-00123461e623 tempest-ServerAddressesTestJSON-1754538036 tempest-ServerAddressesTestJSON-1754538036-project] 10.222.0.67 "GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768" status: 404 len: 111 microversion: 2.1 time: 0.117076 Jul 18 02:26:59.429662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1447/2875] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:59 2022] GET /compute/v2.1/servers/07e4fe07-6694-45f7-8384-cdb7e339a768 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:26:59.447068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:59.450231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:26:59.461774 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52ce7bc0-6612-48af-88db-db3442f6e244 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1927 microversion: 2.75 time: 0.715577 Jul 18 02:26:59.466639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:59.467029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:59.467854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:59.468409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:59.481441 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1429/2876] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:26:58 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1927 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:26:59.672652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:26:59.681031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2b03f61-f339-4072-909d-1dad7d669bc7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043e0b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:59.702443 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac011126-e398-4b04-be9d-a01b98dae351 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1237 microversion: 2.1 time: 0.271824 Jul 18 02:26:59.718605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1448/2877] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:26:59 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1237 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:26:59.765187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2b03f61-f339-4072-909d-1dad7d669bc7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.090259 Jul 18 02:26:59.766151 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1430/2878] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:26:59 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:00.243342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:00.244189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:00.254221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:00.267575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.270230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.281845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.286524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.484566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:00.485361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:00.509557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.510036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.510870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.511450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.777423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:00.792641 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c6401f0-875a-440b-adcc-40b9d7eee053 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.553081 Jul 18 02:27:00.806659 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1449/2879] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:00 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:00.812545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:00.813318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:00.838981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:00.840737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.841329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.842172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:00.842631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:00.929544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:01.239442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:01.284263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20d86e4e-7182-4f85-93b9-0dd7f81be7f0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1304 microversion: 2.1 time: 0.457345 Jul 18 02:27:01.288269 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1450/2880] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:00 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1304 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:01.309662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-261fb326-aef8-46a7-a0d9-41ea8f9b927b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04eb45e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:01.369154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:27:01.463322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4552efe2-a0aa-4391-bac1-38d2d28d050d tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1933 microversion: 2.75 time: 0.983306 Jul 18 02:27:01.474961 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1431/2881] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:00 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1933 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:27:01.530496 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-261fb326-aef8-46a7-a0d9-41ea8f9b927b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.226988 Jul 18 02:27:01.532063 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1451/2882] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:01 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:01.822069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:01.835016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:01.867705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.870235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:01.875912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:01.877430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:02.084649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:02.423629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:02.425446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:02.449952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:02.454402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:02.461860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:02.465532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:02.666636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:02.881719 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a9fc453-96e8-4431-94a6-022c42c715d5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "DELETE /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 204 len: 0 microversion: 2.32 time: 1.404534 Jul 18 02:27:02.882904 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1432/2883] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:27:01 2022] DELETE /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 0 bytes in 1407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:27:03.036326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-749682fc-d56a-4995-a0d1-c4fdd385d8da req-c23f32ff-6701-4be5-8c24-55d789dac125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d042b93d-9a21-41d5-8adb-8e1f68e3f086", "name": "network-vif-plugged", "status": "completed", "tag": "a540a1fd-c2b7-4734-b87d-4bf94cfb25ff"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:03.060577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-749682fc-d56a-4995-a0d1-c4fdd385d8da req-c23f32ff-6701-4be5-8c24-55d789dac125 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.061364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-749682fc-d56a-4995-a0d1-c4fdd385d8da req-c23f32ff-6701-4be5-8c24-55d789dac125 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.091272 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-749682fc-d56a-4995-a0d1-c4fdd385d8da req-c23f32ff-6701-4be5-8c24-55d789dac125 service nova] Creating event network-vif-plugged:a540a1fd-c2b7-4734-b87d-4bf94cfb25ff for instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 on n-h2-849796-1 Jul 18 02:27:03.121213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-749682fc-d56a-4995-a0d1-c4fdd385d8da req-c23f32ff-6701-4be5-8c24-55d789dac125 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235702 Jul 18 02:27:03.126308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1433/2884] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:03.143519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:03.160697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:03.162540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:03.195710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9376f03d-bc6d-4558-892c-99ebb63b6134 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 1.387263 Jul 18 02:27:03.198403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.199999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.202363 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1452/2885] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:01 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:03.226225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.227553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.245151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:03.246482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:03.293896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.301594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.307231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:03.312181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:03.782135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:27:03.827082 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac777594-2c51-4862-ba2c-c65387803601 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1933 microversion: 2.75 time: 0.611975 Jul 18 02:27:03.841949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1453/2886] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:03 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1933 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:03.855857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26b4a3ac-144e-47b3-9a5a-9d62dfcc219b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04eb4040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:03.988394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26b4a3ac-144e-47b3-9a5a-9d62dfcc219b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.143402 Jul 18 02:27:03.992026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1454/2887] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:03 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:03.997494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:04.009369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:04.022879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.023638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.024697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.025391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.251687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:04.288965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7958dbe6-222e-45cc-989b-9ea8bbe4667d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1304 microversion: 2.1 time: 1.157381 Jul 18 02:27:04.290034 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1434/2888] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:03 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1304 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:04.318980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:04.320310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:04.345714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.347425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:04.359505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:04.360529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.617866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.628806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed79cf4c-f3c5-443d-91b0-78ae1aa6a926 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 1.335857 Jul 18 02:27:05.634907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1435/2889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:04 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:05.647946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:05.648996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:05.668844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:05.669629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.674446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:05.675750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.820306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.843661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.847538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:05.848468 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f706bf8b-013e-4544-b507-4fe467667961 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2958 microversion: 2.32 time: 1.854995 Jul 18 02:27:05.861348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1455/2890] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:03 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2958 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:05.871506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e29151a8-ba0a-4548-aaf5-a16cab83396a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04c590d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:05.943232 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e29151a8-ba0a-4548-aaf5-a16cab83396a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.073598 Jul 18 02:27:05.944154 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1456/2891] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:05 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:05.960584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:05.968782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:05.989502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:05.989977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:05.998294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.001644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.047488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] Lazy-loading 'services' on Instance uuid 48af76e0-6199-48d8-9de9-79e1b450a8fd {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:27:06.050551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:06.143169 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d141635d-e943-4628-a801-55f9e0326bf0 tempest-ServersAdmin275Test-2032966631 tempest-ServersAdmin275Test-2032966631-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1918 microversion: 2.75 time: 0.503503 Jul 18 02:27:06.145565 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1436/2892] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:05 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1918 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:06.214455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:06.226650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:06.262585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.271672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.275599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.284898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.440076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:06.585836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:06.606190 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfa46158-2f83-4f13-bd47-224b88e4eccd tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1304 microversion: 2.1 time: 0.660473 Jul 18 02:27:06.617624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1457/2893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:05 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1304 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:06.662270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:06.663217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:06.678148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.678624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.688872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:06.693735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:06.708493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:06.963648 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ef8986a-c60f-4637-9297-fd7870b16a6f tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 204 len: 0 microversion: 2.75 time: 0.766462 Jul 18 02:27:06.969462 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1437/2894] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:27:06 2022] DELETE /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:27:06.992610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:06.994646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:07.024501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:07.025578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:07.027228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:07.028415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:07.529581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:07.558814 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a395a90b-8972-4216-9d5f-5f932293d441 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1314 microversion: 2.1 time: 0.898402 Jul 18 02:27:07.560108 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1458/2895] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:06 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:07.576895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3190415-8460-4c03-8f26-5048a23a4142 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04eb4280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:07.729121 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3190415-8460-4c03-8f26-5048a23a4142 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.165823 Jul 18 02:27:07.730383 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1459/2896] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:07 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:07.746899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:07.749874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:07.779890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:07.780978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:07.785506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:07.786462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:07.960308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:07.978895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:07.984272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:07.996140 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70808989-bbee-4239-894f-53db8f1222bf tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1443 microversion: 2.75 time: 0.263328 Jul 18 02:27:07.998144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1460/2897] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:07 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1443 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:08.005861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:08.006877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:08.020762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.021610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.024399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.025389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.452067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:08.479582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86f961a7-07b8-4ee5-80d3-15ecdcd88503 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1304 microversion: 2.1 time: 0.479051 Jul 18 02:27:08.484119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1461/2898] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:07 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1304 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:08.713531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d166bfa8-0d4e-4cc1-bec1-31b0eb6c9673 req-e2fdd3c4-0166-4cd4-a855-1189b67c7a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028eedd8-9876-489c-bd5f-2e8f62ed5e82", "tag": "df056e25-33ec-4a0a-91e8-b3f74536ccd7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:08.762095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d166bfa8-0d4e-4cc1-bec1-31b0eb6c9673 req-e2fdd3c4-0166-4cd4-a855-1189b67c7a44 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.763673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d166bfa8-0d4e-4cc1-bec1-31b0eb6c9673 req-e2fdd3c4-0166-4cd4-a855-1189b67c7a44 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.810857 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d166bfa8-0d4e-4cc1-bec1-31b0eb6c9673 req-e2fdd3c4-0166-4cd4-a855-1189b67c7a44 service nova] Creating event network-changed:df056e25-33ec-4a0a-91e8-b3f74536ccd7 for instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 on n-h2-849796-1 Jul 18 02:27:08.823127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d166bfa8-0d4e-4cc1-bec1-31b0eb6c9673 req-e2fdd3c4-0166-4cd4-a855-1189b67c7a44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339823 Jul 18 02:27:08.826143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1462/2899] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:08.840303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:08.841565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:08.860426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.864650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:08.883547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:08.884214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.051586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.069946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.078204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.079865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-523994c7-8e81-4e30-8d5f-aea7392f3117 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2958 microversion: 2.32 time: 2.106493 Jul 18 02:27:09.082179 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1438/2900] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:06 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2958 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:09.090012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a40d018a-354d-497e-90d0-cb8fa64b93d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a5a2790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:09.289957 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a40d018a-354d-497e-90d0-cb8fa64b93d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.205414 Jul 18 02:27:09.299138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1439/2901] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:09 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:09.310753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:09.311287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:09.326294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.326877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.327702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.337575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.570697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.590613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.592345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c173c4ec32c41bdb78696874daf0f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70217adf78d94a809101da5d623241c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.626663 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2b56a45-29f1-4fd2-8642-b4d9ec7c663c tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 200 len: 1443 microversion: 2.75 time: 0.334645 Jul 18 02:27:09.644962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1440/2902] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:09 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 1443 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:09.644962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:09.644962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:09.673059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.679299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.688756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.690814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.737022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:09.749561 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7687b041-0dc5-4944-b6cf-e4373152afe6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1501 microversion: 2.1 time: 0.921158 Jul 18 02:27:09.750821 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1463/2903] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:08 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1501 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:09.781056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:09.781946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:09.796718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.802106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.805384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:09.806157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:09.875385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:10.135510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4fbf6af-9ed7-48bf-8349-93c6c8c718ec tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 204 len: 0 microversion: 2.1 time: 0.357800 Jul 18 02:27:10.141835 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1464/2904] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:09 2022] DELETE /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:10.162748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:10.177968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:10.215498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:10.216499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:10.218145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:10.219044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:11.422539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:11.470823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba7fff17-8960-4661-b302-e7f6b6e328fb tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1304 microversion: 2.1 time: 1.830778 Jul 18 02:27:11.495733 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1441/2905] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:09 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1304 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:11.542856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:11.544816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:11.587171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:11.605957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:11.612889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:11.617191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.497909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:12.552901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:12.577571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:12.595373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85f70eb8-5aa6-4c64-a0de-b4655251290c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2958 microversion: 2.32 time: 2.439528 Jul 18 02:27:12.597345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1465/2906] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:10 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2958 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:12.605483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f949ba59-4ac6-4254-a58d-2255b3826645 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ed9ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:12.800808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f949ba59-4ac6-4254-a58d-2255b3826645 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.201342 Jul 18 02:27:12.813592 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1466/2907] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:12 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:12.854651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:12.867648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] [instance: 48af76e0-6199-48d8-9de9-79e1b450a8fd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:12.904422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.905315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.906876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:12.907676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:12.983469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] HTTP exception thrown: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Request method failure captured: Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd HTTP/1.1 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MSmsYZTFvM4oGxPcTcoQHVR0JxVxXUY_qyCjNQC18O74UCE3DS4f4T8a3xR4DIhaOskFofDHKisgvclBciu6AMTYWr8-VkUQdgpcUJ67bu6UFcr1J3a9wRGmmIOAl6TRzAo861HiVVpWTPzXMzB9hBUlZX539bkG8wSVTaSwOr3DAI Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.75 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 70217adf78d94a809101da5d623241c2 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersAdmin275Test-2100951614 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70217adf78d94a809101da5d623241c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70217adf78d94a809101da5d623241c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70217adf78d94a809101da5d623241c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70217adf78d94a809101da5d623241c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersAdmin275Test-2100951614 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 70217adf78d94a809101da5d623241c2 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersAdmin275Test-2100951614 Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersAdmin275Test-2100951614-project Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7c173c4ec32c41bdb78696874daf0f9d Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersAdmin275Test-2100951614-project Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '48af76e0-6199-48d8-9de9-79e1b450a8fd'} Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:12.986944 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] Returning 404 to user: Instance 48af76e0-6199-48d8-9de9-79e1b450a8fd could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89448815-aaa9-4e3e-b718-9b811a3f4bb2 tempest-ServersAdmin275Test-2100951614 tempest-ServersAdmin275Test-2100951614-project] 10.222.0.67 "GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd" status: 404 len: 111 microversion: 2.75 time: 0.173594 Jul 18 02:27:12.995474 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1467/2908] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:12 2022] GET /compute/v2.1/servers/48af76e0-6199-48d8-9de9-79e1b450a8fd => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:27:13.035591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-dd0cf674-241a-4c52-82f0-c9fcc020d833 req-b510c318-0fcb-41dc-9c82-9f46c5687a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:13.074863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dd0cf674-241a-4c52-82f0-c9fcc020d833 req-b510c318-0fcb-41dc-9c82-9f46c5687a68 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.082581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dd0cf674-241a-4c52-82f0-c9fcc020d833 req-b510c318-0fcb-41dc-9c82-9f46c5687a68 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.179986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-dd0cf674-241a-4c52-82f0-c9fcc020d833 req-b510c318-0fcb-41dc-9c82-9f46c5687a68 service nova] Creating event network-vif-unplugged:a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:13.207534 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-dd0cf674-241a-4c52-82f0-c9fcc020d833 req-b510c318-0fcb-41dc-9c82-9f46c5687a68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210345 Jul 18 02:27:13.208707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1468/2909] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:13.224125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:13.234250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:13.252540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.256888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.262077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.263350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.579787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:13.606961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd251058-d770-4af2-988d-d1465705dff3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1507 microversion: 2.1 time: 2.105550 Jul 18 02:27:13.609720 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1442/2910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:11 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1507 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:13.667424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:13.670259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:13.720894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.722739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:13.723999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:13.724645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:14.749460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:14.762679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-556a00c1-b3ee-4da7-a268-800fc7a86799 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 1.552490 Jul 18 02:27:14.763462 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1469/2911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:13 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:14.789703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-186dac7b-b1b2-480f-bd1d-7004b4a90790 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a74f550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:14.975329 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-186dac7b-b1b2-480f-bd1d-7004b4a90790 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.199934 Jul 18 02:27:14.977058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1470/2912] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:14 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:14.989103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:14.993609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:15.011488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:15.012314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:15.013588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:15.015900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.495016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:16.529924 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e24fec31-f142-43be-80f0-5e47dc637697 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1507 microversion: 2.1 time: 1.551207 Jul 18 02:27:16.534448 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1471/2913] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:14 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1507 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:16.565446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "804f95d4-9cf9-4928-9668-8d25b51873f2"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "4f456121-fd6f-4052-a2bc-5c6324652c5f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:16.616011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.618807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.641640 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] Creating event network-vif-unplugged:804f95d4-9cf9-4928-9668-8d25b51873f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:16.643240 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] Creating event network-vif-unplugged:4f456121-fd6f-4052-a2bc-5c6324652c5f for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:16.650269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c84f9e5d-39ca-426e-bf67-10fe13f6973a req-124eb9ed-624a-453f-87f1-477d5695d658 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.111197 Jul 18 02:27:16.653689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1472/2914] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:16.666352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:16.667536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:16.679159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.679921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:16.681126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:16.681911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:17.036614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:17.067096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:17.075833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:17.082737 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ffc14b5-2348-433a-b139-200a5f68a27c tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2937 microversion: 2.32 time: 3.446625 Jul 18 02:27:17.085676 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1443/2915] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:13 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2937 bytes in 3457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:17.094640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-266ca615-0981-43a2-b2f6-7f0fe34422f5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0436d670>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:17.212771 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-266ca615-0981-43a2-b2f6-7f0fe34422f5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.125166 Jul 18 02:27:17.216533 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1444/2916] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:17 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:17.344021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-25b63dcd-2f9a-42e5-926c-ece5ce97cce7 req-8a209f32-9440-4bd9-9ba2-63cbb4b6e868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d042b93d-9a21-41d5-8adb-8e1f68e3f086", "name": "network-vif-deleted", "tag": "a540a1fd-c2b7-4734-b87d-4bf94cfb25ff"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:17.365456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25b63dcd-2f9a-42e5-926c-ece5ce97cce7 req-8a209f32-9440-4bd9-9ba2-63cbb4b6e868 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:17.366087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25b63dcd-2f9a-42e5-926c-ece5ce97cce7 req-8a209f32-9440-4bd9-9ba2-63cbb4b6e868 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:17.410537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-25b63dcd-2f9a-42e5-926c-ece5ce97cce7 req-8a209f32-9440-4bd9-9ba2-63cbb4b6e868 service nova] Creating event network-vif-deleted:a540a1fd-c2b7-4734-b87d-4bf94cfb25ff for instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 on n-h2-849796-1 Jul 18 02:27:17.425681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-25b63dcd-2f9a-42e5-926c-ece5ce97cce7 req-8a209f32-9440-4bd9-9ba2-63cbb4b6e868 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086262 Jul 18 02:27:17.429555 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1445/2917] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:27:17.477070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:17.493083 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1761fc21-794d-4f31-899d-8881287b7270 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 0.831379 Jul 18 02:27:17.494649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1473/2918] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:16 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:17.563535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:17.564396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:17.589036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:17.589502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:17.590325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:17.590769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.072706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:18.084541 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92a7d9f7-9f4f-4ef0-afb7-d85b981a9e96 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 200 len: 1299 microversion: 2.1 time: 0.527424 Jul 18 02:27:18.094388 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1446/2919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:17 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 1299 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:18.106883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:18.108297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:18.117006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.117803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.118863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.119536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.230829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d76501c-b650-45cc-8e31-9b07d0c261b7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0436d310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:18.354574 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d76501c-b650-45cc-8e31-9b07d0c261b7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1411 microversion: 2.1 time: 0.128181 Jul 18 02:27:18.357682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1447/2920] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:18 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:18.511426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:18.512680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:18.521941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.522799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.523939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.524665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.654820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:18.693962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:18.695507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:18.696999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97807e1e-d8c8-415f-83d6-5cbdc1891b59 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2937 microversion: 2.32 time: 0.594280 Jul 18 02:27:18.697556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1474/2921] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:18 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2937 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:18.751301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "df68d20a-4518-4fc1-8770-f6dd7fe75468"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba63a1c-8406-45b2-ade6-0a4a17c34c8b"}, {"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-unplugged", "status": "completed", "tag": "1bb5c7e7-e428-4d94-9253-52e8ef2e2338"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:18.772024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:18.772499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:18.802566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Creating event network-vif-unplugged:df68d20a-4518-4fc1-8770-f6dd7fe75468 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:18.805817 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Creating event network-vif-unplugged:1ba63a1c-8406-45b2-ade6-0a4a17c34c8b for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:18.806344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] Creating event network-vif-unplugged:1bb5c7e7-e428-4d94-9253-52e8ef2e2338 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:18.819881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f00b0578-1c22-4638-b33c-bc10d72cef45 req-b8f64bf5-d0fd-4a1f-977f-d592034a9a4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.071914 Jul 18 02:27:18.821743 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1475/2922] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:27:19.103633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:19.104397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:19.116882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:19.119185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:19.119185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:19.119185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:19.142034 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 HTTP/1.1 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd042b93d-9a21-41d5-8adb-8e1f68e3f086'} Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:19.144015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:27:19.148516 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:19.150263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:19.151331 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2cf3ab84-dcea-4003-bf1c-1550e1708bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 404 len: 111 microversion: 2.1 time: 0.052120 Jul 18 02:27:19.152351 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1476/2923] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:19 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:27:19.360243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-767168463", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:19.472374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:19.625610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:19.645104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-216616c0-6cd8-4d48-83df-8addbe707a39 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 1.136616 Jul 18 02:27:19.646730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1448/2924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:18 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:19.654084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3714b327-9f1d-45d0-84ff-65bedaf477bb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04397550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:19.812757 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3714b327-9f1d-45d0-84ff-65bedaf477bb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1420 microversion: 2.1 time: 0.159065 Jul 18 02:27:19.818243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1449/2925] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:19 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:19.832234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:19.832886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:19.849751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:19.852192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:19.853211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:19.865803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.726753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:20.759536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:20.782352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:20.785821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65df01f3-eceb-44aa-8618-b86623da2284 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2937 microversion: 2.32 time: 0.965580 Jul 18 02:27:20.787653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1450/2926] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:19 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2937 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:20.807542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57db0725-8e78-4c6f-ae0a-44fe53b691d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0439c4c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:20.936089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:20.937774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:20.938576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:20.940726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:20.941538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:20.977318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:20.978139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:20.991140 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57db0725-8e78-4c6f-ae0a-44fe53b691d0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 200 len: 1420 microversion: 2.1 time: 0.201075 Jul 18 02:27:20.992465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1451/2927] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:20 2022] GET /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:21.010069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.011561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.019448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:21.020587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:21.043328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.044117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.049812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:21.050692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:21.093940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:21.119581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:21.192645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:21.198435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:21.352345 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29169c62-566d-45dc-ad60-51a3fd18f8f5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998590 Jul 18 02:27:21.364156 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1477/2928] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:21.374943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-116b7971-f118-4881-906d-6b68195782c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04f6a9d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:22.952735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-116b7971-f118-4881-906d-6b68195782c8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 204 len: 0 microversion: 2.1 time: 1.586177 Jul 18 02:27:22.953408 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1478/2929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:21 2022] DELETE /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 0 bytes in 1588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:22.963050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:22.963573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:22.977567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.978030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:22.983166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:22.983899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.085206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:23.098372 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ecf8b36-a278-4c07-933c-55b108774f3b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1210 microversion: 2.1 time: 0.140291 Jul 18 02:27:23.110791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1479/2930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:22 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:23.119276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:23.121959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:23.131218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.132063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.133309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.134242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.460111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:23.480859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:23.485637 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2874681-2422-42cd-87d8-35fa31c2fb7e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 2.489750 Jul 18 02:27:23.488456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1452/2931] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:20 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:23.496686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:23.497359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:23.504954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:23.508949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:23.511724 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ab6bf08-eaf1-4c9f-9b48-fa4ae3421a6e tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2916 microversion: 2.32 time: 0.398427 Jul 18 02:27:23.513543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.513870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1480/2932] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:23 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2916 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:23.523649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.523988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4c151cd7-8c16-454c-b23f-ab5f497b6f20 req-75ec7d4c-87bf-4ec1-b0c6-e5666f3330ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb7154-5239-40f6-b79d-99a38d02777c", "name": "network-vif-unplugged", "status": "completed", "tag": "d1b5c46e-3ed0-4025-b756-48c1824c2034"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:23.526051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.527205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.561465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c151cd7-8c16-454c-b23f-ab5f497b6f20 req-75ec7d4c-87bf-4ec1-b0c6-e5666f3330ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:23.562316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c151cd7-8c16-454c-b23f-ab5f497b6f20 req-75ec7d4c-87bf-4ec1-b0c6-e5666f3330ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:23.594256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:23.608567 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4c151cd7-8c16-454c-b23f-ab5f497b6f20 req-75ec7d4c-87bf-4ec1-b0c6-e5666f3330ee service nova] Creating event network-vif-unplugged:d1b5c46e-3ed0-4025-b756-48c1824c2034 for instance 60fb7154-5239-40f6-b79d-99a38d02777c on n-h1-849796-1 Jul 18 02:27:23.629110 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4c151cd7-8c16-454c-b23f-ab5f497b6f20 req-75ec7d4c-87bf-4ec1-b0c6-e5666f3330ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113486 Jul 18 02:27:23.636344 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1481/2933] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:23.639296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:27:23.844087 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f256dba4-7a3f-46ee-b97d-5cde2f8a9a88 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 204 len: 0 microversion: 2.1 time: 0.353441 Jul 18 02:27:23.847830 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1453/2934] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:27:23 2022] DELETE /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:27:24.064458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-871773855", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "cc961fa4-53ad-43f0-b036-d186e7700255"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:24.125883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:24.129545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:24.155749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:24.160666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:24.164118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:24.165222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:24.250058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] validate_networks() for [('cc961fa4-53ad-43f0-b036-d186e7700255', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:24.528408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:24.574214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bee64a79-8bf7-42d3-8db6-0a1bf8f8f15c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1272 microversion: 2.1 time: 0.457515 Jul 18 02:27:24.576402 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1454/2935] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:24 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:25.035284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:25.035732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:25.036470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:25.037174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:25.037789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:25.059826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.060292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.061174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.061639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.124821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:25.132062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for user 927f29b5f43d405ca9d3fed68e53cdb1 and project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:25.162136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:25.168887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:25.234202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdb3ca72-e46f-4387-8abb-777a09e3c128 tempest-ListImageFiltersNegativeTestJSON-1821828608 tempest-ListImageFiltersNegativeTestJSON-1821828608-project] Calling method '.version_select at 0x7fab0a5a2af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:25.280376 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bdb3ca72-e46f-4387-8abb-777a09e3c128 tempest-ListImageFiltersNegativeTestJSON-1821828608 tempest-ListImageFiltersNegativeTestJSON-1821828608-project] HTTP exception thrown: Image not found. Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdb3ca72-e46f-4387-8abb-777a09e3c128 tempest-ListImageFiltersNegativeTestJSON-1821828608 tempest-ListImageFiltersNegativeTestJSON-1821828608-project] Request method failure captured: Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/37f54996-8fd2-4d03-b42b-b1560496919d HTTP/1.1 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUMGX6aT9OhgFc9X9kvqFiNKnjGmka8v7Ur2wo9RdpvoxBH5BiyVy_vHj_JXm61rWZiWqZWOWHFk0MzbJTye1Jnvk7PkREldq_ATdtrHYMcUd58mGNzx0MBLHBh_9zMPMT16Z83WwqgqoW9QsgLUCzCxcCnNa51kMq8Dcttxu9v_Ck Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a6618d3127ae4e94b319e38e7adad524 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1821828608 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6618d3127ae4e94b319e38e7adad524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6618d3127ae4e94b319e38e7adad524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6618d3127ae4e94b319e38e7adad524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6618d3127ae4e94b319e38e7adad524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1821828608 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a6618d3127ae4e94b319e38e7adad524 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1821828608 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListImageFiltersNegativeTestJSON-1821828608-project Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: b4c56644bfa5478882dd5fdf70a922a7 Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1821828608-project Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '37f54996-8fd2-4d03-b42b-b1560496919d'} Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37f54996-8fd2-4d03-b42b-b1560496919d Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:27:25.286812 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37f54996-8fd2-4d03-b42b-b1560496919d could not be found. Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:27:25.301420 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:25.310943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdb3ca72-e46f-4387-8abb-777a09e3c128 tempest-ListImageFiltersNegativeTestJSON-1821828608 tempest-ListImageFiltersNegativeTestJSON-1821828608-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:25.313249 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdb3ca72-e46f-4387-8abb-777a09e3c128 tempest-ListImageFiltersNegativeTestJSON-1821828608 tempest-ListImageFiltersNegativeTestJSON-1821828608-project] 10.222.0.67 "GET /compute/v2.1/images/37f54996-8fd2-4d03-b42b-b1560496919d" status: 404 len: 62 microversion: 2.1 time: 0.734399 Jul 18 02:27:25.315494 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1455/2936] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:27:24 2022] GET /compute/v2.1/images/37f54996-8fd2-4d03-b42b-b1560496919d => generated 62 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:27:25.331980 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98c37b0b-5cad-4373-a58d-3eec136c3f58 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.280468 Jul 18 02:27:25.342001 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1482/2937] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:25.344235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:25.346321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:25.350044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:25.361389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.362649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.363313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:25.364227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.365163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.382268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.388865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:25.390885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:25.395731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.216240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:26.239742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-563466c1-e997-4243-9cd9-5ed797eb4c07 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 0.917001 Jul 18 02:27:26.245434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1456/2938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:25 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:26.268208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f754b84-e404-435d-a0c7-e9d3cd89088b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:26.269926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3f754b84-e404-435d-a0c7-e9d3cd89088b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:26.286550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:26.732504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:26.746082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:26.747799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:26.765403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3b53359-2b4b-4bc8-9c9e-8609c24ceafe tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2869 microversion: 2.32 time: 1.413806 Jul 18 02:27:26.766867 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1483/2939] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:25 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2869 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:26.779816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d0958a8b-ed81-4ec6-8382-273026389923 req-5e205196-5e3b-473b-b64e-b2255a94a359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-deleted", "tag": "804f95d4-9cf9-4928-9668-8d25b51873f2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:26.828703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d0958a8b-ed81-4ec6-8382-273026389923 req-5e205196-5e3b-473b-b64e-b2255a94a359 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:26.829222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d0958a8b-ed81-4ec6-8382-273026389923 req-5e205196-5e3b-473b-b64e-b2255a94a359 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.887516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d0958a8b-ed81-4ec6-8382-273026389923 req-5e205196-5e3b-473b-b64e-b2255a94a359 service nova] Creating event network-vif-deleted:804f95d4-9cf9-4928-9668-8d25b51873f2 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:26.904823 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d0958a8b-ed81-4ec6-8382-273026389923 req-5e205196-5e3b-473b-b64e-b2255a94a359 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135957 Jul 18 02:27:26.905838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1484/2940] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:26.915085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:26.915824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:26.935225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:26.935967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:26.937392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:26.938122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.328500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.343770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc2cffba-33c4-4d08-a744-bc58a475c1da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.436454 Jul 18 02:27:27.344404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1485/2941] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:26 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.357079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6336a148-08d2-495d-85bf-7c66f7fd1604 req-e9a86883-15b5-4f19-a38a-833144a1aa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028eedd8-9876-489c-bd5f-2e8f62ed5e82", "name": "network-vif-plugged", "status": "completed", "tag": "df056e25-33ec-4a0a-91e8-b3f74536ccd7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:27.382725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6336a148-08d2-495d-85bf-7c66f7fd1604 req-e9a86883-15b5-4f19-a38a-833144a1aa62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.383188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6336a148-08d2-495d-85bf-7c66f7fd1604 req-e9a86883-15b5-4f19-a38a-833144a1aa62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.408286 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6336a148-08d2-495d-85bf-7c66f7fd1604 req-e9a86883-15b5-4f19-a38a-833144a1aa62 service nova] Creating event network-vif-plugged:df056e25-33ec-4a0a-91e8-b3f74536ccd7 for instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 on n-h2-849796-1 Jul 18 02:27:27.423978 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6336a148-08d2-495d-85bf-7c66f7fd1604 req-e9a86883-15b5-4f19-a38a-833144a1aa62 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077674 Jul 18 02:27:27.425663 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1486/2942] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:27.432250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:27.443829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:27.466364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:27.469003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.469675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.471979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.472880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.683878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3f754b84-e404-435d-a0c7-e9d3cd89088b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:27.721958 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f754b84-e404-435d-a0c7-e9d3cd89088b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1207 microversion: 2.1 time: 1.473663 Jul 18 02:27:27.748965 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1457/2943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:26 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1207 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:27.822389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:27.824145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:27.846085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.848471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:27.851947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:27.852833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:28.636703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:28.653151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5b11403-8fc3-4d6b-bcca-8f8ce368c0aa tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 1.225129 Jul 18 02:27:28.654411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1487/2944] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:27 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:28.661586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:28.662418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:28.683648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.684581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:28.685711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:28.687759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.033964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.055388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.059966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.061403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4212c4cf-5d6c-4b23-90d4-7e2f4a94d375 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2755 microversion: 2.32 time: 1.261417 Jul 18 02:27:29.069802 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1458/2945] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:27 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2755 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:29.082408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:29.083395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:29.095030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.099298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.100541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.101271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.219233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.237620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29102414-355d-41e8-844b-85e6bf9e0306 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.581554 Jul 18 02:27:29.238995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1488/2946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:28 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:29.468890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:29.504098 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38e7c537-717c-4606-9e76-1d131b28ac4a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1265 microversion: 2.1 time: 0.420182 Jul 18 02:27:29.505813 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1459/2947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:29 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:29.684045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:29.685366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:29.700297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.701087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.702340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.708193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.828264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2a6501f3-328d-47f8-8140-3613203c691e req-83906d10-dedc-4291-b7bb-a2b448fbbd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-deleted", "tag": "a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:29.845806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2a6501f3-328d-47f8-8140-3613203c691e req-83906d10-dedc-4291-b7bb-a2b448fbbd9a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:29.847334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2a6501f3-328d-47f8-8140-3613203c691e req-83906d10-dedc-4291-b7bb-a2b448fbbd9a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:29.863762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:29.912611 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2a6501f3-328d-47f8-8140-3613203c691e req-83906d10-dedc-4291-b7bb-a2b448fbbd9a service nova] Creating event network-vif-deleted:a13e7a3d-b19a-46ec-b0ea-b58f9fbd8f67 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:29.937528 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2a6501f3-328d-47f8-8140-3613203c691e req-83906d10-dedc-4291-b7bb-a2b448fbbd9a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113516 Jul 18 02:27:29.942467 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1460/2948] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:27:30.103791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:30.104636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:30.128168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:30.132617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:30.135220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:30.137714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:30.978948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.005654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.007342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.008677 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a0aac0ed-bd1e-45a2-876f-0bbb7e43f1b8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2594 microversion: 2.32 time: 0.910540 Jul 18 02:27:31.018434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1461/2949] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:30 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2594 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:31.032289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:31.034232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:31.055696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.058613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.060383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.063004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.404757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.416360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4cccb70c-89eb-4f3a-a1f0-2d8139b01bd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1292 microversion: 2.1 time: 1.737281 Jul 18 02:27:31.416994 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1489/2950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:29 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1292 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:31.444011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:31.445627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:31.480415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.480625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.483984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:31.484390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:31.815963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:31.854740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42528cb0-d251-4284-adcb-cdb2a7859b19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1265 microversion: 2.1 time: 0.427049 Jul 18 02:27:31.869129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1490/2951] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:31 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:32.270450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41f6c958-6c14-4143-9192-c9ec0ba9e06e tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04e48940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzaGsw8xR4SVIFwnGt/erXIyVelyZPSJde5FrdpiCn9qnShfhJwfTl2PKP7sbOdRqZqX/yfxqscGT+BCsYPr+NSlVeAo1issSwoxCae15qtjWomjAnAEkYY9VevpeWC6w=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:32.295568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-41f6c958-6c14-4143-9192-c9ec0ba9e06e tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:27:32.304912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41f6c958-6c14-4143-9192-c9ec0ba9e06e tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 257 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzaGsw8xR4SVIFwnGt/erXIyVelyZPSJde5FrdpiCn9qnShfhJwfTl2PKP7sbOdRqZqX/yfxqscGT+BCsYPr+NSlVeAo1issSwoxCae15qtjWomjAnAEkYY9VevpeWC6w=="}} Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzaGsw8xR4SVIFwnGt/erXIyVelyZPSJde5FrdpiCn9qnShfhJwfTl2PKP7sbOdRqZqX/yfxqscGT+BCsYPr+NSlVeAo1issSwoxCae15qtjWomjAnAEkYY9VevpeWC6w=='}}} Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:32.314346 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41f6c958-6c14-4143-9192-c9ec0ba9e06e tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:32.319408 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-41f6c958-6c14-4143-9192-c9ec0ba9e06e tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.300108 Jul 18 02:27:32.331788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1491/2952] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:27:32.347784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.350199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:32.356340 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae4108ed-8479-4338-86f1-4690d7b58f32 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 1.326126 Jul 18 02:27:32.360267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1462/2953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:31 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:32.381652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c38fc1e9-9fe8-4021-b01d-558286ea1d17 req-4397f5b9-288c-45b1-812b-13458c121087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb7154-5239-40f6-b79d-99a38d02777c", "name": "network-vif-deleted", "tag": "d1b5c46e-3ed0-4025-b756-48c1824c2034"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:32.395801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.398343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.400115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.401944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.435764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c38fc1e9-9fe8-4021-b01d-558286ea1d17 req-4397f5b9-288c-45b1-812b-13458c121087 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.436571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c38fc1e9-9fe8-4021-b01d-558286ea1d17 req-4397f5b9-288c-45b1-812b-13458c121087 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.468797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c38fc1e9-9fe8-4021-b01d-558286ea1d17 req-4397f5b9-288c-45b1-812b-13458c121087 service nova] Creating event network-vif-deleted:d1b5c46e-3ed0-4025-b756-48c1824c2034 for instance 60fb7154-5239-40f6-b79d-99a38d02777c on n-h1-849796-1 Jul 18 02:27:32.484754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c38fc1e9-9fe8-4021-b01d-558286ea1d17 req-4397f5b9-288c-45b1-812b-13458c121087 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122115 Jul 18 02:27:32.487881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1463/2954] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:32.495491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04397670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1815559460", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:32.530504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:32.543084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for user f629ad62331a4b0688d58c473f266fd7 and project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:32.589746 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 2167 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1815559460", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:27:32.622776 n-d-849796-1 devstack@n-api.service[119440]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1815559460', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:32.625066 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:32.628685 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84a59b3c-54c2-4379-b18f-03bf74f85940 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.134501 Jul 18 02:27:32.636824 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1464/2955] 10.222.0.67 () {60 vars in 1159 bytes} [Mon Jul 18 02:27:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:27:32.643430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.644239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:32.654812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.655372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:32.657315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:32.658585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.450071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:33.467118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:33.473328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:33.475180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97acdc93-a5b4-4b1e-ad18-145db3ce0314 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2594 microversion: 2.32 time: 1.141856 Jul 18 02:27:33.476089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1492/2956] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:32 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2594 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:33.481544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5fe3f82-63d8-4295-980f-5e96fd673872 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04befc10>, body: {"keypair": {"name": "tempest-keypair-1689678319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfUmiMEYAdCBrwU+klWOJ3EkdyBkyNezkFUpupl813cYjsK4ZynJaKCZXSDmDm2Qz+V1OPD1WE0J+anK7Dc/E+QO1kuhY+CEx0E9kz/aTBhDm4KeSNbrYLDOvqK9AGQvg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:33.499907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a5fe3f82-63d8-4295-980f-5e96fd673872 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:33.508491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a5fe3f82-63d8-4295-980f-5e96fd673872 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for user f629ad62331a4b0688d58c473f266fd7 and project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:33.556082 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5fe3f82-63d8-4295-980f-5e96fd673872 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078598 Jul 18 02:27:33.557133 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1493/2957] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:33.563595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:33.565120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:33.579961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.580362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.582963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.583723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.849732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:33.879773 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfa59df7-cb66-4616-96a6-e7968a6a27b2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1482 microversion: 2.1 time: 1.241060 Jul 18 02:27:33.881303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1465/2958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:32 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1482 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:33.894120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-59159d73-703e-4627-8f1c-3e5920c499a2 req-bf9e2d24-e492-4153-b918-8f7b8acc9c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd682eb-1bfc-42db-a303-7ab92bfe47df", "tag": "3e406bd7-6eac-47ad-95a3-715f5788e85d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:33.907389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-59159d73-703e-4627-8f1c-3e5920c499a2 req-bf9e2d24-e492-4153-b918-8f7b8acc9c93 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.908319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-59159d73-703e-4627-8f1c-3e5920c499a2 req-bf9e2d24-e492-4153-b918-8f7b8acc9c93 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.926050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-59159d73-703e-4627-8f1c-3e5920c499a2 req-bf9e2d24-e492-4153-b918-8f7b8acc9c93 service nova] Creating event network-changed:3e406bd7-6eac-47ad-95a3-715f5788e85d for instance ccd682eb-1bfc-42db-a303-7ab92bfe47df on n-h2-849796-1 Jul 18 02:27:33.936320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-59159d73-703e-4627-8f1c-3e5920c499a2 req-bf9e2d24-e492-4153-b918-8f7b8acc9c93 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049777 Jul 18 02:27:33.937717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1466/2959] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:33.947313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:33.948075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:33.968501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.969161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:33.973303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:33.974438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:34.322088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:34.331627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6a5a411-96eb-4e98-8189-797986150271 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.772509 Jul 18 02:27:34.338293 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1494/2960] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:33 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:34.343980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04bfe550>, body: {"keypair": {"name": "tempest-keypair-1689678319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYXiIHVm69Irkj7jHnrs6mV3puuZEj5NROZ0mGRM46U0eA8MONOS9hzjGGWsL0SzlJpC71hBI0RBt3g+C8zVnejQvQ/m1Nw4UJ9Fyvr0mhIXmb/aZEQbfiG5pQacrDXUw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:34.403414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:34.426819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for user f629ad62331a4b0688d58c473f266fd7 and project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:34.497967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Key pair 'tempest-keypair-1689678319' already exists. Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 273 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "tempest-keypair-1689678319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYXiIHVm69Irkj7jHnrs6mV3puuZEj5NROZ0mGRM46U0eA8MONOS9hzjGGWsL0SzlJpC71hBI0RBt3g+C8zVnejQvQ/m1Nw4UJ9Fyvr0mhIXmb/aZEQbfiG5pQacrDXUw=="}} Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: exception: Key pair 'tempest-keypair-1689678319' already exists. Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1689678319', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYXiIHVm69Irkj7jHnrs6mV3puuZEj5NROZ0mGRM46U0eA8MONOS9hzjGGWsL0SzlJpC71hBI0RBt3g+C8zVnejQvQ/m1Nw4UJ9Fyvr0mhIXmb/aZEQbfiG5pQacrDXUw=='}}} Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f629ad62331a4b0688d58c473f266fd7-tempest-keypair-1689678319' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 02:27:34.519204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi session.flush() Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result.read() Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 18 02:27:34.525092 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f629ad62331a4b0688d58c473f266fd7-tempest-keypair-1689678319' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 18, 2, 27, 34, 485989), 'updated_at': None, 'name': 'tempest-keypair-1689678319', 'user_id': 'f629ad62331a4b0688d58c473f266fd7', 'fingerprint': 'bb:8c:7a:9f:51:2d:eb:b4:ba:e5:d9:62:ae:10:d4:7b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYXiIHVm69Irkj7jHnrs6mV3puuZEj5NROZ0mGRM46U0eA8MONOS9hzjGGWsL0SzlJpC71hBI0RBt3g+C8zVnejQvQ/m1Nw4UJ9Fyvr0mhIXmb/aZEQbfiG5pQacrDXUw==', 'type': 'ssh'}] Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair.create() Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._create() Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1689678319' already exists. Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 18 02:27:34.531428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1689678319' already exists. Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1689678319' already exists. Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 409 to user: Key pair 'tempest-keypair-1689678319' already exists. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:34.537562 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ad7bb7d-75fa-43e8-84a2-a4e44b85ce3d tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.197503 Jul 18 02:27:34.538733 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1495/2961] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:34 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:27:34.551828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:34.552695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:34.574114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:34.574926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:34.576413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:34.577278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:34.715062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:34.728692 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5586153-84b1-46b6-bdcf-fdb43fcd181d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.788339 Jul 18 02:27:34.730682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1467/2962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:33 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:34.752642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:34.754531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:34.766088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:34.767556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:34.768830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:34.769654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:35.013671 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a696197b-765f-4637-99f8-87fe254f8538 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.473518 Jul 18 02:27:35.020609 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1496/2963] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:27:34 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82/os-interface => generated 284 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:35.025926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1de59ff7-aa41-4daf-aac8-de3e1474ecbf tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Calling method '.version_select at 0x7fab04bfeca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:35.076973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1de59ff7-aa41-4daf-aac8-de3e1474ecbf tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689678319" status: 202 len: 0 microversion: 2.1 time: 0.055054 Jul 18 02:27:35.078100 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1497/2964] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689678319 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:27:35.085049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8d5eb5da-d97e-44c1-b402-5802b88bbe01 req-ff0512f2-e9a7-41d2-aa98-df84a1d4d0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-deleted", "tag": "1ba63a1c-8406-45b2-ade6-0a4a17c34c8b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:35.091076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:35.106055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8d5eb5da-d97e-44c1-b402-5802b88bbe01 req-ff0512f2-e9a7-41d2-aa98-df84a1d4d0f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:35.109877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8d5eb5da-d97e-44c1-b402-5802b88bbe01 req-ff0512f2-e9a7-41d2-aa98-df84a1d4d0f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:35.147336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8d5eb5da-d97e-44c1-b402-5802b88bbe01 req-ff0512f2-e9a7-41d2-aa98-df84a1d4d0f8 service nova] Creating event network-vif-deleted:1ba63a1c-8406-45b2-ade6-0a4a17c34c8b for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:35.162321 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8d5eb5da-d97e-44c1-b402-5802b88bbe01 req-ff0512f2-e9a7-41d2-aa98-df84a1d4d0f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082518 Jul 18 02:27:35.163214 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1498/2965] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:35.176018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dbf7f63-9ee0-41be-aa0a-61141eb07d59 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04bed4c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRXS/n5WkXXxMSDfOfhVutGvzhxZOWr4CQnrBQ8axcKvdW6x+1hAPf8nZM+p903+O163S0j0keuN9uJRqD8PKs3lfs62LN7gvxveG/+8GgEqek4e2jIY+ZKwqqeh8ttdg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dbf7f63-9ee0-41be-aa0a-61141eb07d59 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 247 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRXS/n5WkXXxMSDfOfhVutGvzhxZOWr4CQnrBQ8axcKvdW6x+1hAPf8nZM+p903+O163S0j0keuN9uJRqD8PKs3lfs62LN7gvxveG/+8GgEqek4e2jIY+ZKwqqeh8ttdg=="}} Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRXS/n5WkXXxMSDfOfhVutGvzhxZOWr4CQnrBQ8axcKvdW6x+1hAPf8nZM+p903+O163S0j0keuN9uJRqD8PKs3lfs62LN7gvxveG/+8GgEqek4e2jIY+ZKwqqeh8ttdg=='}}} Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '' Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:27:35.179023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:27:35.183342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.190395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dbf7f63-9ee0-41be-aa0a-61141eb07d59 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:35.191622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0dbf7f63-9ee0-41be-aa0a-61141eb07d59 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.027007 Jul 18 02:27:35.193234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1499/2966] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:27:35.206862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04e485e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1396640108", "public_key": " "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:35.254767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:35.277927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for user f629ad62331a4b0688d58c473f266fd7 and project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:35.326367 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 95 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1396640108", "public_key": " "}} Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1396640108', 'public_key': ' '}}} Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.328870 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:35.335450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c7ed762-cf78-4a1a-bca7-6256de8ae1c0 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.130422 Jul 18 02:27:35.338676 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1500/2967] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Jul 18 02:27:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:27:35.350483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21a38d6a-164b-4566-aa0e-76db04772b2f tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04bfeca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJjPtFe3UsYsFISZ9Y4Guagw39YwjosQ7zlER3hY2Nkdgv898TB2xKPWzi4DP6rjydAOm0bP4Kh5Y5GzA6WdES9ZN7ghTNK+V/A/lLe4Sm+HrsV05OFPjxxFBqJFxBDwA=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21a38d6a-164b-4566-aa0e-76db04772b2f tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 507 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJjPtFe3UsYsFISZ9Y4Guagw39YwjosQ7zlER3hY2Nkdgv898TB2xKPWzi4DP6rjydAOm0bP4Kh5Y5GzA6WdES9ZN7ghTNK+V/A/lLe4Sm+HrsV05OFPjxxFBqJFxBDwA=="}} Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJjPtFe3UsYsFISZ9Y4Guagw39YwjosQ7zlER3hY2Nkdgv898TB2xKPWzi4DP6rjydAOm0bP4Kh5Y5GzA6WdES9ZN7ghTNK+V/A/lLe4Sm+HrsV05OFPjxxFBqJFxBDwA=='}}} Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 18 02:27:35.353295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21a38d6a-164b-4566-aa0e-76db04772b2f tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:35.356350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21a38d6a-164b-4566-aa0e-76db04772b2f tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010251 Jul 18 02:27:35.363355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1501/2968] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:27:35.368452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:35.369247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:35.405093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:35.405753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:35.406750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:35.408282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:36.281652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:36.301147 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f377818f-572c-4840-a7bb-db4510f68a66 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.935631 Jul 18 02:27:36.302491 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1502/2969] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:35 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:36.316916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:36.323360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Action: 'create', calling method: .version_select at 0x7fab04bed310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1764262948", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:36.348659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:36.354740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:36.356512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-523aae41-51a5-44ff-96ba-64292357ee7a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2547 microversion: 2.32 time: 1.624280 Jul 18 02:27:36.372949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:36.373290 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1468/2970] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:34 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2547 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:36.378991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:36.379981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:36.388122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:36.388890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:36.390036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:36.390733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:36.399528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Getting quotas for user f629ad62331a4b0688d58c473f266fd7 and project d539c490628b4090826bf211dfd9a85f. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:36.444219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 118 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1764262948", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: exception: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1764262948', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 18 02:27:36.446970 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 18 02:27:36.451336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.462791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:36.464210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8301bfcb-670b-4406-b0ef-7b8c596d70b5 tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.159706 Jul 18 02:27:36.465056 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1503/2971] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:27:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:27:36.480890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db8d80a7-1aa3-4afd-bcc4-fc8bda27ac0b tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Calling method '.version_select at 0x7fab04c59c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:36.496257 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-db8d80a7-1aa3-4afd-bcc4-fc8bda27ac0b tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db8d80a7-1aa3-4afd-bcc4-fc8bda27ac0b tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Request method failure captured: Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1393169127 HTTP/1.1 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUTv-PMdDjag8vazV75C3USWYaNlpuUEVAYbWjsOVax997Gc2C9b-LHumX5siUjNj-qX1-Qc7grIdMKek4wNRQlZuIm0xknE7xwV0JPc9dhD30omzFH1MQmPN3fc4tX9bZJhqkdOxf643urs7g7KcwBdoDkKzNB3EqDn66bnXKCgWg Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d539c490628b4090826bf211dfd9a85f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d539c490628b4090826bf211dfd9a85f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d539c490628b4090826bf211dfd9a85f Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1961686726 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1961686726-project Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: exception: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'tempest-keypair-non-existent-1393169127'} Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise self.value Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.498731 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 Jul 18 02:27:36.503222 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:27:36.506851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db8d80a7-1aa3-4afd-bcc4-fc8bda27ac0b tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1393169127 not found for user f629ad62331a4b0688d58c473f266fd7 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:36.508156 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db8d80a7-1aa3-4afd-bcc4-fc8bda27ac0b tempest-KeyPairsNegativeTestJSON-1961686726 tempest-KeyPairsNegativeTestJSON-1961686726-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1393169127" status: 404 len: 145 microversion: 2.1 time: 0.035303 Jul 18 02:27:36.519299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1504/2972] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:27:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1393169127 => generated 145 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:27:36.947250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-328ec42f-65b2-414d-b769-ec24c75f8ad3 req-ff1620d9-7b51-4b9f-bfd7-b1a0532980df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fde38d2-6a9e-404d-86ac-d264f9a2da65", "tag": "cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:36.979701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-328ec42f-65b2-414d-b769-ec24c75f8ad3 req-ff1620d9-7b51-4b9f-bfd7-b1a0532980df service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:36.982493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-328ec42f-65b2-414d-b769-ec24c75f8ad3 req-ff1620d9-7b51-4b9f-bfd7-b1a0532980df service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:37.037724 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-328ec42f-65b2-414d-b769-ec24c75f8ad3 req-ff1620d9-7b51-4b9f-bfd7-b1a0532980df service nova] Creating event network-changed:cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba for instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 on n-h1-849796-1 Jul 18 02:27:37.052381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-328ec42f-65b2-414d-b769-ec24c75f8ad3 req-ff1620d9-7b51-4b9f-bfd7-b1a0532980df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109115 Jul 18 02:27:37.053774 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1505/2973] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:37.330611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:37.331403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:37.368015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:37.368485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:37.408129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:37.408975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:37.695084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:37.708134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90285ed7-9a4b-4018-a708-14d60588d909 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 1.333730 Jul 18 02:27:37.718325 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1469/2974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:36 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:37.724906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:37.728797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:37.750485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:37.753424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:37.754686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:37.755731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:38.373658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:38.411815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:38.414609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:38.418229 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d34d103a-11c7-4c81-a966-bcd2e02d62e8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 2213 microversion: 2.32 time: 0.698020 Jul 18 02:27:38.446935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1470/2975] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:37 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 2213 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:38.457654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0779f0a3-5966-480a-b9b1-40c67ae3606c req-ccfffbc5-95bc-48d2-9405-4a9721ff2eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-deleted", "tag": "4f456121-fd6f-4052-a2bc-5c6324652c5f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:38.476662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0779f0a3-5966-480a-b9b1-40c67ae3606c req-ccfffbc5-95bc-48d2-9405-4a9721ff2eb0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:38.478083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0779f0a3-5966-480a-b9b1-40c67ae3606c req-ccfffbc5-95bc-48d2-9405-4a9721ff2eb0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:38.507136 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0779f0a3-5966-480a-b9b1-40c67ae3606c req-ccfffbc5-95bc-48d2-9405-4a9721ff2eb0 service nova] Creating event network-vif-deleted:4f456121-fd6f-4052-a2bc-5c6324652c5f for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:38.513648 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0779f0a3-5966-480a-b9b1-40c67ae3606c req-ccfffbc5-95bc-48d2-9405-4a9721ff2eb0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063809 Jul 18 02:27:38.514302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1471/2976] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:38.660622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:38.683110 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-931a6488-9a61-4fa4-ab5a-44a82931bde7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 1.361337 Jul 18 02:27:38.701455 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1506/2977] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:37 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:38.731977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:38.733408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:38.771694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:38.777161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:38.779002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:38.781970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.466466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:39.470218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:39.489854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.491542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.492819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.494053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.700580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:39.703072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:39.725307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:39.732800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:39.733579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fccc1129-ccb5-41cf-83b5-69a29bb33e3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 1.009419 Jul 18 02:27:39.734913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-580f87c3-6fa6-4162-a2bc-be7b6344ac34 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1987 microversion: 2.32 time: 0.281553 Jul 18 02:27:39.744812 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1472/2978] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:38 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:39.747281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1507/2979] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:39 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1987 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:39.757779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:39.758416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:39.783731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.784847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:39.786928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:39.788596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.596530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-082ef168-de60-4e47-ba2f-305f52eb9e2c req-10a1bf1d-4915-48d2-8517-1a946492a40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d4272c-f2ee-480f-b47d-3ee75d9accc0", "name": "network-vif-deleted", "tag": "df68d20a-4518-4fc1-8770-f6dd7fe75468"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:40.622242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-082ef168-de60-4e47-ba2f-305f52eb9e2c req-10a1bf1d-4915-48d2-8517-1a946492a40c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.625600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-082ef168-de60-4e47-ba2f-305f52eb9e2c req-10a1bf1d-4915-48d2-8517-1a946492a40c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.656769 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-082ef168-de60-4e47-ba2f-305f52eb9e2c req-10a1bf1d-4915-48d2-8517-1a946492a40c service nova] Creating event network-vif-deleted:df68d20a-4518-4fc1-8770-f6dd7fe75468 for instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 on n-h1-849796-1 Jul 18 02:27:40.687681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-082ef168-de60-4e47-ba2f-305f52eb9e2c req-10a1bf1d-4915-48d2-8517-1a946492a40c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090924 Jul 18 02:27:40.689961 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1508/2980] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:40.765180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:40.770443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:40.823042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.828290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:40.831799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:40.836891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.027946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.081007 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65ec9b64-ae92-433a-ba91-4229993b9ded tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 1.333333 Jul 18 02:27:41.083546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1473/2981] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:39 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:41.108765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.112988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:41.143664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.146573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.149176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.151364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.364260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.387884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.394629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.400231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c132689d-92e3-4acb-9e1b-7a827da6739f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1987 microversion: 2.32 time: 0.310675 Jul 18 02:27:41.408867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1474/2982] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1987 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:41.429403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:41.432644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.434617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:41.446915 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f6cb9aa-0a94-40fc-a7b5-6fbbca030d2d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.696815 Jul 18 02:27:41.447537 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1509/2983] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:40 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:41.453784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.457036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:41.459411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:41.460908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.132998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:42.139088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:42.145652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:42.159572 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efcc7b96-141c-495f-917c-86548439896d tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1482 microversion: 2.1 time: 0.748609 Jul 18 02:27:42.160203 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1475/2984] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1482 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:42.205408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.207558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.214225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.217868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.566919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:42.714559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:42.734991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-614e7ec0-353e-466b-8a08-5c73dd65e3e3 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.618576 Jul 18 02:27:42.741152 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1510/2985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:42 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:42.760841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:42.766118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:42.797299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.799917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:42.806424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:42.807570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:43.070044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2024362656", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:43.088344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:43.104987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:43.134624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:43.148307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:43.151599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be43f9a4-3017-414d-a29c-790c248db315 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.408657 Jul 18 02:27:43.155835 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1511/2986] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:42 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:43.177724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:43.179947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:43.210573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] validate_networks() for [('c547de47-f38b-4e31-894b-bc19135e8d69', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:43.216911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:43.217795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:43.223397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:43.227243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:43.759347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:43.794815 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf787c3d-b240-4eec-a247-fe790d57c5d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.629299 Jul 18 02:27:43.818981 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1512/2987] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:43 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:43.831071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d8245b51-2254-4cae-86af-ccac12346464 req-d7ed89dc-cc0b-4899-bc89-aa4ef3849d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028eedd8-9876-489c-bd5f-2e8f62ed5e82", "tag": "df056e25-33ec-4a0a-91e8-b3f74536ccd7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:43.848164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d8245b51-2254-4cae-86af-ccac12346464 req-d7ed89dc-cc0b-4899-bc89-aa4ef3849d41 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:43.849681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d8245b51-2254-4cae-86af-ccac12346464 req-d7ed89dc-cc0b-4899-bc89-aa4ef3849d41 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:43.873880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d8245b51-2254-4cae-86af-ccac12346464 req-d7ed89dc-cc0b-4899-bc89-aa4ef3849d41 service nova] Creating event network-changed:df056e25-33ec-4a0a-91e8-b3f74536ccd7 for instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 on n-h2-849796-1 Jul 18 02:27:43.888179 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d8245b51-2254-4cae-86af-ccac12346464 req-d7ed89dc-cc0b-4899-bc89-aa4ef3849d41 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063911 Jul 18 02:27:43.893786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1513/2988] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:43.912452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:43.917455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:43.942599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:43.946159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:43.948109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:43.950198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.005462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.047626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93de6e2a-e5fc-4f1d-bd63-0135cdcd132c tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 1.149824 Jul 18 02:27:45.048839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1514/2989] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:43 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:45.081058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:45.083426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:45.127823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.149993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.153314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.158417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.345416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.384672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.389098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.395422 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4ac530c-ed18-4603-a9e9-596e627ec28a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.340251 Jul 18 02:27:45.400559 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1515/2990] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:45 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:45.424896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:45.430350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:45.471035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.471802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.472835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.473452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:45.920766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:45.934289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b4600b2-7d96-4657-91fe-b9ad800809c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.531800 Jul 18 02:27:45.948963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1516/2991] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:45 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:45.948963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d1b13917-abe5-4d55-8868-25fafffb145f req-aea40e22-9199-4f0f-9c16-0f3745ad2acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd682eb-1bfc-42db-a303-7ab92bfe47df", "name": "network-vif-plugged", "status": "completed", "tag": "3e406bd7-6eac-47ad-95a3-715f5788e85d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:45.974375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d1b13917-abe5-4d55-8868-25fafffb145f req-aea40e22-9199-4f0f-9c16-0f3745ad2acc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:45.974996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d1b13917-abe5-4d55-8868-25fafffb145f req-aea40e22-9199-4f0f-9c16-0f3745ad2acc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.000549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d1b13917-abe5-4d55-8868-25fafffb145f req-aea40e22-9199-4f0f-9c16-0f3745ad2acc service nova] Creating event network-vif-plugged:3e406bd7-6eac-47ad-95a3-715f5788e85d for instance ccd682eb-1bfc-42db-a303-7ab92bfe47df on n-h2-849796-1 Jul 18 02:27:46.011761 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d1b13917-abe5-4d55-8868-25fafffb145f req-aea40e22-9199-4f0f-9c16-0f3745ad2acc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074937 Jul 18 02:27:46.014865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1517/2992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:46.067058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:46.067907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:46.076166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.076742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.078463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.079939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.419953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:46.535107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:46.561234 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbf60d25-8a26-4337-9439-d8440cfef550 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.499374 Jul 18 02:27:46.568499 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1518/2993] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:46 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:46.592949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:46.593961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:46.605957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:46.606634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:46.607723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:46.608376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:46.609037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:46.627686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.628598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.630059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.630849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.651290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.652141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.658810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.660053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.756362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:46.784620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for user a5664e98b90c4542b9186b42ca89d99c and project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:46.847213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:46.851282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:46.855719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:46.859964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:46.871932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:46.873845 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9321d87-8a66-4e86-9cec-4d3090885ea5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.297004 Jul 18 02:27:46.874994 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1519/2994] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:46 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:46.969417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:46.970108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:46.981754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.984205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:46.987231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:46.989372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.040827 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9eff1d30-0812-46ad-9f2a-b81a56c70881 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.748321 Jul 18 02:27:47.044743 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1476/2995] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:27:47.090827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b8f092e-64c7-42c4-99ea-7e093918ac48 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.094215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b8f092e-64c7-42c4-99ea-7e093918ac48 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:47.464140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:47.486622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48854878-4eff-4b60-b170-01501186d234 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1314 microversion: 2.1 time: 0.520779 Jul 18 02:27:47.487635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b8f092e-64c7-42c4-99ea-7e093918ac48 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:47.489012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1520/2996] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:46 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:47.526805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b8f092e-64c7-42c4-99ea-7e093918ac48 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1222 microversion: 2.1 time: 0.474761 Jul 18 02:27:47.562345 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1477/2997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1222 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:47.605820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.617970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:47.624289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:47.659384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.660226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.661669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.662426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.903416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.904204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:47.924553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.925044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:47.934276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:47.935055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:48.365503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:48.403095 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dba0ec5d-71b6-4051-9111-8e02b06974a6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.811571 Jul 18 02:27:48.448229 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1521/2998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:48.475076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-100743997", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:48.662305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] validate_networks() for [('c547de47-f38b-4e31-894b-bc19135e8d69', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:27:49.429291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:49.476378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:49.498725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:49.512388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c6ce54d-d511-4ef5-8b85-0f43b3be52ee tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 1.612850 Jul 18 02:27:49.531912 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1478/2999] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:49.583673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:49.586645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:49.616377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.620708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:49.624352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:49.629302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.059102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:27:50.060595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:27:50.061765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:27:50.063097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:27:50.064768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:27:50.116045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.122387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.130691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.131411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.206124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:50.221676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for user a5664e98b90c4542b9186b42ca89d99c and project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:50.274807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:27:50.277872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:27:50.450613 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1e1198e-456b-4dbb-ba92-28e0c4965108 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.998035 Jul 18 02:27:50.453420 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1522/3000] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:27:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:27:50.493704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:50.497597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:50.538599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.543652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.545556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:50.550706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:50.898691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:50.908785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f683d0eb-af80-49d3-95f5-362ee1294528 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.448844 Jul 18 02:27:50.926385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1523/3001] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:50 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:50.931843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-203519e2-0823-415f-a746-a0607b145062 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:50.932490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-203519e2-0823-415f-a746-a0607b145062 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:51.160377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-203519e2-0823-415f-a746-a0607b145062 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.203041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-203519e2-0823-415f-a746-a0607b145062 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1221 microversion: 2.1 time: 0.274736 Jul 18 02:27:51.205015 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1524/3002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:50 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:51.240286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:51.260175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:51.290065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.291111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.295642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.299042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.426325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.484101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15c69757-06cd-4eb5-918f-f8487d5afa8f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1500 microversion: 2.1 time: 1.947746 Jul 18 02:27:51.487188 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1479/3003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:49 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1500 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:51.788130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.838499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.843706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:51.856357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-333c3653-5ab6-424a-a8fa-2e3777fd8d6a tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.645466 Jul 18 02:27:51.861523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1525/3004] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:51 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:51.932516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:51.938744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:51.974259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.975842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:51.978239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:51.982195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:52.227094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:52.230039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:52.273685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:52.274505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:52.275700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:52.276491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.342952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:53.352623 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4ebebb8-4372-4cf9-a4a4-ffef55b91320 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1225 microversion: 2.1 time: 1.134171 Jul 18 02:27:53.366027 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1526/3005] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:52 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1225 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:53.384934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ac032110-5f02-4aa3-8c73-7df4686aad53 req-4d54e20f-30ad-4e1c-acb0-0bb4a94e48af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fde38d2-6a9e-404d-86ac-d264f9a2da65", "name": "network-vif-plugged", "status": "completed", "tag": "cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:53.436070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ac032110-5f02-4aa3-8c73-7df4686aad53 req-4d54e20f-30ad-4e1c-acb0-0bb4a94e48af service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.441163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ac032110-5f02-4aa3-8c73-7df4686aad53 req-4d54e20f-30ad-4e1c-acb0-0bb4a94e48af service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.555841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ac032110-5f02-4aa3-8c73-7df4686aad53 req-4d54e20f-30ad-4e1c-acb0-0bb4a94e48af service nova] Creating event network-vif-plugged:cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba for instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 on n-h1-849796-1 Jul 18 02:27:53.608138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ac032110-5f02-4aa3-8c73-7df4686aad53 req-4d54e20f-30ad-4e1c-acb0-0bb4a94e48af service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237377 Jul 18 02:27:53.609260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1527/3006] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:53.647656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:53.649428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:53.680906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.687197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:53.693294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:53.694460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.346910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.390568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.393317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.401224 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7f19f4a-4df4-4c08-9c1a-be2ec9e0ade1 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.788383 Jul 18 02:27:54.402893 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1528/3007] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:53 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:54.413599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:54.414843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:54.432207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.433946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.435958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:54.440065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:54.730842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:54.752335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5691f4b-9955-44b5-a891-27e013a2fa71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 2.829595 Jul 18 02:27:54.764258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1480/3008] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:51 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 2842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:54.981567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:55.021273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b735885-fa49-48b7-8651-ea03de32ca0d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1279 microversion: 2.1 time: 0.614369 Jul 18 02:27:55.025118 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1529/3009] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:54 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1279 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:55.439446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:55.441215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:55.466217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.466916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:55.468021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.469722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:55.652883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Action: 'create', calling method: .version_select at 0x7fab042e4820>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:55.706325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Getting quotas for project 8c810d8029454ac9815b0728b90c6a6b. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:55.714489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Getting quotas for user edeb3584e06e4907abbf9ac05ebe7701 and project 8c810d8029454ac9815b0728b90c6a6b. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:55.817880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Getting quotas for project 8c810d8029454ac9815b0728b90c6a6b. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:27:55.826333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Getting quotas for user edeb3584e06e4907abbf9ac05ebe7701 and project 8c810d8029454ac9815b0728b90c6a6b. Resources: {'server_groups'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:27:55.849206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:55.853476 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5cbfc32e-cc7e-43a7-80e4-52c6ee89561c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.512650 Jul 18 02:27:55.855231 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1481/3010] 10.222.0.67 () {62 vars in 1213 bytes} [Mon Jul 18 02:27:55 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:27:55.862809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:55.863984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:55.878501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.879401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:55.884038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:55.884985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.068517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.089217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.095566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.098237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35221b6c-34ea-45e5-931a-0f9c62cf8063 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.664114 Jul 18 02:27:56.099190 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1530/3011] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:55 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:27:56.114180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b26a40f-554f-4baa-9809-266b8a5ac5ca tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:56.134203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b26a40f-554f-4baa-9809-266b8a5ac5ca tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.033086 Jul 18 02:27:56.140610 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1531/3012] 10.222.0.67 () {60 vars in 1192 bytes} [Mon Jul 18 02:27:56 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:56.147264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:56.148212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:56.157514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.158450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.159502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.162761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.502916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.539686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09721b76-1280-402e-90d9-f4ecaa5ac4ca tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1279 microversion: 2.1 time: 0.396577 Jul 18 02:27:56.566580 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1532/3013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:56 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1279 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:56.585400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c2b7963-1d81-4a01-a449-47329cbe4e7c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:56.642174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c2b7963-1d81-4a01-a449-47329cbe4e7c tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204" status: 200 len: 235 microversion: 2.64 time: 0.070509 Jul 18 02:27:56.652539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1533/3014] 10.222.0.67 () {60 vars in 1303 bytes} [Mon Jul 18 02:27:56 2022] GET /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204 => generated 235 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:56.670749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c31c3ff5-0b02-4d25-a412-a273e92e600a req-45dec32f-84f0-41cb-ba16-b3d733d6d305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad144596-42e9-47bb-b290-8febab20f782", "tag": "b3d63561-3126-48d6-ace6-741e16cd2332"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:56.709615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c31c3ff5-0b02-4d25-a412-a273e92e600a req-45dec32f-84f0-41cb-ba16-b3d733d6d305 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.716634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c31c3ff5-0b02-4d25-a412-a273e92e600a req-45dec32f-84f0-41cb-ba16-b3d733d6d305 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.716977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:56.738538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:56.771130 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c31c3ff5-0b02-4d25-a412-a273e92e600a req-45dec32f-84f0-41cb-ba16-b3d733d6d305 service nova] Creating event network-changed:b3d63561-3126-48d6-ace6-741e16cd2332 for instance ad144596-42e9-47bb-b290-8febab20f782 on n-h1-849796-1 Jul 18 02:27:56.778378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:56.788174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c31c3ff5-0b02-4d25-a412-a273e92e600a req-45dec32f-84f0-41cb-ba16-b3d733d6d305 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130613 Jul 18 02:27:56.794985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1534/3015] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:56.808811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a0bc389-8b50-4afc-a74d-a99f5ce33dbd"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:56.811662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:56.812728 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1436071-bb14-4d8c-9bad-36633dcfb9fe tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1307 microversion: 2.1 time: 0.954874 Jul 18 02:27:56.819723 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1482/3016] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:55 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1307 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:56.837363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.841816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.846774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:56.848052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:56.853253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ddf8752d-abdf-4188-ab8e-7a712f7ab25f tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:56.964299 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ddf8752d-abdf-4188-ab8e-7a712f7ab25f tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204" status: 204 len: 0 microversion: 2.64 time: 0.138125 Jul 18 02:27:56.966963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1483/3017] 10.222.0.67 () {60 vars in 1306 bytes} [Mon Jul 18 02:27:56 2022] DELETE /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:27:56.996474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5feccb0-854d-4bc2-9d06-340404463e03 tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.022772 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b5feccb0-854d-4bc2-9d06-340404463e03 tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] HTTP exception thrown: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5feccb0-854d-4bc2-9d06-340404463e03 tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Request method failure captured: Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204 HTTP/1.1 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUrxqSZ3-KaLaVFQzsoyLGFfPTNV6c94p9wOnaKcIHDMm3dncT3r-VpizRopUClFkH6PG8ZMM0u7QVMdz4YV0_cjVGgc0fi5co3BzVYuAYhAeXXep9KD3BlNAy3ViQb_eZrqhPn8ejR4xTir-fLGLGXlZ-DWrRtc8zIO-UTPZTax8Q Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.64 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 8c810d8029454ac9815b0728b90c6a6b Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerGroup264TestJSON-233153386 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c810d8029454ac9815b0728b90c6a6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c810d8029454ac9815b0728b90c6a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c810d8029454ac9815b0728b90c6a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c810d8029454ac9815b0728b90c6a6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerGroup264TestJSON-233153386 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 8c810d8029454ac9815b0728b90c6a6b Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerGroup264TestJSON-233153386 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerGroup264TestJSON-233153386-project Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: edeb3584e06e4907abbf9ac05ebe7701 Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerGroup264TestJSON-233153386-project Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '4629cd7e-be46-4c7f-bf6e-a23032dd8204'} Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:57.036142 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. Jul 18 02:27:57.049114 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:27:57.051509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5feccb0-854d-4bc2-9d06-340404463e03 tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] Returning 404 to user: Instance group 4629cd7e-be46-4c7f-bf6e-a23032dd8204 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:27:57.053388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5feccb0-854d-4bc2-9d06-340404463e03 tempest-ServerGroup264TestJSON-233153386 tempest-ServerGroup264TestJSON-233153386-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204" status: 404 len: 117 microversion: 2.64 time: 0.075983 Jul 18 02:27:57.056315 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1484/3018] 10.222.0.67 () {60 vars in 1306 bytes} [Mon Jul 18 02:27:56 2022] DELETE /compute/v2.1/os-server-groups/4629cd7e-be46-4c7f-bf6e-a23032dd8204 => generated 117 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:27:57.131413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.137848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.171267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.174047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.177805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.179656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.193679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:57.437555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.453106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.459787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.465400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f6985c2-a0ce-40ce-b10a-5d8fa727ed49 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.347239 Jul 18 02:27:57.471019 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1485/3019] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:57.574019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.574963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.586188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.593305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.596006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.598280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.727467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-447b7819-bc99-449c-8b11-39effdf786a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929150 Jul 18 02:27:57.734759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1535/3020] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:27:56 2022] POST /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:57.839879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:57.848599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:57.853454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5461b364-836d-4adf-bc4e-57e2b714f355 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1279 microversion: 2.1 time: 0.282269 Jul 18 02:27:57.857722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1486/3021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:57.869319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:57.899431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.903937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:57.906720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:57.910606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.505434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:58.506193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:58.535021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.546182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.546514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.546923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.781668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:58.799564 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7c74131-9534-4595-97b9-86b2fc776956 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1487 microversion: 2.1 time: 0.965511 Jul 18 02:27:58.815238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1536/3022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:57 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1487 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:58.830131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:58.831212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:58.848637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.859875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.861620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:58.862289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:58.910470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lazy-loading 'flavor' on Instance uuid 7fde38d2-6a9e-404d-86ac-d264f9a2da65 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:27:59.226876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60571f1b-728e-43e9-97cf-0efb08cc139f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65/action" status: 202 len: 0 microversion: 2.1 time: 0.410109 Jul 18 02:27:59.230879 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1537/3023] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:27:58 2022] POST /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:27:59.237992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:59.238728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:59.279096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.280042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.281655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.291591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.403030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.420450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.439311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.442628 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-432ab285-5a83-4779-852c-e5d9b19c30c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.943293 Jul 18 02:27:59.444598 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1487/3024] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:27:58 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:27:59.461201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:59.471844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:27:59.510005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.512789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.516136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:27:59.521081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:27:59.801448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:27:59.856293 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e4a42b4-d494-4825-a635-4eec2e82798a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1279 microversion: 2.1 time: 0.623169 Jul 18 02:27:59.859470 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1538/3025] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:59 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1279 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:00.184975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:00.204790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56cd4582-c602-4c75-bf00-565607489201 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1495 microversion: 2.1 time: 0.756282 Jul 18 02:28:00.207066 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1488/3026] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:27:59 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1495 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:00.484641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:00.486668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:00.506012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:00.530559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.542028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.545327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.551193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.895004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:00.896072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:00.987975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.995432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:00.997237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:00.998528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.171920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:01.240750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.315215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.323645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.335544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-293498aa-f7f2-480a-a802-e8b4dcab4db5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.858589 Jul 18 02:28:01.343554 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1539/3027] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:00 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:01.371865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:01.376733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:01.412734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.415110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.417029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:01.421756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:01.740962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:01.757898 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1356834-d9c4-4988-a71e-f55b384100f1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.877737 Jul 18 02:28:01.760610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1489/3028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:00 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:02.362035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:02.363512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:02.385486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:02.385969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:02.386900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:02.387360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:02.418702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:02.437476 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3272e4fb-1b41-41bd-aea6-e7c67e8bae64 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1495 microversion: 2.1 time: 1.090445 Jul 18 02:28:02.439211 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1540/3029] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:01 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1495 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:02.741682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:02.793973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:02.794807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:02.808241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:02.808686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:02.821220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:02.821472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:02.822308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:02.822775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:02.829819 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1db3be38-00d1-4c84-9f36-da6947bc830b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.469954 Jul 18 02:28:02.839766 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1490/3030] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:02 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:03.460333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:03.462267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:03.476968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.478082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:03.479228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:03.480070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:04.208885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:04.311264 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-912c784e-fd9d-4590-8ee4-97def5082bcb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 200 len: 1478 microversion: 2.1 time: 0.852292 Jul 18 02:28:04.323928 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1491/3031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:03 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 1478 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:04.363096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:04.367237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:04.389690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:04.392348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:04.395035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:04.396214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:04.630796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:04.656299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:04.663691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:04.666291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:04.674510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af8cf89f-fb40-4476-976c-6ecf49ee35ad tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.335215 Jul 18 02:28:04.685817 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1492/3032] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:04 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:04.685817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-869601510"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:04.686208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:04.699105 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50df6a4c-8b91-41f9-ab3f-e8952e0d7d80 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.909941 Jul 18 02:28:04.723549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:04.723943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1541/3033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:02 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:04.729912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:04.730901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:04.731370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.701108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:05.701805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:05.738536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e370dfa-3142-425e-9aed-8d9b6705afd6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65/action" status: 202 len: 0 microversion: 2.1 time: 1.061418 Jul 18 02:28:05.743422 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1493/3034] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:04 2022] POST /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:28:05.751463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.753351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.754533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.760164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.782826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:05.790784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:05.820790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.821745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.825745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:05.827041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:05.855234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=16 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:06.095349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:06.114262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:06.120176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:06.124695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfeed505-732d-4615-ad2f-3f9f2b8363c7 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.432071 Jul 18 02:28:06.128128 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1542/3035] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:05 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:28:06.153619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85ffb0c4-b141-477c-9839-01bc1766abc0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ed9ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:06.251489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:06.284677 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb3c229f-c74d-49ed-99a8-5dbd8e53e85a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.518017 Jul 18 02:28:06.286618 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1494/3036] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:05 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:06.330808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-69e73cc0-d2f4-4de2-ae45-6c1870f8f6fc req-6e8d32d1-9eeb-4d6d-8ad5-c6d82d66ecfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad144596-42e9-47bb-b290-8febab20f782", "name": "network-vif-plugged", "status": "completed", "tag": "b3d63561-3126-48d6-ace6-741e16cd2332"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:06.372086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85ffb0c4-b141-477c-9839-01bc1766abc0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.241757 Jul 18 02:28:06.375531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-69e73cc0-d2f4-4de2-ae45-6c1870f8f6fc req-6e8d32d1-9eeb-4d6d-8ad5-c6d82d66ecfa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:06.384729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-69e73cc0-d2f4-4de2-ae45-6c1870f8f6fc req-6e8d32d1-9eeb-4d6d-8ad5-c6d82d66ecfa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:06.407539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1543/3037] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:06 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:06.434482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-69e73cc0-d2f4-4de2-ae45-6c1870f8f6fc req-6e8d32d1-9eeb-4d6d-8ad5-c6d82d66ecfa service nova] Creating event network-vif-plugged:b3d63561-3126-48d6-ace6-741e16cd2332 for instance ad144596-42e9-47bb-b290-8febab20f782 on n-h1-849796-1 Jul 18 02:28:06.461083 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-69e73cc0-d2f4-4de2-ae45-6c1870f8f6fc req-6e8d32d1-9eeb-4d6d-8ad5-c6d82d66ecfa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168797 Jul 18 02:28:06.467062 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1495/3038] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:07.150778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:07.156572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:07.182572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.192072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.196009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.200981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.320867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:07.321692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:07.341107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.348093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.352593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:07.354021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:07.415849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:07.441483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:07.443893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:07.450558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9815ff9c-92ef-4f56-b626-3cb98ee1a6c8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.307405 Jul 18 02:28:07.468556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1544/3039] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:07 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:07.478788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79fa87d4-1908-4098-90c9-c2ea5ecf4e80 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ed9f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:07.569434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79fa87d4-1908-4098-90c9-c2ea5ecf4e80 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.098261 Jul 18 02:28:07.570983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1545/3040] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:07 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:08.096435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5af22b9b-d517-4a6d-be69-c11ac2f3e012 req-71f63c3e-0f67-4d35-bb8f-1702bc20c622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db28d67-4e43-4c24-aaf9-e26279f86242", "tag": "f0295ae4-0d75-4cb3-875f-7ba4bf9afd49"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:08.126923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5af22b9b-d517-4a6d-be69-c11ac2f3e012 req-71f63c3e-0f67-4d35-bb8f-1702bc20c622 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:08.127969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5af22b9b-d517-4a6d-be69-c11ac2f3e012 req-71f63c3e-0f67-4d35-bb8f-1702bc20c622 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:08.173111 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5af22b9b-d517-4a6d-be69-c11ac2f3e012 req-71f63c3e-0f67-4d35-bb8f-1702bc20c622 service nova] Creating event network-changed:f0295ae4-0d75-4cb3-875f-7ba4bf9afd49 for instance 3db28d67-4e43-4c24-aaf9-e26279f86242 on n-h2-849796-1 Jul 18 02:28:08.192954 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5af22b9b-d517-4a6d-be69-c11ac2f3e012 req-71f63c3e-0f67-4d35-bb8f-1702bc20c622 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100725 Jul 18 02:28:08.199340 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1546/3041] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:08.475393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:08.476418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:08.499811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:08.501677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:08.505199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:08.506070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:08.783586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:08.819662 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60767005-7fd5-4365-9f51-2e3b95cce63b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.504295 Jul 18 02:28:08.823863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1496/3042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:07 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:08.844554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fe3039a-cd24-40f5-ba06-2fe9c6ccf40f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04346790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:08.960310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fe3039a-cd24-40f5-ba06-2fe9c6ccf40f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.123171 Jul 18 02:28:08.966383 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1497/3043] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:08 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:09.842787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:09.844216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:09.871252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:09.873878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:09.876812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:09.877628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:10.024558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:10.061504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:10.072668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:10.075566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93d84d4e-6426-4bb9-8d52-4143fcf6352f tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 1.605910 Jul 18 02:28:10.084440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1547/3044] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:08 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:10.100453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51ab7505-1461-4e6d-8b18-f44c6475ee14 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b89700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:10.181054 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51ab7505-1461-4e6d-8b18-f44c6475ee14 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.094224 Jul 18 02:28:10.183890 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1548/3045] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:10 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:10.202871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:10.217372 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-943edaea-982a-4518-a970-19bb0dc39381 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.381943 Jul 18 02:28:10.229348 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1498/3046] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:09 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:11.106236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:11.109586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:11.161848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.163539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.165369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.166892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.205033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f3635913-cd8a-4fff-afa7-64a7929ef688 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04397040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:11.418837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f3635913-cd8a-4fff-afa7-64a7929ef688 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.219004 Jul 18 02:28:11.454537 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1499/3047] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:11 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:11.477326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:11.486369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:11.495239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.496448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.497641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.498373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.807067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:11.834285 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13a281df-5f34-44e2-8f26-1d78d8790af7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.377653 Jul 18 02:28:11.836468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1500/3048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:11 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:11.852875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cecd1bef-ca94-4c97-8c22-a3f9ef1fc27e req-80e8fd07-1ba1-4fa2-8f7b-e73262e637ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fde38d2-6a9e-404d-86ac-d264f9a2da65", "name": "network-vif-plugged", "status": "completed", "tag": "cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:11.894805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cecd1bef-ca94-4c97-8c22-a3f9ef1fc27e req-80e8fd07-1ba1-4fa2-8f7b-e73262e637ae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:11.895410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cecd1bef-ca94-4c97-8c22-a3f9ef1fc27e req-80e8fd07-1ba1-4fa2-8f7b-e73262e637ae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:11.928184 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cecd1bef-ca94-4c97-8c22-a3f9ef1fc27e req-80e8fd07-1ba1-4fa2-8f7b-e73262e637ae service nova] Creating event network-vif-plugged:cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba for instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 on n-h1-849796-1 Jul 18 02:28:11.939096 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cecd1bef-ca94-4c97-8c22-a3f9ef1fc27e req-80e8fd07-1ba1-4fa2-8f7b-e73262e637ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098221 Jul 18 02:28:11.940639 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1501/3049] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:12.008912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:12.019287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:12.021000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:12.032019 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71015147-8f75-4f84-b46e-85bfdfc35643 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.934798 Jul 18 02:28:12.032761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1549/3050] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:11 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:12.439030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-289e81de-479f-4669-80c1-b95338840dde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0437d700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:12.535448 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-289e81de-479f-4669-80c1-b95338840dde tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.102504 Jul 18 02:28:12.537514 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1502/3051] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:12 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:12.871152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:12.879758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:12.912810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.913567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:12.915090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:12.915904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.057536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:13.061692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:13.088705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:13.088705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.090136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:13.090924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:13.303266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:13.343529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:13.352024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:13.361233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d80c3cd7-36c2-4146-a0b5-3130ecc25b83 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.310195 Jul 18 02:28:13.382515 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1503/3052] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:13 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:28:13.556681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4edbcb3-948b-4576-98ce-988d53e3b5b5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab042e4af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:13.727385 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4edbcb3-948b-4576-98ce-988d53e3b5b5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.174388 Jul 18 02:28:13.728889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1504/3053] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:13 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:14.029653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:14.056452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47a9e80e-a0c1-4492-8544-7ed760363626 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.192695 Jul 18 02:28:14.060200 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1550/3054] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:12 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:14.439346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:14.445671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:14.504078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.507131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:14.512210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:14.514174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:14.754820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1c83815-f28c-4b43-b7b5-b6d97df44fc9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04bb1e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:14.766608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:14.778287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:14.800019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:14.802143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:14.814955 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70d41aac-4a0a-42ae-9acb-da47da5d33d8 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.412417 Jul 18 02:28:14.814955 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1505/3055] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:14 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:14.958014 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1c83815-f28c-4b43-b7b5-b6d97df44fc9 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.200656 Jul 18 02:28:14.959136 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1551/3056] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:14 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:15.084953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:15.086179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:15.151343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.152093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.156117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.157157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.732809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:15.738204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] Calling method '.version_select at 0x7fab04e48b80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:15.755993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95eee42f-f928-4828-8f6c-ede34569ef49 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.680049 Jul 18 02:28:15.757139 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1506/3057] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:15.835047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:15.836032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:15.860342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.862305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.867465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:15.869831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:15.945581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ffe98311-2b58-4c00-be95-efdcdf9ad862 could not be found", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:28:15.946956 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] HTTP exception thrown: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] Request method failure captured: Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-floating-ips/ffe98311-2b58-4c00-be95-efdcdf9ad862 HTTP/1.1 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MU_7x7gzTrRabn1ZL2Ct1Y7c70Ei5dqshH27563K21rtNkJsj3dgFOZGihcZGtbh08beIixNONgw1mW5x4wZG_Kfs_d01i_xU6tkU8Eb-lz3AdDUqhDJuFF2I4DQywvd7Se-CMBeEdHO1QnABceODgRIwPn0YcCIVyHblCVyOb1eQg Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 1603e8c5673f43a49996a9d3b188e300 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2097714541 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1603e8c5673f43a49996a9d3b188e300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1603e8c5673f43a49996a9d3b188e300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1603e8c5673f43a49996a9d3b188e300"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1603e8c5673f43a49996a9d3b188e300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2097714541 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 1603e8c5673f43a49996a9d3b188e300 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2097714541 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f65be2f7a6ad41e692aa762e3d84c9e1 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: exception: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ffe98311-2b58-4c00-be95-efdcdf9ad862'} Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ffe98311-2b58-4c00-be95-efdcdf9ad862 could not be found Jul 18 02:28:15.952221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96f8e5e2-7195-4c30-b534-ad4a644a0166'] Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862. Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862 Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862 Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] Returning 404 to user: Floating IP not found for ID ffe98311-2b58-4c00-be95-efdcdf9ad862 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e8b970e-6464-4e30-a66d-978ab25060f5 tempest-FloatingIPDetailsNegativeTestJSON-2097714541 tempest-FloatingIPDetailsNegativeTestJSON-2097714541-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/ffe98311-2b58-4c00-be95-efdcdf9ad862" status: 404 len: 111 microversion: 2.1 time: 0.653209 Jul 18 02:28:15.964644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1552/3058] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/os-floating-ips/ffe98311-2b58-4c00-be95-efdcdf9ad862 => generated 111 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:16.036854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09a2d8c1-e16d-413b-bf71-49ac249860be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05694550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:16.228676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:16.239781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09a2d8c1-e16d-413b-bf71-49ac249860be tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.270956 Jul 18 02:28:16.245067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1553/3059] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:16.254627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:16.265088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:16.299030 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7de4a291-3995-4906-875a-ba1e9f7f17e0 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.468627 Jul 18 02:28:16.309885 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1507/3060] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:15 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:28:16.780652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:16.788590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:16.853119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:16.854131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:16.855709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:16.867075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.128592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.148994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:17.150553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Searching by: {'deleted': False, 'project_id': '62e644dea14a4d249db4e89e158f6107'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:17.185155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.188631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.190346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.196215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.328648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:17.424873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-171e0bd5-d312-4fb5-9f50-40c0aec182f1 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.304809 Jul 18 02:28:17.426991 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1508/3061] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/servers => generated 344 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:17.441661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-151c781b-4e6f-4317-a627-feebe7132665 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0a5b0940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.600319 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-151c781b-4e6f-4317-a627-feebe7132665 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.170607 Jul 18 02:28:17.604962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1509/3062] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:17.647670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:17.665699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:17.717512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.735824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.738680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:17.757543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:17.958268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:17.978378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02b1763e-8d33-43a0-9e10-0000ae660ee8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.202108 Jul 18 02:28:17.986748 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1554/3063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:16 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:18.009177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:18.019804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.021290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Searching by: {'deleted': False, 'project_id': '62e644dea14a4d249db4e89e158f6107'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:28:18.039642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:18.055069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.056320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.060113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.061237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.120251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:18.158278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:28:18.264341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.304264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:18.314049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.315216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:18.373965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.378699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:18.381641 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-788f9453-803a-490d-84a5-078ba9497094 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.768716 Jul 18 02:28:18.383142 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1510/3064] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:18.624397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38c7cce7-a336-44d8-849f-d19aa6291663 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043a1280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:18.839045 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38c7cce7-a336-44d8-849f-d19aa6291663 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.211724 Jul 18 02:28:18.844592 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1511/3065] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:18 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:19.005387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:19.006492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:19.055721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.056577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.072544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:19.098497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:19.969657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:19.987674 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97187c37-be1b-488d-bc52-606357d1ff00 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.990643 Jul 18 02:28:19.988586 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1512/3066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:18 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:20.008530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:20.009556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:20.019416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:20.023131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:20.024201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:20.031178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:20.229073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8bdd333f-58eb-419f-ba99-f09992343b18 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 2.240075 Jul 18 02:28:20.230101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1555/3067] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:28:17 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:20.236184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9948d2a4-2f76-441e-9edd-db971a13cd79 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b9d040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:20.499708 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9948d2a4-2f76-441e-9edd-db971a13cd79 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.268108 Jul 18 02:28:20.511289 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1556/3068] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:20 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:20.524968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b0d7eedd-2151-4d6e-a71c-09d03b4d4bd0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:20.569449 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b0d7eedd-2151-4d6e-a71c-09d03b4d4bd0 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055678 Jul 18 02:28:20.571311 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1557/3069] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:28:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:20.860759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:20.892631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:20.896271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:20.904425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27d3c6ba-92e7-4a00-81dd-cc2dba4cb434 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.914481 Jul 18 02:28:20.912865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1513/3070] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:19 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:20.939585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:20.945299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:20.974134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:20.976159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:20.977961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:20.985361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.080576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:21.286172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8db9e0c-ab4e-4313-b75a-defbbfbb730f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04b9d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2036188201", "description": "tempest-description-138172516"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:21.475328 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc94776a-de78-4f5c-a091-8008dfa72467 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 204 len: 0 microversion: 2.1 time: 0.554708 Jul 18 02:28:21.483087 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1514/3071] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:20 2022] DELETE /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:21.506018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:21.507496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:21.548587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.549458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.555352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.556394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.730539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8db9e0c-ab4e-4313-b75a-defbbfbb730f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.980158 Jul 18 02:28:21.742804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1558/3072] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:28:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:21.755305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:21.762106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:21.788164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.789625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:21.791466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:21.792641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.418532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.441800 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9eb23f32-c634-4b21-a660-3354dfca2dd3 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1606 microversion: 2.1 time: 0.687677 Jul 18 02:28:22.458832 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1559/3073] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:21 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1606 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.485657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1ebce7a-f930-4e40-b7c0-38660c23f33d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ba0040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.576907 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1ebce7a-f930-4e40-b7c0-38660c23f33d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.117288 Jul 18 02:28:22.577875 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1560/3074] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.587442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.594568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-524248ae-95f2-4b79-9599-d69627a4990b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04ba0dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1174850367", "description": "tempest-description-1695581477"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:22.602586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d59cff4-c6de-414f-968b-73fb6fedbadb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.116032 Jul 18 02:28:22.603612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1515/3075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:21 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.612756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.619404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:22.636230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.637693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.642006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:22.646541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:22.818880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.843909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.845805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:22.853825 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f3727db-f593-48c9-aba7-227a6a4302de tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.247569 Jul 18 02:28:22.855111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1516/3076] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:23.467277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:23.468526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:23.519667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.520859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:23.530815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:23.536563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.072313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:24.122774 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf662510-04c3-4854-8c6a-199ce0b7c9ed tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1606 microversion: 2.1 time: 0.662939 Jul 18 02:28:24.130417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-524248ae-95f2-4b79-9599-d69627a4990b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.549894 Jul 18 02:28:24.131665 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1561/3077] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:28:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:24.135669 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1517/3078] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:23 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1606 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:24.147392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6db6fe00-8f1c-4e73-b078-2e03417e498e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04e1ea60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.158291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.165459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:24.215303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.216294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.219869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.225955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.233617 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6db6fe00-8f1c-4e73-b078-2e03417e498e tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.100532 Jul 18 02:28:24.235267 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1562/3079] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:24.251101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.251859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:24.270464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.271462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.272589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:24.274450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:24.781786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:24.798125 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6399ee66-8f58-4e08-873f-7fea4688bdd4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.659259 Jul 18 02:28:24.804483 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1518/3080] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:24.821130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1150092546", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "aac5963c-d41f-4f71-84e9-0ddc25e394b5"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:24.943374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] validate_networks() for [('aac5963c-d41f-4f71-84e9-0ddc25e394b5', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:28:25.016523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:25.051920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:25.056819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:25.059103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0b971c85-aaa1-42e6-aa54-04ebd5cd0346 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1604 microversion: 2.32 time: 0.822575 Jul 18 02:28:25.060060 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1563/3081] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1604 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:25.150882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:25.151957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:25.174221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.174738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:25.186470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:25.186950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.297917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:28:26.298732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:28:26.299490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:28:26.300140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:28:26.300834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:28:26.304546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:26.367749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.368542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.388337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:26.390383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:26.535326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Getting quotas for project 5379df4258724e15b439342b884c7dd6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:28:26.555874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Getting quotas for user 7859b13877c346ad9a6e8c2a9e38d584 and project 5379df4258724e15b439342b884c7dd6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:28:26.623539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:28:26.627699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:28:26.945918 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f93dfc9b-850d-40a6-a2cf-7213f25ce5ae tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137031 Jul 18 02:28:26.952846 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1519/3082] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:28:26.975747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48f5dd6b-9708-4c9c-a6a4-9e5440605678 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043461f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.027040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:27.089748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5c26911-9c03-4d43-8a44-a611e39a82d4 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1606 microversion: 2.1 time: 1.943239 Jul 18 02:28:27.096522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1564/3083] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1606 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:27.117476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-537bbf79-96bb-48fb-83f8-465b85330807 req-bc8295a8-64c8-4941-9178-03b0497f48c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db28d67-4e43-4c24-aaf9-e26279f86242", "name": "network-vif-plugged", "status": "completed", "tag": "f0295ae4-0d75-4cb3-875f-7ba4bf9afd49"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:27.171034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-537bbf79-96bb-48fb-83f8-465b85330807 req-bc8295a8-64c8-4941-9178-03b0497f48c2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.184176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-537bbf79-96bb-48fb-83f8-465b85330807 req-bc8295a8-64c8-4941-9178-03b0497f48c2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.202263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48f5dd6b-9708-4c9c-a6a4-9e5440605678 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.243031 Jul 18 02:28:27.208586 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1520/3084] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:27.296448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.314974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:27.335722 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-537bbf79-96bb-48fb-83f8-465b85330807 req-bc8295a8-64c8-4941-9178-03b0497f48c2 service nova] Creating event network-vif-plugged:f0295ae4-0d75-4cb3-875f-7ba4bf9afd49 for instance 3db28d67-4e43-4c24-aaf9-e26279f86242 on n-h2-849796-1 Jul 18 02:28:27.357746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.357746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.368594 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-537bbf79-96bb-48fb-83f8-465b85330807 req-bc8295a8-64c8-4941-9178-03b0497f48c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270474 Jul 18 02:28:27.369072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.369728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.376170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1565/3085] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:27.430958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.432354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:27.480547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.486041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.489640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.495528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.645871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:27.646689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:27.647486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lazy-loading 'fault' on Instance uuid 77d4272c-f2ee-480f-b47d-3ee75d9accc0 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:28.099158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:28.216404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:28.249314 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21dd1545-57ac-4c0e-8022-b2f72ce3031e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 1.036663 Jul 18 02:28:28.259105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:28.260951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1521/3086] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:28.278124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79eb863a-379a-43d3-b0d0-3c01c3785527 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:28.285963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79eb863a-379a-43d3-b0d0-3c01c3785527 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:28.523033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79eb863a-379a-43d3-b0d0-3c01c3785527 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:28.558880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79eb863a-379a-43d3-b0d0-3c01c3785527 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1216 microversion: 2.1 time: 0.288858 Jul 18 02:28:28.576188 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1522/3087] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1216 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:28.591130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:28.599525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:28.617351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.618358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.619580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:28.620351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:28.918443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:28.928163 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f32ca590-6fba-4d9f-9a32-ab26ccdc1ca2 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1606 microversion: 2.1 time: 0.346327 Jul 18 02:28:28.934128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1523/3088] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1606 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:28.947062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b3a3cea-03b5-45c0-b74d-54b2c6931ffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04346280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.116835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b3a3cea-03b5-45c0-b74d-54b2c6931ffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.173913 Jul 18 02:28:29.123430 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1524/3089] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:29.206325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.217332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.229089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8682b94d00cc441fa05e0978b1a56b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdb481f9f84d8cabf7d597a49ff953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.244469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb76ce0e-b801-427d-a180-5ac29311fc8b tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 200 len: 1371 microversion: 2.32 time: 1.866946 Jul 18 02:28:29.245121 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1566/3090] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 1371 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:29.267699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.268651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:29.293327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.295190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.303088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.306620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.526140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d9b0a198-6827-4538-a2e8-d093b9bf48a0 req-d86328c6-aaac-4013-9b7e-46f98e0ce37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028eedd8-9876-489c-bd5f-2e8f62ed5e82", "name": "network-vif-unplugged", "status": "completed", "tag": "df056e25-33ec-4a0a-91e8-b3f74536ccd7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:29.542933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d9b0a198-6827-4538-a2e8-d093b9bf48a0 req-d86328c6-aaac-4013-9b7e-46f98e0ce37e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.549698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d9b0a198-6827-4538-a2e8-d093b9bf48a0 req-d86328c6-aaac-4013-9b7e-46f98e0ce37e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.611437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d9b0a198-6827-4538-a2e8-d093b9bf48a0 req-d86328c6-aaac-4013-9b7e-46f98e0ce37e service nova] Creating event network-vif-unplugged:df056e25-33ec-4a0a-91e8-b3f74536ccd7 for instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 on n-h2-849796-1 Jul 18 02:28:29.623335 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d9b0a198-6827-4538-a2e8-d093b9bf48a0 req-d86328c6-aaac-4013-9b7e-46f98e0ce37e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101058 Jul 18 02:28:29.625673 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1567/3091] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:29.642978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.646008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:29.660351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.663547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.664466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.671421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.854811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.873549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71404389-ea82-4693-a921-12728bb5ec15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1268 microversion: 2.1 time: 0.246325 Jul 18 02:28:29.874166 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1568/3092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1268 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:29.901834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:29.922179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1dce7052-e8dc-4cc0-a86c-7a969dba7927 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.657843 Jul 18 02:28:29.926748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1525/3093] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:29.965956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:29.967532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:29.984899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.986450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:29.988748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:29.991237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.131752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9767cfbe-a693-4c1e-8bb6-03447e58c1d2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043469d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.316855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9767cfbe-a693-4c1e-8bb6-03447e58c1d2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.189865 Jul 18 02:28:30.323307 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1526/3094] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:30.344366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.345428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:30.364963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.372114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.373222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:30.376143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:30.393756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:30.440540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] HTTP exception thrown: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Request method failure captured: Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 HTTP/1.1 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNJe9qFg72iGqmfAnfUlKoDNMHML_TS6tRaw4jGi0TIQpREY-uHtwi6lqFEnZJgFQ4hTZMxy6aKVno02P46n1BXvIyy_gCgK_oSz40NPdu8U-5ElGy-qYjg1cFV5gq1ZgdBYGLaBdqz_xwGzv7sI1eqE1JfoFVSUM8OidJLu4R9hak Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8682b94d00cc441fa05e0978b1a56b45 Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '77d4272c-f2ee-480f-b47d-3ee75d9accc0'} Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:30.442364 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Returning 404 to user: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f7f517b-6b09-4b7d-baba-3078c27fdb70 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 404 len: 111 microversion: 2.32 time: 0.119101 Jul 18 02:28:30.452886 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1527/3095] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:30.464085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4cbaa46-a9d1-4a05-8ecf-be301ebad5c3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '.version_select at 0x7fab04346670>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.540854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4cbaa46-a9d1-4a05-8ecf-be301ebad5c3 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396196790" status: 204 len: 0 microversion: 2.32 time: 0.087606 Jul 18 02:28:30.554763 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1528/3096] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Jul 18 02:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396196790 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:28:30.590616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:30.628271 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03d0b015-4646-48bc-833b-9976528208ee tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1539 microversion: 2.1 time: 0.667184 Jul 18 02:28:30.630806 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1569/3097] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1539 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:30.916605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.917818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:30.949574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.950673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:31.025714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.026266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.030141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.030511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.031519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.031968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.040589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.041114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.572678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:31.595803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-066e10b9-9051-4ccc-8d8f-d4276ca48aa5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1321 microversion: 2.1 time: 0.654837 Jul 18 02:28:31.596860 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1570/3098] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:31.632399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6de36c62-624d-43eb-b598-b0864e9128da req-9bf6bcb2-632f-438e-8dbe-b9218f662174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028eedd8-9876-489c-bd5f-2e8f62ed5e82", "name": "network-vif-deleted", "tag": "df056e25-33ec-4a0a-91e8-b3f74536ccd7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:31.683059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6de36c62-624d-43eb-b598-b0864e9128da req-9bf6bcb2-632f-438e-8dbe-b9218f662174 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.683657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6de36c62-624d-43eb-b598-b0864e9128da req-9bf6bcb2-632f-438e-8dbe-b9218f662174 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.701804 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6de36c62-624d-43eb-b598-b0864e9128da req-9bf6bcb2-632f-438e-8dbe-b9218f662174 service nova] Creating event network-vif-deleted:df056e25-33ec-4a0a-91e8-b3f74536ccd7 for instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 on n-h2-849796-1 Jul 18 02:28:31.711383 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6de36c62-624d-43eb-b598-b0864e9128da req-9bf6bcb2-632f-438e-8dbe-b9218f662174 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113405 Jul 18 02:28:31.716807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1571/3099] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:31.727749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aff10526-5fa8-49b0-a687-bc308eb332af tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05818280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:31.855679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aff10526-5fa8-49b0-a687-bc308eb332af tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.137356 Jul 18 02:28:31.865692 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1572/3100] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:31 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:31.873593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:31.874635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:31.883610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.885542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:31.886978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:31.887760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.139724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:32.191137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ce87e90-dfc3-4708-b921-cf95d38b1ff7 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.322484 Jul 18 02:28:32.213425 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1573/3101] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:31 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:32.635190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:32.636299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:32.662044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.662870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.664353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:32.676061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:32.842603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:32.892237 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5ba1139-fa57-4085-86aa-5f935ac68a35 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1274 microversion: 2.1 time: 1.983522 Jul 18 02:28:32.893865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1529/3102] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1274 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:32.922619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fb8a3e8-3b42-4618-bb04-2e945426eb71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab042b6940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.050003 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fb8a3e8-3b42-4618-bb04-2e945426eb71 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.146114 Jul 18 02:28:33.053776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1530/3103] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:32 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:33.106569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:33.116887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e77ff9f1-3631-4eb5-b88f-355c7dbf6d52 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1515 microversion: 2.1 time: 0.488981 Jul 18 02:28:33.119142 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1574/3104] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:32 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1515 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:33.150504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:33.152870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.177566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.178631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.181650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.183820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.221890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.222893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.234795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.238837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.249261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.260484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.268671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'flavor' on Instance uuid 3db28d67-4e43-4c24-aaf9-e26279f86242 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:33.760839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81d7e973-8aff-4962-b865-b5b1e51dfb59 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action" status: 200 len: 32 microversion: 2.1 time: 0.616633 Jul 18 02:28:33.762275 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1531/3105] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:33 2022] POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action => generated 32 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:28:33.793105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.794529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.799462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:33.822576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48dc7dfc-42c2-4c9f-9185-c24eb1b4642c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.606161 Jul 18 02:28:33.837309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.839154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.841546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.846064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.851332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1575/3106] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:33 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:33.922181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.929665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:33.946785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.947255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:33.949580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:33.950982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.169023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:34.188632 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f05db4b5-3dc3-4a2f-a348-86d2b2f721c3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1274 microversion: 2.1 time: 0.281336 Jul 18 02:28:34.189938 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1576/3107] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:33 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:34.213686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f1f80f95-0a2d-44b8-bab0-403f6a900d84 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04bb1e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:34.345597 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f1f80f95-0a2d-44b8-bab0-403f6a900d84 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.152125 Jul 18 02:28:34.347676 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1577/3108] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:34 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:34.780253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:34.795148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c215b6a1-acf3-4b02-b483-2286312c438c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 1.019986 Jul 18 02:28:34.799081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1532/3109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:33 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:34.860444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:34.862851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:34.880031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.884582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:34.887173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:34.895561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.113321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:35.122994 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c39e3d80-2d16-42e2-af2c-3c01638ed64c tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.267254 Jul 18 02:28:35.128733 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1578/3110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:34 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:35.208354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.210995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:35.224262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.230120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.231471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.233422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.364699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03e8b43b-18d7-480f-9ab7-27dc3dc72c61 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05818280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.452374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03e8b43b-18d7-480f-9ab7-27dc3dc72c61 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.088028 Jul 18 02:28:35.465839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1579/3111] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:35.820722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.822361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:35.851575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.852674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.853900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:35.854996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:35.899175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:35.918107 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d2926a1-f4e9-4af5-9667-2a0d9574bd5f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1274 microversion: 2.1 time: 0.715961 Jul 18 02:28:35.927183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1533/3112] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1274 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:36.148890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:36.150417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:36.167937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:36.171015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:36.179695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:36.181584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:36.393834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:36.443279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cf2c8ea-754f-4e6f-a09e-3b0d7ad345db tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.300282 Jul 18 02:28:36.464871 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1534/3113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:36 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:36.498380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65544046-b023-4eba-803c-01b4a8d7f16b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043a1790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:36.564334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:36.587091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:36.614499 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ec94f99-ca1a-431e-9eef-f44c3b54b01a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.800449 Jul 18 02:28:36.625643 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1580/3114] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:36.742325 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65544046-b023-4eba-803c-01b4a8d7f16b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.275092 Jul 18 02:28:36.743653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1535/3115] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:36 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:36.949325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:36.950211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:36.988156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.002228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:37.004067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.009630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:37.491418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:37.493827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:37.507001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.511026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:37.512671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:37.516419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.118595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:38.153120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bac7c4d9-322c-40e2-81a5-98f89e3f9998 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.671043 Jul 18 02:28:38.166990 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1536/3116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:37 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:38.182029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:38.185395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:38.200662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.203990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.205447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.209445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.466717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:38.479362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:38.485287 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ccf264ec-9c53-4ff8-b8e5-47b9591ce4fe tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 1.544368 Jul 18 02:28:38.486628 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1581/3117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:36 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:38.492400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbbd20ca-378a-4f4a-b2fa-1ca27741b84b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ed9ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:38.535746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:38.753417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbbd20ca-378a-4f4a-b2fa-1ca27741b84b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.263180 Jul 18 02:28:38.754322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1582/3118] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:38 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:38.763442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:38.763442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:38.791909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.793620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.795245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:38.796696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:38.831431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:39.037676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:39.049619 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ecf708f-bf15-43e1-8f12-fcd1ba78f820 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.878414 Jul 18 02:28:39.050757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1537/3119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:38 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.067391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1816fd76-f99a-4d32-b7cd-86613756fd82 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 204 len: 0 microversion: 2.1 time: 0.311103 Jul 18 02:28:39.072117 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1583/3120] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:38 2022] DELETE /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:39.079346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.082046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:39.094652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.095229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.109864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.111055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.480332 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78c84f2f-bdf6-4736-a81a-34d7d27bfeea tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.418523 Jul 18 02:28:39.481043 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1538/3121] 10.222.0.67 () {58 vars in 1127 bytes} [Mon Jul 18 02:28:39 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:28:39.488742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.489526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:39.500384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:39.515647 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4080b716-30e0-47b0-837f-fdd4b6ee4120 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1552 microversion: 2.1 time: 0.441363 Jul 18 02:28:39.519119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.520536 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1584/3122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:39 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1552 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.523164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.524344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.525047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.532392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.533605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:39.550965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.551796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.553200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:39.553959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:39.762480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:39.775488 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e1ee3e1-dd29-4abb-9648-afc2c7b62b56 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 0.253340 Jul 18 02:28:39.788528 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1585/3123] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:39 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.794488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f7f90be-47e0-478b-8202-07380d6ec383 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Calling method '.version_select at 0x7fab04b69f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.831753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4f7f90be-47e0-478b-8202-07380d6ec383 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] HTTP exception thrown: Image not found. Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f7f90be-47e0-478b-8202-07380d6ec383 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Request method failure captured: Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVWeH0-W0Tnhi4Z1E9I0v7oBJXJsnSjLQPZNRHoEALVCpX_aWMeFhjg60PmiM1QnYleV5gCO_mrlVoFMTSMixEoyuAacnNj4uqqEgPEuUu2yd41KllLYfJ97MXPBOE13-uY7c69R__DmcH-klFOufMKk28OsOEtHlvwQFDAeyR9jxU Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 264979610ba24596bcde7be31fe0f52a Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '-1'} Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.835705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:28:39.842424 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:39.849010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f7f90be-47e0-478b-8202-07380d6ec383 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:39.850623 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f7f90be-47e0-478b-8202-07380d6ec383 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.060329 Jul 18 02:28:39.852906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1586/3124] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Jul 18 02:28:39 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:28:39.863364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc034cb6-4a78-47c3-b482-3c4a2f29150a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05528ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:39.954303 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc034cb6-4a78-47c3-b482-3c4a2f29150a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.097978 Jul 18 02:28:39.955946 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1587/3125] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:39 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:39.969130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ccf5bc-eb19-4541-b3fe-1b209f0a3c7f tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Calling method '.version_select at 0x7fab04b69ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.016080 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b1ccf5bc-eb19-4541-b3fe-1b209f0a3c7f tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] HTTP exception thrown: Image not found. Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ccf5bc-eb19-4541-b3fe-1b209f0a3c7f tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Request method failure captured: Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/eeab4ea1-c192-4f68-a438-1e983f17a09j HTTP/1.1 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVWeH0-W0Tnhi4Z1E9I0v7oBJXJsnSjLQPZNRHoEALVCpX_aWMeFhjg60PmiM1QnYleV5gCO_mrlVoFMTSMixEoyuAacnNj4uqqEgPEuUu2yd41KllLYfJ97MXPBOE13-uY7c69R__DmcH-klFOufMKk28OsOEtHlvwQFDAeyR9jxU Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 264979610ba24596bcde7be31fe0f52a Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'eeab4ea1-c192-4f68-a438-1e983f17a09j'} Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eeab4ea1-c192-4f68-a438-1e983f17a09j to delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eeab4ea1-c192-4f68-a438-1e983f17a09j could not be found. Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.020208 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:28:40.027844 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.037916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ccf5bc-eb19-4541-b3fe-1b209f0a3c7f tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.037916 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1ccf5bc-eb19-4541-b3fe-1b209f0a3c7f tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/eeab4ea1-c192-4f68-a438-1e983f17a09j" status: 404 len: 62 microversion: 2.1 time: 0.076746 Jul 18 02:28:40.037916 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1588/3126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:39 2022] DELETE /compute/v2.1/images/eeab4ea1-c192-4f68-a438-1e983f17a09j => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:28:40.059109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62849a61-23b5-4f6e-817d-4591892ee0e9 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Calling method '.version_select at 0x7fab04b57160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.110603 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-62849a61-23b5-4f6e-817d-4591892ee0e9 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] HTTP exception thrown: Image not found. Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62849a61-23b5-4f6e-817d-4591892ee0e9 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Request method failure captured: Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/0307c7fe-1f96-4659-aaad-ef2434f518f41 HTTP/1.1 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVWeH0-W0Tnhi4Z1E9I0v7oBJXJsnSjLQPZNRHoEALVCpX_aWMeFhjg60PmiM1QnYleV5gCO_mrlVoFMTSMixEoyuAacnNj4uqqEgPEuUu2yd41KllLYfJ97MXPBOE13-uY7c69R__DmcH-klFOufMKk28OsOEtHlvwQFDAeyR9jxU Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 264979610ba24596bcde7be31fe0f52a Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '0307c7fe-1f96-4659-aaad-ef2434f518f41'} Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0307c7fe-1f96-4659-aaad-ef2434f518f41 to delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0307c7fe-1f96-4659-aaad-ef2434f518f41 could not be found. Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.114146 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62849a61-23b5-4f6e-817d-4591892ee0e9 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62849a61-23b5-4f6e-817d-4591892ee0e9 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/0307c7fe-1f96-4659-aaad-ef2434f518f41" status: 404 len: 62 microversion: 2.1 time: 0.076693 Jul 18 02:28:40.125411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1589/3127] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:40 2022] DELETE /compute/v2.1/images/0307c7fe-1f96-4659-aaad-ef2434f518f41 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:28:40.144136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:40.150262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.153956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:40.164527 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c12f8768-6b75-479f-99e6-3c597bb2da46 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.681854 Jul 18 02:28:40.166142 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1539/3128] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:39 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:40.176513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57dfdf7d-a9a1-4ede-a1bf-de43a6c7fdf3 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Calling method '.version_select at 0x7fab04303e50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.192101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.193197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.195047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.195841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.279644 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-57dfdf7d-a9a1-4ede-a1bf-de43a6c7fdf3 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] HTTP exception thrown: Image not found. Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57dfdf7d-a9a1-4ede-a1bf-de43a6c7fdf3 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Request method failure captured: Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/tempest-invalid-212906656 HTTP/1.1 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVWeH0-W0Tnhi4Z1E9I0v7oBJXJsnSjLQPZNRHoEALVCpX_aWMeFhjg60PmiM1QnYleV5gCO_mrlVoFMTSMixEoyuAacnNj4uqqEgPEuUu2yd41KllLYfJ97MXPBOE13-uY7c69R__DmcH-klFOufMKk28OsOEtHlvwQFDAeyR9jxU Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 264979610ba24596bcde7be31fe0f52a Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'tempest-invalid-212906656'} Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-212906656 to delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-212906656 could not be found. Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.283492 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.288001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57dfdf7d-a9a1-4ede-a1bf-de43a6c7fdf3 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.293329 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57dfdf7d-a9a1-4ede-a1bf-de43a6c7fdf3 tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/tempest-invalid-212906656" status: 404 len: 62 microversion: 2.1 time: 0.124890 Jul 18 02:28:40.294322 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1540/3129] 10.222.0.67 () {58 vars in 1202 bytes} [Mon Jul 18 02:28:40 2022] DELETE /compute/v2.1/images/tempest-invalid-212906656 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:28:40.322399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-143ffdb3-c28b-4708-982b-8c05dd30b87b tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Calling method '.version_select at 0x7fab04307b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.386193 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-143ffdb3-c28b-4708-982b-8c05dd30b87b tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] HTTP exception thrown: Image not found. Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-143ffdb3-c28b-4708-982b-8c05dd30b87b tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Request method failure captured: Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/ae94cc8a-902e-4dfd-98a5-8755e4290c01 HTTP/1.1 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVWeH0-W0Tnhi4Z1E9I0v7oBJXJsnSjLQPZNRHoEALVCpX_aWMeFhjg60PmiM1QnYleV5gCO_mrlVoFMTSMixEoyuAacnNj4uqqEgPEuUu2yd41KllLYfJ97MXPBOE13-uY7c69R__DmcH-klFOufMKk28OsOEtHlvwQFDAeyR9jxU Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/691bb6d8ef5c4bdd89f2b7ac98d55347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 691bb6d8ef5c4bdd89f2b7ac98d55347 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377 Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 264979610ba24596bcde7be31fe0f52a Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1985210377-project Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ae94cc8a-902e-4dfd-98a5-8755e4290c01'} Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae94cc8a-902e-4dfd-98a5-8755e4290c01 to delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae94cc8a-902e-4dfd-98a5-8755e4290c01 could not be found. Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.388359 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-143ffdb3-c28b-4708-982b-8c05dd30b87b tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-143ffdb3-c28b-4708-982b-8c05dd30b87b tempest-ImagesDeleteNegativeTestJSON-1985210377 tempest-ImagesDeleteNegativeTestJSON-1985210377-project] 10.222.0.67 "DELETE /compute/v2.1/images/ae94cc8a-902e-4dfd-98a5-8755e4290c01" status: 404 len: 62 microversion: 2.1 time: 0.079798 Jul 18 02:28:40.394445 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1541/3130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:40 2022] DELETE /compute/v2.1/images/ae94cc8a-902e-4dfd-98a5-8755e4290c01 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:28:40.545196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:40.547708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:40.583111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.585390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.590038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:40.598705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:40.980712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:41.005421 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b862482-f7d0-4087-a25c-a3d3ee3c4701 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.873341 Jul 18 02:28:41.011854 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1590/3131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:41.034869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3666208d-2d97-4dc0-8668-c8f7481f45be req-22cbea03-9ec7-4287-9c32-7bbb49fd3ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb909f3-4a90-47dd-85c4-4f4648b29ba4", "tag": "4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:41.092876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3666208d-2d97-4dc0-8668-c8f7481f45be req-22cbea03-9ec7-4287-9c32-7bbb49fd3ed9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.095064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3666208d-2d97-4dc0-8668-c8f7481f45be req-22cbea03-9ec7-4287-9c32-7bbb49fd3ed9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.122363 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3666208d-2d97-4dc0-8668-c8f7481f45be req-22cbea03-9ec7-4287-9c32-7bbb49fd3ed9 service nova] Creating event network-changed:4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 for instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 on n-h1-849796-1 Jul 18 02:28:41.141111 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3666208d-2d97-4dc0-8668-c8f7481f45be req-22cbea03-9ec7-4287-9c32-7bbb49fd3ed9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121262 Jul 18 02:28:41.147141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1591/3132] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:41.160116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:41.167908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:41.182148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.183684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.186458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.188276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.238195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:41.273890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-137f83d9-d7a4-4721-95fd-edcf6605ea76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1552 microversion: 2.1 time: 0.733917 Jul 18 02:28:41.275802 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1542/3133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:40 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1552 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:41.302856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c070f9d-3a51-477d-b28d-fb6fa33d027f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab0436d940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:41.476209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c070f9d-3a51-477d-b28d-fb6fa33d027f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.192662 Jul 18 02:28:41.481265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1543/3134] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:41 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:41.495875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:41.499374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:41.514708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.517074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:41.519970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:41.521541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.522086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.536205 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e36d6915-9131-4efa-af3f-c8c4f9301c6e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 1.049552 Jul 18 02:28:42.547722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1544/3135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:41 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:42.571106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:42.573034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:42.598292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.602168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.605158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.605745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.785857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:42.832830 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca1c85bf-5867-4d53-824a-2bd7ac78811f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 1.680307 Jul 18 02:28:42.836347 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1592/3136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:41 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:42.866572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:42.869892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:42.887170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.888953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:42.893072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:42.899789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.198813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:43.226341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c1017d8a-8590-4ba0-8192-c1f5c5f290ea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1510 microversion: 2.1 time: 0.373690 Jul 18 02:28:43.227158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1593/3137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:42 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:43.258062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-704c8490-466b-46dd-8e42-2d44a7199588 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab05767ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:43.365548 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-704c8490-466b-46dd-8e42-2d44a7199588 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.129653 Jul 18 02:28:43.366559 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1594/3138] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:43 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:43.384196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6c53b0a1-c9d9-4a0b-bdc2-316ebf194285 req-98596414-da4d-486b-8c03-557ae3e2d485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd682eb-1bfc-42db-a303-7ab92bfe47df", "name": "network-vif-deleted", "tag": "3e406bd7-6eac-47ad-95a3-715f5788e85d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:43.451316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6c53b0a1-c9d9-4a0b-bdc2-316ebf194285 req-98596414-da4d-486b-8c03-557ae3e2d485 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.454748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6c53b0a1-c9d9-4a0b-bdc2-316ebf194285 req-98596414-da4d-486b-8c03-557ae3e2d485 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.478332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:43.503284 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8845709b-b274-45fd-9f00-746ec8f4f367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.953160 Jul 18 02:28:43.512757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6c53b0a1-c9d9-4a0b-bdc2-316ebf194285 req-98596414-da4d-486b-8c03-557ae3e2d485 service nova] Creating event network-vif-deleted:3e406bd7-6eac-47ad-95a3-715f5788e85d for instance ccd682eb-1bfc-42db-a303-7ab92bfe47df on n-h2-849796-1 Jul 18 02:28:43.532974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1545/3139] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:42 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:43.535462 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6c53b0a1-c9d9-4a0b-bdc2-316ebf194285 req-98596414-da4d-486b-8c03-557ae3e2d485 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165853 Jul 18 02:28:43.536088 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1595/3140] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:43.567513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:43.572250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:43.599959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.602442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.604574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.605887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.869040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:43.869772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:43.896436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.899095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.899589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:43.900686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:43.907076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:43.910326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-faf92bd7-8053-4010-bb9d-b0b56bbb742f tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1252 microversion: 2.1 time: 0.357719 Jul 18 02:28:43.926684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1546/3141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:43 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1252 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:44.249090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:44.250492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:44.280007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.294461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.302620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:44.303836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:44.658865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:44.769867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b10e11c8-d056-44c3-8860-ddfe8745a8b1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.526397 Jul 18 02:28:44.773490 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1547/3142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:44 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:44.826360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c59884b-4a69-41d9-8491-44f77e257638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04329430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.022375 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c59884b-4a69-41d9-8491-44f77e257638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.244013 Jul 18 02:28:45.027266 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1548/3143] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:44 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:45.046120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.073956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.095364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.097740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.098897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.101592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.147572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:45.162494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9871a96-bdf3-458a-9d6a-adfa897cdedd tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 1.300166 Jul 18 02:28:45.183045 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1596/3144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:43 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:45.193860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.205222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.224782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.230316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.234605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.240060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.335217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.340030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.342064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lazy-loading 'fault' on Instance uuid 028eedd8-9876-489c-bd5f-2e8f62ed5e82 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:28:45.488943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08a03788c1a4fd2981ca862916c7b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e644dea14a4d249db4e89e158f6107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:45.499035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07a73947-e5f8-4b5e-afc1-d2934145581e tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 200 len: 1211 microversion: 2.1 time: 0.314451 Jul 18 02:28:45.505381 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1597/3145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 1211 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:45.789373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:45.790204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:45.799722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.808440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:45.812672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:45.813633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.007896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:46.021681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f238b1bf-aa0c-4c03-8065-30b04fa2a774 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.236286 Jul 18 02:28:46.029245 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1598/3146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:46.058207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02137208-00e8-4c52-8af8-a4f621b3ff63 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04bef820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:46.236353 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02137208-00e8-4c52-8af8-a4f621b3ff63 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.190630 Jul 18 02:28:46.237856 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1599/3147] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:46 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:46.252278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:46.266954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:46.295478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:46.302042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:46.306120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:46.306978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.049821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:47.099339 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b92452a-b1e6-4cc7-8122-dc476e04a850 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 0.858075 Jul 18 02:28:47.116207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1600/3148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:46 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:47.125660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:47.127105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] [instance: 028eedd8-9876-489c-bd5f-2e8f62ed5e82] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:47.164238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.165086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.166518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.167301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.232818 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] HTTP exception thrown: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Request method failure captured: Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 HTTP/1.1 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MStcPaOgOKSbptV2WzbiTxtFh6tZlo_K1nDRXCjSUYWLuc46Lbf4o19HLCwA8Q9-lHz9j_5eSZ1m3qt3_OaTeciC1lC_bzy9Y7_ulUnQMDjL7fWue4TtRr2btXpmTq21I02Y80SVbAoGwu9O6cGnJWEgsnHcXs5JoKArYu17P3drrk Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 62e644dea14a4d249db4e89e158f6107 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestBootFromVolume-154822837 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62e644dea14a4d249db4e89e158f6107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62e644dea14a4d249db4e89e158f6107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62e644dea14a4d249db4e89e158f6107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62e644dea14a4d249db4e89e158f6107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestBootFromVolume-154822837 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 62e644dea14a4d249db4e89e158f6107 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestBootFromVolume-154822837 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestBootFromVolume-154822837-project Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: e08a03788c1a4fd2981ca862916c7b67 Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestBootFromVolume-154822837-project Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '028eedd8-9876-489c-bd5f-2e8f62ed5e82'} Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:47.242565 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. Jul 18 02:28:47.252485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:47.270384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Returning 404 to user: Instance 028eedd8-9876-489c-bd5f-2e8f62ed5e82 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:47.274145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe7e8ed7-2d4a-4d37-b601-00f3301e9826 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82" status: 404 len: 111 microversion: 2.1 time: 0.156049 Jul 18 02:28:47.285511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1601/3149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/servers/028eedd8-9876-489c-bd5f-2e8f62ed5e82 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:47.413708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:47.436239 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec2f6414-02b2-48b0-a1e9-d0b8dbfb3213 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 2.389793 Jul 18 02:28:47.439972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1549/3150] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:45 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:47.460579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:47.461709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:47.490082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.493144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.498402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:47.502019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:47.588613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:47.778779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:47.799985 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4313ab7-15d3-4118-8f8f-fb37ed09ef38 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.352953 Jul 18 02:28:47.801458 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1550/3151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:47.821889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60d97d77-b3c2-435e-8830-a6b78230ad1f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab043afd30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:47.986717 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60d97d77-b3c2-435e-8830-a6b78230ad1f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.182177 Jul 18 02:28:47.988827 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1551/3152] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:48.003813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1120203-c4a1-482c-9b7d-918a9d5c3895 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] Calling method '.version_select at 0x7fab04329b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.055152 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1120203-c4a1-482c-9b7d-918a9d5c3895 tempest-ServersTestBootFromVolume-154822837 tempest-ServersTestBootFromVolume-154822837-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963145363" status: 202 len: 0 microversion: 2.1 time: 0.064441 Jul 18 02:28:48.060405 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1552/3153] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963145363 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:28:48.069459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.071283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.088438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.090511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.094084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.095797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.137609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] HTTP exception thrown: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Request method failure captured: Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 HTTP/1.1 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNJe9qFg72iGqmfAnfUlKoDNMHML_TS6tRaw4jGi0TIQpREY-uHtwi6lqFEnZJgFQ4hTZMxy6aKVno02P46n1BXvIyy_gCgK_oSz40NPdu8U-5ElGy-qYjg1cFV5gq1ZgdBYGLaBdqz_xwGzv7sI1eqE1JfoFVSUM8OidJLu4R9hak Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8682b94d00cc441fa05e0978b1a56b45 Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '77d4272c-f2ee-480f-b47d-3ee75d9accc0'} Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:48.155519 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.160232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.163761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Returning 404 to user: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:48.165866 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c74d10cb-46a6-470c-abbe-d621580327a9 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "DELETE /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 404 len: 111 microversion: 2.32 time: 0.100707 Jul 18 02:28:48.166668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1553/3154] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:28:48 2022] DELETE /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:48.179774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.180944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.200567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.201417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.209293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.210522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.451174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] Calling method '.version_select at 0x7fab04c09700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.501584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:48.506265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:48.543548 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae1d43e9-8695-488b-963e-632b68ad51f4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 0.375067 Jul 18 02:28:48.544879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1554/3155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:48 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:48.559156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.560101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.569877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.570173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.571458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] [instance: 77d4272c-f2ee-480f-b47d-3ee75d9accc0] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.573038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.596511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.603617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.605657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.606674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.681238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] HTTP exception thrown: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.693522 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23805f3f-876d-4653-8004-6ac1d86b61c0 tempest-AbsoluteLimitsTestJSON-366395513 tempest-AbsoluteLimitsTestJSON-366395513-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.399153 Jul 18 02:28:48.697512 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1602/3156] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Jul 18 02:28:47 2022] GET /compute/v2.1/limits => generated 511 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Request method failure captured: Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 HTTP/1.1 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MNJe9qFg72iGqmfAnfUlKoDNMHML_TS6tRaw4jGi0TIQpREY-uHtwi6lqFEnZJgFQ4hTZMxy6aKVno02P46n1BXvIyy_gCgK_oSz40NPdu8U-5ElGy-qYjg1cFV5gq1ZgdBYGLaBdqz_xwGzv7sI1eqE1JfoFVSUM8OidJLu4R9hak Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.32 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1cbdb481f9f84d8cabf7d597a49ff953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1cbdb481f9f84d8cabf7d597a49ff953 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TaggedBootDevicesTest-514999429 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8682b94d00cc441fa05e0978b1a56b45 Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TaggedBootDevicesTest-514999429-project Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '77d4272c-f2ee-480f-b47d-3ee75d9accc0'} Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:48.701313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. Jul 18 02:28:48.705649 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:28:48.710514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] Returning 404 to user: Instance 77d4272c-f2ee-480f-b47d-3ee75d9accc0 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:48.715298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6bf88c22-1957-4519-89c2-e5e72ec499b5 tempest-TaggedBootDevicesTest-514999429 tempest-TaggedBootDevicesTest-514999429-project] 10.222.0.67 "GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0" status: 404 len: 111 microversion: 2.32 time: 0.165266 Jul 18 02:28:48.719407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1555/3157] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:28:48 2022] GET /compute/v2.1/servers/77d4272c-f2ee-480f-b47d-3ee75d9accc0 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:28:48.784060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.787251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.816373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.822561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.823899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.832869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:48.835635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:48.839242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.864975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.871863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:48.877248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:48.882656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.292531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:49.385532 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cfb1910-b236-4f58-b548-bbf222eda3cb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.559026 Jul 18 02:28:49.393165 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1556/3158] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:48 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:49.423536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4750380-f5cf-457e-8721-9431e3c1c8e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04996550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:49.602491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4750380-f5cf-457e-8721-9431e3c1c8e6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.202809 Jul 18 02:28:49.604939 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1557/3159] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:49 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:49.627572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:49.628212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:49.645391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:49.659389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:49.660089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.661206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:49.661839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:49.670573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cc081924-c222-4980-a23d-092fc6bac024 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.963381 Jul 18 02:28:49.671776 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1603/3160] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:48 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:50.191929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-de75b123-d76c-42be-8100-926ee5c9059e req-8752f80a-681d-44df-b01c-8ba3bd936a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb909f3-4a90-47dd-85c4-4f4648b29ba4", "name": "network-vif-plugged", "status": "completed", "tag": "4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:50.224201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de75b123-d76c-42be-8100-926ee5c9059e req-8752f80a-681d-44df-b01c-8ba3bd936a4d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.224761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:50.225499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-de75b123-d76c-42be-8100-926ee5c9059e req-8752f80a-681d-44df-b01c-8ba3bd936a4d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.256740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1c3f15f-534f-4a5d-8a30-290e82621960 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 0.650175 Jul 18 02:28:50.272730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-de75b123-d76c-42be-8100-926ee5c9059e req-8752f80a-681d-44df-b01c-8ba3bd936a4d service nova] Creating event network-vif-plugged:4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 for instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 on n-h1-849796-1 Jul 18 02:28:50.293856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1558/3161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:49 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:50.297657 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-de75b123-d76c-42be-8100-926ee5c9059e req-8752f80a-681d-44df-b01c-8ba3bd936a4d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108418 Jul 18 02:28:50.304554 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1604/3162] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:28:50.438289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:50.438850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:50.464695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.465450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.466573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.467153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.627295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65a6517c-2351-42a0-a637-c5756361b4b0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b579d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:50.748876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:50.778357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65a6517c-2351-42a0-a637-c5756361b4b0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1437 microversion: 2.1 time: 0.159444 Jul 18 02:28:50.779899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1605/3163] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:50 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:50.783285 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92da955f-e20d-4f40-955c-71551851ee26 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.352626 Jul 18 02:28:50.786092 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1559/3164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:50 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:50.804814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:50.808284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:50.833969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.840239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:50.841988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:50.842863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.314640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:51.340816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:51.344517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:51.356005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec1a11d9-bb8e-4245-ad65-e3941a20dcc2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.574205 Jul 18 02:28:51.362906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1606/3165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:50 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:51.416658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.419490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.420768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.424261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.797169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa09ed2e-3320-4a07-a4e2-e782e92c3670 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b96ca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:51.878109 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa09ed2e-3320-4a07-a4e2-e782e92c3670 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1446 microversion: 2.1 time: 0.086140 Jul 18 02:28:51.879775 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1607/3166] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1446 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:28:51.894289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:51.895070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:51.895903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:51.915108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.915628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.916973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:51.917616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:51.940430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f2403605-df74-4014-9099-0553108d3247 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1316 microversion: 2.1 time: 0.638626 Jul 18 02:28:51.947398 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1560/3167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:51.980582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6be59413-9597-4036-9e1d-14005392fa23 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04303820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.088633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:52.092243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:52.117458 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61676787-bbd9-460b-ba36-d01f3b11f16f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.236305 Jul 18 02:28:52.124196 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1608/3168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:52.154857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6be59413-9597-4036-9e1d-14005392fa23 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 200 len: 1446 microversion: 2.1 time: 0.202452 Jul 18 02:28:52.158205 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1561/3169] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:28:51 2022] GET /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:52.180228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-786dc260-2d10-4771-9214-4f2ab7053925 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b57940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.389187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:52.393326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:52.432123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.444465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:52.446001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:52.446999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.210948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:53.252061 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e76e05bf-7227-40dc-8ecd-2466a3cb4efb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.870597 Jul 18 02:28:53.275547 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1562/3170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:52 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:53.290911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:53.306327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:53.320366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.321817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.323774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.325081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.567281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:53.576604 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f801138-1394-45d2-b073-fc4187a9e184 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1503 microversion: 2.1 time: 0.298722 Jul 18 02:28:53.579692 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1563/3171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:53 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:53.604144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:53.604841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:53.615904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.617105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.622035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.624161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.764521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:53.779355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7a25c6d-03cc-407c-9391-e5613fe456c9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.182049 Jul 18 02:28:53.783660 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1564/3172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:53 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:53.790379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2036188201"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:53.790951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:53.810389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.811134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:53.818140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:53.821116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:54.226639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Adding security group b0cc062b-3407-4de5-a59c-bb2bc3dde6db to port 4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 Jul 18 02:28:54.415868 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-786dc260-2d10-4771-9214-4f2ab7053925 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 204 len: 0 microversion: 2.1 time: 2.243916 Jul 18 02:28:54.417887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1609/3173] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:52 2022] DELETE /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 0 bytes in 2246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:54.426343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:54.428384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:54.453718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:54.461322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:54.462322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:54.462795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.038064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:55.054179 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1df93ec6-714e-488f-a1fb-f66f893da3c1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.634454 Jul 18 02:28:55.055058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1610/3174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:54 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:55.063769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:55.065793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:55.082036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.082999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.085156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.085991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.153021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:28:55.369135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79c9339e-0289-46f1-a1c6-4b1ab11b4091 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/action" status: 202 len: 0 microversion: 2.1 time: 1.583773 Jul 18 02:28:55.370428 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1565/3175] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:53 2022] POST /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/action => generated 0 bytes in 1586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:28:55.376104 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5566c47-278a-4eb8-87e9-63e42ff403a2 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 204 len: 0 microversion: 2.1 time: 0.318822 Jul 18 02:28:55.376732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1611/3176] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:28:55 2022] DELETE /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:28:55.386971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:55.388123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:55.398706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1174850367"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:55.399863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:55.414728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.415862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.418277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.421737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.423379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.424182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.427024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.429261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.746526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:55.790520 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b94b69a4-a35d-4a51-8f89-2e3965e5f164 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 200 len: 1345 microversion: 2.1 time: 0.418078 Jul 18 02:28:55.806379 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1566/3177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:55 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 1345 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:55.825815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-848e7a8e-fd70-4789-8da1-6e7c43e95b1f req-8b95eb51-0cda-4a92-8734-8561a7c21041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb909f3-4a90-47dd-85c4-4f4648b29ba4", "tag": "4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:55.847049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-848e7a8e-fd70-4789-8da1-6e7c43e95b1f req-8b95eb51-0cda-4a92-8734-8561a7c21041 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:55.847049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-848e7a8e-fd70-4789-8da1-6e7c43e95b1f req-8b95eb51-0cda-4a92-8734-8561a7c21041 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:55.886693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-848e7a8e-fd70-4789-8da1-6e7c43e95b1f req-8b95eb51-0cda-4a92-8734-8561a7c21041 service nova] Creating event network-changed:4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 for instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 on n-h1-849796-1 Jul 18 02:28:55.902962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-848e7a8e-fd70-4789-8da1-6e7c43e95b1f req-8b95eb51-0cda-4a92-8734-8561a7c21041 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081554 Jul 18 02:28:55.904169 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1567/3178] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:55.921822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-357183037", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "cc961fa4-53ad-43f0-b036-d186e7700255"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:56.036722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] validate_networks() for [('cc961fa4-53ad-43f0-b036-d186e7700255', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:28:56.703131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.network.security_group_api [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Adding security group 42a35406-a4b4-422c-b788-bd5def5d45b6 to port 4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 Jul 18 02:28:57.747715 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9427cc49-ebd8-48f0-914d-8d1b848db41b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/action" status: 202 len: 0 microversion: 2.1 time: 2.364005 Jul 18 02:28:57.754323 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1612/3179] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:28:55 2022] POST /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/action => generated 0 bytes in 2377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:28:57.771464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:57.772136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:57.824396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:57.828005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:57.829988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:57.830811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.534683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:58.625470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:58.758870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:28:58.760694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:28:58.761521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:28:58.762179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:28:58.762867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:28:58.767056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:58.775656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:58.809215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.810841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.814542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b90e6528-6f41-42e1-8e6e-2d22ed973367 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 1.056414 Jul 18 02:28:58.815154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.815620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1613/3180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:57 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:58.816465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.849290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:58.861033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:58.886176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.887188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.888686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:58.889190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:28:58.890923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:58.908147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Getting quotas for user 927f29b5f43d405ca9d3fed68e53cdb1 and project e406623bbd284f9f8deef088cadbe361. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:28:58.959806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:28:58.963430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:28:58.969308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df HTTP/1.1 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ccd682eb-1bfc-42db-a303-7ab92bfe47df'} Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:58.981121 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:28:58.986685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:28:58.989746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:58.991494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3e29a39-6783-4aff-a745-d52810ea11db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 404 len: 111 microversion: 2.1 time: 0.165123 Jul 18 02:28:58.993173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1614/3181] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:58 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:28:59.019271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:59.020151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:59.044342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:59.051307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:59.053576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:59.054640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:59.115510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-745a156b-703f-4ecb-9cff-8590067ddbc6 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.208936 Jul 18 02:28:59.132132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1568/3182] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:28:59.156821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-091cb29c-e297-44e2-9292-60c82cd5294e req-e9b1c19a-9002-439f-88ac-e977d275b10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb909f3-4a90-47dd-85c4-4f4648b29ba4", "tag": "4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:59.226817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-091cb29c-e297-44e2-9292-60c82cd5294e req-e9b1c19a-9002-439f-88ac-e977d275b10a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:28:59.233233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-091cb29c-e297-44e2-9292-60c82cd5294e req-e9b1c19a-9002-439f-88ac-e977d275b10a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:28:59.286238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-091cb29c-e297-44e2-9292-60c82cd5294e req-e9b1c19a-9002-439f-88ac-e977d275b10a service nova] Creating event network-changed:4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 for instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 on n-h1-849796-1 Jul 18 02:28:59.312854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-091cb29c-e297-44e2-9292-60c82cd5294e req-e9b1c19a-9002-439f-88ac-e977d275b10a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177327 Jul 18 02:28:59.318084 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1569/3183] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:59.364464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10628e44-18d1-49e4-ab62-37644d17b21d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:59.368088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10628e44-18d1-49e4-ab62-37644d17b21d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:28:59.955263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10628e44-18d1-49e4-ab62-37644d17b21d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:28:59.980432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10628e44-18d1-49e4-ab62-37644d17b21d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1207 microversion: 2.1 time: 0.659693 Jul 18 02:28:59.989434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1570/3184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:28:59 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1207 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:00.002977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:00.015287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:00.058556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.067054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.070654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.078960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.169654 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df/os-volume_attachments HTTP/1.1 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'ccd682eb-1bfc-42db-a303-7ab92bfe47df'} Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:00.198308 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:00.212024 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac626a39-df73-4926-baa8-03e4fe3823b6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.219433 Jul 18 02:29:00.220858 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1571/3185] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:28:59 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df/os-volume_attachments => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:00.256606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:00.256606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:00.283148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.289707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.291652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:00.292450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:00.633727 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc6c51d8-90ad-4925-b666-f876643d6d9f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.636859 Jul 18 02:29:00.637874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1615/3186] 10.222.0.67 () {58 vars in 1292 bytes} [Mon Jul 18 02:28:58 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4/os-security-groups => generated 1158 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:00.683660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-33d279ff-08e1-4116-bb1e-c5b016b8bfcf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04c09ca0>, body: {"security_group": {"name": " tempest-securitygroup -1101429600 ", "description": "tempest-description-1493082570"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:01.169246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:01.185748 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-904f1cec-6849-43a0-abb5-11ee16c7588d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 0.960337 Jul 18 02:29:01.191080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1572/3187] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:00 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:01.209846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:01.210551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:01.243902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.244369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:01.245227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:01.245690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:01.534931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:01.610589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fda8d75-ccba-4097-a82d-9d238a35a0a0 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1203 microversion: 2.1 time: 0.411570 Jul 18 02:29:01.616016 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1573/3188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:01 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1203 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:01.657270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-148346745", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:01.821858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:03.090056 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-33d279ff-08e1-4116-bb1e-c5b016b8bfcf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 2.421400 Jul 18 02:29:03.097736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1616/3189] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:00 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:03.131139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4c4efd81-184f-43dd-ba64-25dabd2df8db req-0f28b609-f358-4ecd-a486-d3bf8c012fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fde38d2-6a9e-404d-86ac-d264f9a2da65", "name": "network-vif-deleted", "tag": "cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:03.194970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c4efd81-184f-43dd-ba64-25dabd2df8db req-0f28b609-f358-4ecd-a486-d3bf8c012fae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:03.196782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4c4efd81-184f-43dd-ba64-25dabd2df8db req-0f28b609-f358-4ecd-a486-d3bf8c012fae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:03.239007 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4c4efd81-184f-43dd-ba64-25dabd2df8db req-0f28b609-f358-4ecd-a486-d3bf8c012fae service nova] Creating event network-vif-deleted:cc61beaf-2bb8-4bd1-bfc7-af4ebe3acdba for instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 on n-h1-849796-1 Jul 18 02:29:03.267729 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4c4efd81-184f-43dd-ba64-25dabd2df8db req-0f28b609-f358-4ecd-a486-d3bf8c012fae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172416 Jul 18 02:29:03.274239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1617/3190] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:03.281291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:03.281594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:03.309246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:03.309697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:03.310531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:03.310992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.239394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:04.241353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:04.242117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:04.243249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:04.245544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:04.299530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.302222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.304587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.321254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.367417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:04.385945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:04.418386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:04.425502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:04.575867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53a7878d-5b50-485b-b398-e9f465278d62 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.932486 Jul 18 02:29:04.592757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1574/3191] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:04.598881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:04.599582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:04.619696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.622944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.625696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:04.631755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:04.695824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:04.705502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bcbbf4d9-8efd-4205-8a0d-3db15e9228c2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 1.429481 Jul 18 02:29:04.706399 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1618/3192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:03 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:04.720879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae7765cb-e4a0-4689-8f0d-c85ee1ab2f21 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04ba0670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:04.792660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:04.807095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51a22419-0c4f-42fd-a4ef-86d4452accac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1265 microversion: 2.1 time: 0.212682 Jul 18 02:29:04.807977 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1575/3193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:04 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:04.816014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f656f44-5481-4a69-869c-93451b303813 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:04.816419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f656f44-5481-4a69-869c-93451b303813 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:04.997867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1f656f44-5481-4a69-869c-93451b303813 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:05.023411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f656f44-5481-4a69-869c-93451b303813 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4" status: 200 len: 1214 microversion: 2.1 time: 0.213641 Jul 18 02:29:05.033115 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1576/3194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:04 2022] GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:05.066976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:05.070723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:05.154965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:05.921467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae7765cb-e4a0-4689-8f0d-c85ee1ab2f21 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a" status: 200 len: 224 microversion: 2.1 time: 1.204720 Jul 18 02:29:05.922123 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1619/3195] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:29:04 2022] GET /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a => generated 224 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:05.927174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:05.927975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:05.949077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.949595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:05.950543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:05.951009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:06.245798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.scheduler.client.report [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Deleted allocations for instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 Jul 18 02:29:06.314000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Instance Mapping does not exist while attempting local delete cleanup. Jul 18 02:29:06.317847 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10b1a3b6-b66b-4fc3-821e-843a8762ce14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4" status: 204 len: 0 microversion: 2.1 time: 1.275300 Jul 18 02:29:06.325457 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1577/3196] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:05 2022] DELETE /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 => generated 0 bytes in 1282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:06.334392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:06.335526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:06.354399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:06.355143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:06.356212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:06.357604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:06.479727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:06.492864 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39239ecc-5d71-4b39-b235-18943d9b51b4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1265 microversion: 2.1 time: 0.168540 Jul 18 02:29:06.493914 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1578/3197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:06 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:06.505637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e76cbe29-f0c0-44cd-ad62-de4ae6b9e870 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab0a7b5040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:06.994764 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e76cbe29-f0c0-44cd-ad62-de4ae6b9e870 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a" status: 202 len: 0 microversion: 2.1 time: 0.499095 Jul 18 02:29:06.997649 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1579/3198] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:29:06 2022] DELETE /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:07.005636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:07.008584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:07.028870 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 HTTP/1.1 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7c18f3ec-1338-4415-b397-96eb12bc24e4'} Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.035025 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d5d6836-e705-4ed9-842e-0beb0ba735d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4" status: 404 len: 111 microversion: 2.1 time: 0.038080 Jul 18 02:29:07.045198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1580/3199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:06 2022] GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:07.051651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04303b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:07.085461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:29:07.086311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group fe346f37-35b4-4e32-93ce-cefe93a0005a not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:29:07.086914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.086914 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a HTTP/1.1 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'fe346f37-35b4-4e32-93ce-cefe93a0005a'} Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:29:07.091587 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-19eb7374-cfa5-4e96-9a59-1c7dbfcd9ace'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89b5be94-509c-4568-be77-7c5322f78f6d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a" status: 404 len: 194 microversion: 2.1 time: 0.052819 Jul 18 02:29:07.101935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1581/3200] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:29:07 2022] GET /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:07.113656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8d71a6a-857a-45c5-89c7-9fc3305673e8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab0a7b5160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-118065488", "description": "tempest-description-659006883"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:07.681626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8d71a6a-857a-45c5-89c7-9fc3305673e8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.575796 Jul 18 02:29:07.682798 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1582/3201] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:07.711465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-982475342", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:07.882138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:07.924859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:07.933514 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7cb4b39d-7f95-4329-addf-5b50170debcd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1521 microversion: 2.1 time: 2.010273 Jul 18 02:29:07.937974 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1620/3202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:05 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1521 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:07.948314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:07.952523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:07.970474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:07.971282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:07.972518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:07.973320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:08.149305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:08.167929 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-183f9658-42d7-497b-ae5b-48a2ce423255 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1265 microversion: 2.1 time: 0.226353 Jul 18 02:29:08.168999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1621/3203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:07 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:08.174482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1343af1e-dcd6-4d18-8221-d7d2f142b727 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04c3f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-313908360", "description": "tempest-description-1640328557"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:08.658242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:08.658952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:08.659603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:08.660211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:08.661020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:08.673443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:08.674299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:08.675564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:08.676267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:08.685466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:08.705769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:08.715462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:08.756412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:08.761464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:08.836004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-082593e9-a9e2-4355-8e9a-db402772aa69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145275 Jul 18 02:29:08.866255 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1583/3204] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:08.894570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-227120eb-faf3-4df6-826c-60c94c224f3f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:08.915258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-227120eb-faf3-4df6-826c-60c94c224f3f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.225253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-227120eb-faf3-4df6-826c-60c94c224f3f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:09.242040 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-227120eb-faf3-4df6-826c-60c94c224f3f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1214 microversion: 2.1 time: 0.367514 Jul 18 02:29:09.242985 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1584/3205] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:08 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:09.264864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:09.265611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.275635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.276775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.278164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.278810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.298778 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1343af1e-dcd6-4d18-8221-d7d2f142b727 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.128254 Jul 18 02:29:09.300761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1622/3206] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:09.307025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:09.308013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.321190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.322051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.323414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.324945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.570188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:09.580059 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2d6e3f6d-72cf-4d86-b7ef-50eeda05a774 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1501 microversion: 2.1 time: 0.324407 Jul 18 02:29:09.588201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1585/3207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:09 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:09.596085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a514a308-9833-42ba-987e-92b4f3c887e3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab0439c280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1784426569", "description": "tempest-description-1163820625"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:09.775935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:09.804515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09a52565-15a6-41fc-bd8c-6f9440ce9a16 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.501477 Jul 18 02:29:09.813450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1623/3208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:09 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:09.829126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:09.834401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:09.862897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.867030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:09.872756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:09.873362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.141529 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a514a308-9833-42ba-987e-92b4f3c887e3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.551654 Jul 18 02:29:10.143708 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1586/3209] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:10.165329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed4f8a74-a7a9-463e-8376-08e427fc61ca tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab042b6940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.735087 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed4f8a74-a7a9-463e-8376-08e427fc61ca tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.575500 Jul 18 02:29:10.737684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1587/3210] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:29:10 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:10.749355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.750974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:10.773262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.774614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.776363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:10.779693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:10.851301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:10.884058 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b18bbc1e-8a0a-4ad3-bc12-48114b1d39e2 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1517 microversion: 2.1 time: 1.068302 Jul 18 02:29:10.901972 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1624/3211] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:09 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1517 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:10.926306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-414317f3-7dc8-4f19-8eb3-15a9faedd856 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04ae4550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.967345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:10.978320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd612469-445e-42b1-a0ba-660ef683cb3d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1266 microversion: 2.1 time: 0.238808 Jul 18 02:29:10.978883 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1588/3212] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:10 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:10.986002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:10.986918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:11.017697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.018942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:11.023412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.024442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:11.783456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:11.799371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fdb1989f-a57c-459a-a9fc-d59827b469fc tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.818420 Jul 18 02:29:11.800022 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1589/3213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:10 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:11.820444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:11.829394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: da3d5b8a-de4c-43e7-a8dd-642b1a00af2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:11.843722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/da3d5b8a-de4c-43e7-a8dd-642b1a00af2a/action HTTP/1.1 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 14 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: {"rescue": {}} Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'da3d5b8a-de4c-43e7-a8dd-642b1a00af2a', 'body': {'rescue': {}}} Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:11.855458 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 404 to user: Instance da3d5b8a-de4c-43e7-a8dd-642b1a00af2a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f979e28-c388-4eea-b47c-cb6af378dbd7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/da3d5b8a-de4c-43e7-a8dd-642b1a00af2a/action" status: 404 len: 111 microversion: 2.1 time: 0.052731 Jul 18 02:29:11.866290 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1590/3214] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:11 2022] POST /compute/v2.1/servers/da3d5b8a-de4c-43e7-a8dd-642b1a00af2a/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:11.875708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:11.876275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:11.894235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.895006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:11.897476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:11.898371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.103775 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05560fde-02dd-4c32-b2f3-8b929a525aba tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action" status: 202 len: 0 microversion: 2.1 time: 0.234885 Jul 18 02:29:12.105770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1591/3215] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:11 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:12.107209 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-414317f3-7dc8-4f19-8eb3-15a9faedd856 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43" status: 202 len: 0 microversion: 2.1 time: 1.211494 Jul 18 02:29:12.125040 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1625/3216] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:29:10 2022] DELETE /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:12.130057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.132655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:12.142196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.143374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:12.180388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.186216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.196675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.198249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.204646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.205457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.206928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.210877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.479437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:12.509688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-056b2c84-f204-41f2-af92-8c75bb553057 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1272 microversion: 2.1 time: 0.398574 Jul 18 02:29:12.515401 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1592/3217] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:12.537722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab047eaee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.837836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:29:12.840159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:29:12.841413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.841413 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 HTTP/1.1 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43'} Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:29:12.846596 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] Jul 18 02:29:12.854698 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:12.866730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:29:12.866730 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-dad14c21-b802-458b-bb79-afbb01008983'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:12.868861 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84d8e6ea-5c04-400b-9e91-f4194caf2698 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43" status: 404 len: 194 microversion: 2.1 time: 0.351154 Jul 18 02:29:12.870227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1593/3218] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 => generated 194 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:12.884543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:12.893909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:12.924187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.928118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:12.929976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:12.935778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:13.437527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:13.480995 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b39be7e5-518e-4634-82db-f7a71d4ca4cd tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.601498 Jul 18 02:29:13.490420 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1594/3219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:13.508250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f205a59-77b1-4599-864d-bb8aff8dee76 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab047b89d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:14.643460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:14.662549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a489e380-7075-4a53-b198-7ca985412e87 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1522 microversion: 2.1 time: 2.534723 Jul 18 02:29:14.686839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1626/3220] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:12 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1522 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:14.694989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:14.695646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:14.722775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:14.725247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:14.727228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:14.728194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f205a59-77b1-4599-864d-bb8aff8dee76 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1" status: 202 len: 0 microversion: 2.1 time: 1.222747 Jul 18 02:29:14.729348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:14.731186 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1595/3221] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:29:13 2022] DELETE /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1 => generated 0 bytes in 1240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:14.760654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6ada653c-d1f8-477b-8d70-479891b223ac req-958d3483-e284-4c53-bb5e-96b25d97b1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a883255c-d4c6-40b0-97b3-303bcef311ed", "tag": "4c371726-327e-47c7-8cc9-adba2dd5846d"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:14.814579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ada653c-d1f8-477b-8d70-479891b223ac req-958d3483-e284-4c53-bb5e-96b25d97b1f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:14.821578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ada653c-d1f8-477b-8d70-479891b223ac req-958d3483-e284-4c53-bb5e-96b25d97b1f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:14.880487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6ada653c-d1f8-477b-8d70-479891b223ac req-958d3483-e284-4c53-bb5e-96b25d97b1f9 service nova] Creating event network-changed:4c371726-327e-47c7-8cc9-adba2dd5846d for instance a883255c-d4c6-40b0-97b3-303bcef311ed on n-h2-849796-1 Jul 18 02:29:14.912008 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6ada653c-d1f8-477b-8d70-479891b223ac req-958d3483-e284-4c53-bb5e-96b25d97b1f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177688 Jul 18 02:29:14.913043 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1596/3222] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:14.924208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:14.925581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:14.928083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:14.968365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:14.969271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:14.970435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:14.971612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:15.800707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:15.841289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55106a99-90e2-4400-9bf3-162b8e8a7034 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 1.144892 Jul 18 02:29:15.851678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1627/3223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:14 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:15.872475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04aebaf0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.121988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:29:16.124433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:29:16.126265 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.126265 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1 HTTP/1.1 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '76a5e66d-e55b-4f31-8482-3de8d730dbe1'} Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:29:16.131410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] Jul 18 02:29:16.138959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.155935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:29:16.155935 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-261e8ea0-8b48-4e42-bb77-b35457bbe3f3'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:16.156777 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34f18276-e93c-4a6e-b73a-f7d0a27165dc tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1" status: 404 len: 194 microversion: 2.1 time: 0.294985 Jul 18 02:29:16.162263 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1628/3224] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:29:15 2022] GET /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1 => generated 194 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:16.182920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.184748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.206304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.215155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.218664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.220149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.689605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:16.716134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:16.722802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8205376-3748-4461-8e9d-117922770708 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 1.804656 Jul 18 02:29:16.726140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1597/3225] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:14 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:16.743312 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3a3a0ec-b457-4b41-a426-49ac9b22b6aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1502 microversion: 2.1 time: 0.578552 Jul 18 02:29:16.743494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8952f628-6173-4e9c-9dae-40aff06738b2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab042b63a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.750960 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1629/3226] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:16 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1502 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:16.784586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:16.788465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.810234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.812842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.817579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.818087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.899512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'flavor' on Instance uuid ad144596-42e9-47bb-b290-8febab20f782 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:16.932649 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Cannot 'rescue' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state paused Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action HTTP/1.1 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 14 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: {"rescue": {}} Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'rescue' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state paused Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ad144596-42e9-47bb-b290-8febab20f782', 'body': {'rescue': {}}} Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad144596-42e9-47bb-b290-8febab20f782 in vm_state paused. Cannot rescue while the instance is in this state. Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state paused Jul 18 02:29:16.934566 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state paused Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 409 to user: Cannot 'rescue' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state paused {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:16.939641 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-54156a0c-7524-44b5-a3a7-4d0bef174ff6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action" status: 409 len: 144 microversion: 2.1 time: 0.168565 Jul 18 02:29:16.946981 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1630/3227] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:16 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action => generated 144 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:29:16.971519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:16.972157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:16.997079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.997532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:16.998374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:16.998899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.441971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:17.444488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:17.455820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe8dcfed-da68-4c52-a6e4-e77578a68e83 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.501950 Jul 18 02:29:17.462830 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1631/3228] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:16 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:17.477686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:17.478247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:17.496753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.499515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.500821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.501498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.622245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c59cdc24-e390-4572-9d5c-c64741a39f44 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action" status: 202 len: 0 microversion: 2.1 time: 0.157435 Jul 18 02:29:17.622919 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1632/3229] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:17 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:17.651014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:17.651746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:17.680230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.681644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:17.683641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:17.684812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.029286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:18.071626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6fad515-f534-454f-84b7-dd6f08d1c904 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1509 microversion: 2.1 time: 0.427707 Jul 18 02:29:18.084797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1633/3230] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:17 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:18.101534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:18.102733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:18.138646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.139988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.141453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.152232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.638857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:18.652828 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07c62d80-2a34-4a3d-a7c5-19c19381d171 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.569536 Jul 18 02:29:18.657348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1634/3231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:18 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:18.673782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:18.680192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:18.688236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:18.708083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:18.722551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.723287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:18.724799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:18.725730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.026343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:19.051712 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-778a1d12-1806-415c-9763-5219417a34bf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.389086 Jul 18 02:29:19.054814 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1635/3232] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:18 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:19.094516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:19.095425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:19.165367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.166830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.168624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:19.169735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:19.231677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=26 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:19.241942 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8952f628-6173-4e9c-9dae-40aff06738b2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c" status: 202 len: 0 microversion: 2.1 time: 2.512373 Jul 18 02:29:19.242897 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1598/3233] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:29:16 2022] DELETE /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c => generated 0 bytes in 2514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:19.253229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab048219d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:19.421051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:29:19.422083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:29:19.424706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.424706 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c HTTP/1.1 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd3ec3ed9-bee0-44c7-80a4-b00334b7276c'} Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:29:19.427883 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] Jul 18 02:29:19.432871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:19.439653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:29:19.439653 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-9f0fb650-af44-41ad-a70b-27bbd8bc99bb'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:19.442339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c989d2c0-ec24-49a5-bb1f-ce5ff8cd3516 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c" status: 404 len: 194 microversion: 2.1 time: 0.194385 Jul 18 02:29:19.443252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1599/3234] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:29:19 2022] GET /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:19.494361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e6a263d-0672-48f2-b151-094f2e7a6961 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab042e43a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:20.210682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:20.242543 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b313ce86-52a7-4fe3-8f39-1d08a2394ff5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1517 microversion: 2.1 time: 1.153177 Jul 18 02:29:20.243676 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1636/3235] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:19 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1517 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:20.332741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:20.336188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:20.407821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:20.422186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:20.431360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:20.434363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:20.984748 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e6a263d-0672-48f2-b151-094f2e7a6961 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.533442 Jul 18 02:29:20.985900 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1600/3236] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:29:19 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:20.995466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:20.995466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:21.016982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.019008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.021344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:21.023256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:21.836767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:21.850502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eaee9fe3-98e1-4a57-940e-b3666a01eff8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 1.557274 Jul 18 02:29:21.854611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1637/3237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:20 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:21.876236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31fc101a-127a-461b-8c78-a2e0295e5a15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab055b6700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-937880864", "description": "tempest-description-1364215722"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:22.493537 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31fc101a-127a-461b-8c78-a2e0295e5a15 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.637424 Jul 18 02:29:22.494799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1638/3238] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:22.501623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a60debc5-dc80-44d8-b328-03893f00b15e req-d34bd3e0-1d20-498d-8409-d356a0997c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746178a7-9071-46a0-bcb0-020f58d4d4d3", "tag": "9bf1d356-b885-4777-b8d5-97c73d07bd59"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:22.535596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a60debc5-dc80-44d8-b328-03893f00b15e req-d34bd3e0-1d20-498d-8409-d356a0997c96 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:22.536082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a60debc5-dc80-44d8-b328-03893f00b15e req-d34bd3e0-1d20-498d-8409-d356a0997c96 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:22.573884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a60debc5-dc80-44d8-b328-03893f00b15e req-d34bd3e0-1d20-498d-8409-d356a0997c96 service nova] Creating event network-changed:9bf1d356-b885-4777-b8d5-97c73d07bd59 for instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 on n-h1-849796-1 Jul 18 02:29:22.585425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a60debc5-dc80-44d8-b328-03893f00b15e req-d34bd3e0-1d20-498d-8409-d356a0997c96 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088989 Jul 18 02:29:22.595444 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1639/3239] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:22.601593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b954630-1e6a-4c61-98f3-a8dee6ba30c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04c09700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-425175754", "description": "tempest-description-305124783"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:23.251106 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b954630-1e6a-4c61-98f3-a8dee6ba30c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.653503 Jul 18 02:29:23.259951 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1640/3240] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:29:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:23.930286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:23.947874 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a27fe54e-c2de-4701-be51-99b39106f3a6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 2.960118 Jul 18 02:29:23.950352 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1601/3241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:20 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:23.964512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-817186120", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "aac5963c-d41f-4f71-84e9-0ddc25e394b5"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:24.105900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] validate_networks() for [('aac5963c-d41f-4f71-84e9-0ddc25e394b5', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:24.280189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:24.288805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:24.301731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.302777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.303904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.304637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.702490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:24.711497 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9243b35c-f054-4f4a-a208-1135e4cea0ad tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 1.449198 Jul 18 02:29:24.716347 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1641/3242] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:23 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:24.725224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:24.729378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:24.759898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.760672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.761738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:24.762399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:24.818200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'flavor' on Instance uuid ad144596-42e9-47bb-b290-8febab20f782 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:25.086426 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d90be9bb-6f8b-4a5e-b288-4554811b9aa9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action" status: 200 len: 32 microversion: 2.1 time: 0.367444 Jul 18 02:29:25.087214 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1642/3243] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:24 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:29:25.103699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:25.105553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:25.154397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.155626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.160028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.161334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.687259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:25.705453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1526cc14-3bf0-4008-a771-4569bbb3aa56 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.615228 Jul 18 02:29:25.720662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1643/3244] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:25 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:25.731180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:25.732539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:25.742261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.743030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:25.744016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:25.744608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.042387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:26.101300 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b190547b-3ce9-4039-9c86-a0adc2851eef tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.378089 Jul 18 02:29:26.112058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1644/3245] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:25 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:26.115827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:26.117252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:26.131665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.132908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.134450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.143048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.471688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:26.486302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5273096-911c-4b5c-8bf9-161dbd686537 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.381523 Jul 18 02:29:26.497134 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1645/3246] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:26 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:26.703990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:26.706464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:26.707323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:26.708296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:26.709272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:26.730127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:26.730930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:26.746069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.746735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.748975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.748975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.752910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.754124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.756629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:26.760831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:26.856470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Getting quotas for project 5379df4258724e15b439342b884c7dd6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:26.896344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Getting quotas for user 7859b13877c346ad9a6e8c2a9e38d584 and project 5379df4258724e15b439342b884c7dd6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:26.965880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:26.978595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:27.114024 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f7c5e78-38a9-4c8a-8e37-6b374d3d1c41 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.162389 Jul 18 02:29:27.124289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1602/3247] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:27.135392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.140743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:27.179292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.180232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.181646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.187843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.345339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:27.384187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1bbedac7-c353-42a4-b07f-8ea6e1c4e243 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.658943 Jul 18 02:29:27.385089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1646/3248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:26 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.433556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f941c04-6908-4d1b-8c1e-5a6247064fd5 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.439077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f941c04-6908-4d1b-8c1e-5a6247064fd5 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:27.804358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f941c04-6908-4d1b-8c1e-5a6247064fd5 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:27.832862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f941c04-6908-4d1b-8c1e-5a6247064fd5 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1215 microversion: 2.1 time: 0.439909 Jul 18 02:29:27.840826 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1647/3249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1215 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.873659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.874871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:27.929922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.930739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:27.934633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:27.936714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.158175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:28.197114 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fddd1dfe-bb0f-4111-858a-82c0c468c934 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.068696 Jul 18 02:29:28.199647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1603/3250] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:28.410552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:28.432910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:28.491148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:28.506662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.509571 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38d18363-f63a-4af1-8464-6f178ddc335a tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.666312 Jul 18 02:29:28.510472 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1648/3251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:28.512009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.517738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.521695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.805541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a3425535-af2c-4fc8-ae59-829795244ecc req-87a10901-0a4f-4d99-abf1-4e35bf5816c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a883255c-d4c6-40b0-97b3-303bcef311ed", "name": "network-vif-plugged", "status": "completed", "tag": "4c371726-327e-47c7-8cc9-adba2dd5846d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:28.841277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3425535-af2c-4fc8-ae59-829795244ecc req-87a10901-0a4f-4d99-abf1-4e35bf5816c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:28.843691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3425535-af2c-4fc8-ae59-829795244ecc req-87a10901-0a4f-4d99-abf1-4e35bf5816c7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:28.872879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:28.904468 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a3425535-af2c-4fc8-ae59-829795244ecc req-87a10901-0a4f-4d99-abf1-4e35bf5816c7 service nova] Creating event network-vif-plugged:4c371726-327e-47c7-8cc9-adba2dd5846d for instance a883255c-d4c6-40b0-97b3-303bcef311ed on n-h2-849796-1 Jul 18 02:29:28.920312 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a3425535-af2c-4fc8-ae59-829795244ecc req-87a10901-0a4f-4d99-abf1-4e35bf5816c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119646 Jul 18 02:29:28.924809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1649/3252] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:29:28.939486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:28.942026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:28.996773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:29.004246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:29.009890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:29.010893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:29.707257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:29.726279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50b21db6-fe80-4465-8509-a666f251d1d2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1211 microversion: 2.1 time: 0.799437 Jul 18 02:29:29.730334 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1650/3253] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:28 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1211 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:29.765214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:29.770622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:29.824358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:29.829003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:29.836223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:29.841226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.320543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:30.334967 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37c0a670-a997-4b0b-ae36-50f399b7b4c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 1.933922 Jul 18 02:29:30.339270 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1604/3254] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:28 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:30.356893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2002711086", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "356a7953-dafe-407e-a520-73083f2c4622"}, {"uuid": "e618417b-8883-4077-807a-e4cd785b78d7"}, {"uuid": "356a7953-dafe-407e-a520-73083f2c4622"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:30.554310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] validate_networks() for [('356a7953-dafe-407e-a520-73083f2c4622', None, None, None, None, None), ('e618417b-8883-4077-807a-e4cd785b78d7', None, None, None, None, None), ('356a7953-dafe-407e-a520-73083f2c4622', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:30.891409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:30.903595 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5742bda8-019c-4676-8cdc-506e3196b6eb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.171946 Jul 18 02:29:30.904215 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1651/3255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:29 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:30.923422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:30.924064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:30.945778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.946319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:30.947224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:30.947708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.691643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:31.785762 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-787f1ffc-78d9-4c15-ae75-7f5868c0973b tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1307 microversion: 2.1 time: 0.862673 Jul 18 02:29:31.788127 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1652/3256] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:30 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1307 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:31.803102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:31.806034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:31.820703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.822327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:31.824401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:31.826042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:32.282230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:32.336080 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d76951f-17a6-4b10-8f1f-a547f976937c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1273 microversion: 2.1 time: 0.539134 Jul 18 02:29:32.336552 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1653/3257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:31 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1273 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:32.370718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:32.371894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:32.406412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:32.413264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:32.414982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:32.415745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:33.162756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:33.219077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aeb5c999-0c8c-4d24-ac43-a60af977ab2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.880652 Jul 18 02:29:33.243943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1654/3258] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:32 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:33.274711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:33.276714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:33.308731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:33.309697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:33.311252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:33.312161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:34.775270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:34.810578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1738d98-bd84-433d-bf45-f333e8e8a208 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.562645 Jul 18 02:29:34.813243 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1655/3259] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:33 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:34.831707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:34.843183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:34.870987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:34.880370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:34.882340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:34.883820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.096116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:35.098127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:35.099444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:35.100619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:35.107528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:35.139785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.141048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.142867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.143821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.221764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Getting quotas for project 2aeaf897fc3a45cbbbd2c4fba4bed525. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:35.235534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Getting quotas for user 95a91925d5ea4bdb91ed033db2658c5d and project 2aeaf897fc3a45cbbbd2c4fba4bed525. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:35.311499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:35.323172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:35.463355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-df15c36a-ea99-4f0e-a759-71bc78185ad5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.116989 Jul 18 02:29:35.471386 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1605/3260] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 5129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:35.490091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:35.490634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:35.518764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.519271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.520173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.538105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.653274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:35.668689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7949bef4-78f2-4ead-999b-8d99b2e0455f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1486 microversion: 2.1 time: 0.853730 Jul 18 02:29:35.681475 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1656/3261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:34 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1486 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:35.700395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:35.701100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:35.738136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.740326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:35.742516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:35.743875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:36.258903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:36.288038 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1c220303-7721-4e57-8d29-e1a9b649fdd7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.600516 Jul 18 02:29:36.289177 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1657/3262] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:35 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:36.301979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:36.322214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee636aa3-19c9-4bf9-b3a6-5d5d8a042e38 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:36.323959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee636aa3-19c9-4bf9-b3a6-5d5d8a042e38 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:36.329627 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64186ba9-a6cb-47d1-9d05-1efb1a07316a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.855117 Jul 18 02:29:36.352609 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1606/3263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:35 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:36.628271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee636aa3-19c9-4bf9-b3a6-5d5d8a042e38 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:36.664312 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee636aa3-19c9-4bf9-b3a6-5d5d8a042e38 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1213 microversion: 2.1 time: 0.363328 Jul 18 02:29:36.676565 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1658/3264] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:36 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1213 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:36.691191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-838547377"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:36.700015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:36.722087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:36.722610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:36.729193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:36.730110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:37.127645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1502969080", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ec1ee082-ceb7-49e4-b192-50fc3d6df013"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:37.403017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] validate_networks() for [('ec1ee082-ceb7-49e4-b192-50fc3d6df013', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:29:37.776797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08af730c-3d32-47f7-a1bf-3c4cf1e5f638 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "POST /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed/action" status: 202 len: 0 microversion: 2.1 time: 1.098212 Jul 18 02:29:37.788705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1659/3265] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:36 2022] POST /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 02:29:37.837599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:37.838747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:37.848578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:37.849424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:37.850513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:37.851311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.717140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:38.754209 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95a94bcf-0898-4498-b0ff-221b027ca1b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.958789 Jul 18 02:29:38.761213 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1660/3266] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:37 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:38.770088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:38.774235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:38.787728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.793875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:38.795944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:38.797139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.469753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:39.482027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a5483d5-b419-40d8-a0d7-b8266a9779a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.719212 Jul 18 02:29:39.487602 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1661/3267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:38 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:39.496206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:39.501920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:39.515735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.516600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:39.520256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:39.523504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.088200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:40.090651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:40.092340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:40.093551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:40.095880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:29:40.150890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.151709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.164910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.166160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.210480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:40.275466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Getting quotas for project d5b3cc001b0e40a681c47c9d32aa2641. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:29:40.304127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Getting quotas for user f3b9a855b25b4326989f13498e16ac82 and project d5b3cc001b0e40a681c47c9d32aa2641. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:29:40.308290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:40.337477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a385a1d4-5802-43c9-908d-10e6bcbb1fbf tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.846291 Jul 18 02:29:40.345468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1662/3268] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:39 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:40.349625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-08dd4509-972f-46a1-87d5-57b9c1eb47c3 req-dae8abeb-c1fa-49eb-92e4-9cb15e87fe03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95d20fc-549b-4e31-aba7-e4ed73bc28a7", "tag": "74f1dfe5-2825-4bdb-bd2f-ecdecc680e56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:40.361658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-08dd4509-972f-46a1-87d5-57b9c1eb47c3 req-dae8abeb-c1fa-49eb-92e4-9cb15e87fe03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.362562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-08dd4509-972f-46a1-87d5-57b9c1eb47c3 req-dae8abeb-c1fa-49eb-92e4-9cb15e87fe03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.382723 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-08dd4509-972f-46a1-87d5-57b9c1eb47c3 req-dae8abeb-c1fa-49eb-92e4-9cb15e87fe03 service nova] Creating event network-changed:74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 for instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 on n-h1-849796-1 Jul 18 02:29:40.391989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:29:40.394711 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-08dd4509-972f-46a1-87d5-57b9c1eb47c3 req-dae8abeb-c1fa-49eb-92e4-9cb15e87fe03 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054433 Jul 18 02:29:40.396012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1663/3269] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:40.396195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:29:40.402309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:40.403614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:40.411665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.412407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.413805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.414768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.523890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0904266-703c-4d95-be58-5c79cb0e778f tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.169021 Jul 18 02:29:40.535369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1607/3270] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:29:40.546694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ece3843-b2dc-4f9f-9635-ce59667bffa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab042b60d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:40.712968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ece3843-b2dc-4f9f-9635-ce59667bffa5 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d" status: 200 len: 1411 microversion: 2.1 time: 0.174345 Jul 18 02:29:40.718202 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1608/3271] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:29:40 2022] GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d => generated 1411 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:40.747588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-49a738f6-10f3-4dba-86f5-688ccc7fd363 req-372dd8a9-169e-4eba-bea4-c87e4072f49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746178a7-9071-46a0-bcb0-020f58d4d4d3", "name": "network-vif-plugged", "status": "completed", "tag": "9bf1d356-b885-4777-b8d5-97c73d07bd59"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:40.800312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49a738f6-10f3-4dba-86f5-688ccc7fd363 req-372dd8a9-169e-4eba-bea4-c87e4072f49e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.801865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49a738f6-10f3-4dba-86f5-688ccc7fd363 req-372dd8a9-169e-4eba-bea4-c87e4072f49e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.883886 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-49a738f6-10f3-4dba-86f5-688ccc7fd363 req-372dd8a9-169e-4eba-bea4-c87e4072f49e service nova] Creating event network-vif-plugged:9bf1d356-b885-4777-b8d5-97c73d07bd59 for instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 on n-h1-849796-1 Jul 18 02:29:40.919311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-49a738f6-10f3-4dba-86f5-688ccc7fd363 req-372dd8a9-169e-4eba-bea4-c87e4072f49e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183845 Jul 18 02:29:40.921773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1609/3272] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:40.939345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:40.945407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:40.962896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.965453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:40.968885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:40.971947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:41.140076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:41.153687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-289067c5-798d-4051-bdc9-c73ef308b224 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1313 microversion: 2.1 time: 0.751606 Jul 18 02:29:41.156234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1664/3273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:40 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1313 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:41.170051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:41.177241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:41.200308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:41.201706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:41.202579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:41.203041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:41.983104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:42.016075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-533a8c43-c20f-419c-9f2b-0ec9b137be14 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.850860 Jul 18 02:29:42.017277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1665/3274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:41 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:42.039201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.053686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:42.087009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.087823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.096386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.105911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.260750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:42.287973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-740432fe-56e4-48a2-840a-474cd7dd12cb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.361059 Jul 18 02:29:42.291148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:42.293991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:42.294464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1610/3275] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:40 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:42.312217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fc6daf8-8c17-4e29-b41d-71c8df8f32e4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04765f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.315177 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1dd3e76-434b-4026-84e7-d81a171cb1ca tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1229 microversion: 2.1 time: 0.288985 Jul 18 02:29:42.317299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1666/3276] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:42.333927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.338976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:42.355777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.361652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.366879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.367765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.480004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3fc6daf8-8c17-4e29-b41d-71c8df8f32e4 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d" status: 200 len: 1411 microversion: 2.1 time: 0.183083 Jul 18 02:29:42.487454 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1611/3277] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d => generated 1411 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:42.492889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.499513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:42.519278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.519764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.523255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:42.523727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:42.755351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:42.763997 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d7d4d15-c04d-4c38-9184-2eb4a87ef824 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.445314 Jul 18 02:29:42.776418 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1667/3278] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:42.787116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e692d906-0d99-4114-95ac-ad7fd71e148d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04b1cee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:42.954375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:42.968273 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-812d1ac7-4234-4fad-ba54-070b282a903b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1313 microversion: 2.1 time: 0.484514 Jul 18 02:29:42.975324 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1612/3279] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:43.044447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:43.046849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:43.065862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.068126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.071859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.072613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.368645 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e692d906-0d99-4114-95ac-ad7fd71e148d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d" status: 204 len: 0 microversion: 2.1 time: 0.590250 Jul 18 02:29:43.369983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1668/3280] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:42 2022] DELETE /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:43.393250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:43.398408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:43.436964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.450669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.453187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.454233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.799816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:43.824021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8278c570-5fde-493f-8f90-a18e4d608f72 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.782910 Jul 18 02:29:43.828190 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1613/3281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:43 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:43.850517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:43.857710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:43.892872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.898374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:43.900811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:43.901677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.095138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:44.114851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ff00afd-ad38-4b57-b2ad-2e8f37a7e499 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1285 microversion: 2.1 time: 0.284234 Jul 18 02:29:44.116283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1614/3282] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:43 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:44.126065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6411d02c-1bf2-4534-8446-7cfc731670bf tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab044390d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:44.166282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6411d02c-1bf2-4534-8446-7cfc731670bf tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Image not found. Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6411d02c-1bf2-4534-8446-7cfc731670bf tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d HTTP/1.1 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '04e6dbc6-701f-4d99-a4d8-e5788315405d'} Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 04e6dbc6-701f-4d99-a4d8-e5788315405d Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 18 02:29:44.172819 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04e6dbc6-701f-4d99-a4d8-e5788315405d could not be found. Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:29:44.181763 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:44.193573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6411d02c-1bf2-4534-8446-7cfc731670bf tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:44.193573 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6411d02c-1bf2-4534-8446-7cfc731670bf tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d" status: 404 len: 62 microversion: 2.1 time: 0.073885 Jul 18 02:29:44.194230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1615/3283] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:29:44 2022] GET /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:29:44.206629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:44.208094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:44.239033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.240210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.242216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.246414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.833037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:44.841733 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3cd0aa5b-c38e-46ac-87a0-e0d25234e9b1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.469577 Jul 18 02:29:44.843161 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1669/3284] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:43 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:44.848633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:44.849666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:44.859531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.860663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.861953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:44.863275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:44.892422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:44.950022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a81c4e8b-94fa-4a5c-a0a5-e658be01a586 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.750998 Jul 18 02:29:44.955096 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1616/3285] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:44 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:44.986509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:44.990530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:45.027754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.030360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.036214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.038992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.320842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:45.335981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96db9769-6b56-4e82-8d9d-74a1ab41d20d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1334 microversion: 2.1 time: 0.491449 Jul 18 02:29:45.347795 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1670/3286] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:44 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1334 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:45.360838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:45.368165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:45.379779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.383928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:45.385197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:45.391421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.330140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:46.348049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd277613-5ccc-4583-b575-6941582d2a42 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1314 microversion: 2.1 time: 0.993838 Jul 18 02:29:46.349043 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1671/3287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:45 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:46.371012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.373365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:46.398033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.399058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.401814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.406509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.658077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:46.695779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:46.715502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4c34440-45b1-41d2-9cbb-6d29fb51b873 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1283 microversion: 2.1 time: 0.361662 Jul 18 02:29:46.723007 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1672/3288] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1283 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:46.739361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.742690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:46.780693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.782121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.786365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.787236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.828861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:46.863292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-affaf066-131f-4e45-8ce5-fb1bc6ebffe7 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1504 microversion: 2.1 time: 1.903353 Jul 18 02:29:46.865289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1617/3289] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:44 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1504 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:46.884772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:46.886768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:46.893753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:46.901697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.902822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:46.904636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:46.905660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.374135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:47.387398 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d7f2ce3-243b-4114-8489-02f0972f8732 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.663037 Jul 18 02:29:47.390678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1673/3290] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:47.401510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:47.402779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:47.439736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.440562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:47.448438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:47.449354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.035564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:48.059782 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-485e0312-ac98-4ae6-a816-7e470b00ca03 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.667774 Jul 18 02:29:48.068764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1674/3291] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:47 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:48.082643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:48.091035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:48.118610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.122333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.123384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.126543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.698939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:48.766319 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c847165-8b69-45d2-a3d7-bec0a37e0808 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1501 microversion: 2.1 time: 0.695967 Jul 18 02:29:48.767806 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1675/3292] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:48 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1501 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:48.789868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:48.792591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:48.820460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=80 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:48.828562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.849043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.851055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.859133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.881944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:48.931750 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40183b3a-00ef-4cc1-9dfa-14e203e27080 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 2.063828 Jul 18 02:29:48.938617 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1618/3293] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:46 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:48.956576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:48.964008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:48.990535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.990894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:48.991727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:48.994882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:49.939976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:49.973361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2d9587a7-1ecc-410e-9cee-70e6cd51dffb tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1499 microversion: 2.1 time: 1.029356 Jul 18 02:29:49.975445 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1619/3294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:48 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1499 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:49.991204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:49.992666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:50.023794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.026710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:50.034884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.036867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:50.211421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:50.334712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=18 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:50.645857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:50.670355 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cae24f0d-6046-4c1d-8b4d-002159b29922 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 1.893452 Jul 18 02:29:50.675753 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1676/3295] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:48 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:50.704366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:50.706171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:50.730386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.731223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:50.732533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.733372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:50.902683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:50.929215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f756d495-06cb-41b9-8cf3-7a75d05cca45 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1503 microversion: 2.1 time: 0.950521 Jul 18 02:29:50.929941 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1620/3296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:49 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1503 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:50.948672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:50.951009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:50.970259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.974044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:50.975530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:50.976685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.003381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5ce91c5-0a44-480f-9d20-9efed0228951 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3/action" status: 202 len: 0 microversion: 2.1 time: 0.312832 Jul 18 02:29:51.007011 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1677/3297] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:50 2022] POST /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:51.038803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a5247a42-36f6-4d09-b23d-7c95696ec5f6 req-54e38f0c-e998-4c5c-9885-278e7d063c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95d20fc-549b-4e31-aba7-e4ed73bc28a7", "name": "network-vif-plugged", "status": "completed", "tag": "74f1dfe5-2825-4bdb-bd2f-ecdecc680e56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:51.100271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a5247a42-36f6-4d09-b23d-7c95696ec5f6 req-54e38f0c-e998-4c5c-9885-278e7d063c55 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.100983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a5247a42-36f6-4d09-b23d-7c95696ec5f6 req-54e38f0c-e998-4c5c-9885-278e7d063c55 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.152761 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a5247a42-36f6-4d09-b23d-7c95696ec5f6 req-54e38f0c-e998-4c5c-9885-278e7d063c55 service nova] Creating event network-vif-plugged:74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 for instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 on n-h1-849796-1 Jul 18 02:29:51.160878 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a5247a42-36f6-4d09-b23d-7c95696ec5f6 req-54e38f0c-e998-4c5c-9885-278e7d063c55 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152302 Jul 18 02:29:51.162285 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1678/3298] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:51.183522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:51.185043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:51.204859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.205718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.206827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.207534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.546874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:51.557889 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-985f40f4-5a8f-401a-b11c-279dcac219d2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.624371 Jul 18 02:29:51.558778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1621/3299] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:50 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:51.565789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d0181a8-fb5c-4b95-ba0f-3f6a8dbaa822"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:51.567277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:51.575465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.576647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.577888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.578527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.632715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Cannot 'attach_volume' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state rescued Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/os-volume_attachments HTTP/1.1 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 74 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: {"volumeAttachment": {"volumeId": "0d0181a8-fb5c-4b95-ba0f-3f6a8dbaa822"}} Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'attach_volume' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state rescued Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'ad144596-42e9-47bb-b290-8febab20f782', 'body': {'volumeAttachment': {'volumeId': '0d0181a8-fb5c-4b95-ba0f-3f6a8dbaa822'}}} Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad144596-42e9-47bb-b290-8febab20f782 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 02:29:51.635123 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state rescued Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state rescued Jul 18 02:29:51.640632 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:51.643165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 409 to user: Cannot 'attach_volume' instance ad144596-42e9-47bb-b290-8febab20f782 while it is in vm_state rescued {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:51.644550 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d65123d-b575-4ea9-8829-43f3ceb7675c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084491 Jul 18 02:29:51.650105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1622/3300] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:29:51 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:29:51.658513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:51.660222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:51.678624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.679785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.681724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:51.684195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:51.964598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:51.981197 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19087225-a8cf-4493-9944-09542aefd09b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.816836 Jul 18 02:29:51.982648 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1679/3301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:51 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:52.009111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:52.010508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.028076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.030673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.031585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.032409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.387430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:52.409541 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f97d5bde-e435-4fb7-8043-461376a61800 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1486 microversion: 2.1 time: 0.757297 Jul 18 02:29:52.421797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1623/3302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:51 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1486 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:52.449400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cc4a3590-5099-4fc9-a36a-ae5afd81bcfc req-68ac57a0-4039-4bc5-be45-3209f8163e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "tag": "412e919b-9bb2-416a-8b32-224c89ab10db"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:52.475106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cc4a3590-5099-4fc9-a36a-ae5afd81bcfc req-68ac57a0-4039-4bc5-be45-3209f8163e3e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.476355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cc4a3590-5099-4fc9-a36a-ae5afd81bcfc req-68ac57a0-4039-4bc5-be45-3209f8163e3e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.510150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:52.510531 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cc4a3590-5099-4fc9-a36a-ae5afd81bcfc req-68ac57a0-4039-4bc5-be45-3209f8163e3e service nova] Creating event network-changed:412e919b-9bb2-416a-8b32-224c89ab10db for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:29:52.517860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cc4a3590-5099-4fc9-a36a-ae5afd81bcfc req-68ac57a0-4039-4bc5-be45-3209f8163e3e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083489 Jul 18 02:29:52.521009 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1624/3303] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:52.527545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:52.529742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.532033 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad7c8551-62da-4d15-b12a-ada28522b429 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1486 microversion: 2.1 time: 0.547099 Jul 18 02:29:52.543945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1680/3304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:51 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1486 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:52.543945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:52.545595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.550814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.551156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.551783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.552434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.599859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.603936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.605542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.606304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.749162 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bba40a91-2fca-4ef5-9cb5-e8b8cb9534de tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action" status: 202 len: 0 microversion: 2.1 time: 0.224362 Jul 18 02:29:52.750958 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1625/3305] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:52 2022] POST /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:52.762373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:52.763504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:52.785003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.785806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.787091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:52.787726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:52.823046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:52.885834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:53.023543 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01069785-abfd-4e1d-9057-1b51297e7de1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 204 len: 0 microversion: 2.1 time: 0.269655 Jul 18 02:29:53.031928 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1626/3306] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:52 2022] DELETE /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:53.048679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:53.049356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:53.062370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.063342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.064490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.064952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.125267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:53.281232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aed552d8-3eab-46c9-ac0d-48dfd22c8f87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 204 len: 0 microversion: 2.1 time: 0.246377 Jul 18 02:29:53.282537 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1627/3307] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:53 2022] DELETE /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:53.293486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:53.295140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:53.318349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.318827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.322548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.322967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.421246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:53.438589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e69296a-c38c-403e-a0d5-6ce65b271a55 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.903298 Jul 18 02:29:53.439520 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1681/3308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:52 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:53.453680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:53.457076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:53.470356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.470831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.471671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.472133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.788965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:53.801009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d258ff5-cce6-4637-9294-23765f7614c7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1511 microversion: 2.1 time: 0.359937 Jul 18 02:29:53.803006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1682/3309] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:53 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:53.814450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:53.825512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:53.832829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.833617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:53.834707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:53.835137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.055324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:54.085159 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb37643f-edf2-4186-8f4a-ee3a63371d1a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.800406 Jul 18 02:29:54.120957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:54.121849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1628/3310] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:53 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:54.131997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0822a918-337d-4345-bcdb-7ecc1abf67aa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04439160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:54.132703 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c166cf0f-286b-4be3-b8ac-9ee2421d6245 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1315 microversion: 2.1 time: 0.328474 Jul 18 02:29:54.133894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1683/3311] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:53 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:54.140726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a883255c-d4c6-40b0-97b3-303bcef311ed", "name": "network-vif-plugged", "status": "completed", "tag": "4c371726-327e-47c7-8cc9-adba2dd5846d"}, {"server_uuid": "a883255c-d4c6-40b0-97b3-303bcef311ed", "name": "network-vif-unplugged", "status": "completed", "tag": "4c371726-327e-47c7-8cc9-adba2dd5846d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:54.154853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.155876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.188033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-0822a918-337d-4345-bcdb-7ecc1abf67aa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Image not found. Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0822a918-337d-4345-bcdb-7ecc1abf67aa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d HTTP/1.1 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '04e6dbc6-701f-4d99-a4d8-e5788315405d'} Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 04e6dbc6-701f-4d99-a4d8-e5788315405d to delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04e6dbc6-701f-4d99-a4d8-e5788315405d could not be found. Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.192118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0822a918-337d-4345-bcdb-7ecc1abf67aa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0822a918-337d-4345-bcdb-7ecc1abf67aa tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d" status: 404 len: 62 microversion: 2.1 time: 0.069655 Jul 18 02:29:54.198437 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1629/3312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:54 2022] DELETE /compute/v2.1/images/04e6dbc6-701f-4d99-a4d8-e5788315405d => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:29:54.218259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:54.221261 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] Creating event network-vif-plugged:4c371726-327e-47c7-8cc9-adba2dd5846d for instance a883255c-d4c6-40b0-97b3-303bcef311ed on n-h2-849796-1 Jul 18 02:29:54.222443 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] Creating event network-vif-unplugged:4c371726-327e-47c7-8cc9-adba2dd5846d for instance a883255c-d4c6-40b0-97b3-303bcef311ed on n-h2-849796-1 Jul 18 02:29:54.229689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-af6e4c7d-a8f8-4901-ac8e-942f65f65085 req-62b05452-ed92-461f-b1e2-be80ad916f7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.094210 Jul 18 02:29:54.236365 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1684/3313] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:54.237838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:54.238946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:54.243375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-54b05765-45b1-4796-92a8-3e2740d5593b req-606851cd-889f-45e1-89e6-cbe4ff7b6204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c70c4ba-5c4a-472c-b15b-744e640b5da8", "tag": "ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:54.258799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-54b05765-45b1-4796-92a8-3e2740d5593b req-606851cd-889f-45e1-89e6-cbe4ff7b6204 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.259578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.260320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.260527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-54b05765-45b1-4796-92a8-3e2740d5593b req-606851cd-889f-45e1-89e6-cbe4ff7b6204 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.272082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.273067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.298668 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-54b05765-45b1-4796-92a8-3e2740d5593b req-606851cd-889f-45e1-89e6-cbe4ff7b6204 service nova] Creating event network-changed:ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97 for instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 on n-h1-849796-1 Jul 18 02:29:54.310474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-54b05765-45b1-4796-92a8-3e2740d5593b req-606851cd-889f-45e1-89e6-cbe4ff7b6204 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072270 Jul 18 02:29:54.313578 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1685/3314] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:54.332646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:54.333403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:54.362776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.362776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.362776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.362776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.460354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:29:54.667958 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Instance is already in deleting state, ignoring this request Jul 18 02:29:54.674085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-838d51d0-a953-4d86-943c-3f4eeb40cad8 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 204 len: 0 microversion: 2.1 time: 0.354309 Jul 18 02:29:54.682312 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1686/3315] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:29:54 2022] DELETE /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:29:54.698527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:54.708704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:54.734259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.735575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.737629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:54.744804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:54.943321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:54.969775 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-726a245e-ad5b-499a-b02c-7418e096b6fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1492 microversion: 2.1 time: 0.772337 Jul 18 02:29:54.970777 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1630/3316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:54 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1492 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:54.993401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0a096934-b5da-4d37-9db8-40d4051850b1 req-25b9e293-4497-4212-aa2c-bec80622684b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "tag": "ad9f3fb4-a6b2-4c53-b7a7-80bff212f491"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:55.022482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0a096934-b5da-4d37-9db8-40d4051850b1 req-25b9e293-4497-4212-aa2c-bec80622684b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.023407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0a096934-b5da-4d37-9db8-40d4051850b1 req-25b9e293-4497-4212-aa2c-bec80622684b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.086456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0a096934-b5da-4d37-9db8-40d4051850b1 req-25b9e293-4497-4212-aa2c-bec80622684b service nova] Creating event network-changed:ad9f3fb4-a6b2-4c53-b7a7-80bff212f491 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:29:55.098777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0a096934-b5da-4d37-9db8-40d4051850b1 req-25b9e293-4497-4212-aa2c-bec80622684b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118195 Jul 18 02:29:55.100189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1631/3317] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:55.111402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:55.115261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:55.139452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.145424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.147947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.154063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.474970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:55.483575 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-708d8885-8eac-440e-8e08-eabc19e689d1 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.799491 Jul 18 02:29:55.485834 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1687/3318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:54 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:55.491591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:55.492227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:55.504058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.504887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:55.505929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:55.506536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:56.181344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:56.197701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a0ad272-e80c-4686-80c0-2eaecfc30122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1511 microversion: 2.1 time: 0.710705 Jul 18 02:29:56.198510 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1688/3319] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:55 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:56.207913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:56.223949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:56.224584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:56.226186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69a39362-15e7-4333-a756-fa7a85dce59f tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1492 microversion: 2.1 time: 1.123595 Jul 18 02:29:56.242392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:56.242392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:56.242817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:56.243264 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1632/3320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:55 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1492 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:56.243755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:56.257954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:56.259526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:56.271834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:56.273058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:56.274740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:56.275796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:56.956136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:56.984223 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2cffa0cf-93d2-454e-9a9e-537fa859cd6b tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1503 microversion: 2.1 time: 0.739063 Jul 18 02:29:56.985664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1633/3321] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:56 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1503 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:57.004317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:57.007996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:57.034599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.035497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.037172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.038272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.064265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:57.078122 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da76709a-d692-4a0e-a556-2550d4a56143 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.875788 Jul 18 02:29:57.079438 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1689/3322] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:56 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:57.092403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:57.094272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:57.121649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.125049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.127284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.128418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.896209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:57.905321 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc39a3ba-ef43-4f5f-8376-668f7bf5e231 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1492 microversion: 2.1 time: 0.917989 Jul 18 02:29:57.924704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1634/3323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:56 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1492 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:57.930424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-937880864"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:57.931282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:57.953725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.954402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:57.955234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:57.955687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:58.409203 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Adding security group 32e48972-1d48-4efb-b133-a474c3d2543a to port 74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 Jul 18 02:29:58.549303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:58.565393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a73680ab-7bfa-4e24-9af8-dd8b1e14f5a6 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 1.477204 Jul 18 02:29:58.575607 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1690/3324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:57 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:58.581655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:58.593885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:58.605583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:58.606045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:58.607417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:58.613545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:58.944003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:58.959740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48215ff4-3d77-4617-9366-dbb65d99632c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1511 microversion: 2.1 time: 0.382156 Jul 18 02:29:58.960461 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1691/3325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:58 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:58.977355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:58.986418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:59.017262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.018881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.021893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.022365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.091681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.092972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.093682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lazy-loading 'fault' on Instance uuid a883255c-d4c6-40b0-97b3-303bcef311ed {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:29:59.161288 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-afbce423-f9be-43bc-a99e-ca7d517a8564 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action" status: 202 len: 0 microversion: 2.1 time: 1.234447 Jul 18 02:29:59.164196 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1635/3326] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:29:57 2022] POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:29:59.172774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:59.174395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:59.187308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.188439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.191048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.192099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.262512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f29b5f43d405ca9d3fed68e53cdb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e406623bbd284f9f8deef088cadbe361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:59.272435 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1aa7f95-a197-4b60-8d71-d8aa30f7ab19 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 200 len: 1297 microversion: 2.1 time: 0.309869 Jul 18 02:29:59.291163 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1692/3327] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:58 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 1297 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:59.297719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1c507d24-1742-4cf1-920b-edf369029d7c req-e5f7a768-bc4f-45cd-8cf6-072454fc30c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a883255c-d4c6-40b0-97b3-303bcef311ed", "name": "network-vif-deleted", "tag": "4c371726-327e-47c7-8cc9-adba2dd5846d"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:59.341020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1c507d24-1742-4cf1-920b-edf369029d7c req-e5f7a768-bc4f-45cd-8cf6-072454fc30c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.342032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1c507d24-1742-4cf1-920b-edf369029d7c req-e5f7a768-bc4f-45cd-8cf6-072454fc30c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.408063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1c507d24-1742-4cf1-920b-edf369029d7c req-e5f7a768-bc4f-45cd-8cf6-072454fc30c1 service nova] Creating event network-vif-deleted:4c371726-327e-47c7-8cc9-adba2dd5846d for instance a883255c-d4c6-40b0-97b3-303bcef311ed on n-h2-849796-1 Jul 18 02:29:59.430819 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1c507d24-1742-4cf1-920b-edf369029d7c req-e5f7a768-bc4f-45cd-8cf6-072454fc30c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135011 Jul 18 02:29:59.432467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1693/3328] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:59.623931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:59.634214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4cb8acb1-80f7-4f3c-bbdf-3e94951ba3a4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.467743 Jul 18 02:29:59.646523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1636/3329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:59 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:59.654766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:59.655986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:29:59.665698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.666695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.668650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:29:59.669881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:29:59.763867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:29:59.773824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1573404964", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:29:59.775626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9eca2e12-3531-499f-af69-9a70e63bd8d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1450 microversion: 2.1 time: 0.127285 Jul 18 02:29:59.776814 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1637/3330] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:29:59 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1450 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:59.786063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab042b60d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:59.955634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:29:59.958890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:29:59.963156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:29:59.966631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:29:59.977359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:00.023363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.027816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.040451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.044171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.118304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Getting quotas for project 440578d96c8c4e87bba5db201f10dc42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:00.141854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use.", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:00.142782 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.142782 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a HTTP/1.1 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: exception: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '32e48972-1d48-4efb-b133-a474c3d2543a'} Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:00.145028 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 400 to user: Security Group 32e48972-1d48-4efb-b133-a474c3d2543a in use. Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-cd93489a-7a5d-4fd6-a328-6345ec7758a3'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-199ecbe5-c047-4a07-98b4-795b0c564f32 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a" status: 400 len: 185 microversion: 2.1 time: 0.368564 Jul 18 02:30:00.150831 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1638/3331] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:29:59 2022] DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a => generated 185 bytes in 370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:30:00.155981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Getting quotas for user 07fc6801a5c445f7872c290b6e0c4940 and project 440578d96c8c4e87bba5db201f10dc42. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:00.163065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-64221e20-8e2a-41d8-9af1-7613f4fffba6 req-4d35a5e4-bec8-4a72-80bb-f754eaaca878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95d20fc-549b-4e31-aba7-e4ed73bc28a7", "tag": "74f1dfe5-2825-4bdb-bd2f-ecdecc680e56"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:00.194306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-64221e20-8e2a-41d8-9af1-7613f4fffba6 req-4d35a5e4-bec8-4a72-80bb-f754eaaca878 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.194791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-64221e20-8e2a-41d8-9af1-7613f4fffba6 req-4d35a5e4-bec8-4a72-80bb-f754eaaca878 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.203480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:00.209481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:00.212684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64221e20-8e2a-41d8-9af1-7613f4fffba6 req-4d35a5e4-bec8-4a72-80bb-f754eaaca878 service nova] Creating event network-changed:74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 for instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 on n-h1-849796-1 Jul 18 02:30:00.223921 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-64221e20-8e2a-41d8-9af1-7613f4fffba6 req-4d35a5e4-bec8-4a72-80bb-f754eaaca878 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075508 Jul 18 02:30:00.224614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1639/3332] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:00.230605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.231436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.240030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.241300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.241549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.242162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.356088 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13003014-5d9e-4cf2-b581-95a9079c7dad tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.920895 Jul 18 02:30:00.358616 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1694/3333] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:30:00.380253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.384999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.410971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.412327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.416801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.418035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.518716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:00.529354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b94ffae2-8a09-4c06-968c-b26636730744 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.302501 Jul 18 02:30:00.541951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1640/3334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:00.548874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:00.549907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.568281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.570541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.571458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.573812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.773711 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f1a3e2a-4872-4196-bca1-10980a6b064e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action" status: 202 len: 0 microversion: 2.1 time: 0.230015 Jul 18 02:30:00.775038 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1641/3335] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:30:00 2022] POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:00.782349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.783235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: a883255c-d4c6-40b0-97b3-303bcef311ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.792403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.792976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.794070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.795394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.811736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed HTTP/1.1 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a883255c-d4c6-40b0-97b3-303bcef311ed'} Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.814224 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. Jul 18 02:30:00.818612 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:00.820153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance a883255c-d4c6-40b0-97b3-303bcef311ed could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:00.821395 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c37aee85-a38d-4d98-96c9-b272adf8e9ac tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed" status: 404 len: 111 microversion: 2.1 time: 0.045043 Jul 18 02:30:00.828139 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1642/3336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/a883255c-d4c6-40b0-97b3-303bcef311ed => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:00.831361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.832533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.915267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:00.928903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:00.931157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:00.932796 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66d3fa27-f870-4490-8cdc-57863dff65f6 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1281 microversion: 2.47 time: 0.105798 Jul 18 02:30:00.933871 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1643/3337] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:00.940823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:00.941811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:00.953882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.954926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:00.956019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:00.956472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.005596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.015414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35a861d4-6fb7-418c-9090-e96fea5840a9 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1511 microversion: 2.1 time: 0.654975 Jul 18 02:30:01.025053 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1695/3338] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:01.025053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.025053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.037098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.037561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.038392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.038860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.270847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.300700 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13f6792a-5a16-4d88-a58f-36c0cc17782a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.364646 Jul 18 02:30:01.347869 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1644/3339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:00 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:01.363250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.371309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.384601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.385128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.385959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.386422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.404721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.427885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.428647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.429416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lazy-loading 'fault' on Instance uuid 746178a7-9071-46a0-bcb0-020f58d4d4d3 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:30:01.433117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:01.436770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ff91578-5412-4b0b-a2c2-6c959ed80492 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1573 microversion: 2.1 time: 0.418692 Jul 18 02:30:01.443805 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1696/3340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:01 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1573 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:01.451503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-708c13a1-8060-42ea-b9fb-611018dd285d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04ab4940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.483081 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-708c13a1-8060-42ea-b9fb-611018dd285d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Image not found. Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-708c13a1-8060-42ea-b9fb-611018dd285d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 HTTP/1.1 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2ee81579-d585-4df5-bea0-067155f7d836'} Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ee81579-d585-4df5-bea0-067155f7d836 to delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ee81579-d585-4df5-bea0-067155f7d836 could not be found. Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.485212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.493175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-708c13a1-8060-42ea-b9fb-611018dd285d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:01.501180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.517888 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-708c13a1-8060-42ea-b9fb-611018dd285d tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836" status: 404 len: 62 microversion: 2.1 time: 0.070955 Jul 18 02:30:01.519131 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1697/3341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:01 2022] DELETE /compute/v2.1/images/2ee81579-d585-4df5-bea0-067155f7d836 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:01.530540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c057cea-bf3d-4c1d-b17b-318e2def77a7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1304 microversion: 2.1 time: 0.179514 Jul 18 02:30:01.532498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1645/3342] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:01 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:01.534412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746178a7-9071-46a0-bcb0-020f58d4d4d3", "name": "network-vif-deleted", "tag": "9bf1d356-b885-4777-b8d5-97c73d07bd59"}, {"name": "network-changed", "server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "tag": "22d79d61-9909-4823-b24b-f802288da837"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:01.545927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.547489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.558439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.559555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.562198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.563455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.565490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.566554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.592840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 HTTP/1.1 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7fde38d2-6a9e-404d-86ac-d264f9a2da65'} Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:01.594807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:01.599242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79d51f53-61f6-411b-9487-84d43b55c490 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 404 len: 111 microversion: 2.1 time: 0.062207 Jul 18 02:30:01.600682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1646/3343] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:01 2022] DELETE /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:01.601995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] Creating event network-vif-deleted:9bf1d356-b885-4777-b8d5-97c73d07bd59 for instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 on n-h1-849796-1 Jul 18 02:30:01.602889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] Creating event network-changed:22d79d61-9909-4823-b24b-f802288da837 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:01.606052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.608288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.616133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.617095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.617988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7b149669-8ce0-46f7-a91a-cd35baf11e8f req-ae9c67e1-29a1-457f-be6f-b80e37ac6d4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.096288 Jul 18 02:30:01.618455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.619080 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1698/3344] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:01.619341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.633689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.635125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 7fde38d2-6a9e-404d-86ac-d264f9a2da65] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.647149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.647911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.649289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.650040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.866118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:01.877226 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e5344a7-3b3d-472a-ab68-94427899ba58 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.275556 Jul 18 02:30:01.877951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1647/3345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:01 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:01.959754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:01.961157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:01.973219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.974077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.975607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:01.976393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:01.994281 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 HTTP/1.1 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '7fde38d2-6a9e-404d-86ac-d264f9a2da65'} Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:01.996716 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 7fde38d2-6a9e-404d-86ac-d264f9a2da65 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.001563 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28ab3aea-7dd5-4ebc-aaa8-fcb071841e43 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65" status: 404 len: 111 microversion: 2.1 time: 0.374845 Jul 18 02:30:02.002433 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1699/3346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:01 2022] GET /compute/v2.1/servers/7fde38d2-6a9e-404d-86ac-d264f9a2da65 => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:02.015581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8535188e-6477-454b-9b6a-fed0f6a771b1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04af23a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.051278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8535188e-6477-454b-9b6a-fed0f6a771b1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Image not found. Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8535188e-6477-454b-9b6a-fed0f6a771b1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 HTTP/1.1 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: exception: Image not found. Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '887e47a8-253f-4102-b426-83b734171eb5'} Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 887e47a8-253f-4102-b426-83b734171eb5 to delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 887e47a8-253f-4102-b426-83b734171eb5 could not be found. Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.055086 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8535188e-6477-454b-9b6a-fed0f6a771b1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Image not found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8535188e-6477-454b-9b6a-fed0f6a771b1 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5" status: 404 len: 62 microversion: 2.1 time: 0.049869 Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1700/3347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] DELETE /compute/v2.1/images/887e47a8-253f-4102-b426-83b734171eb5 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.070795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.078310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.078846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.079680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.080553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.102145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:02.114403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:02.116353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:02.117886 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-723598ed-0887-4ee8-92e3-239e24441eac tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1333 microversion: 2.47 time: 0.166258 Jul 18 02:30:02.118744 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1648/3348] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:01 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1333 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:02.123870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.124714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.131444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.131910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.132726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.133204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.149233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c HTTP/1.1 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '60fb7154-5239-40f6-b79d-99a38d02777c'} Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:02.151324 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-777a7a04-0d63-4a7a-a0e3-7ac35949af82 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 404 len: 111 microversion: 2.1 time: 0.032897 Jul 18 02:30:02.156451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1649/3349] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:02 2022] DELETE /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:02.165114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.166018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 60fb7154-5239-40f6-b79d-99a38d02777c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.172673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.173285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.174186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.174742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.191586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c HTTP/1.1 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '60fb7154-5239-40f6-b79d-99a38d02777c'} Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.193385 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 60fb7154-5239-40f6-b79d-99a38d02777c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d07769e-e519-4608-81c6-5beadc62da41 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c" status: 404 len: 111 microversion: 2.1 time: 0.034115 Jul 18 02:30:02.197674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1650/3350] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/60fb7154-5239-40f6-b79d-99a38d02777c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:30:02.213657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f2e4eb5-e963-410a-9662-682f092e2f30 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '.version_select at 0x7fab04303b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.251805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8f2e4eb5-e963-410a-9662-682f092e2f30 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Image not found. Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f2e4eb5-e963-410a-9662-682f092e2f30 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 HTTP/1.1 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: exception: Image not found. Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '5c84dfd0-aee6-43d5-9628-cc7b807ac5a7'} Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 to delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 could not be found. Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.255766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 18 02:30:02.263094 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.266834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f2e4eb5-e963-410a-9662-682f092e2f30 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Image not found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.267753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f2e4eb5-e963-410a-9662-682f092e2f30 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7" status: 404 len: 62 microversion: 2.1 time: 0.060193 Jul 18 02:30:02.272549 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1651/3351] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] DELETE /compute/v2.1/images/5c84dfd0-aee6-43d5-9628-cc7b807ac5a7 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:02.283742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.284484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.298563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.299349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.301339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.302875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.304367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:02.319173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3214f37-819d-48e7-9b0b-fb5b8684c1dc tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1511 microversion: 2.1 time: 0.254674 Jul 18 02:30:02.320040 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1701/3352] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:02.326240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 HTTP/1.1 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '421978c4-4f6a-4cec-9c46-518ae92112c3'} Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:02.328360 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e759f524-0adc-4fbb-861e-8e7204635199 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 404 len: 111 microversion: 2.1 time: 0.055116 Jul 18 02:30:02.336389 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1652/3353] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:02 2022] DELETE /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:30:02.345063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.346531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] [instance: 421978c4-4f6a-4cec-9c46-518ae92112c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.360552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.361721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.374678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.375477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.384595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.385537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.395919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.396704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.398343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.399146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.456222 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] HTTP exception thrown: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Request method failure captured: Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 HTTP/1.1 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MRV7qJhdHQhzfKTdUVU-AB92WK_pB2asJG_8J7NNOYWg84gjLwvZB1aMXKbmrTqonkFrbYaW-iYm62SzkVxUAJnhYt_hksQ49a6IFrUpv6QLTVyj11lmQuehtva8k7VShW3rE-BRi_M7o2AvIF7Cma_zU3zf436zI9A-5FmaJNHw8g Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e406623bbd284f9f8deef088cadbe361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e406623bbd284f9f8deef088cadbe361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e406623bbd284f9f8deef088cadbe361 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ImagesTestJSON-831338689 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 927f29b5f43d405ca9d3fed68e53cdb1 Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ImagesTestJSON-831338689-project Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '421978c4-4f6a-4cec-9c46-518ae92112c3'} Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.467584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] Returning 404 to user: Instance 421978c4-4f6a-4cec-9c46-518ae92112c3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76e40cce-8304-4d5e-a122-5c79a4b81e49 tempest-ImagesTestJSON-831338689 tempest-ImagesTestJSON-831338689-project] 10.222.0.67 "GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3" status: 404 len: 111 microversion: 2.1 time: 0.132607 Jul 18 02:30:02.471881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1702/3354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/421978c4-4f6a-4cec-9c46-518ae92112c3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:02.498991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:02.500292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:02.524798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.525577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:02.527073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:02.527829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.029753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.034163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.042909 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fa908dda-6454-4aff-b655-10dd24eb2dff tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.691339 Jul 18 02:30:03.057450 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1653/3355] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:03.063911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.064837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:03.071905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.072639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.073699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.074344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.077326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4fd7354-41a5-43dd-a901-f02312bc3ea8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1573 microversion: 2.1 time: 0.590410 Jul 18 02:30:03.099600 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1703/3356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:02 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1573 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:03.117560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.119879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:03.120211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.120684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.121190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lazy-loading 'fault' on Instance uuid 746178a7-9071-46a0-bcb0-020f58d4d4d3 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:30:03.136863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.138872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.140900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.142833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.257435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.282538 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-791bd3f4-d8b5-47e3-b3c5-60e5c69ca6fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 200 len: 1304 microversion: 2.1 time: 0.219618 Jul 18 02:30:03.293024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1654/3357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:03 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:03.313566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.316114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:03.327336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.328043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.329052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.329586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.594045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.614796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.616995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.619739 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-308eb86b-619f-4f6b-b167-4ea48f528982 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1333 microversion: 2.47 time: 0.322402 Jul 18 02:30:03.620882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1655/3358] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:03 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1333 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:03.628804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:03.630730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:03.647379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.647862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.648909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:03.649405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:03.756138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:03.815063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a301f2d8-fa79-4635-8a54-9473bbc51e38 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.694110 Jul 18 02:30:03.816748 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1704/3359] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:03 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:04.012318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:04.034959 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-595ec474-8460-4355-8cb9-9d574a814474 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1517 microversion: 2.1 time: 0.411968 Jul 18 02:30:04.036642 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1656/3360] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:03 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:04.067890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:04.068668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:04.089632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:04.090483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:04.092988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:04.094141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:04.121468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:04.123280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:04.153627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:04.157845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:04.162063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:04.163738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.035558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.087698 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b355aa28-eec4-4b8e-9f88-f955d94a5c1c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1573 microversion: 2.1 time: 0.975770 Jul 18 02:30:05.105132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1657/3361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:04 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1573 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:05.125966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:05.135624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:05.162843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.163652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.170418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.173618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.209976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.214062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:05.248277 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84267040-58db-487e-a667-9f3f97ca9cb2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 1.175375 Jul 18 02:30:05.250251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:30:05.262499 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1705/3362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:04 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 HTTP/1.1 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '746178a7-9071-46a0-bcb0-020f58d4d4d3'} Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:05.277661 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:05.287983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7bb4df5-1b6a-4272-9fa4-e8670a02b5a0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 404 len: 111 microversion: 2.1 time: 0.177777 Jul 18 02:30:05.293736 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1658/3363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:05 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:05.296251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:05.299116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:05.324721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:05.326588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:05.333743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.334894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.343671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.344784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.370012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.371064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.381098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.381922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.676232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.730434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.743963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.749464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cab81baa-293c-4fc9-a184-f090eaba323c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1351 microversion: 2.47 time: 0.484267 Jul 18 02:30:05.757800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1706/3364] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:05 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1351 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:05.775695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c72c8721-e9b4-4115-9932-c08dea84125d req-38161f51-18f1-4e60-b961-1968218ec585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c70c4ba-5c4a-472c-b15b-744e640b5da8", "name": "network-vif-plugged", "status": "completed", "tag": "ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:05.811662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c72c8721-e9b4-4115-9932-c08dea84125d req-38161f51-18f1-4e60-b961-1968218ec585 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:05.818888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c72c8721-e9b4-4115-9932-c08dea84125d req-38161f51-18f1-4e60-b961-1968218ec585 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:05.846350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c72c8721-e9b4-4115-9932-c08dea84125d req-38161f51-18f1-4e60-b961-1968218ec585 service nova] Creating event network-vif-plugged:ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97 for instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 on n-h1-849796-1 Jul 18 02:30:05.859627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c72c8721-e9b4-4115-9932-c08dea84125d req-38161f51-18f1-4e60-b961-1968218ec585 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099009 Jul 18 02:30:05.861145 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1707/3365] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:05.882508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2054723710", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:05.891025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:05.916618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88da122a-9d54-4d6d-98bd-54a0fd44f102 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 0.621257 Jul 18 02:30:05.917270 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1659/3366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:05 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:06.081105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:06.136451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:06.137228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:06.154698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:06.155594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:06.158263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:06.163084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:06.520531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:06.541063 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d13a8624-2701-4295-a1ee-f67784237229 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1573 microversion: 2.1 time: 0.408278 Jul 18 02:30:06.554182 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1660/3367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:06 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1573 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:06.576595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:06.578604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:06.594505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:06.596908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:06.598986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:06.600072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.079753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:07.096276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5f299ae2-37d9-4509-9f5e-afbc2ff65fb9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.539627 Jul 18 02:30:07.098347 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1661/3368] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:06 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:07.113614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:07.115032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:07.129518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:07.131411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.131881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.139490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.140157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.381215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:07.433705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:07.443215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:07.469104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13a6cde6-94db-4cbb-a65b-0579f5827161 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1339 microversion: 2.47 time: 0.347973 Jul 18 02:30:07.475262 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1662/3369] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:07 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:07.495134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:07.499567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:07.515415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.516819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:07.518043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:07.519586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:08.541762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:08.558401 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54fb6830-2ae9-47c9-8a28-622e3d63b410 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1325 microversion: 2.1 time: 1.077854 Jul 18 02:30:08.559916 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1663/3370] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:07 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1325 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:08.570544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:08.572044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:08.593285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:08.594519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:08.596016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:08.597122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:08.935305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:08.952189 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b9be2651-25d0-4cb8-a764-a38e269f6bc3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1573 microversion: 2.1 time: 0.389018 Jul 18 02:30:08.954643 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1664/3371] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:08 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1573 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:08.968026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:30:08.969893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:30:08.970621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:30:08.971199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:30:08.972133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:08.983335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:08.988886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:08.990094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:08.991369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:08.991986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:08.997989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:09.020572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.021832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.024657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.026035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.030030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:09.043749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:09.078249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:09.083169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:09.199982 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08b0c6e4-0fbc-4b65-bd72-98a8138bb3c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.333128 Jul 18 02:30:09.202768 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1708/3372] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:30:09.211487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:09.228632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:09.248158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.248636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.249509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.249973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.323501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:09.334624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c684660c-cdaa-40ed-a586-460035ad106d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.377764 Jul 18 02:30:09.335607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1665/3373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:08 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:09.344617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-028a004d-6c77-4ab6-9849-9500465d6311 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: .version_select at 0x7fab04a8e310>, body: {"keypair": {"name": "tempest-keypair-1258267705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjl4+mmMQJQxUePIlDVLLJjtX3duOOKUXcVR7LVtfrXWrEL6bDYl0zsutpI4gcz4hB0Rw6Xpb06fFSvsFQQ9adcqbA5k3DX0k6rSZNL5HQ+m7OJQ0hCiZCcCtwK5BieeQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:09.364063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-028a004d-6c77-4ab6-9849-9500465d6311 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:09.371159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-028a004d-6c77-4ab6-9849-9500465d6311 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for user a5664e98b90c4542b9186b42ca89d99c and project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:09.413793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-028a004d-6c77-4ab6-9849-9500465d6311 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075691 Jul 18 02:30:09.415080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1666/3374] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:30:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:09.421266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec8f099d-a554-4d70-8671-01bb832e0ac0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:09.436235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec8f099d-a554-4d70-8671-01bb832e0ac0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:09.599248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec8f099d-a554-4d70-8671-01bb832e0ac0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:09.632821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec8f099d-a554-4d70-8671-01bb832e0ac0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1215 microversion: 2.1 time: 0.215984 Jul 18 02:30:09.638858 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1667/3375] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:09 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:09.658438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:09.667046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:09.680494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:09.691723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.692518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.696802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:09.697902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:09.703928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:09.712711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:09.718451 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4231b8d-a55c-41af-a303-3e1a83af2d85 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1339 microversion: 2.47 time: 0.509865 Jul 18 02:30:09.720843 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1709/3376] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:09 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1339 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:09.722887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:09.983060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:09.984390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:09.998365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.000091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.001901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.006440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.336455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:10.385963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d59925b-9d4c-4d37-9221-aae4cef53032 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1522 microversion: 2.1 time: 0.744737 Jul 18 02:30:10.397424 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1668/3377] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:09 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:10.416823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:10.421265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:10.437417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.438661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.439814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.444021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.741978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:10.759848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b2bbad2-c5ae-467b-a254-fe6f4fa80f36 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1571 microversion: 2.1 time: 0.782626 Jul 18 02:30:10.773505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1710/3378] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:09 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1571 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:10.789171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:10.789775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:10.805707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.806180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.807027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.807490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.885028 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] HTTP exception thrown: Action 999 not found Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Request method failure captured: Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8/os-instance-actions/999 HTTP/1.1 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MWPQJta1-oDhGFMkqtvsefIx2tL1XDanVbKKDa0feroH6xkW0pRNB-PqWm6_gKGQHVQiArYk5EaMBbee45VvNuAMO_efJnV_5Dw4jbysfKrlKj2EtxI_t1Guhto3W_KHUxHVa6tmcgVAJm7Ye7JCAvW-rYHo0GZIaOuJVdjzzhCyL4 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f3b9a855b25b4326989f13498e16ac82 Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: exception: Action 999 not found Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '1c70c4ba-5c4a-472c-b15b-744e640b5da8', 'id': '999'} Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 18 02:30:10.896216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:10.901689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Returning 404 to user: Action 999 not found {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:10.902869 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fdc5ee7a-45e4-49b3-84fe-a0e30bdae779 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.128451 Jul 18 02:30:10.913483 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1711/3379] 10.222.0.67 () {58 vars in 1307 bytes} [Mon Jul 18 02:30:10 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8/os-instance-actions/999 => generated 66 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:30:10.921800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:10.925173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:10.941946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.942863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:10.946029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:10.947397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.227840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:11.249328 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5424bd07-bd59-48b6-b951-7d6653d98638 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1219 microversion: 2.1 time: 0.331333 Jul 18 02:30:11.251277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1712/3380] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:10 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1219 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:11.277404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:11.281425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:11.297293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:11.302082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.304405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.306266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.307379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.328783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:11.342220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d28ac7df-23a6-42a3-a39f-c6e55910b71c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.931298 Jul 18 02:30:11.343894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1669/3381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:10 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:11.349441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-425175754"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:11.357459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:11.373210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.379365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.380852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.381628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.549701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:11.593329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:11.597463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:11.600078 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15ddf955-7e17-4ea2-956e-7204ff8b9eb7 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1360 microversion: 2.47 time: 0.346482 Jul 18 02:30:11.601535 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1713/3382] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:11 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1360 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:11.613296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '.version_select at 0x7fab04af23a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:11.614659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 470507a2-c49c-4ca0-b2e6-aea55daefb36] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:11.632989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] HTTP exception thrown: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Request method failure captured: Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/470507a2-c49c-4ca0-b2e6-aea55daefb36/os-instance-actions HTTP/1.1 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MWPQJta1-oDhGFMkqtvsefIx2tL1XDanVbKKDa0feroH6xkW0pRNB-PqWm6_gKGQHVQiArYk5EaMBbee45VvNuAMO_efJnV_5Dw4jbysfKrlKj2EtxI_t1Guhto3W_KHUxHVa6tmcgVAJm7Ye7JCAvW-rYHo0GZIaOuJVdjzzhCyL4 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f3b9a855b25b4326989f13498e16ac82 Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '470507a2-c49c-4ca0-b2e6-aea55daefb36'} Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:11.634364 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Returning 404 to user: Instance 470507a2-c49c-4ca0-b2e6-aea55daefb36 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef43e78c-7708-43fa-9b67-1a66d3471406 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/470507a2-c49c-4ca0-b2e6-aea55daefb36/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032416 Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1714/3383] 10.222.0.67 () {58 vars in 1295 bytes} [Mon Jul 18 02:30:11 2022] GET /compute/v2.1/servers/470507a2-c49c-4ca0-b2e6-aea55daefb36/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:11.651131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1231180292"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:11.657530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:11.670712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.671017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.671861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:11.672328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:11.793721 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Adding security group a4717974-08a2-43d5-a6bb-d1351a702c94 to port 74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 Jul 18 02:30:12.233526 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b15a52e-963e-4fff-8860-6cbbb004e0fd tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "POST /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05/action" status: 202 len: 52 microversion: 2.47 time: 0.593173 Jul 18 02:30:12.237123 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1715/3384] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:30:11 2022] POST /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05/action => generated 52 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:30:12.249171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:12.250712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:12.270795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.271620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:12.273181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.274011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:12.340656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:12.476906 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c25727b1-fdeb-41e9-b844-0da90b723f8c tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 204 len: 0 microversion: 2.1 time: 0.237267 Jul 18 02:30:12.483338 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1716/3385] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:12 2022] DELETE /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:30:12.493174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:12.494104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:12.503822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.506272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:12.507538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.508322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:12.550344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:12.788894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f725125-f700-4f15-83be-07b30376d0b3 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "DELETE /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 204 len: 0 microversion: 2.47 time: 0.303332 Jul 18 02:30:12.794248 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1717/3386] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:30:12 2022] DELETE /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:30:12.813575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:12.817813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:12.866477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.871470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:12.875892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:12.876421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:13.029970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:13.044637 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24312691-6ae2-4654-9c32-351fa6c17a94 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1273 microversion: 2.1 time: 0.246052 Jul 18 02:30:13.045806 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1718/3387] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:12 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:13.086648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:13.089003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:13.115406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:13.117372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:13.121019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:13.122508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:13.956978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a526c013-0275-4c25-9a41-de0d47e127e4 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action" status: 202 len: 0 microversion: 2.1 time: 2.611574 Jul 18 02:30:13.958694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1670/3388] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:30:11 2022] POST /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7/action => generated 0 bytes in 2614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:13.970488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:13.974601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:13.986922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:13.987785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:13.989937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:13.990816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:14.159023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:14.176089 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7fb60ea-4f3e-4187-a915-1c61a5689ab0 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 1.126350 Jul 18 02:30:14.177138 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1719/3389] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:13 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:14.186755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:14.194969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:14.206411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:14.209787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:14.211025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:14.213695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:14.249033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:14.547427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:14.594126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:14.598087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:14.601713 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e0df864-e6a4-4239-84ca-a9a441b53313 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1366 microversion: 2.47 time: 0.422182 Jul 18 02:30:14.621758 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1720/3390] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:14 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:14.635766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-50ff6092-748c-4274-8cf6-d5e2f98a0806 req-3a9fb1b8-b443-4f15-b64b-4124a23a2eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-plugged", "status": "completed", "tag": "ad9f3fb4-a6b2-4c53-b7a7-80bff212f491"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:14.656364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-50ff6092-748c-4274-8cf6-d5e2f98a0806 req-3a9fb1b8-b443-4f15-b64b-4124a23a2eb7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:14.659127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-50ff6092-748c-4274-8cf6-d5e2f98a0806 req-3a9fb1b8-b443-4f15-b64b-4124a23a2eb7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:14.700137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-50ff6092-748c-4274-8cf6-d5e2f98a0806 req-3a9fb1b8-b443-4f15-b64b-4124a23a2eb7 service nova] Creating event network-vif-plugged:ad9f3fb4-a6b2-4c53-b7a7-80bff212f491 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:14.717756 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-50ff6092-748c-4274-8cf6-d5e2f98a0806 req-3a9fb1b8-b443-4f15-b64b-4124a23a2eb7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092565 Jul 18 02:30:14.719119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1721/3391] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:14.726933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04e45af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:14.913054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:14.967180 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99388418-4abd-4d66-8ffb-e3f6b58eb57d tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1528 microversion: 2.1 time: 1.005777 Jul 18 02:30:14.969594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1671/3392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:13 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1528 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:14.991308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ab95b977-7620-49c7-b76e-0c0091f8a815 req-2cf37c82-65c5-4cc3-bbab-634a037cd198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95d20fc-549b-4e31-aba7-e4ed73bc28a7", "tag": "74f1dfe5-2825-4bdb-bd2f-ecdecc680e56"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:15.055800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ab95b977-7620-49c7-b76e-0c0091f8a815 req-2cf37c82-65c5-4cc3-bbab-634a037cd198 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:15.068668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ab95b977-7620-49c7-b76e-0c0091f8a815 req-2cf37c82-65c5-4cc3-bbab-634a037cd198 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:15.127889 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ab95b977-7620-49c7-b76e-0c0091f8a815 req-2cf37c82-65c5-4cc3-bbab-634a037cd198 service nova] Creating event network-changed:74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 for instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 on n-h1-849796-1 Jul 18 02:30:15.136713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ab95b977-7620-49c7-b76e-0c0091f8a815 req-2cf37c82-65c5-4cc3-bbab-634a037cd198 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164936 Jul 18 02:30:15.138370 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1672/3393] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:15.148011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:15.149176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:15.159470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:15.160783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:15.162158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:15.162975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:15.923075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use.", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:15.924734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.924734 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94 HTTP/1.1 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: exception: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'a4717974-08a2-43d5-a6bb-d1351a702c94'} Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:15.927138 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] Jul 18 02:30:15.931098 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:15.937223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 400 to user: Security Group a4717974-08a2-43d5-a6bb-d1351a702c94 in use. Jul 18 02:30:15.937223 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-11d30d9b-2f63-4d38-b1e7-ce795fca9ed3'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:15.939378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e9e9a4a-bb68-4a4c-94fe-fbd92d9b8744 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94" status: 400 len: 185 microversion: 2.1 time: 1.217826 Jul 18 02:30:15.940539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1722/3394] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:14 2022] DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94 => generated 185 bytes in 1220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:30:15.956309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:15.958845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:15.971954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:15.977222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:15.979059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:15.980520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.210335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:16.234043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f8fa6c3-60b0-4e4b-8a3d-f8568d36c679 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 1.093559 Jul 18 02:30:16.236783 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1673/3395] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:15 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:16.244291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:16.250824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:16.273368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.274096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.275120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.275767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.795392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:16.828290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c428730d-34ec-4e84-8fe0-507ce86bf934 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 0.886319 Jul 18 02:30:16.830207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1723/3396] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:15 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:16.917712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:16.919497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:16.938788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.940133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.944348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:16.945948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:16.968775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:16.998367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:17.006732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:17.036262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:17.048206 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14ea583b-6435-4a53-b33d-3c85d9d18e8a tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1366 microversion: 2.47 time: 0.807043 Jul 18 02:30:17.049453 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1674/3397] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:16 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1366 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:17.067244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:17.068207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:17.090303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:17.092530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:17.093996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:17.096067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:17.160403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-868ff055-401c-497a-bfd7-21595d21e0b3 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 204 len: 0 microversion: 2.1 time: 0.326929 Jul 18 02:30:17.162317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1724/3398] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:16 2022] DELETE /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:30:17.178482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2003343503", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c547de47-f38b-4e31-894b-bc19135e8d69"}], "security_groups": [{"name": "tempest-securitygroup--1179664033"}], "key_name": "tempest-keypair-1258267705", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:17.459565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b9a855b25b4326989f13498e16ac82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b3cc001b0e40a681c47c9d32aa2641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:17.484360 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eefbde76-cb53-43d1-ac4f-aefee7f7634a tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 200 len: 1486 microversion: 2.1 time: 0.431409 Jul 18 02:30:17.486313 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1675/3399] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:17 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 1486 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:17.508326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-plugged", "status": "completed", "tag": "22d79d61-9909-4823-b24b-f802288da837"}, {"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-plugged", "status": "completed", "tag": "412e919b-9bb2-416a-8b32-224c89ab10db"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:17.524688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:17.525310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:17.545591 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] Creating event network-vif-plugged:22d79d61-9909-4823-b24b-f802288da837 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:17.546027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] Creating event network-vif-plugged:412e919b-9bb2-416a-8b32-224c89ab10db for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:17.550787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] validate_networks() for [('c547de47-f38b-4e31-894b-bc19135e8d69', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:30:17.552312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2ca6b548-d13f-4c85-af35-92c267bb51ad req-11abf92f-c6e5-44d5-899d-1a59f3126432 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062772 Jul 18 02:30:17.553091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1676/3400] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:17.563220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:17.564204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:17.571963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:17.572757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:17.573655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:17.574135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.252942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:18.262180 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-984f8a51-be01-4619-acd2-1e84f847b15a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1645 microversion: 2.1 time: 0.704409 Jul 18 02:30:18.270236 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1677/3401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:17 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1645 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:18.281437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:18.284955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:18.305187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:18.306603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.310250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:18.311774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.904356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:18.925574 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e6f80d5b-49ce-4679-845e-014586dba399 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.648649 Jul 18 02:30:18.939451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1678/3402] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:18 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:18.955498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:18.967790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:18.990835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:18.991596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:18.993672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:18.997865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.005710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:19.059117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:19.181314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:30:19.182029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:30:19.182690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:30:19.183296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:30:19.183907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:30:19.199806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.201186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.202323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.203035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.256465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:30:19.264513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Getting quotas for user a5664e98b90c4542b9186b42ca89d99c and project 56e44aa1cfa64cc2a6786cc755ae7f1c. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:30:19.286155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:30:19.292995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:30:19.352679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e54fcce-3b67-44a0-9e7f-8629ca71ae91 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.187135 Jul 18 02:30:19.354050 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1725/3403] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:30:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:30:19.359426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6abe0b9f-d56d-4e5a-a424-7a3091a84b43 req-d0a9f57e-0112-4b8c-91b7-0253147a4a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c70c4ba-5c4a-472c-b15b-744e640b5da8", "name": "network-vif-deleted", "tag": "ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:19.369182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6abe0b9f-d56d-4e5a-a424-7a3091a84b43 req-d0a9f57e-0112-4b8c-91b7-0253147a4a54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.370147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6abe0b9f-d56d-4e5a-a424-7a3091a84b43 req-d0a9f57e-0112-4b8c-91b7-0253147a4a54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.384672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6abe0b9f-d56d-4e5a-a424-7a3091a84b43 req-d0a9f57e-0112-4b8c-91b7-0253147a4a54 service nova] Creating event network-vif-deleted:ad4b945f-4fc5-4353-9cfc-bfd2e1b5ac97 for instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 on n-h1-849796-1 Jul 18 02:30:19.442781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6abe0b9f-d56d-4e5a-a424-7a3091a84b43 req-d0a9f57e-0112-4b8c-91b7-0253147a4a54 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087209 Jul 18 02:30:19.453050 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1726/3404] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:19.467982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:19.469060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:19.477716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.479029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.480087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.481437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.633607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:19.874585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:19.888548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:19.896966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07fc6801a5c445f7872c290b6e0c4940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440578d96c8c4e87bba5db201f10dc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:19.902001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b543dbd-f466-495a-aa83-b2739cad6376 tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 200 len: 1366 microversion: 2.47 time: 0.441272 Jul 18 02:30:19.916485 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1727/3405] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:19 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:30:19.932168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:19.932968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] [instance: 1c70c4ba-5c4a-472c-b15b-744e640b5da8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:19.949883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.953910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.957559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:19.958297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:19.984568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] HTTP exception thrown: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Request method failure captured: Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 HTTP/1.1 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MWPQJta1-oDhGFMkqtvsefIx2tL1XDanVbKKDa0feroH6xkW0pRNB-PqWm6_gKGQHVQiArYk5EaMBbee45VvNuAMO_efJnV_5Dw4jbysfKrlKj2EtxI_t1Guhto3W_KHUxHVa6tmcgVAJm7Ye7JCAvW-rYHo0GZIaOuJVdjzzhCyL4 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5b3cc001b0e40a681c47c9d32aa2641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5b3cc001b0e40a681c47c9d32aa2641 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-217909919 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f3b9a855b25b4326989f13498e16ac82 Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-217909919-project Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1c70c4ba-5c4a-472c-b15b-744e640b5da8'} Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:19.986749 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. Jul 18 02:30:19.990879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:19.992896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] Returning 404 to user: Instance 1c70c4ba-5c4a-472c-b15b-744e640b5da8 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:19.994625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6bd22c15-7bf2-43db-94e0-0480cff98bb9 tempest-InstanceActionsNegativeTestJSON-217909919 tempest-InstanceActionsNegativeTestJSON-217909919-project] 10.222.0.67 "GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8" status: 404 len: 111 microversion: 2.1 time: 0.076811 Jul 18 02:30:19.996317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1728/3406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:19 2022] GET /compute/v2.1/servers/1c70c4ba-5c4a-472c-b15b-744e640b5da8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:20.005140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:20.006537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:20.018415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:20.019175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:20.020274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:20.021219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:20.066858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:20.106750 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6806f4e8-2c33-4b8c-b818-af48f0a9b879 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1355 microversion: 2.1 time: 1.163098 Jul 18 02:30:20.107428 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1679/3407] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:18 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1355 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:20.117233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-caac32cb-36c4-4027-a3ac-24ddbc250165 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:20.118203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-caac32cb-36c4-4027-a3ac-24ddbc250165 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:20.451118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-caac32cb-36c4-4027-a3ac-24ddbc250165 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:20.488593 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-caac32cb-36c4-4027-a3ac-24ddbc250165 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1246 microversion: 2.1 time: 0.377450 Jul 18 02:30:20.490990 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1680/3408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:20 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1246 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:20.530415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:20.531223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:20.557916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:20.558617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:20.559868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:20.560749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.234112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:21.312279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19a78d4c-52cc-4f0b-82f0-1b5a10e48ccb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.818796 Jul 18 02:30:21.321010 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1681/3409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:20 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:21.342875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:21.344028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] [instance: decf06fc-82bf-425d-948c-3abe0fccef05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:21.371356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.373342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.374693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.381598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.454042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] HTTP exception thrown: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Request method failure captured: Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 HTTP/1.1 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MWmcFtWudurZdWkhqmROoJ6VRhLd3TU-mrBB44nXhEugQtlKObbM4cmUO1Jv41_iUeaWDzblSRE0tjCIq9ekKLeWwrInLcwU1EIu-fu1lN9kPEKJ607dxHa3Wm-k1es1mLLi960Rp5D2ZAzocs1P-e5ZfAjKXnOs38PQD83C5Pj_NY Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 440578d96c8c4e87bba5db201f10dc42 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAaction247Test-229325624 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/440578d96c8c4e87bba5db201f10dc42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_440578d96c8c4e87bba5db201f10dc42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/440578d96c8c4e87bba5db201f10dc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/440578d96c8c4e87bba5db201f10dc42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAaction247Test-229325624 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 440578d96c8c4e87bba5db201f10dc42 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAaction247Test-229325624 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAaction247Test-229325624-project Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 07fc6801a5c445f7872c290b6e0c4940 Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAaction247Test-229325624-project Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'decf06fc-82bf-425d-948c-3abe0fccef05'} Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:21.463358 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:21.468701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] Returning 404 to user: Instance decf06fc-82bf-425d-948c-3abe0fccef05 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:21.471664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4f780ade-8028-43d6-92fe-4b1bfd2cad4c tempest-ServersAaction247Test-229325624 tempest-ServersAaction247Test-229325624-project] 10.222.0.67 "GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05" status: 404 len: 111 microversion: 2.47 time: 0.148550 Jul 18 02:30:21.473329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:21.475193 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1682/3410] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:30:21 2022] GET /compute/v2.1/servers/decf06fc-82bf-425d-948c-3abe0fccef05 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:30:21.503189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:21.509337 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6077dfef-6dd7-482a-ae2f-f490faf18583 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1645 microversion: 2.1 time: 1.509968 Jul 18 02:30:21.510032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:21.510446 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1729/3411] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:19 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1645 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:21.541985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.542810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.547419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.551492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.567554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:21.568602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:21.588434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.597055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:21.599089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:21.608084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.158450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:22.171174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7065af56-a616-4b63-9507-a17f23f29e10 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1306 microversion: 2.1 time: 0.634612 Jul 18 02:30:22.171789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1730/3412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:21 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1306 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:22.196555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-98238e48-aa05-486a-9f8c-f784ddffb427 req-3a2790cf-8b8f-476b-9637-86e96141f4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33060fc5-8a98-4fa7-88b7-b45721489fed", "tag": "d61a9228-42d9-4ba6-9ee7-36c0161d3c9a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:22.225201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-98238e48-aa05-486a-9f8c-f784ddffb427 req-3a2790cf-8b8f-476b-9637-86e96141f4f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.225663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-98238e48-aa05-486a-9f8c-f784ddffb427 req-3a2790cf-8b8f-476b-9637-86e96141f4f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.255888 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-98238e48-aa05-486a-9f8c-f784ddffb427 req-3a2790cf-8b8f-476b-9637-86e96141f4f9 service nova] Creating event network-changed:d61a9228-42d9-4ba6-9ee7-36c0161d3c9a for instance 33060fc5-8a98-4fa7-88b7-b45721489fed on n-h1-849796-1 Jul 18 02:30:22.277605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-98238e48-aa05-486a-9f8c-f784ddffb427 req-3a2790cf-8b8f-476b-9637-86e96141f4f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104509 Jul 18 02:30:22.279038 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1731/3413] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:22.338989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:22.339714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:22.357995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.365877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.367655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.378706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.824498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:22.846124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:22.847042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef1b48ca-44dd-482a-b97a-60c53cf9aa28 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1802 microversion: 2.1 time: 1.368070 Jul 18 02:30:22.855279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af08b42e-4ad7-4e02-80b1-590d36d0b200 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.520503 Jul 18 02:30:22.865623 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1732/3414] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:22 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:22.872771 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1683/3415] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:21 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1802 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:22.876027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9375f41e-f9b9-4f98-92e6-d22c1fe903dd req-1652ae4f-c77b-4044-a4e3-2f971cd1822a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95d20fc-549b-4e31-aba7-e4ed73bc28a7", "name": "network-vif-deleted", "tag": "74f1dfe5-2825-4bdb-bd2f-ecdecc680e56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:22.888046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:22.889299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:22.897371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9375f41e-f9b9-4f98-92e6-d22c1fe903dd req-1652ae4f-c77b-4044-a4e3-2f971cd1822a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.897944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9375f41e-f9b9-4f98-92e6-d22c1fe903dd req-1652ae4f-c77b-4044-a4e3-2f971cd1822a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.901916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.903631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.905351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.907342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.922979 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9375f41e-f9b9-4f98-92e6-d22c1fe903dd req-1652ae4f-c77b-4044-a4e3-2f971cd1822a service nova] Creating event network-vif-deleted:74f1dfe5-2825-4bdb-bd2f-ecdecc680e56 for instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 on n-h1-849796-1 Jul 18 02:30:22.938672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9375f41e-f9b9-4f98-92e6-d22c1fe903dd req-1652ae4f-c77b-4044-a4e3-2f971cd1822a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067868 Jul 18 02:30:22.939995 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1733/3416] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:22.987676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:22.988632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:22.989249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lazy-loading 'fault' on Instance uuid e95d20fc-549b-4e31-aba7-e4ed73bc28a7 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:30:23.203939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:23.220665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ebdbd3e3-21b0-483c-8e25-6c070fb23f33 tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] Calling method '.version_select at 0x7fab04eebc10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.227502 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c734be07-be84-441e-befb-82ad84997e1a tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 200 len: 1305 microversion: 2.1 time: 0.353126 Jul 18 02:30:23.240487 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1684/3417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:22 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 1305 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:23.246161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.259180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.289597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.295392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.299327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.302800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.337618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ebdbd3e3-21b0-483c-8e25-6c070fb23f33 tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] 10.222.0.67 "GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef" status: 200 len: 784 microversion: 2.1 time: 0.396067 Jul 18 02:30:23.338408 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1734/3418] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Jul 18 02:30:22 2022] GET /compute/v2.1/images/8c01d435-c8d4-440f-bb6f-419ec4a428ef => generated 784 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:23.366626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.368307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.386029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.387054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.388791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.389648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.429729 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d158027-1a42-4860-910d-ef16ab20257b tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b/ips" status: 200 len: 215 microversion: 2.1 time: 0.179261 Jul 18 02:30:23.431735 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1685/3419] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b/ips => generated 215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:23.460965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a279c09-fa2f-4925-8dd8-d7ab4778ebc4 tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] Calling method '.version_select at 0x7fab04964310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.541296 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a279c09-fa2f-4925-8dd8-d7ab4778ebc4 tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] 10.222.0.67 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.107665 Jul 18 02:30:23.542215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1686/3420] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/images => generated 445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:23.552543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.554942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.571243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.572306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.583085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.583892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.623219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:23.643569 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e4efff7-79fc-490a-a442-32d2e1e640ff tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1304 microversion: 2.1 time: 0.301925 Jul 18 02:30:23.646146 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1735/3421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:23.659623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5043c02-d8ea-49ee-8455-c99411a0fd6f tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] Calling method '.version_select at 0x7fab04e1e550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.679318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:23.769233 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5043c02-d8ea-49ee-8455-c99411a0fd6f tempest-ListImagesTestJSON-1658734814 tempest-ListImagesTestJSON-1658734814-project] 10.222.0.67 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.118412 Jul 18 02:30:23.770647 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1736/3422] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:23.802448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:23.883432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.884179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.901844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.902617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.905510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.906569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a6dc983-dfea-4dfe-bf3b-5506201c708c tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 204 len: 0 microversion: 2.1 time: 0.362680 Jul 18 02:30:23.907449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.907660 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1687/3423] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:23 2022] DELETE /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:30:23.917226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:23.930629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:23.949808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.955383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:23.956581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:23.957478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:24.348424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:24.389988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76138009-f728-409f-b884-e0c4bcb512e7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.510668 Jul 18 02:30:24.393197 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1737/3424] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:24.399815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:24.400815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:24.409892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.411488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:24.433838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.437369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:24.484873 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 HTTP/1.1 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e95d20fc-549b-4e31-aba7-e4ed73bc28a7'} Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:24.499763 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:24.503825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:24.506115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:24.507325 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d60e99c5-8fa8-487e-b437-a68f6ac3300c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 404 len: 111 microversion: 2.1 time: 0.112737 Jul 18 02:30:24.511594 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1738/3425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:24 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:24.517890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b8f92f6-fac3-453b-b58e-d34d7a06e625 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04ed9c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:24.896873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:24.907488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3425ea3a-d4d7-402f-863e-ac6ec80ae773 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1808 microversion: 2.1 time: 0.994861 Jul 18 02:30:24.922415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1688/3426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:23 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1808 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:24.929075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:24.930100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:24.941341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.942970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:24.944367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:24.945249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:25.126835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:25.142307 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-485f1fa8-e1da-494b-9f6e-4bd034598cf6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1304 microversion: 2.1 time: 0.217984 Jul 18 02:30:25.156625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1689/3427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:24 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:25.429445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:25.436978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:25.461869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:25.472844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:25.478643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:25.485710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:25.838437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b8f92f6-fac3-453b-b58e-d34d7a06e625 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a" status: 202 len: 0 microversion: 2.1 time: 1.324593 Jul 18 02:30:25.840076 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1739/3428] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:24 2022] DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:25.848833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-073d4075-fd5e-48cc-afc7-449e9073823e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04e451f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:26.192645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:26.229228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b20a7bb-5efe-46d4-85bd-20ee0e1c3c4a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.808853 Jul 18 02:30:26.230470 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1690/3429] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:25 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:26.298115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:26.299523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:26.323890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:26.324701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:26.327016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:26.328263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:26.835411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:26.847815 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7155ae1-4ef8-4520-9776-b47daf87aeaf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1808 microversion: 2.1 time: 0.592754 Jul 18 02:30:26.859074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1691/3430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:26 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1808 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:26.866150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:26.867142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:26.877199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:26.878107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:26.879709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:26.880851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.267479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:27.297893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61dc0eba-1dd3-4d5b-a4ca-9278ef71f9c3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 0.436708 Jul 18 02:30:27.299753 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1692/3431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:26 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:27.306402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:27.307529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:27.318401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.319544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.320837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.321729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.688997 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-073d4075-fd5e-48cc-afc7-449e9073823e tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94" status: 202 len: 0 microversion: 2.1 time: 1.843237 Jul 18 02:30:27.692768 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1740/3432] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:25 2022] DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94 => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:30:27.716491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42e71a1c-2fa6-461b-9ee9-88d124c35fd2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'create', calling method: .version_select at 0x7fab04eb40d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-690949810", "description": "tempest-description-1474808640"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:27.742341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:27.762141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2739b702-90be-48cb-8e31-96bebbce97e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 0.459957 Jul 18 02:30:27.778760 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1693/3433] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:27 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:27.869546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:27.871064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:27.900818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.901750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:27.903043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:27.903871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:28.942733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:28.958950 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c88de194-f031-40c3-a4db-20a3464c2722 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1808 microversion: 2.1 time: 1.096933 Jul 18 02:30:28.973557 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42e71a1c-2fa6-461b-9ee9-88d124c35fd2 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.254295 Jul 18 02:30:28.973557 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1741/3434] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:30:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:28.974131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:28.974352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:28.975676 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1694/3435] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:27 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1808 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:28.991377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:28.992391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:28.993364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:28.993833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:28.994647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:29.000960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:29.003226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:29.004007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:29.005166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:29.006837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:29.246593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:29.283322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:29.970246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:29.987926 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd0235ef-ec24-4452-a2e2-ee98b1bd723c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 1.010519 Jul 18 02:30:29.989509 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1695/3436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:28 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:30.002724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f258cabe-72a6-4196-977f-5c681be48dce tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Action: 'update', calling method: .version_select at 0x7fab047eaee0>, body: {"security_group": {"name": "tempest-sg-hth-798552969", "description": "tempest-description-hth-1521771962"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:30.244016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:30.261740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2448904d-520a-4042-baae-c9e9b4618cea tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 1.293073 Jul 18 02:30:30.264455 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1742/3437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:28 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:30.283322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0ddce1b6-3ece-4e24-8351-bdddecd35e7f req-62e8fc58-f6f3-4d3e-98e8-039497ff0f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-deleted", "tag": "ad9f3fb4-a6b2-4c53-b7a7-80bff212f491"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:30.300627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ddce1b6-3ece-4e24-8351-bdddecd35e7f req-62e8fc58-f6f3-4d3e-98e8-039497ff0f37 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:30.301152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0ddce1b6-3ece-4e24-8351-bdddecd35e7f req-62e8fc58-f6f3-4d3e-98e8-039497ff0f37 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:30.318282 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0ddce1b6-3ece-4e24-8351-bdddecd35e7f req-62e8fc58-f6f3-4d3e-98e8-039497ff0f37 service nova] Creating event network-vif-deleted:ad9f3fb4-a6b2-4c53-b7a7-80bff212f491 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:30.328478 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0ddce1b6-3ece-4e24-8351-bdddecd35e7f req-62e8fc58-f6f3-4d3e-98e8-039497ff0f37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061049 Jul 18 02:30:30.330689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1743/3438] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:30.338321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:30.340129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:30.370325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:30.370703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:30.373033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:30.375064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:30.478953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:31.058409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f258cabe-72a6-4196-977f-5c681be48dce tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d" status: 200 len: 217 microversion: 2.1 time: 1.063849 Jul 18 02:30:31.061380 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1696/3439] 10.222.0.67 () {60 vars in 1289 bytes} [Mon Jul 18 02:30:29 2022] PUT /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d => generated 217 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.082354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-98459cc8-7239-43be-a371-e505367a1ca7 req-2ce67f15-c0f3-4bdd-9db1-da0ef760ebe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33060fc5-8a98-4fa7-88b7-b45721489fed", "name": "network-vif-plugged", "status": "completed", "tag": "d61a9228-42d9-4ba6-9ee7-36c0161d3c9a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:31.131366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-98459cc8-7239-43be-a371-e505367a1ca7 req-2ce67f15-c0f3-4bdd-9db1-da0ef760ebe6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.133639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-98459cc8-7239-43be-a371-e505367a1ca7 req-2ce67f15-c0f3-4bdd-9db1-da0ef760ebe6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.182468 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-98459cc8-7239-43be-a371-e505367a1ca7 req-2ce67f15-c0f3-4bdd-9db1-da0ef760ebe6 service nova] Creating event network-vif-plugged:d61a9228-42d9-4ba6-9ee7-36c0161d3c9a for instance 33060fc5-8a98-4fa7-88b7-b45721489fed on n-h1-849796-1 Jul 18 02:30:31.188462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:31.204012 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15fc8d09-0c88-4e9c-9cb6-97d1205b0a84 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1787 microversion: 2.1 time: 0.871495 Jul 18 02:30:31.204495 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-98459cc8-7239-43be-a371-e505367a1ca7 req-2ce67f15-c0f3-4bdd-9db1-da0ef760ebe6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138249 Jul 18 02:30:31.204996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1744/3440] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:30 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1787 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:31.205769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1697/3441] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.214845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7817048-41c5-4889-8f14-fc781cffaacb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab047eac10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.226951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.227597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:31.254241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.258167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.259653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.260435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.534896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7817048-41c5-4889-8f14-fc781cffaacb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d" status: 200 len: 217 microversion: 2.1 time: 0.327561 Jul 18 02:30:31.535527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1698/3442] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d => generated 217 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:31.542984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:31.545334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:31.553569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.556018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:31.563993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:31.564895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:32.154149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:32.184672 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5de4b879-3552-49cd-a0b9-c3105b5bc122 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 0.646232 Jul 18 02:30:32.197231 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1699/3443] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:32.204636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73425042-60a5-464f-838f-076b95a62ed1 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04f78b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:32.801936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:32.827269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c72f503e-bd73-4766-b436-e323fe7daf61 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1315 microversion: 2.1 time: 1.617912 Jul 18 02:30:32.828831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1745/3444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:31 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1315 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:32.834785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:32.836364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:32.847135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:32.848065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:32.849269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:32.849995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:32.876421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:33.182349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73425042-60a5-464f-838f-076b95a62ed1 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d" status: 202 len: 0 microversion: 2.1 time: 0.982822 Jul 18 02:30:33.187579 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1700/3445] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:32 2022] DELETE /compute/v2.1/os-security-groups/5dee0533-4048-429e-9846-045abe304b1d => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:33.194751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-31aaf28d-2bff-4067-9a40-57e79e2ac182 req-446273f6-e055-4085-aa06-ec75fb193021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:33.229594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-31aaf28d-2bff-4067-9a40-57e79e2ac182 req-446273f6-e055-4085-aa06-ec75fb193021 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.230649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-31aaf28d-2bff-4067-9a40-57e79e2ac182 req-446273f6-e055-4085-aa06-ec75fb193021 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.281285 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-31aaf28d-2bff-4067-9a40-57e79e2ac182 req-446273f6-e055-4085-aa06-ec75fb193021 service nova] Creating event network-changed:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:30:33.297616 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-31aaf28d-2bff-4067-9a40-57e79e2ac182 req-446273f6-e055-4085-aa06-ec75fb193021 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106824 Jul 18 02:30:33.299812 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1701/3446] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:33.314742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4c31b1dc-be64-43b0-a557-c622f1966cb6 req-a96da5ee-6711-473d-bf7c-31ea4cc32f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-deleted", "tag": "412e919b-9bb2-416a-8b32-224c89ab10db"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:33.353579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c31b1dc-be64-43b0-a557-c622f1966cb6 req-a96da5ee-6711-473d-bf7c-31ea4cc32f90 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.354441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c31b1dc-be64-43b0-a557-c622f1966cb6 req-a96da5ee-6711-473d-bf7c-31ea4cc32f90 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.405624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4c31b1dc-be64-43b0-a557-c622f1966cb6 req-a96da5ee-6711-473d-bf7c-31ea4cc32f90 service nova] Creating event network-vif-deleted:412e919b-9bb2-416a-8b32-224c89ab10db for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:33.421648 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4c31b1dc-be64-43b0-a557-c622f1966cb6 req-a96da5ee-6711-473d-bf7c-31ea4cc32f90 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117044 Jul 18 02:30:33.428166 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1702/3447] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:33.453975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:33.458157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:33.479792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.489024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.491375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.493519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.529120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 HTTP/1.1 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'e95d20fc-549b-4e31-aba7-e4ed73bc28a7'} Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:33.533753 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b89b9b4e-0daf-47a6-9bc9-7376d96165e9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 404 len: 111 microversion: 2.1 time: 0.107712 Jul 18 02:30:33.547802 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1703/3448] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:33 2022] DELETE /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:33.551290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:33.556656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:33.571146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.572392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:33.574825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:33.576680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.120852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:34.152033 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f587602d-ede4-4e6a-b73e-25c58fdf6bc2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1610 microversion: 2.1 time: 1.320464 Jul 18 02:30:34.154847 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1746/3449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:32 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1610 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:34.171689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0d24759e-fa1f-40ed-93c5-aaba0fc51188 req-70f532f8-97e1-4d8e-b217-8ba4b7fac616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-unplugged", "status": "completed", "tag": "22d79d61-9909-4823-b24b-f802288da837"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:34.185652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0d24759e-fa1f-40ed-93c5-aaba0fc51188 req-70f532f8-97e1-4d8e-b217-8ba4b7fac616 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:34.187521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0d24759e-fa1f-40ed-93c5-aaba0fc51188 req-70f532f8-97e1-4d8e-b217-8ba4b7fac616 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.263138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0d24759e-fa1f-40ed-93c5-aaba0fc51188 req-70f532f8-97e1-4d8e-b217-8ba4b7fac616 service nova] Creating event network-vif-unplugged:22d79d61-9909-4823-b24b-f802288da837 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:34.279836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0d24759e-fa1f-40ed-93c5-aaba0fc51188 req-70f532f8-97e1-4d8e-b217-8ba4b7fac616 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109457 Jul 18 02:30:34.280810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1747/3450] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:34.306717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:34.308479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: e95d20fc-549b-4e31-aba7-e4ed73bc28a7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:34.326647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:34.327386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.328431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:34.329583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.365078 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 HTTP/1.1 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e95d20fc-549b-4e31-aba7-e4ed73bc28a7'} Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.370236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. Jul 18 02:30:34.378915 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.381226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Instance e95d20fc-549b-4e31-aba7-e4ed73bc28a7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:34.382448 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-44ed8309-e5d6-4825-b227-5e24c15c1d0f tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7" status: 404 len: 111 microversion: 2.1 time: 0.098548 Jul 18 02:30:34.386679 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1748/3451] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:34 2022] GET /compute/v2.1/servers/e95d20fc-549b-4e31-aba7-e4ed73bc28a7 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:34.395709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:34.395709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:34.408152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:34.409381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.410465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:34.412201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:34.581162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:34.595422 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3871084c-5186-4f00-a0d3-a956349faf25 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 1.054285 Jul 18 02:30:34.597955 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1704/3452] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:33 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:34.612274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04f23160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:34.751527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:34.752240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group a4717974-08a2-43d5-a6bb-d1351a702c94 not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:34.752702 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.752702 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94 HTTP/1.1 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a4717974-08a2-43d5-a6bb-d1351a702c94'} Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:34.754725 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group a4717974-08a2-43d5-a6bb-d1351a702c94 does not exist Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0b48a7cf-13df-4026-bd95-a2a60c513225'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc56113c-b35b-4c34-8651-a93bdb1ed40c tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94" status: 404 len: 194 microversion: 2.1 time: 0.156568 Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1705/3453] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:34 2022] DELETE /compute/v2.1/os-security-groups/a4717974-08a2-43d5-a6bb-d1351a702c94 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:34.769411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab047cc4c0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:34.915035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:34.916293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group 32e48972-1d48-4efb-b133-a474c3d2543a not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:34.917777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.917777 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a HTTP/1.1 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '32e48972-1d48-4efb-b133-a474c3d2543a'} Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:34.923372 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group 32e48972-1d48-4efb-b133-a474c3d2543a does not exist Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-6ac2a639-5fd7-441e-a9fb-df0cd7126b21'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c771e95-cbff-4b93-8bdf-ce8636bb9204 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a" status: 404 len: 194 microversion: 2.1 time: 0.164509 Jul 18 02:30:34.940940 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1706/3454] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:34 2022] DELETE /compute/v2.1/os-security-groups/32e48972-1d48-4efb-b133-a474c3d2543a => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:30:34.975739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab043ed8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:35.183841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:35.187128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:35.194476 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.194476 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c HTTP/1.1 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd3ec3ed9-bee0-44c7-80a4-b00334b7276c'} Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:35.204059 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] Jul 18 02:30:35.212232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:35.231604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group d3ec3ed9-bee0-44c7-80a4-b00334b7276c does not exist Jul 18 02:30:35.231604 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-e048ba5b-526a-4b2f-90f4-02f3aeeb1790'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:35.231604 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bab02153-9e05-4034-972d-d6fff3aabd34 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c" status: 404 len: 194 microversion: 2.1 time: 0.275869 Jul 18 02:30:35.231604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1707/3455] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:34 2022] DELETE /compute/v2.1/os-security-groups/d3ec3ed9-bee0-44c7-80a4-b00334b7276c => generated 194 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:35.254089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:35.256249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:35.285833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:35.290076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:35.291673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:35.293789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:35.294687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:35.748092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:35.779925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a2e971d-af0c-4e48-aaca-9e270c6748e5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1502 microversion: 2.1 time: 1.389890 Jul 18 02:30:35.786768 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1749/3456] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:34 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1502 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:35.833468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04bb1a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:36.046263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:36.047776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:36.048708 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.048708 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1 HTTP/1.1 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '76a5e66d-e55b-4f31-8482-3de8d730dbe1'} Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:36.053678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group 76a5e66d-e55b-4f31-8482-3de8d730dbe1 does not exist Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-63206407-2ee4-4b1e-809f-68a3f6ccbd2a'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:36.058641 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e043067-f684-444f-aa34-6048be784464 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1" status: 404 len: 194 microversion: 2.1 time: 0.249879 Jul 18 02:30:36.064301 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1750/3457] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:35 2022] DELETE /compute/v2.1/os-security-groups/76a5e66d-e55b-4f31-8482-3de8d730dbe1 => generated 194 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:36.078621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:36.088881 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46b0345b-7635-4d3e-a07a-2dad3a2201d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 200 len: 1455 microversion: 2.1 time: 0.852229 Jul 18 02:30:36.089741 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1708/3458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:35 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 1455 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:36.103800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-93583766-b19a-4fb3-a88c-2acab0ed6f6e req-bcf1bd2d-29d1-4dfc-a113-73283f9a642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202219e-3906-4a44-bfcb-ffac69d89b3b", "name": "network-vif-deleted", "tag": "22d79d61-9909-4823-b24b-f802288da837"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:36.112551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:36.117079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:36.132756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93583766-b19a-4fb3-a88c-2acab0ed6f6e req-bcf1bd2d-29d1-4dfc-a113-73283f9a642a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.133397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93583766-b19a-4fb3-a88c-2acab0ed6f6e req-bcf1bd2d-29d1-4dfc-a113-73283f9a642a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.155425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-93583766-b19a-4fb3-a88c-2acab0ed6f6e req-bcf1bd2d-29d1-4dfc-a113-73283f9a642a service nova] Creating event network-vif-deleted:22d79d61-9909-4823-b24b-f802288da837 for instance 5202219e-3906-4a44-bfcb-ffac69d89b3b on n-h2-849796-1 Jul 18 02:30:36.162443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.163279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.172467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.174653 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-93583766-b19a-4fb3-a88c-2acab0ed6f6e req-bcf1bd2d-29d1-4dfc-a113-73283f9a642a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078047 Jul 18 02:30:36.175440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1709/3459] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:36.177877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.192549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:36.193394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:36.205270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.205884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.207042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:36.207773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:36.281408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lazy-loading 'flavor' on Instance uuid 33060fc5-8a98-4fa7-88b7-b45721489fed {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:30:36.780985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:36.805472 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10a3d7e9-c835-4eda-83a7-b224358e64b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 0.719726 Jul 18 02:30:36.819421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1751/3460] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:36 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:36.845615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab0a74f940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:36.965954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:36.966800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:36.967719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.967719 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 HTTP/1.1 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43'} Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:36.969991 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] Jul 18 02:30:36.974421 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:36.978307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group 13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 does not exist Jul 18 02:30:36.978307 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-10ac6c6c-74ad-4189-9589-6ab1a5aa6007'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:36.979507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-987d2417-5b5c-43b8-9658-e35410ab84fb tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43" status: 404 len: 194 microversion: 2.1 time: 0.154831 Jul 18 02:30:36.985264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1752/3461] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:36 2022] DELETE /compute/v2.1/os-security-groups/13a7fdb6-f0c0-4497-8c3b-d728bcfa2e43 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:37.002332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab04c3f4c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.060197 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1c30a0c-557f-47a5-a83b-96b7852b6ea3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed/action" status: 202 len: 0 microversion: 2.1 time: 0.882305 Jul 18 02:30:37.064451 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1710/3462] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:30:36 2022] POST /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:37.065635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:30:37.066412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Neutron security group fe346f37-35b4-4e32-93ce-cefe93a0005a not found {{(pid=119439) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:30:37.067432 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.067432 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a HTTP/1.1 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'fe346f37-35b4-4e32-93ce-cefe93a0005a'} Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:30:37.071141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Security group fe346f37-35b4-4e32-93ce-cefe93a0005a does not exist Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-947ccfd4-534b-42e2-ad70-693c5af644c4'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ffd3abc-13f0-48a8-b401-71c613316523 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a" status: 404 len: 194 microversion: 2.1 time: 0.084761 Jul 18 02:30:37.076833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1753/3463] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:36 2022] DELETE /compute/v2.1/os-security-groups/fe346f37-35b4-4e32-93ce-cefe93a0005a => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:37.089991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.089991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:37.095247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.100606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:37.112785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.113938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.114814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.115279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.117046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.117756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.119659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.120225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.165774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:37.202846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:30:37.404727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:37.466609 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58493a1a-422b-4a95-80e2-52978113bf48 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 204 len: 0 microversion: 2.1 time: 0.382019 Jul 18 02:30:37.468981 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1754/3464] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:30:37 2022] DELETE /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:30:37.487936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.488744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:37.503716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.504189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.509178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.514597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.545926 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b HTTP/1.1 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5202219e-3906-4a44-bfcb-ffac69d89b3b'} Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:37.555256 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:30:37.560183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:37.560732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17f6f21a-0c48-4ccd-b006-ecf66b7663c1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 404 len: 111 microversion: 2.1 time: 0.084599 Jul 18 02:30:37.565885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1755/3465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:37 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:37.571570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:37.580472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:37.594679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.595463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:37.597018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:37.600186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:38.117036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:38.133634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5a8822b-fe3c-4d5b-907a-1e61e36eb07d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.058673 Jul 18 02:30:38.149499 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1711/3466] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:37 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:38.161992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:38.167278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:38.185494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:38.186740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:38.188777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:38.190700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:38.347937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:38.377364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-903de55f-90e5-45fd-bcc1-32c8c85746c7 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1647 microversion: 2.1 time: 0.808788 Jul 18 02:30:38.383918 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1756/3467] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:37 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1647 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:39.162836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:39.164419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:39.194653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:39.207330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:39.209418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:39.210789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:40.543946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:40.577660 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-722abd29-54ba-4f33-9ce1-865bb461dbc8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 2.425164 Jul 18 02:30:40.578773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1712/3468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:38 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:40.615472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:40.617343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:40.657352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:40.665531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:40.671464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:40.672806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:40.710203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:40.742185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c25643e-965f-4359-9ce9-75793b5b30b5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.586919 Jul 18 02:30:40.743761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1757/3469] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:39 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:41.629177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:41.631875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:41.646948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:41.648000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:41.652984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:41.654202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:42.222094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:42.277432 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f7024ae-ef4c-4c46-819a-f9e48fe21625 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 0.675347 Jul 18 02:30:42.282640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1758/3470] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:41 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:42.313168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:42.314469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:42.356433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:42.357254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:42.361173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:42.368035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:42.854136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:42.896102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b6c7c59-e83c-4348-bbfb-fab3c7b641a6 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1647 microversion: 2.1 time: 2.308939 Jul 18 02:30:42.900349 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1713/3471] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:40 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1647 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:43.320108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:43.324153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:43.354928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:43.357884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:43.367752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:43.370998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:43.531382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:43.564190 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcc54db6-404d-4840-9e47-f19b4bca75f3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.279165 Jul 18 02:30:43.571610 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1759/3472] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:42 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:43.944194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:43.945998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:43.988246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:43.990523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:43.996171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:43.997979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.588120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7859b13877c346ad9a6e8c2a9e38d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5379df4258724e15b439342b884c7dd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:44.602008 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eecdf137-7d42-45b0-b7e6-ad054b97655d tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 200 len: 1467 microversion: 2.1 time: 0.677150 Jul 18 02:30:44.602616 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1760/3473] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:43 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 1467 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:44.609936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2b2a9195-ad9c-4e88-bbca-0bf8aa648451 req-927bfbc7-a1ce-4cb6-b0ae-917df708d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb909f3-4a90-47dd-85c4-4f4648b29ba4", "name": "network-vif-deleted", "tag": "4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:44.636701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2b2a9195-ad9c-4e88-bbca-0bf8aa648451 req-927bfbc7-a1ce-4cb6-b0ae-917df708d7a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:44.637675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2b2a9195-ad9c-4e88-bbca-0bf8aa648451 req-927bfbc7-a1ce-4cb6-b0ae-917df708d7a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.670446 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2b2a9195-ad9c-4e88-bbca-0bf8aa648451 req-927bfbc7-a1ce-4cb6-b0ae-917df708d7a8 service nova] Creating event network-vif-deleted:4eeec520-cb4d-4e2b-8e0b-bc21bce5b9e8 for instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 on n-h1-849796-1 Jul 18 02:30:44.690364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2b2a9195-ad9c-4e88-bbca-0bf8aa648451 req-927bfbc7-a1ce-4cb6-b0ae-917df708d7a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086254 Jul 18 02:30:44.691413 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1761/3474] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:44.708138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:44.714709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:44.733404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:44.734170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.735169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:44.735805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:44.790595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:44.842374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ebde348-6393-4258-be92-e157ea4fde31 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 1.537426 Jul 18 02:30:44.852544 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1714/3475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:43 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:45.108839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a0439537-bfe0-48e5-8074-fbc85aa4252b req-fc7dc129-220c-4468-be77-9a5ab55f5781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "name": "network-vif-plugged", "status": "completed", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:45.146033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a0439537-bfe0-48e5-8074-fbc85aa4252b req-fc7dc129-220c-4468-be77-9a5ab55f5781 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:45.148567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a0439537-bfe0-48e5-8074-fbc85aa4252b req-fc7dc129-220c-4468-be77-9a5ab55f5781 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:45.201759 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a0439537-bfe0-48e5-8074-fbc85aa4252b req-fc7dc129-220c-4468-be77-9a5ab55f5781 service nova] Creating event network-vif-plugged:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:30:45.219282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a0439537-bfe0-48e5-8074-fbc85aa4252b req-fc7dc129-220c-4468-be77-9a5ab55f5781 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120221 Jul 18 02:30:45.235039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1715/3476] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:45.640204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:45.641875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] [instance: 8cb909f3-4a90-47dd-85c4-4f4648b29ba4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:45.663714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:45.665219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:45.666976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:45.668005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:45.767704 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] HTTP exception thrown: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Request method failure captured: Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 HTTP/1.1 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MVEBuaEi2YgRID7_v0mF03O-Bw5Pn5rAq5AKTCJhQDIF5he3d_y43ScaTaIFX-qVzouynnIjO-ZCz_VTCWDr_Gou_NP-2qkb7aeNzFnwskhBn7JDDfQ0TZipEb3VtRid4BSCH09XI2bf975XGoRT_ZVPLxfnQt-viztmeBZY7IdwTc Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5379df4258724e15b439342b884c7dd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5379df4258724e15b439342b884c7dd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5379df4258724e15b439342b884c7dd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 5379df4258724e15b439342b884c7dd6 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1869924442 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7859b13877c346ad9a6e8c2a9e38d584 Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupsTestJSON-1869924442-project Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8cb909f3-4a90-47dd-85c4-4f4648b29ba4'} Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:45.781140 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Returning 404 to user: Instance 8cb909f3-4a90-47dd-85c4-4f4648b29ba4 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:45.786418 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e69783e5-a62b-4025-b277-8df31eb80256 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4" status: 404 len: 111 microversion: 2.1 time: 0.155397 Jul 18 02:30:45.791286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1716/3477] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:45 2022] GET /compute/v2.1/servers/8cb909f3-4a90-47dd-85c4-4f4648b29ba4 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:30:45.812261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f74ccd1-e55b-4899-ba18-d423e4b0c8d9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab046d6f70>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:46.545526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:46.579005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd201916-3944-4fa2-879c-8465df084571 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.884240 Jul 18 02:30:46.593706 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1762/3478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:44 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:46.609268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:46.610348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:46.619894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:46.620818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:46.622581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:46.624640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:46.910502 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f74ccd1-e55b-4899-ba18-d423e4b0c8d9 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/42a35406-a4b4-422c-b788-bd5def5d45b6" status: 202 len: 0 microversion: 2.1 time: 1.115647 Jul 18 02:30:46.913384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1717/3479] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:45 2022] DELETE /compute/v2.1/os-security-groups/42a35406-a4b4-422c-b788-bd5def5d45b6 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:46.933244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6515c5d-add0-4f4f-971d-9880fb636eb8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] Calling method '.version_select at 0x7fab0a5b0280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:48.172301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:48.218284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74285eaa-9a55-46a3-861e-6cf3d5d6c2b6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1372 microversion: 2.1 time: 1.622380 Jul 18 02:30:48.219297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1763/3480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:46 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1372 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:48.232771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:48.233998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:48.275278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:48.281428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:48.285375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:48.289837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:49.473379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:49.489959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-377bde64-cb20-4c26-966b-00026521ac6f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.268267 Jul 18 02:30:49.490902 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1764/3481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:48 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:49.508903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:49.510087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:49.526153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:49.529795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:49.530948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:49.533237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:50.045147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6515c5d-add0-4f4f-971d-9880fb636eb8 tempest-SecurityGroupsTestJSON-1869924442 tempest-SecurityGroupsTestJSON-1869924442-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/b0cc062b-3407-4de5-a59c-bb2bc3dde6db" status: 202 len: 0 microversion: 2.1 time: 3.124359 Jul 18 02:30:50.047141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1718/3482] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:30:46 2022] DELETE /compute/v2.1/os-security-groups/b0cc062b-3407-4de5-a59c-bb2bc3dde6db => generated 0 bytes in 3127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:50.521014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:50.521826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:50.542598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:50.548362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:50.550506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:50.556581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:51.349163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:51.377226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18c69c7a-5e0a-42ac-8d79-516cd41fb42a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1566 microversion: 2.1 time: 1.877158 Jul 18 02:30:51.378435 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1765/3483] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:49 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1566 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:51.418689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:51.419678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:51.458078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:51.463452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:51.484696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:51.486940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:51.645418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:51.677674 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90affc6a-74c9-48a8-bdfc-31352845d5d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.163147 Jul 18 02:30:51.679240 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1719/3484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:50 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:52.010414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46b8f4c3-b848-48ac-b8c8-1c452405690b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.603673 Jul 18 02:30:52.016988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1766/3485] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:30:51 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-interface => generated 284 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:52.715679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:52.717115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:52.749114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.759200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:52.761312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:52.763728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:53.047661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8a28c58-da3b-4e66-ac77-dc2bb67f5aa9 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab04ed93a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1874796137", "description": "tempest-description-1142674199"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:53.140873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:53.179425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f73d1ae8-b639-4243-94ac-69699cde881c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 0.465553 Jul 18 02:30:53.190770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1720/3486] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:52 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:54.208290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:54.209782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:54.224698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:54.224698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:54.228481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:54.229314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:54.787670 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8a28c58-da3b-4e66-ac77-dc2bb67f5aa9 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.006448 Jul 18 02:30:54.794302 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1767/3487] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:30:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:30:54.806665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa3fe7ed-1500-4e98-a448-6e3947df9efa tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab0a7955e0>, body: {"security_group_rule": {"parent_group_id": "165bced6-f7bc-44cf-aeb1-66c7bfcb1a63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:55.070880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:55.098651 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c1e94f1-6d78-4931-aa1a-1b02230b8b65 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 0.893639 Jul 18 02:30:55.103023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1721/3488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:54 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:30:56.139465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:56.141213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:56.154286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:56.155473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:56.156602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:56.157618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:56.450184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:56.460485 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eda44e86-b908-4902-9a96-cb9ff074212e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 0.335228 Jul 18 02:30:56.461583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1722/3489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:56 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:56.783801 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa3fe7ed-1500-4e98-a448-6e3947df9efa tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.979723 Jul 18 02:30:56.787414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1768/3490] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:30:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:30:56.801673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-acb9aa64-6e91-4480-b78d-0158e359a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab045b6940>, body: {"security_group_rule": {"parent_group_id": "165bced6-f7bc-44cf-aeb1-66c7bfcb1a63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:30:56.939466 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-acb9aa64-6e91-4480-b78d-0158e359a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-acb9aa64-6e91-4480-b78d-0158e359a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 138 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: {"security_group_rule": {"parent_group_id": "165bced6-f7bc-44cf-aeb1-66c7bfcb1a63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: exception: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'security_group_rule': {'parent_group_id': '165bced6-f7bc-44cf-aeb1-66c7bfcb1a63', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:30:56.941701 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:30:56.949677 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:30:56.949677 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:30:56.949677 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 Jul 18 02:30:56.949677 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:30:56.957497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-acb9aa64-6e91-4480-b78d-0158e359a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: This rule already exists in group 165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:30:56.964051 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-acb9aa64-6e91-4480-b78d-0158e359a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.162970 Jul 18 02:30:56.967033 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1723/3491] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:30:56 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:30:56.981289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e15f9a4-e278-4e71-bc26-91657c76a66e tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab055ef700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:57.491374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:57.492278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:57.514097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:57.514984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:57.516728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:57.517436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:57.903450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:30:57.919451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0cb13a17-c7d4-4941-b8b7-0eada3768bb2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 0.436341 Jul 18 02:30:57.921074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1724/3492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:57 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:30:58.948425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:30:58.966758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:30:59.005306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:59.006639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:59.011035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:30:59.025361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:30:59.640679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e15f9a4-e278-4e71-bc26-91657c76a66e tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/b60361bc-2074-4fd7-8e54-8a2f6a720f30" status: 202 len: 0 microversion: 2.1 time: 2.668308 Jul 18 02:30:59.641870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1769/3493] 10.222.0.67 () {58 vars in 1286 bytes} [Mon Jul 18 02:30:56 2022] DELETE /compute/v2.1/os-security-group-rules/b60361bc-2074-4fd7-8e54-8a2f6a720f30 => generated 0 bytes in 2670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:30:59.655248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f13e467-3e1c-4444-8327-b7be7d5bb9cd tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab04eb44c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1168963920", "description": "tempest-description-1075416657"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:00.882971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:00.899591 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8de19e7-9d5b-43f6-aa46-3941f5f4b09d tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.965880 Jul 18 02:31:00.900556 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1725/3494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:30:58 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:00.915135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9acee127-eb96-4e4b-a74f-020933f2380b req-b95623b8-01e3-482f-a14f-604681de6902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:00.952489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9acee127-eb96-4e4b-a74f-020933f2380b req-b95623b8-01e3-482f-a14f-604681de6902 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:00.963927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9acee127-eb96-4e4b-a74f-020933f2380b req-b95623b8-01e3-482f-a14f-604681de6902 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:00.996483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9acee127-eb96-4e4b-a74f-020933f2380b req-b95623b8-01e3-482f-a14f-604681de6902 service nova] Creating event network-changed:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:31:01.017421 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9acee127-eb96-4e4b-a74f-020933f2380b req-b95623b8-01e3-482f-a14f-604681de6902 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114797 Jul 18 02:31:01.018769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1726/3495] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:01.455223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:01.568694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:01.920709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:01.923799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:01.939709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.940451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:01.941479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:01.950268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:03.080085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f13e467-3e1c-4444-8327-b7be7d5bb9cd tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 3.430474 Jul 18 02:31:03.093814 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1770/3496] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:30:59 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 3445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:03.218703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1189556057", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:03.277883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:03.291451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b54b5be2-6714-4dd9-a8bd-83a919000875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.376090 Jul 18 02:31:03.294123 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1727/3497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:01 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:03.302461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-991b6a30-1ae8-47fb-87ac-cd07c8beed26 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab0466cb80>, body: {"security_group_rule": {"parent_group_id": "37dd7e06-53e3-456a-b997-9ac2a732e6bd", "ip_protocol": "tcp", "from_port": 1947394969, "to_port": 22}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:03.393807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] validate_networks() for [('76305ca9-d1af-412c-b629-7ead74372066', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:31:03.579162 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-991b6a30-1ae8-47fb-87ac-cd07c8beed26 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Invalid port range 1947394969:22. Former value cannot be greater than the later Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-991b6a30-1ae8-47fb-87ac-cd07c8beed26 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 146 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: {"security_group_rule": {"parent_group_id": "37dd7e06-53e3-456a-b997-9ac2a732e6bd", "ip_protocol": "tcp", "from_port": 1947394969, "to_port": 22}} Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid port range 1947394969:22. Former value cannot be greater than the later Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'security_group_rule': {'parent_group_id': '37dd7e06-53e3-456a-b997-9ac2a732e6bd', 'ip_protocol': 'tcp', 'from_port': 1947394969, 'to_port': 22}}} Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1947394969:22. Former value cannot be greater than the later Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1947394969:22. Former value cannot be greater than the later Jul 18 02:31:03.581605 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1947394969:22. Former value cannot be greater than the later Jul 18 02:31:03.585807 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.589842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-991b6a30-1ae8-47fb-87ac-cd07c8beed26 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: Invalid port range 1947394969:22. Former value cannot be greater than the later {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:03.591148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-991b6a30-1ae8-47fb-87ac-cd07c8beed26 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.295227 Jul 18 02:31:03.592377 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1728/3498] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:03 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:03.606868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24fed0ab-3633-4c20-9f9e-4bb5cca2f943 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab048219d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-666545017", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:03.609329 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-24fed0ab-3633-4c20-9f9e-4bb5cca2f943 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Security group id should be uuid Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24fed0ab-3633-4c20-9f9e-4bb5cca2f943 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 130 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-666545017", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group id should be uuid Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-666545017', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:03.611190 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:03.615456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 18 02:31:03.615456 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:03.622481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24fed0ab-3633-4c20-9f9e-4bb5cca2f943 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: Security group id should be uuid {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:03.623855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24fed0ab-3633-4c20-9f9e-4bb5cca2f943 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021343 Jul 18 02:31:03.624740 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1729/3499] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:03 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:31:03.641719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8aff4e9a-4da4-45a2-9a48-9dc7088ef202 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab048214c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1955242865", "description": "tempest-description-1423607020"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:05.633969 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8aff4e9a-4da4-45a2-9a48-9dc7088ef202 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.997983 Jul 18 02:31:05.635978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1730/3500] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:03 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:05.650967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1375291736", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "292e9684-d278-4a56-b169-34b9997ee775"}, {"uuid": "7221ba5b-60b6-40a0-8007-e0709499dc8b"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:05.722096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:31:05.722997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:31:05.723868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:31:05.724609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:31:05.725356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:31:05.726240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=34 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:05.768982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.769787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.771263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:05.772035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:05.894609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] validate_networks() for [('292e9684-d278-4a56-b169-34b9997ee775', None, None, None, None, None), ('7221ba5b-60b6-40a0-8007-e0709499dc8b', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:31:05.914937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Getting quotas for project db2500ccf386475583649c645294e0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:05.939439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Getting quotas for user 021c3e5665f74561b93527eddf4956fd and project db2500ccf386475583649c645294e0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:06.016234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:31:06.026663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:31:06.271738 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f3e7a07-264a-4e45-9f67-a4b4a11bf601 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.175363 Jul 18 02:31:06.275306 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1771/3501] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:31:06.309183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:06.315840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:06.365548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.368762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:06.372015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:06.372765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:07.195824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:07.298835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1a0c40a-ee0f-472e-9ca4-b34954c4db29 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 1.017484 Jul 18 02:31:07.305319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1772/3502] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:06 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:07.327669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d53a61e9-8cad-441e-b12f-05412afb1be4 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab0591a820>, body: {"security_group_rule": {"parent_group_id": "440855a3-9c1a-48eb-8ad8-22df28c390d0", "ip_protocol": "tempest-999-1468705847", "from_port": 22, "to_port": 22}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:07.611498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-d53a61e9-8cad-441e-b12f-05412afb1be4 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Invalid IP protocol tempest-999-1468705847. Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d53a61e9-8cad-441e-b12f-05412afb1be4 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 157 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: {"security_group_rule": {"parent_group_id": "440855a3-9c1a-48eb-8ad8-22df28c390d0", "ip_protocol": "tempest-999-1468705847", "from_port": 22, "to_port": 22}} Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid IP protocol tempest-999-1468705847. Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'security_group_rule': {'parent_group_id': '440855a3-9c1a-48eb-8ad8-22df28c390d0', 'ip_protocol': 'tempest-999-1468705847', 'from_port': 22, 'to_port': 22}}} Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1468705847. Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1468705847. Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:07.613431 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1468705847. Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d53a61e9-8cad-441e-b12f-05412afb1be4 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: Invalid IP protocol tempest-999-1468705847. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d53a61e9-8cad-441e-b12f-05412afb1be4 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.304122 Jul 18 02:31:07.632737 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1773/3503] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:07 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:31:07.638839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:07.639494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:07.694118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:07.700685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:07.701801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:07.703508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:07.925063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:07.941237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0ba02a1-f0f7-4f13-b670-894c2f652ae2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1218 microversion: 2.1 time: 0.324508 Jul 18 02:31:07.953495 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1774/3504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:07 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:07.969666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f3ee4b4-ec77-48a4-9da4-e7d2a3def281 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab055dd790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1239249132", "description": "tempest-description-1426509828"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:08.546904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f3ee4b4-ec77-48a4-9da4-e7d2a3def281 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.591850 Jul 18 02:31:08.549277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1775/3505] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:08.559808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:08.560765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:08.596864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.604908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:08.607363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:08.611070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.677669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:31:10.679563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:31:10.680609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:31:10.688466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:31:10.689782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:31:10.749674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.758946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.766820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:10.771502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:10.796197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=70 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:10.822079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Getting quotas for project 2aeaf897fc3a45cbbbd2c4fba4bed525. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:10.839126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Getting quotas for user 95a91925d5ea4bdb91ed033db2658c5d and project 2aeaf897fc3a45cbbbd2c4fba4bed525. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:10.880747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:31:10.888707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:31:10.955873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:10.976714 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68e32c66-7668-4402-8f52-be8e6c606352 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1508 microversion: 2.1 time: 2.422884 Jul 18 02:31:10.979432 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1776/3506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:08 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1508 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:10.996685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f289df-3557-4ad8-948a-0b4446d06006 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab05624430>, body: {"security_group_rule": {"parent_group_id": "4dddb8bd-bc42-4d46-a28e-a1465aec4031", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:11.019527 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-02df8a03-f6d8-4079-9a0e-ebd95df12dd6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.381095 Jul 18 02:31:11.020712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1731/3507] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:31:11.026798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:11.029704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:11.040227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:11.041007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:11.042119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:11.043551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:11.209507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:11.225420 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e0d29e1-95a0-4590-9b94-5f494b9247f2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1272 microversion: 2.1 time: 0.202700 Jul 18 02:31:11.228059 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1732/3508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:11 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:11.237940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dc2bd03-3d34-4b5b-a288-c7e04790da6e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:11.239420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dc2bd03-3d34-4b5b-a288-c7e04790da6e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:11.394852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dc2bd03-3d34-4b5b-a288-c7e04790da6e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:11.405238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dc2bd03-3d34-4b5b-a288-c7e04790da6e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1213 microversion: 2.1 time: 0.173908 Jul 18 02:31:11.406404 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1733/3509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:11 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:11.505780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-355901028", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:11.595574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] validate_networks() for [('348c7688-29b0-401c-b57c-f46f0291099b', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:31:12.233037 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f8f289df-3557-4ad8-948a-0b4446d06006 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f289df-3557-4ad8-948a-0b4446d06006 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 138 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: {"security_group_rule": {"parent_group_id": "4dddb8bd-bc42-4d46-a28e-a1465aec4031", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4dddb8bd-bc42-4d46-a28e-a1465aec4031', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:31:12.242840 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f289df-3557-4ad8-948a-0b4446d06006 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8f289df-3557-4ad8-948a-0b4446d06006 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 1.262853 Jul 18 02:31:12.261525 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1777/3510] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 1270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:12.301105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:12.302837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:12.334998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.335865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.337017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.338226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.642295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:31:12.644099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:31:12.645470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:31:12.646567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:31:12.647662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:31:12.668830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.671189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.673939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:12.676184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:12.725414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Getting quotas for project d5474a9be5f5469f94ec7c616dc6dcea. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:31:12.743495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Getting quotas for user 0b4a69db71d04ff9b70d30a3930f84ce and project d5474a9be5f5469f94ec7c616dc6dcea. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:31:12.773173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:31:12.780327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:31:12.936917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5021d75a-b592-41d8-bc5f-1dde42f6d197 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528184 Jul 18 02:31:12.942394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1734/3511] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:31:12.967110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fcb9ead3-2bf9-4a8f-bc29-95533760c40f tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab05297430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1291088673", "description": "tempest-description-717213099"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:14.123999 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fcb9ead3-2bf9-4a8f-bc29-95533760c40f tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.170530 Jul 18 02:31:14.125545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1735/3512] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:31:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:14.142021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:14.144425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:14.173218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.175112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.176178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.177990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.577990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.593693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0450e0e2-9adf-459b-a809-9109a0e3bdf4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1272 microversion: 2.1 time: 0.465565 Jul 18 02:31:14.598251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1736/3513] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:14 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1272 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:14.616827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:14.618016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:14.641651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.643640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.646715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.648783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.706751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:14.741103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19a537fd-6a36-4f32-bf7c-a4768b9fb1fc tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1529 microversion: 2.1 time: 2.474235 Jul 18 02:31:14.742104 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1778/3514] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:12 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1529 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:14.751524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:14.759652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:14.768586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.770232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:14.771905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:14.772539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.079958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:15.123839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-978109dd-91fd-45c5-b289-9b18a78466a9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1313 microversion: 2.1 time: 0.518112 Jul 18 02:31:15.128283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1737/3515] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:14 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:15.162070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac8460e2-835a-481d-bfdd-ee6b7d7ddde2 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab047ea3a0>, body: {"security_group_rule": {"parent_group_id": "64d41988-69cb-4611-85cb-7428b8c1ca81", "ip_protocol": "tcp", "from_port": 22, "to_port": 1514930520}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:15.368581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:15.389407 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b629000-ecf4-439e-b9bf-ac9e6cbec2db tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1275 microversion: 2.1 time: 0.645648 Jul 18 02:31:15.391344 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1779/3516] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:14 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1275 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:15.626842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:15.628163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:15.656840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.669690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.671487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.672440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.749521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ac8460e2-835a-481d-bfdd-ee6b7d7ddde2 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac8460e2-835a-481d-bfdd-ee6b7d7ddde2 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 146 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: {"security_group_rule": {"parent_group_id": "64d41988-69cb-4611-85cb-7428b8c1ca81", "ip_protocol": "tcp", "from_port": 22, "to_port": 1514930520}} Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'security_group_rule': {'parent_group_id': '64d41988-69cb-4611-85cb-7428b8c1ca81', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1514930520}}} Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 Jul 18 02:31:15.753299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac8460e2-835a-481d-bfdd-ee6b7d7ddde2 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 400 to user: Invalid port range 22:1514930520. Valid TCP ports should be between 1-65535 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:15.760916 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac8460e2-835a-481d-bfdd-ee6b7d7ddde2 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.622816 Jul 18 02:31:15.769531 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1738/3517] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:15 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 639 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:15.794815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:15.796242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:15.812580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.813355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.814188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:15.814821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:15.877045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:15.972867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:16.392062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:16.412280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2eed1a95-3a77-425a-8c95-ecdae960e2d2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1529 microversion: 2.1 time: 0.638199 Jul 18 02:31:16.413621 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1739/3518] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:15 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1529 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:16.419524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Action: 'create', calling method: .version_select at 0x7fab04818280>, body: {"security_group_rule": {"parent_group_id": "898e1eac-5b20-4ed1-ae74-aaed86aa0049", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:16.563863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG neutronclient.v2_0.client [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist", "detail": ""}} {{(pid=119440) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:31:16.566096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.security_group_api [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Neutron security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 not found {{(pid=119440) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 18 02:31:16.567652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.567652 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 138 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: {"security_group_rule": {"parent_group_id": "898e1eac-5b20-4ed1-ae74-aaed86aa0049", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: exception: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'security_group_rule': {'parent_group_id': '898e1eac-5b20-4ed1-ae74-aaed86aa0049', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:31:16.571689 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 404 to user: Security group 898e1eac-5b20-4ed1-ae74-aaed86aa0049 does not exist Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: Neutron server returns request_ids: ['req-0c83fc7e-019b-4087-9d35-832a2df07758'] {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:16.587675 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5753e986-d184-4a22-a053-2bf22a0b6fae tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.166148 Jul 18 02:31:16.600296 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1740/3519] 10.222.0.67 () {60 vars in 1194 bytes} [Mon Jul 18 02:31:16 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:16.609848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:16.613198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:16.658040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.660780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.664043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.665345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.890219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:16.900371 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-178387d4-a0cb-4b3e-b5f2-d53c198f5ab2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 1.283114 Jul 18 02:31:16.911934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1780/3520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:15 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:16.918109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ae7578e3-5952-4b78-a405-141393f50fe8 req-bebcd815-24ee-4e71-bdd0-0dd799aa9602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33060fc5-8a98-4fa7-88b7-b45721489fed", "name": "network-vif-plugged", "status": "completed", "tag": "d61a9228-42d9-4ba6-9ee7-36c0161d3c9a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:16.929193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ae7578e3-5952-4b78-a405-141393f50fe8 req-bebcd815-24ee-4e71-bdd0-0dd799aa9602 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:16.930000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ae7578e3-5952-4b78-a405-141393f50fe8 req-bebcd815-24ee-4e71-bdd0-0dd799aa9602 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:16.954785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ae7578e3-5952-4b78-a405-141393f50fe8 req-bebcd815-24ee-4e71-bdd0-0dd799aa9602 service nova] Creating event network-vif-plugged:d61a9228-42d9-4ba6-9ee7-36c0161d3c9a for instance 33060fc5-8a98-4fa7-88b7-b45721489fed on n-h1-849796-1 Jul 18 02:31:16.975103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ae7578e3-5952-4b78-a405-141393f50fe8 req-bebcd815-24ee-4e71-bdd0-0dd799aa9602 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061454 Jul 18 02:31:16.976790 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1781/3521] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:16.987148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:16.989039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:17.001962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.002873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.004534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.005585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.338674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:17.359579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8cd0cc6f-77ff-45e9-a115-b00eaacd67d0 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1281 microversion: 2.1 time: 0.379471 Jul 18 02:31:17.361542 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1782/3522] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:16 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1281 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:17.379288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab05528ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:17.463853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG neutronclient.v2_0.client [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist", "detail": ""}} {{(pid=119439) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 18 02:31:17.469898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Neutron security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae not found {{(pid=119439) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 18 02:31:17.470727 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] HTTP exception thrown: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.470727 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Request method failure captured: Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-security-group-rules/259bc821-e60e-4a6f-8a87-7f7f452b39ae HTTP/1.1 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXcM-nNjtFfltbESklyrcXLHL_8Kp9tvEKboMPgI4hUDM_qXeJ4U2hSWWUdQZ5rUGp7PbZU8gSE-xVvwuGhgABvceowhszh_2V78ePYW9S1Cr3DhzvUOj60zxBxVKioZg2-VoeiakCpX4aki2bnShKoMod8Cm_hSUEjLC2HNXxxey0 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37c7828f0bf84f03b794c7112ef2b9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 37c7828f0bf84f03b794c7112ef2b9c5 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a4958e6394e24a89856fe56830f97303 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: exception: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '259bc821-e60e-4a6f-8a87-7f7f452b39ae'} Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 18 02:31:17.474782 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] Jul 18 02:31:17.479176 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:17.488045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Returning 404 to user: Security group rule 259bc821-e60e-4a6f-8a87-7f7f452b39ae does not exist Jul 18 02:31:17.488045 n-d-849796-1 devstack@n-api.service[119439]: Neutron server returns request_ids: ['req-12d79b3c-18f0-425d-b877-1e34aada0cc8'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:17.488045 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a92533a7-9e99-4bc8-a734-5cc288a499f3 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/259bc821-e60e-4a6f-8a87-7f7f452b39ae" status: 404 len: 199 microversion: 2.1 time: 0.123480 Jul 18 02:31:17.493050 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1783/3523] 10.222.0.67 () {58 vars in 1286 bytes} [Mon Jul 18 02:31:17 2022] DELETE /compute/v2.1/os-security-group-rules/259bc821-e60e-4a6f-8a87-7f7f452b39ae => generated 199 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:17.505082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:17.506775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:17.516483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.517353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.518460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:17.519143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:17.579204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:17.592649 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2e30791-9536-4611-b709-86b18340841e tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1313 microversion: 2.1 time: 0.997716 Jul 18 02:31:17.593578 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1741/3524] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:16 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:17.607092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af21c1f6-01d3-4af9-9ce7-ccaba3ed3614 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab0a5b0b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:18.117936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:18.142480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aab67ca0-3da2-4894-be86-aac1441e0a71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.645617 Jul 18 02:31:18.147416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1784/3525] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:17 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:18.155449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:18.156612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:18.165838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:18.166562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:18.168233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:18.168889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:18.861037 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af21c1f6-01d3-4af9-9ce7-ccaba3ed3614 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/64d41988-69cb-4611-85cb-7428b8c1ca81" status: 202 len: 0 microversion: 2.1 time: 1.265814 Jul 18 02:31:18.861817 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1742/3526] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:17 2022] DELETE /compute/v2.1/os-security-groups/64d41988-69cb-4611-85cb-7428b8c1ca81 => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:18.870528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:18.871383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:18.891994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:18.892457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:18.893312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:18.893762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.884884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:19.900125 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d61c696b-9419-45a9-9600-83fc7f8b9209 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 1.751138 Jul 18 02:31:19.903596 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1785/3527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:18 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:19.918094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:19.930014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:19.951403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.953597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:19.954938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:19.960633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:20.225079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:20.250584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fb2147e-7697-4ee7-8938-a5a4df71a4ba tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 1.384101 Jul 18 02:31:20.251980 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1743/3528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:18 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:20.259149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aff6338f-4018-42b8-9925-dc7f34f06633 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab0466cb80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:21.323203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:21.340662 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b43015e-6246-4ed6-acae-4eebd229d486 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 1.432028 Jul 18 02:31:21.341349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1786/3529] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:19 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:21.352872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:21.353537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:21.369110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:21.369512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:21.380099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:21.380589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:21.788451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aff6338f-4018-42b8-9925-dc7f34f06633 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/4dddb8bd-bc42-4d46-a28e-a1465aec4031" status: 202 len: 0 microversion: 2.1 time: 1.534432 Jul 18 02:31:21.791473 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1744/3530] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:20 2022] DELETE /compute/v2.1/os-security-groups/4dddb8bd-bc42-4d46-a28e-a1465aec4031 => generated 0 bytes in 1539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:21.824225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-49cb8e10-9222-44ca-a773-a350b664d99b req-ba9a9337-6bca-4864-b8bb-c7b21c0c2b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b67d8b5b-5a28-4326-a0c3-1225b60bf0c3", "tag": "6462d721-aa4c-4115-8a3d-c54f24e09c29"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:21.866023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49cb8e10-9222-44ca-a773-a350b664d99b req-ba9a9337-6bca-4864-b8bb-c7b21c0c2b6f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:21.867371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49cb8e10-9222-44ca-a773-a350b664d99b req-ba9a9337-6bca-4864-b8bb-c7b21c0c2b6f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:21.949593 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-49cb8e10-9222-44ca-a773-a350b664d99b req-ba9a9337-6bca-4864-b8bb-c7b21c0c2b6f service nova] Creating event network-changed:6462d721-aa4c-4115-8a3d-c54f24e09c29 for instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 on n-h2-849796-1 Jul 18 02:31:21.965292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-49cb8e10-9222-44ca-a773-a350b664d99b req-ba9a9337-6bca-4864-b8bb-c7b21c0c2b6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169601 Jul 18 02:31:21.975969 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1745/3531] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:21.999156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:22.003720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:22.025291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.038863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.041206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.042924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.512612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:22.572514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d124870-8de2-4d9e-af0c-23eb7e2c56ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 0.593767 Jul 18 02:31:22.582082 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1746/3532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:21 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:22.595126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:22.600138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:22.628096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.629566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.631473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:22.632634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:22.715754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:22.758860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:23.326108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:23.337750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd9aaf62-7ad3-4638-bd6c-1db503e20f01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 1.994670 Jul 18 02:31:23.344000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:23.365728 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1787/3533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:21 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:23.370534 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf456189-0434-4ef2-8b83-9d7607849e0c tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.785512 Jul 18 02:31:23.377152 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1747/3534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:22 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:23.379563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3b51096-b3da-4a69-8e5f-29f8af4ce1fa tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab0561ae50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:23.391343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:23.392488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:23.400175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:23.401452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:23.403980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:23.405025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.275425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:24.300368 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14e6e44f-95a7-4675-952c-db86ccb647af tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.921430 Jul 18 02:31:24.301375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1748/3535] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:23 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:24.308439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ec881897-9d20-4fd7-b1b5-f044cf46d3a2 req-1b5ffbaa-5094-483a-9629-f0b33c51b2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "tag": "d30f2869-901d-497f-9ad4-753f6f1e8e18"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:24.339996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ec881897-9d20-4fd7-b1b5-f044cf46d3a2 req-1b5ffbaa-5094-483a-9629-f0b33c51b2ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.341002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ec881897-9d20-4fd7-b1b5-f044cf46d3a2 req-1b5ffbaa-5094-483a-9629-f0b33c51b2ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.367273 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ec881897-9d20-4fd7-b1b5-f044cf46d3a2 req-1b5ffbaa-5094-483a-9629-f0b33c51b2ed service nova] Creating event network-changed:d30f2869-901d-497f-9ad4-753f6f1e8e18 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:24.387406 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ec881897-9d20-4fd7-b1b5-f044cf46d3a2 req-1b5ffbaa-5094-483a-9629-f0b33c51b2ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084298 Jul 18 02:31:24.387938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1749/3536] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:24.400361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:24.404942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:24.428038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.430321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.439930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.441113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.731420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3b51096-b3da-4a69-8e5f-29f8af4ce1fa tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/440855a3-9c1a-48eb-8ad8-22df28c390d0" status: 202 len: 0 microversion: 2.1 time: 1.363335 Jul 18 02:31:24.732669 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1788/3537] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:23 2022] DELETE /compute/v2.1/os-security-groups/440855a3-9c1a-48eb-8ad8-22df28c390d0 => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:24.738310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:24.739292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:24.765839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.777835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:24.778720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:24.779179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.136710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:25.150825 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de0cc347-c649-4d5b-9acc-2805eca10eee tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.416292 Jul 18 02:31:25.152174 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1789/3538] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:24 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:25.173914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:25.176004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:25.185722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.190253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.191659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:25.193567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:25.743744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:25.752219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7153279-5d73-453d-aa08-7cd101a69e05 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.588254 Jul 18 02:31:25.752833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1790/3539] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:25 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:25.773142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a546975-f947-412c-be50-a2ffc9b98853 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab05694550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:25.987547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:26.005435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fe188cfb-6b56-486c-8335-4dcf7bca8e0d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 1.615494 Jul 18 02:31:26.006060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1750/3540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:24 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:26.024017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dd1c4abc-dc49-4ca2-bd65-fe1100e12409 req-3bfc7f9a-1c14-4fd5-a533-a09e4b01a218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d", "tag": "2cad5f65-c988-4a10-9fde-5b9ef49347a1"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:26.068126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd1c4abc-dc49-4ca2-bd65-fe1100e12409 req-3bfc7f9a-1c14-4fd5-a533-a09e4b01a218 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.068619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd1c4abc-dc49-4ca2-bd65-fe1100e12409 req-3bfc7f9a-1c14-4fd5-a533-a09e4b01a218 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.128573 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dd1c4abc-dc49-4ca2-bd65-fe1100e12409 req-3bfc7f9a-1c14-4fd5-a533-a09e4b01a218 service nova] Creating event network-changed:2cad5f65-c988-4a10-9fde-5b9ef49347a1 for instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d on n-h2-849796-1 Jul 18 02:31:26.136576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dd1c4abc-dc49-4ca2-bd65-fe1100e12409 req-3bfc7f9a-1c14-4fd5-a533-a09e4b01a218 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128502 Jul 18 02:31:26.139843 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1751/3541] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:26.146804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:26.148234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:26.157688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.158449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:26.159585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:26.160220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.041263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:27.077250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27e5777b-6e95-44b5-babd-cff921658b3a tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.935369 Jul 18 02:31:27.080456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1752/3542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:26 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:27.095213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:27.097973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:27.133723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.140455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.142219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.142693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.743090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:27.760274 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efbb6dca-1c64-46fd-b47a-5c49d081b3da tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.676645 Jul 18 02:31:27.776892 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1753/3543] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:27 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:27.787070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:27.796052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:27.816540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.817482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:27.818822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:27.819534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.500189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:28.509829 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54e17fef-be1e-4fcb-8679-53c8928ed8f4 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.730219 Jul 18 02:31:28.516201 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1754/3544] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:27 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:28.530953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:28.532131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:28.566369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:28.567344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.568851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:28.571921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:28.998116 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a546975-f947-412c-be50-a2ffc9b98853 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/37dd7e06-53e3-456a-b997-9ac2a732e6bd" status: 202 len: 0 microversion: 2.1 time: 3.231492 Jul 18 02:31:28.999812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1791/3545] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:25 2022] DELETE /compute/v2.1/os-security-groups/37dd7e06-53e3-456a-b997-9ac2a732e6bd => generated 0 bytes in 3242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:29.020178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-32aad283-c111-4384-8f61-9f96ecdc5fa5 req-f5e0962f-173c-4981-8b3d-20ccfa493680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "tag": "b06f4ccd-8b71-4e75-b7bf-fd9619339929"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:29.108151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-32aad283-c111-4384-8f61-9f96ecdc5fa5 req-f5e0962f-173c-4981-8b3d-20ccfa493680 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.110817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-32aad283-c111-4384-8f61-9f96ecdc5fa5 req-f5e0962f-173c-4981-8b3d-20ccfa493680 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.197841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-32aad283-c111-4384-8f61-9f96ecdc5fa5 req-f5e0962f-173c-4981-8b3d-20ccfa493680 service nova] Creating event network-changed:b06f4ccd-8b71-4e75-b7bf-fd9619339929 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:29.222709 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-32aad283-c111-4384-8f61-9f96ecdc5fa5 req-f5e0962f-173c-4981-8b3d-20ccfa493680 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219859 Jul 18 02:31:29.231485 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1792/3546] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:29.260345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:29.267405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:29.318154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.318981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.325101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.326202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.760377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:29.799383 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ff730af2-7e4a-4601-8f41-1a7c0410b469 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 1.276810 Jul 18 02:31:29.813994 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1755/3547] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:28 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:29.848588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:29.852677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:29.928544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.930088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:29.932074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:29.935649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.538613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:30.569268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:30.574880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d091a61-99f2-41b3-ac58-0937e2f75307 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 1.335916 Jul 18 02:31:30.576697 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1793/3548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:29 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:30.583322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9a92df5-0d1e-4fe8-a044-1c8ee10d070f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.765353 Jul 18 02:31:30.601153 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1756/3549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:29 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:30.602442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3403bf17-b273-44e2-973b-44e28528a3f0 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] Calling method '.version_select at 0x7fab04bedb80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:30.613259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:30.616459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:30.638480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.640021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.642964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:30.644658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:30.658751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:30.967396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:30.989076 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d451071d-d659-4902-9880-573d39519c13 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.385940 Jul 18 02:31:30.992992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1757/3550] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:30 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:31.028819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:31.039756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:31.081040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.083879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.088107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.092057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.439368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:31.482037 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-312d85e2-c43a-45c7-a01c-b9a09355aaad tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 0.486311 Jul 18 02:31:31.484968 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1758/3551] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:30 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:31.510990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-346dbc06-9285-46ff-986b-10d811e75442 req-8d58eb39-59f5-43af-b658-47ffa4e66e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b67d8b5b-5a28-4326-a0c3-1225b60bf0c3", "name": "network-vif-plugged", "status": "completed", "tag": "6462d721-aa4c-4115-8a3d-c54f24e09c29"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:31.539628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-346dbc06-9285-46ff-986b-10d811e75442 req-8d58eb39-59f5-43af-b658-47ffa4e66e21 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.540412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-346dbc06-9285-46ff-986b-10d811e75442 req-8d58eb39-59f5-43af-b658-47ffa4e66e21 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.567108 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-346dbc06-9285-46ff-986b-10d811e75442 req-8d58eb39-59f5-43af-b658-47ffa4e66e21 service nova] Creating event network-vif-plugged:6462d721-aa4c-4115-8a3d-c54f24e09c29 for instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 on n-h2-849796-1 Jul 18 02:31:31.573191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-346dbc06-9285-46ff-986b-10d811e75442 req-8d58eb39-59f5-43af-b658-47ffa4e66e21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072583 Jul 18 02:31:31.575162 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1759/3552] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:31.599801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:31.600146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:31.611648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.612422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:31.613461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:31.614077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.149815 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3403bf17-b273-44e2-973b-44e28528a3f0 tempest-SecurityGroupRulesNegativeTestJSON-1514179222 tempest-SecurityGroupRulesNegativeTestJSON-1514179222-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/165bced6-f7bc-44cf-aeb1-66c7bfcb1a63" status: 202 len: 0 microversion: 2.1 time: 1.564911 Jul 18 02:31:32.152142 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1794/3553] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:31:30 2022] DELETE /compute/v2.1/os-security-groups/165bced6-f7bc-44cf-aeb1-66c7bfcb1a63 => generated 0 bytes in 1573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:31:32.177532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:32.178827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:32.207185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:32.211081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.215411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.216690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.217071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.272467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=91 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:32.351055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:32.371133 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-373d18bf-7d4b-4c39-b677-4d27e293dc0d tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.781458 Jul 18 02:31:32.381318 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1760/3554] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:31 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:32.387288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:32.390514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:32.404649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.405797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.407571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.408500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.695389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:32.722085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c8c3f14-d2ee-42e1-a0d8-4ab4b405014a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.567983 Jul 18 02:31:32.726363 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1795/3555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:32 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:32.745813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:32.746766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:32.756714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.757604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:32.759477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:32.760207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:33.019116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:33.040683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57545610-727d-42fa-8ed4-96949a0b1405 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.657448 Jul 18 02:31:33.051067 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1761/3556] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:32 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:33.388822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:33.390469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:33.408475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.412852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:33.414173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.414872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:33.695188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:33.718336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b165cad-07b1-48bc-9932-92dce4fa49ee tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 0.982699 Jul 18 02:31:33.732623 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1796/3557] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:32 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:33.756668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:33.757336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:33.766209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.766684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:33.767518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:33.767980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.031902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:34.040753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d89c36b-c6a8-4da4-b077-1ecd79302631 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.656410 Jul 18 02:31:34.050361 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1762/3558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:33 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:34.076382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:34.077250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:34.097026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.097533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.098792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.099529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.198126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:34.217965 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b048b4b-8594-4e7f-aa0f-59d664377b1f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.464090 Jul 18 02:31:34.219264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1797/3559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:33 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:34.597253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:34.632153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3297e8ff-f7a6-4852-a4ac-01e797c74b60 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.559799 Jul 18 02:31:34.653787 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1763/3560] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:34 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:34.740031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:34.740970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:34.775120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.775666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:34.777236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:34.777706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.080697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:35.083196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:35.119193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.123113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.125739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.130529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.590244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:35.602048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-267a5f26-ade1-4cf4-9eb7-846e0bd58069 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1314 microversion: 2.1 time: 0.869582 Jul 18 02:31:35.610662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1798/3561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:34 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:35.629205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:35.640896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:35.657669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.658474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:35.660098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:35.661944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:36.020472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:36.061484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d8b721e5-e6de-4d3f-a449-34284e59d048 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.445237 Jul 18 02:31:36.074202 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1799/3562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:35 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:36.094161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:36.099686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:36.114267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:36.117822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:36.119017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:36.123249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:36.772585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:36.829748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c077df40-9331-4f03-8452-e74254e8d748 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.753436 Jul 18 02:31:36.837067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1800/3563] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:36 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:36.847021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-102df8ce-9d0e-40ea-ad66-c6557743eba7 req-6a68b7c0-8a47-4c4e-9c11-007662a4ecb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-plugged", "status": "completed", "tag": "d30f2869-901d-497f-9ad4-753f6f1e8e18"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:36.891436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-102df8ce-9d0e-40ea-ad66-c6557743eba7 req-6a68b7c0-8a47-4c4e-9c11-007662a4ecb2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:36.904746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-102df8ce-9d0e-40ea-ad66-c6557743eba7 req-6a68b7c0-8a47-4c4e-9c11-007662a4ecb2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:36.945668 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-102df8ce-9d0e-40ea-ad66-c6557743eba7 req-6a68b7c0-8a47-4c4e-9c11-007662a4ecb2 service nova] Creating event network-vif-plugged:d30f2869-901d-497f-9ad4-753f6f1e8e18 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:37.003833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-102df8ce-9d0e-40ea-ad66-c6557743eba7 req-6a68b7c0-8a47-4c4e-9c11-007662a4ecb2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164266 Jul 18 02:31:37.005814 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1801/3564] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:37.024325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:37.034843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:37.082687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.088230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:37.094344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.098546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:37.138478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:37.184487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf964fc9-d65d-4a3a-9079-4cd7262a4fbe tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 2.116854 Jul 18 02:31:37.204116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1764/3565] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:35 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:37.806032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:37.818803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:37.843762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:37.849757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.849757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:37.855444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:37.859354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.078233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:38.097159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eeeb16e5-d3ed-48a5-b48c-80c5822c4303 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1499 microversion: 2.1 time: 1.089146 Jul 18 02:31:38.101923 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1802/3566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:37 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1499 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:38.115767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:38.116711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:38.127363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.128180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.129282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.129979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.585684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:38.602274 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5cc212fa-e0dd-4411-8090-82cba0c76251 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.496548 Jul 18 02:31:38.614148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1803/3567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:38 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:38.629469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:38.631174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:38.646566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.652680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.653950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.654746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.721205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lazy-loading 'flavor' on Instance uuid b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:31:38.788148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:38.822342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40b0bbdc-dad4-46de-936d-bfb4ee628424 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 1.611075 Jul 18 02:31:38.827500 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1765/3568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:37 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:38.858439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:38.859951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:38.882196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.883012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:38.884789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:38.888330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:39.013870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f6f1b6f-427c-4bef-87db-39fcb5400da2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "POST /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3/action" status: 200 len: 32 microversion: 2.1 time: 0.385565 Jul 18 02:31:39.014993 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1804/3569] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:31:38 2022] POST /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:31:39.053571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:39.055222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:39.104036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:39.121903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:39.123470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:39.124279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:39.906387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:39.952771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0208e3a3-d731-46d6-8e59-7c5063de757a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.927700 Jul 18 02:31:39.962780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:39.970287 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1805/3570] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:39 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:39.975224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72370a11-2c80-48f1-9d73-0245d54b36b2 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 1.145826 Jul 18 02:31:39.982688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3ad912d5-f398-4414-80f3-6470c354ece9 req-45541466-3b10-472e-9957-25246f402c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d", "name": "network-vif-plugged", "status": "completed", "tag": "2cad5f65-c988-4a10-9fde-5b9ef49347a1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:39.985742 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1766/3571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:38 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:39.994292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:39.995802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:40.006904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3ad912d5-f398-4414-80f3-6470c354ece9 req-45541466-3b10-472e-9957-25246f402c06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.007728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3ad912d5-f398-4414-80f3-6470c354ece9 req-45541466-3b10-472e-9957-25246f402c06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.023076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.023846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.024869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.028779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.032034 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3ad912d5-f398-4414-80f3-6470c354ece9 req-45541466-3b10-472e-9957-25246f402c06 service nova] Creating event network-vif-plugged:2cad5f65-c988-4a10-9fde-5b9ef49347a1 for instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d on n-h2-849796-1 Jul 18 02:31:40.048467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3ad912d5-f398-4414-80f3-6470c354ece9 req-45541466-3b10-472e-9957-25246f402c06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071664 Jul 18 02:31:40.050367 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1806/3572] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:40.060897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:40.063538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:40.084000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.085795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.113933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:40.114985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:40.592846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:40.607797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fc9e815-e04e-4346-9b6b-8231516f5a2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.555362 Jul 18 02:31:40.617320 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1807/3573] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:40 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:40.985342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:40.986240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:41.002234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.008066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:41.009296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.009937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:41.872861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:41.887873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d92337d9-2717-4ee0-85a5-e760b0c8c816 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 1.900604 Jul 18 02:31:41.918553 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1767/3574] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:39 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:41.925836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:41.926823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:41.949649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.950549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:41.957134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:41.958785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:42.469537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:42.483944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3057058-9527-4a2a-8cc1-9f2f9f7861e6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.504286 Jul 18 02:31:42.485319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1808/3575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:40 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:42.490548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:42.501920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:42.509104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:42.517846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:42.519735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:42.521693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:42.724503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:42.739435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c10b561a-f539-41b9-86de-35ddac16a2d7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.819159 Jul 18 02:31:42.751219 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1768/3576] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:41 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:42.780293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-86fcec39-bd12-4254-90e2-5324f87360cd req-198f4317-e314-4088-ad38-ae88c06f43c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-plugged", "status": "completed", "tag": "b06f4ccd-8b71-4e75-b7bf-fd9619339929"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:42.839290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-86fcec39-bd12-4254-90e2-5324f87360cd req-198f4317-e314-4088-ad38-ae88c06f43c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:42.839467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-86fcec39-bd12-4254-90e2-5324f87360cd req-198f4317-e314-4088-ad38-ae88c06f43c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:42.840696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:42.873618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1304e40c-45c9-4487-8e0d-2be559500d87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.384399 Jul 18 02:31:42.887086 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1809/3577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:42 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:42.915014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:42.916979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:42.918626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-86fcec39-bd12-4254-90e2-5324f87360cd req-198f4317-e314-4088-ad38-ae88c06f43c5 service nova] Creating event network-vif-plugged:b06f4ccd-8b71-4e75-b7bf-fd9619339929 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:42.930055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:42.930729 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-86fcec39-bd12-4254-90e2-5324f87360cd req-198f4317-e314-4088-ad38-ae88c06f43c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173534 Jul 18 02:31:42.931714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:42.934176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:42.934380 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1769/3578] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:42.935030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.350629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:43.368032 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b38f06e7-c410-409b-bf3b-a87140b23faf tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1323 microversion: 2.1 time: 0.461235 Jul 18 02:31:43.379738 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1810/3579] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:42 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:43.508738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:43.524599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:43.565932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.571754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.575053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.577026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.767991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:43.769387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:43.780895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.781737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.782763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:43.785481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:43.789162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:44.269317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:44.289809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03add7d2-0ddd-485f-99d7-484342c1f806 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 0.523662 Jul 18 02:31:44.290903 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1811/3580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:43 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:44.308886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:44.310458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:44.331620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:44.332461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:44.333576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:44.334292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:44.712322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:44.724998 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-906f31dc-917f-4a0d-bf54-158f048ea3f4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.428938 Jul 18 02:31:44.726116 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1812/3581] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:44 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:44.735855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:44.740539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:44.755064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:44.755807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:44.756844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:44.757544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:44.881146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:44.923021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5e961c3a-a60e-4d80-90bd-0db7a21282cc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.422607 Jul 18 02:31:44.942728 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1770/3582] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:43 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:45.090876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:45.102948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c33d1510-bbab-47e8-b5e7-5d1ef4ad07ac tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1520 microversion: 2.1 time: 0.375053 Jul 18 02:31:45.105058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1813/3583] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:44 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:45.315595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:45.316805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:45.390570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:45.394824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:45.407698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:45.413095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:45.506604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c256b304-17fd-4fda-8617-e2d8707bd32b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1790741566", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c256b304-17fd-4fda-8617-e2d8707bd32b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 243 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1790741566", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1790741566', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '348c7688-29b0-401c-b57c-f46f0291099b'}]}}} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:31:45.509961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c256b304-17fd-4fda-8617-e2d8707bd32b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c256b304-17fd-4fda-8617-e2d8707bd32b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017949 Jul 18 02:31:45.537507 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1814/3584] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:45 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:31:45.576213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:45.594183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: be354ad9-d670-4fc1-b697-9f033d481ac3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:45.622173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] HTTP exception thrown: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/be354ad9-d670-4fc1-b697-9f033d481ac3/metadata HTTP/1.1 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': 'be354ad9-d670-4fc1-b697-9f033d481ac3'} Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:45.643305 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:45.654218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:45.654218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:45.654218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. Jul 18 02:31:45.654218 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:45.656306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 404 to user: Instance be354ad9-d670-4fc1-b697-9f033d481ac3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:45.663574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71a61220-9b9e-423b-9a65-68a2f64995bc tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/be354ad9-d670-4fc1-b697-9f033d481ac3/metadata" status: 404 len: 111 microversion: 2.1 time: 0.122613 Jul 18 02:31:45.672764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1815/3585] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:31:45 2022] GET /compute/v2.1/servers/be354ad9-d670-4fc1-b697-9f033d481ac3/metadata => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:45.779319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:45.780307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:45.791094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:45.799852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:45.801689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:45.804507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.130621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:46.141445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-995c5555-df14-49ce-8813-cb09e96423a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.386578 Jul 18 02:31:46.154138 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1816/3586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:45 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:46.172872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c36fe731-752f-4998-8a25-6255de8da334 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2141040205", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c36fe731-752f-4998-8a25-6255de8da334 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 499 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2141040205", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2141040205', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '348c7688-29b0-401c-b57c-f46f0291099b'}]}}} Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:31:46.179250 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.183274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c36fe731-752f-4998-8a25-6255de8da334 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:46.187374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c36fe731-752f-4998-8a25-6255de8da334 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.027840 Jul 18 02:31:46.187374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1817/3587] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:46 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:46.218828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:46.223192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:46.275572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.291375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.308731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.309957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.571791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:46.591342 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58ddf575-cd8c-4fc5-96d8-1fce911b3449 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1334 microversion: 2.1 time: 1.283339 Jul 18 02:31:46.595472 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1771/3588] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:45 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1334 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:46.615932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d1e35c0-970e-4b42-b015-d9925c6e4d7b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-109851687", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d1e35c0-970e-4b42-b015-d9925c6e4d7b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 499 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-109851687", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-109851687', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '348c7688-29b0-401c-b57c-f46f0291099b'}]}}} Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:31:46.627780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.631502 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.636338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d1e35c0-970e-4b42-b015-d9925c6e4d7b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:46.636338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d1e35c0-970e-4b42-b015-d9925c6e4d7b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.038469 Jul 18 02:31:46.636338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1772/3589] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:46 2022] POST /compute/v2.1/servers => generated 689 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:31:46.736992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0aca76b9-8c60-4880-80ba-2a07182f5b69 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1558373738", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0aca76b9-8c60-4880-80ba-2a07182f5b69 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 754 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1558373738", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1558373738', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '348c7688-29b0-401c-b57c-f46f0291099b'}]}}} Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:31:46.745601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:31:46.748518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:31:46.751079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.751079 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.753405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0aca76b9-8c60-4880-80ba-2a07182f5b69 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:46.754676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0aca76b9-8c60-4880-80ba-2a07182f5b69 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.031959 Jul 18 02:31:46.755913 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1773/3590] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:31:46 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 18 02:31:46.849902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0611289a-97c4-4937-ba36-9802a52a40b7 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1649317724", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0611289a-97c4-4937-ba36-9802a52a40b7 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 1266 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1649317724", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "348c7688-29b0-401c-b57c-f46f0291099b"}]}} Jul 18 02:31:46.853089 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1649317724', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '348c7688-29b0-401c-b57c-f46f0291099b'}]}}} Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.856128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:31:46.857435 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:31:46.861016 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 18 02:31:46.861016 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.861016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0611289a-97c4-4937-ba36-9802a52a40b7 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:46.861016 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0611289a-97c4-4937-ba36-9802a52a40b7 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011980 Jul 18 02:31:46.862422 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1774/3591] 10.222.0.67 () {60 vars in 1147 bytes} [Mon Jul 18 02:31:46 2022] POST /compute/v2.1/servers => generated 2221 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 18 02:31:46.877553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:46.879219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 54a61ac5-3ffe-43ea-932d-abaf7ef79d43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:46.898247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] HTTP exception thrown: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/54a61ac5-3ffe-43ea-932d-abaf7ef79d43/metadata/test2 HTTP/1.1 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': '54a61ac5-3ffe-43ea-932d-abaf7ef79d43', 'id': 'test2'} Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:46.901269 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 404 to user: Instance 54a61ac5-3ffe-43ea-932d-abaf7ef79d43 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de0120cf-098c-412f-8a57-a976bf302a4b tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/54a61ac5-3ffe-43ea-932d-abaf7ef79d43/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.029640 Jul 18 02:31:46.906374 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1775/3592] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 02:31:46 2022] GET /compute/v2.1/servers/54a61ac5-3ffe-43ea-932d-abaf7ef79d43/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:46.927779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:46.928310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:46.944292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.944970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.945841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:46.946298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:46.977769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:47.000372 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47d51f05-dcdf-46ab-ba7d-3fa94f620156 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.812886 Jul 18 02:31:47.004615 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1818/3593] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:46 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:47.007097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:31:47.181727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:47.183945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:47.219853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.220629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:47.230919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.232255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:47.351842 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d386a59-d4be-4e9f-b447-b65cce8edeb3 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 204 len: 0 microversion: 2.1 time: 0.422534 Jul 18 02:31:47.363880 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1776/3594] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:31:46 2022] DELETE /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:31:47.415980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:47.421095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:47.444803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.450097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:47.454918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.458887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:47.524477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:47.820230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:47.833078 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2184384f-3676-446e-8180-af2a38cf62d1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.676194 Jul 18 02:31:47.834455 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1819/3595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:47 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:47.851279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:47.852369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:47.868872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.871380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:47.872460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:47.877766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.227859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:48.284643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72ab263a-64a8-46da-9f1a-c775be1d9ed7 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1670 microversion: 2.1 time: 0.448291 Jul 18 02:31:48.293702 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1820/3596] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:47 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:48.321484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:48.323956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:48.337625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.340097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.342039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.343061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.725568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:48.735589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a3229f5-0cf2-4990-9c38-6cae239ab3a1 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1526 microversion: 2.1 time: 1.366792 Jul 18 02:31:48.751870 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1777/3597] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:47 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1526 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:48.774647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:48.797078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:48.842319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.852238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:48.858314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:48.862199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.007318 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdf9e14f-48b9-4fa8-af96-8790f7ec3077 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da/ips" status: 200 len: 180 microversion: 2.1 time: 0.253919 Jul 18 02:31:49.012540 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1778/3598] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:31:48 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da/ips => generated 180 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:49.030353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:49.031316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:49.086313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.086770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.087805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.088946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.235909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:49.246438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ce54024-629e-46f4-9b85-cc00498c463b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.950687 Jul 18 02:31:49.253285 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1821/3599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:48 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:49.262825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:49.267695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:49.281720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.288168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.289425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.290088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.357208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:31:49.574551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c91e0374-df8e-455a-ba04-ab4936c381c9 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 204 len: 0 microversion: 2.1 time: 0.319489 Jul 18 02:31:49.575519 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1822/3600] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:31:49 2022] DELETE /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:31:49.586762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:49.587815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:49.609002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.609779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.610835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.611464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.860513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:49.875792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e8d60971-5b15-4872-acc4-7e821aa2867e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 0.861125 Jul 18 02:31:49.876464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1779/3601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:49 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:49.904803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:49.905557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:49.929912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.930271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:49.937445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:49.938357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.465887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:50.475517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6cbf5d10-2d62-47d2-ae95-4a33f632fa48 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1526 microversion: 2.1 time: 0.581030 Jul 18 02:31:50.475869 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1780/3602] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:49 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1526 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:50.493076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:50.493708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:50.510312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.511814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.515003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.517642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.851728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:50.868944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-670fa4c8-69d4-4c8a-b152-cdd9e80a175f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1676 microversion: 2.1 time: 1.284178 Jul 18 02:31:50.870720 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1823/3603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:49 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1676 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:50.896185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:50.901992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:50.942421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.943328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:50.952573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:50.956313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:51.119792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:51.152873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dec9c838-a298-4449-9d6b-a5d42767bd71 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.675541 Jul 18 02:31:51.161531 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1781/3604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:50 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:51.513071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:51.515358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:51.527957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:51.528782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:51.530406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:51.531312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.237700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:52.253813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-288c4d3f-2425-4c67-8a5e-4bf9ddb35170 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1524 microversion: 2.1 time: 1.362188 Jul 18 02:31:52.255731 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1824/3605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:50 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1524 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:52.296578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:52.306851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:52.362043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.365317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.370871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.375072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.427039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4a69db71d04ff9b70d30a3930f84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5474a9be5f5469f94ec7c616dc6dcea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:52.465286 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc0ab562-5594-4010-9ee1-926c375ed075 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 200 len: 1484 microversion: 2.1 time: 0.958619 Jul 18 02:31:52.486360 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1782/3606] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:51 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 1484 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:52.492871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:52.494073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:52.515421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.517037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:52.522855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:52.524013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.277359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:53.320418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c0d5767-8419-4792-8cf2-cff61bc9a7bf tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1676 microversion: 2.1 time: 1.048326 Jul 18 02:31:53.323855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1825/3607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:52 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1676 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:53.355219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7f1bdd2e-da00-42e0-bd53-6225b965848a req-570ff859-bed7-4a46-9ac3-a3dfa9eba4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d", "name": "network-vif-deleted", "tag": "2cad5f65-c988-4a10-9fde-5b9ef49347a1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:53.397863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7f1bdd2e-da00-42e0-bd53-6225b965848a req-570ff859-bed7-4a46-9ac3-a3dfa9eba4b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.399419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7f1bdd2e-da00-42e0-bd53-6225b965848a req-570ff859-bed7-4a46-9ac3-a3dfa9eba4b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.427478 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7f1bdd2e-da00-42e0-bd53-6225b965848a req-570ff859-bed7-4a46-9ac3-a3dfa9eba4b7 service nova] Creating event network-vif-deleted:2cad5f65-c988-4a10-9fde-5b9ef49347a1 for instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d on n-h2-849796-1 Jul 18 02:31:53.442387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7f1bdd2e-da00-42e0-bd53-6225b965848a req-570ff859-bed7-4a46-9ac3-a3dfa9eba4b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114374 Jul 18 02:31:53.444240 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1826/3608] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:53.459038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:53.462811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:53.484134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.489704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.492290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.494772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.608186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:53.637844 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6957744-d8b9-411b-b15a-3f6f56b02ea7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.149056 Jul 18 02:31:53.642899 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1783/3609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:52 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:53.662990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:53.664900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] [instance: 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:53.707854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.709981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.714442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:53.716087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:53.782361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] HTTP exception thrown: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Request method failure captured: Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d HTTP/1.1 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXv-qhxCQIk8i6J7rhWDHpXyTdD8yLvZ7PEpsOoIPUj5ATanLJHcRf7c3oRubdEiViU8Sjfyk-nU4TYauR2vigiH7N5opb_H_ScQITmlRmxhFL989iUdEG8xMtkR4dq35c8Muk_Lt1JnwEQEyPvi935QSpmF_pL5Hb6R5lKTfyST_0 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d5474a9be5f5469f94ec7c616dc6dcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d5474a9be5f5469f94ec7c616dc6dcea Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-839588261 Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0b4a69db71d04ff9b70d30a3930f84ce Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-839588261-project Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d'} Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:53.787146 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. Jul 18 02:31:53.796239 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:31:53.804072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] Returning 404 to user: Instance 4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:31:53.809915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e52414c-ab5d-4793-a773-44eeb56d88a8 tempest-ServerMetadataNegativeTestJSON-839588261 tempest-ServerMetadataNegativeTestJSON-839588261-project] 10.222.0.67 "GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d" status: 404 len: 111 microversion: 2.1 time: 0.164665 Jul 18 02:31:53.816517 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1784/3610] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:53 2022] GET /compute/v2.1/servers/4302bb3b-bf76-4b4d-b0ee-c7a793c5b60d => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:31:54.361451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:54.363216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:54.401956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.405322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.414233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.415520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.790573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:54.815365 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29d0c8e5-8fb9-4029-ba5e-f42d6422ed17 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1506 microversion: 2.1 time: 1.368472 Jul 18 02:31:54.829304 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1827/3611] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:53 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1506 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:54.831433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:54.838554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:54.842914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.843591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:54.844859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:54.845377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:55.369961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:55.381783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b48f754f-348b-42e4-9185-3c1721e6bf26 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.559379 Jul 18 02:31:55.382683 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1828/3612] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:54 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:55.388958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ffa262b6-922a-412b-937d-9c878be3650c req-d1ea24e3-62f5-476b-95fd-a1e35df3c04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-unplugged", "status": "completed", "tag": "d30f2869-901d-497f-9ad4-753f6f1e8e18"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:55.409636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ffa262b6-922a-412b-937d-9c878be3650c req-d1ea24e3-62f5-476b-95fd-a1e35df3c04b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:55.410557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ffa262b6-922a-412b-937d-9c878be3650c req-d1ea24e3-62f5-476b-95fd-a1e35df3c04b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:55.426950 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ffa262b6-922a-412b-937d-9c878be3650c req-d1ea24e3-62f5-476b-95fd-a1e35df3c04b service nova] Creating event network-vif-unplugged:d30f2869-901d-497f-9ad4-753f6f1e8e18 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:55.434025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ffa262b6-922a-412b-937d-9c878be3650c req-d1ea24e3-62f5-476b-95fd-a1e35df3c04b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049260 Jul 18 02:31:55.434991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1829/3613] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:55.610974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:55.624102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66d220e9-8be3-4cbc-971f-7febe2020d16 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1676 microversion: 2.1 time: 1.274431 Jul 18 02:31:55.628528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1785/3614] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:54 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1676 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:55.848076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:55.849051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:55.867433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:55.868014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:55.868997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:55.869743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:55.905961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:56.402678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:56.403686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:56.414991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:56.419728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.421498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.423415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.426880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.458110 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64d0e5ff-405c-4d8c-916a-266318402e2a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1506 microversion: 2.1 time: 0.611125 Jul 18 02:31:56.464945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1830/3615] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:55 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:56.488029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5c6c9f92-40e2-4b05-b5ad-510746e56406 req-46b1b271-e170-4d9f-8ce2-fc5fa7623e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-deleted", "tag": "d30f2869-901d-497f-9ad4-753f6f1e8e18"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:56.524227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5c6c9f92-40e2-4b05-b5ad-510746e56406 req-46b1b271-e170-4d9f-8ce2-fc5fa7623e1d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.526621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5c6c9f92-40e2-4b05-b5ad-510746e56406 req-46b1b271-e170-4d9f-8ce2-fc5fa7623e1d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.581258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5c6c9f92-40e2-4b05-b5ad-510746e56406 req-46b1b271-e170-4d9f-8ce2-fc5fa7623e1d service nova] Creating event network-vif-deleted:d30f2869-901d-497f-9ad4-753f6f1e8e18 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:56.598550 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5c6c9f92-40e2-4b05-b5ad-510746e56406 req-46b1b271-e170-4d9f-8ce2-fc5fa7623e1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130975 Jul 18 02:31:56.605828 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1831/3616] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:31:56.667434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:56.668692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:56.684658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.685868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:56.687635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:56.689023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:57.132569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:57.157641 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0bd3daf6-6856-40fd-ae3f-75f569bde9f5 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1496 microversion: 2.1 time: 0.500115 Jul 18 02:31:57.159074 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1832/3617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:56 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1496 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:57.453398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:57.485015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:57.486766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:57.492653 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4ea71f4-530e-462a-9563-14777db76d0b tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.094321 Jul 18 02:31:57.501696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1786/3618] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:56 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:57.509972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:57.512138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:57.529680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:57.531060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:57.539262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-unplugged", "status": "completed", "tag": "b06f4ccd-8b71-4e75-b7bf-fd9619339929"}, {"server_uuid": "33060fc5-8a98-4fa7-88b7-b45721489fed", "name": "network-vif-unplugged", "status": "completed", "tag": "d61a9228-42d9-4ba6-9ee7-36c0161d3c9a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:57.571160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:57.572176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:57.628716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] Creating event network-vif-unplugged:b06f4ccd-8b71-4e75-b7bf-fd9619339929 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:57.630706 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] Creating event network-vif-unplugged:d61a9228-42d9-4ba6-9ee7-36c0161d3c9a for instance 33060fc5-8a98-4fa7-88b7-b45721489fed on n-h1-849796-1 Jul 18 02:31:57.648242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d340de64-da87-4d7d-81bc-ccb72c2d69f8 req-05f71df1-6ca4-459f-8ad8-5ccd7ac9fc03 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.118080 Jul 18 02:31:57.649100 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1787/3619] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:57.966890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:57.975620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63a3c2cf-250d-42f5-9060-5a39b72cb01e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1506 microversion: 2.1 time: 0.502101 Jul 18 02:31:57.976083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1833/3620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:57 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:58.189213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:58.190961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:58.205094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.205940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.207010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.207733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.476202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:58.494649 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a0591c6-783a-4432-aa7e-88d30a9d42b1 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1496 microversion: 2.1 time: 0.311874 Jul 18 02:31:58.506626 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1788/3621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:58 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1496 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:31:58.517712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:58.518694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:58.532423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.533028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:58.533922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:58.534985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.175896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:59.190371 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2620626-ae8a-4fa3-8af6-2640c023a94e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 0.676866 Jul 18 02:31:59.191396 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1834/3622] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:58 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:31:59.202808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:59.203459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:59.221225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.221700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.222527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.222977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.578672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6ac43a9a-bda6-4f96-a28c-6df03ce21880 req-b2ffdef2-c8b8-4463-9a12-e7c064901db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a5bf5a-9058-4e80-a953-0093429410da", "name": "network-vif-deleted", "tag": "b06f4ccd-8b71-4e75-b7bf-fd9619339929"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:31:59.637182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ac43a9a-bda6-4f96-a28c-6df03ce21880 req-b2ffdef2-c8b8-4463-9a12-e7c064901db2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.638405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ac43a9a-bda6-4f96-a28c-6df03ce21880 req-b2ffdef2-c8b8-4463-9a12-e7c064901db2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.677582 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6ac43a9a-bda6-4f96-a28c-6df03ce21880 req-b2ffdef2-c8b8-4463-9a12-e7c064901db2 service nova] Creating event network-vif-deleted:b06f4ccd-8b71-4e75-b7bf-fd9619339929 for instance f9a5bf5a-9058-4e80-a953-0093429410da on n-h1-849796-1 Jul 18 02:31:59.704458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6ac43a9a-bda6-4f96-a28c-6df03ce21880 req-b2ffdef2-c8b8-4463-9a12-e7c064901db2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.921830 Jul 18 02:31:59.709046 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1789/3623] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:31:59.725446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:31:59.727184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:31:59.748643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.752061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.756190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.763153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.863615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:31:59.864436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:31:59.865415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lazy-loading 'fault' on Instance uuid f9a5bf5a-9058-4e80-a953-0093429410da {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:31:59.958852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a91925d5ea4bdb91ed033db2658c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeaf897fc3a45cbbbd2c4fba4bed525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:31:59.977850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43dbee1e-6862-4e30-8a75-910d615793e4 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 200 len: 1303 microversion: 2.1 time: 0.266817 Jul 18 02:31:59.993002 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1790/3624] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:59 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 1303 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:00.244155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:00.254258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:00.285646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.289183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.292061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.294231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.408017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:00.445603 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-095d138b-bc1f-4694-a4fc-a9f7ee01b063 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 200 len: 1509 microversion: 2.1 time: 1.252901 Jul 18 02:32:00.446386 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1835/3625] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:31:59 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 1509 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:00.466964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:00.467608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:00.499481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.506157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.507666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:00.508385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:00.582719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:32:00.607470 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Working on deleting snapshot df60bc14-a440-4e62-9230-52de5cbbb90d from shelved instance... Jul 18 02:32:01.475969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:01.510823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb0191db-3f14-4fbf-8335-2fbc91be211d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.300861 Jul 18 02:32:01.513498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1791/3626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:00 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:01.536015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:01.538776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:01.573905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:01.575080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:01.576703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:01.577899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:01.627892 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da HTTP/1.1 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'f9a5bf5a-9058-4e80-a953-0093429410da'} Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:01.632811 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:01.642500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-91c37ad5-7c6e-435e-8a71-7acdffc008bd tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 404 len: 111 microversion: 2.1 time: 0.123246 Jul 18 02:32:01.648739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1792/3627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:01 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:02.480953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:02.483825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Doing local delete in cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119439) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 02:32:02.485431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:02.486414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:02.487381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 02:32:02.503343 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [733ea8e7-f63c-4c0a-895f-442fa739b4c5] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 02:32:02.549939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:02.550716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:02.570232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:02.570707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:02.573993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:02.577974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:03.527492 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [733ea8e7-f63c-4c0a-895f-442fa739b4c5] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 33712. Jul 18 02:32:03.578088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] deallocate_for_instance() {{(pid=119439) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 02:32:03.616619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:03.637716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7245b56e-82df-471b-bb30-c4a9aac5f62e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.097439 Jul 18 02:32:03.648967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1793/3628] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:02 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:04.663124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:04.664349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:04.693756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:04.694174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:04.704445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:04.709402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:06.031034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Updating instance_info_cache with network_info: [] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:32:06.582016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:06.637746 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94e982e6-8a3c-4416-a8e7-9c847cb6fe16 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.982739 Jul 18 02:32:06.639476 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1794/3629] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:04 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:06.656907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-93e017a2-f4cb-4cd3-8c25-8b63e67e1993 req-2bd41221-415f-46bb-929e-0fac0b3a78b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33060fc5-8a98-4fa7-88b7-b45721489fed", "name": "network-vif-deleted", "tag": "d61a9228-42d9-4ba6-9ee7-36c0161d3c9a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:06.680404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93e017a2-f4cb-4cd3-8c25-8b63e67e1993 req-2bd41221-415f-46bb-929e-0fac0b3a78b1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:06.682291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93e017a2-f4cb-4cd3-8c25-8b63e67e1993 req-2bd41221-415f-46bb-929e-0fac0b3a78b1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:06.725080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_external_events [req-93e017a2-f4cb-4cd3-8c25-8b63e67e1993 req-2bd41221-415f-46bb-929e-0fac0b3a78b1 service nova] Unable to find a host for instance 33060fc5-8a98-4fa7-88b7-b45721489fed. Dropping event network-vif-deleted {{(pid=119440) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:32:06.727198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-93e017a2-f4cb-4cd3-8c25-8b63e67e1993 req-2bd41221-415f-46bb-929e-0fac0b3a78b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.083077 Jul 18 02:32:06.734712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1795/3630] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 02:32:07.670601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:07.675361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:07.685574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:07.686540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:07.687649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:07.688684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:07.831505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0826398e-63f4-4b6b-9683-50fdb400e316 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 204 len: 0 microversion: 2.1 time: 7.369998 Jul 18 02:32:07.852268 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1836/3631] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:00 2022] DELETE /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 0 bytes in 7392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:32:07.886451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:07.892310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:07.911000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:07.911473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:07.912294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:07.912745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:07.949077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed HTTP/1.1 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '33060fc5-8a98-4fa7-88b7-b45721489fed'} Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:07.950867 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:07.957756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:07.962462 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb06d943-dd12-4bbc-acc6-3eab29735e01 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 404 len: 111 microversion: 2.1 time: 0.088284 Jul 18 02:32:07.963939 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1837/3632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:07 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:08.232329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1884360871", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:08.404152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:08.793846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:08.872477 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53d6551f-4e02-488b-b641-eeed2062a670 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 1.199551 Jul 18 02:32:08.875796 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1796/3633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:07 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:09.917578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:09.918629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:09.922200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:09.961177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:09.978286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:09.981453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:09.982777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:10.045175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:10.046060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:10.047554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:10.050197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:10.051423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:10.088116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:10.094043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:10.096144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:10.099241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:10.103016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:10.191505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:10.219597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:10.293900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:10.296481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:10.365207 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09d4bdc3-f109-45db-ac7e-f14d4c418ad5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138597 Jul 18 02:32:10.366823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1838/3634] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:10.404329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe8cf48f-22b7-4bd9-bb94-95318e04cec0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:10.405065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe8cf48f-22b7-4bd9-bb94-95318e04cec0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:11.191848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe8cf48f-22b7-4bd9-bb94-95318e04cec0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:11.214414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe8cf48f-22b7-4bd9-bb94-95318e04cec0 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1215 microversion: 2.1 time: 0.835283 Jul 18 02:32:11.215468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1839/3635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:10 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1215 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:12.142718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:12.187830 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b16d504d-f666-4acd-b73b-5bbc29d7cdd8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1505 microversion: 2.1 time: 2.298508 Jul 18 02:32:12.202151 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1797/3636] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:09 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1505 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:12.238533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:12.246367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:12.278589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:12.279828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:12.281641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:12.284755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:12.929082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:12.980998 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cc8a346e-2b10-44c0-8cc8-62122c0e1d36 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1267 microversion: 2.1 time: 0.746516 Jul 18 02:32:12.986087 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1840/3637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:12 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1267 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:13.222821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:13.224465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:13.262761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.270256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.272444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:13.273586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:13.792590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:13.817584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d2c13b8-0521-4091-ba24-1e8b77fd2850 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1485 microversion: 2.1 time: 0.605559 Jul 18 02:32:13.819598 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1798/3638] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:13 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1485 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:14.005421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:14.006835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:14.060903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.073591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.077765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.078797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.187707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-740556714", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:14.318130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] validate_networks() for [('76305ca9-d1af-412c-b629-7ead74372066', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:14.391222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:14.409322 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-892d716f-bb53-4524-ac84-5ef289c3f9a5 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1273 microversion: 2.1 time: 0.409548 Jul 18 02:32:14.410277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1841/3639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:13 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1273 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:14.711380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:14.711891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:14.730032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.734100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.737761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.739726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.773971 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da HTTP/1.1 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f9a5bf5a-9058-4e80-a953-0093429410da'} Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:14.787049 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:14.796307 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a04e8d5e-c09c-4dc3-b46f-9ee9f70c74c3 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 404 len: 111 microversion: 2.1 time: 0.088420 Jul 18 02:32:14.798571 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1842/3640] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:14 2022] DELETE /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:14.819277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:14.820528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: f9a5bf5a-9058-4e80-a953-0093429410da] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:14.829010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.829735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.831020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.831687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.875323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da HTTP/1.1 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f9a5bf5a-9058-4e80-a953-0093429410da'} Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.879175 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. Jul 18 02:32:14.885105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.889371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance f9a5bf5a-9058-4e80-a953-0093429410da could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:14.892633 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1211f8ae-c60b-4e3d-95f0-47f14986b439 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da" status: 404 len: 111 microversion: 2.1 time: 0.085455 Jul 18 02:32:14.895808 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1843/3641] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:14 2022] GET /compute/v2.1/servers/f9a5bf5a-9058-4e80-a953-0093429410da => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:14.911513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:14.913522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:14.929093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.931840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.935817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:14.937440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:14.975653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b HTTP/1.1 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5202219e-3906-4a44-bfcb-ffac69d89b3b'} Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:14.980070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:14.984709 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:14.989117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:14.990770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b260a5a7-cd39-4e3b-96ff-6928af385ee6 tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 404 len: 111 microversion: 2.1 time: 0.090054 Jul 18 02:32:14.992068 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1844/3642] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:32:14 2022] DELETE /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:32:15.004284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:15.005321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] [instance: 5202219e-3906-4a44-bfcb-ffac69d89b3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:15.017264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.018610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.019957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.020913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.044225 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] HTTP exception thrown: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Request method failure captured: Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b HTTP/1.1 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MV_Ga_uuc-sYtMY1Gp2_3INZUNPGNr4MUvJBkSSA6fdMqNmFKzL5SsBTBikZhYXhQd-vybg6XqP9-axlaf7yxu6TeoYJw2tRKezaJ96AMO4M87uaPzFe0zF4Br306DwxX9LAIk8IYklyVb4LQ7dQDTaRt2ueQrwE-2F02AJVdoygeo Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2aeaf897fc3a45cbbbd2c4fba4bed525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 2aeaf897fc3a45cbbbd2c4fba4bed525 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestMultiNic-144757087 Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 95a91925d5ea4bdb91ed033db2658c5d Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestMultiNic-144757087-project Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5202219e-3906-4a44-bfcb-ffac69d89b3b'} Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:32:15.046835 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. Jul 18 02:32:15.052451 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:32:15.056203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] Returning 404 to user: Instance 5202219e-3906-4a44-bfcb-ffac69d89b3b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:32:15.057910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f1de723-3685-4555-b0aa-f380c7325a8f tempest-ServersTestMultiNic-144757087 tempest-ServersTestMultiNic-144757087-project] 10.222.0.67 "GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b" status: 404 len: 111 microversion: 2.1 time: 0.059381 Jul 18 02:32:15.059210 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1845/3643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:14 2022] GET /compute/v2.1/servers/5202219e-3906-4a44-bfcb-ffac69d89b3b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:32:15.436462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:15.438552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:15.453940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.454417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.456370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:15.456838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:15.524866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:15.716313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:15.743850 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b17dc13d-0f3f-4688-abeb-154b1bb574d7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1273 microversion: 2.1 time: 0.312201 Jul 18 02:32:15.745341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1846/3644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:15 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:16.762353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:16.763002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:16.784381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:16.785519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:16.786609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:16.787803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:17.241979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:17.247657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:17.248897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:17.250277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:17.251025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:17.295152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:17.299328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:17.303534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:17.305735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:17.355299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Getting quotas for project db2500ccf386475583649c645294e0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:17.386600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Getting quotas for user 021c3e5665f74561b93527eddf4956fd and project db2500ccf386475583649c645294e0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:17.463862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:17.479158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:17.520778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:17.534270 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-755afa70-ed66-485a-88b4-a31fee9dbc87 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 0.776011 Jul 18 02:32:17.535980 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1847/3645] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:16 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:17.674064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-093c54d0-4dca-4ff5-b4f5-80221fea7ec7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.496741 Jul 18 02:32:17.680645 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1799/3646] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:17.691253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-409fc07b-f5d9-4960-ac9d-f7dec277a055 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:17.692541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-409fc07b-f5d9-4960-ac9d-f7dec277a055 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:18.100099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-409fc07b-f5d9-4960-ac9d-f7dec277a055 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:18.112063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-409fc07b-f5d9-4960-ac9d-f7dec277a055 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1213 microversion: 2.1 time: 0.426995 Jul 18 02:32:18.117362 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1848/3647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:17 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1213 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:18.557678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:18.558809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:18.614495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:18.615314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:18.616829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:18.627759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:19.088378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:19.110045 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d604664f-bbc9-4067-855f-57b67a397e93 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 0.559931 Jul 18 02:32:19.112086 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1800/3648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:18 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:19.149007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:19.150573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:19.185448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:19.186878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:19.188443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:19.189232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:19.382901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:19.396140 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab86ddd1-b409-43ae-8c7d-62ca685cc294 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1209 microversion: 2.1 time: 0.262280 Jul 18 02:32:19.410155 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1849/3649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:19 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1209 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:19.602892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-76115395-4e68-454f-bd19-38ad37dc565b req-6ca9f93b-d2b9-4c1e-9d92-7372afb39d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e6d9b6-49e4-44e3-ba58-f134bbbcb645", "tag": "858a341e-3306-4e34-a11e-ca45175f0396"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:19.688715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-76115395-4e68-454f-bd19-38ad37dc565b req-6ca9f93b-d2b9-4c1e-9d92-7372afb39d4c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:19.690913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-76115395-4e68-454f-bd19-38ad37dc565b req-6ca9f93b-d2b9-4c1e-9d92-7372afb39d4c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:19.758558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-76115395-4e68-454f-bd19-38ad37dc565b req-6ca9f93b-d2b9-4c1e-9d92-7372afb39d4c service nova] Creating event network-changed:858a341e-3306-4e34-a11e-ca45175f0396 for instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 on n-h1-849796-1 Jul 18 02:32:19.773323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-76115395-4e68-454f-bd19-38ad37dc565b req-6ca9f93b-d2b9-4c1e-9d92-7372afb39d4c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178589 Jul 18 02:32:19.789323 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1801/3650] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:20.152392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:20.154352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:20.172109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:20.213460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:20.214270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:20.219492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:20.220414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:20.418461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:20.423595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:20.435278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:20.436283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:20.439547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:20.448452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:21.001935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:21.022687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d0828440-ca8f-4945-aed8-72ffb47c4224 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1271 microversion: 2.1 time: 0.609424 Jul 18 02:32:21.044837 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1802/3651] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:20 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1271 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:21.874745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:21.904830 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5a405e0-33a4-44bd-9a3a-84c7c81a5ab8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 1.765774 Jul 18 02:32:21.907246 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1850/3652] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:20 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:22.058916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:22.059960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:22.080394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.080985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.081827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.082280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.263547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:22.278348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c4116f4-8a7b-489c-9708-47ed8952cb62 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1271 microversion: 2.1 time: 0.221790 Jul 18 02:32:22.281319 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1803/3653] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:22 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:22.929728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:22.930988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:22.959126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.969427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:22.983212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:22.989088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.323192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:23.326787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:23.341949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.342866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.343838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:23.344391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:23.459707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:23.476326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a262a289-ab2b-414e-8d91-e4da9dab69ba tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1271 microversion: 2.1 time: 0.162688 Jul 18 02:32:23.481594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1804/3654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:23 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:23.876080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:23.897886 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81627b43-dc47-4ed7-97df-7359c5e511af tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 0.976686 Jul 18 02:32:23.900630 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1851/3655] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:22 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:24.503494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:24.508882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:24.545542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:24.546960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:24.549585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:24.552414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:24.935949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:24.939250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:24.950483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:24.951966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1149a9d-22e4-4563-9662-43bea5c66b44 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1271 microversion: 2.1 time: 0.459390 Jul 18 02:32:24.964152 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1805/3656] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:24 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1271 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:25.006076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.006886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.007959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.010228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.465666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Action: 'create', calling method: .version_select at 0x7fab04a8e820>, body: {"keypair": {"name": "tempest-keypair-1976653803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9Lq9PsLlRkoYIvVsiLcZQHNV2dXFUGH4lh+qUUgHEIE1jGZAu3iCsFDmRAOaqaDeQzadnvkHIt+dF3CQnVA3fZsEdMnsNQbAx+ag8u27IdPgRxS22ZTmNGsqjtNceyYg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:25.544083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:25.560834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for user 35b2f13c4ffd4e3a8046c4c92b3ef37f and project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:25.604112 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 02:32:25.840952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:25.876414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7a66169-47b1-4cff-ad2a-24854c551ed1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 0.947580 Jul 18 02:32:25.877887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1852/3657] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:24 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:25.914378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3673f2f9-bd15-40b6-b110-5882913021bb"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:25.920704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:25.939803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.941833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:25.946224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:25.948679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.621235 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34074. Jul 18 02:32:26.686435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4af67f3b-f65e-473e-86c2-53772136da81 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.731819 Jul 18 02:32:26.687696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1806/3658] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:32:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:26.689697 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a3bbca2-8806-4052-8de3-d8aaba41cd66 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782372 Jul 18 02:32:26.695524 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1853/3659] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:32:25 2022] POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:26.697651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:26.710135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:26.748101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.752495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.759889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.763800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.910784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:26.911817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:26.943025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.951866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:26.953218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:26.957655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:27.332316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:27.968490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:27.984520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c923ccb4-a062-4c4f-a840-461a09f8574a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 1.080013 Jul 18 02:32:28.006670 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1854/3660] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:26 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:28.111678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:28.489170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:28.503392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-401610d7-147a-4c2e-ba03-6c5c5b620771 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.814114 Jul 18 02:32:28.504140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1807/3661] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:26 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:28.594335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2dfcd2e2-cb21-4065-ab90-c30c8dd8e43b req-8ff900e5-7c3b-43bb-a4bf-cce166b343c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e6d9b6-49e4-44e3-ba58-f134bbbcb645", "name": "network-vif-plugged", "status": "completed", "tag": "858a341e-3306-4e34-a11e-ca45175f0396"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:28.648090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2dfcd2e2-cb21-4065-ab90-c30c8dd8e43b req-8ff900e5-7c3b-43bb-a4bf-cce166b343c8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:28.648984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2dfcd2e2-cb21-4065-ab90-c30c8dd8e43b req-8ff900e5-7c3b-43bb-a4bf-cce166b343c8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:28.701575 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2dfcd2e2-cb21-4065-ab90-c30c8dd8e43b req-8ff900e5-7c3b-43bb-a4bf-cce166b343c8 service nova] Creating event network-vif-plugged:858a341e-3306-4e34-a11e-ca45175f0396 for instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 on n-h1-849796-1 Jul 18 02:32:28.714065 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2dfcd2e2-cb21-4065-ab90-c30c8dd8e43b req-8ff900e5-7c3b-43bb-a4bf-cce166b343c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.701566 Jul 18 02:32:28.715680 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1855/3662] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:29.006275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:29.007029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:29.029247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.030024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.031123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.039182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.537563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:29.539083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:29.570636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.574223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:29.586807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:29.587821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:30.141331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:30.215287 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09ca5fe7-76c1-4ef7-97ab-a54f39ce98e3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 1.205391 Jul 18 02:32:30.234742 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1808/3663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:29 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:30.707347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:30.723851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfadbff8-2c0d-455a-9a4b-abfa01726365 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.192617 Jul 18 02:32:30.727717 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1856/3664] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:29 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:31.001107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cb0b2ad9-222a-45b9-929a-9c6df42d7b81 req-77136ae5-9106-4dc8-9acf-c6eac404b250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a37a09-e42f-439b-87e7-076600b21d05", "tag": "aee9c657-7046-45d6-8577-79a49e62eebe"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:31.051374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cb0b2ad9-222a-45b9-929a-9c6df42d7b81 req-77136ae5-9106-4dc8-9acf-c6eac404b250 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.061911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cb0b2ad9-222a-45b9-929a-9c6df42d7b81 req-77136ae5-9106-4dc8-9acf-c6eac404b250 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.095496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cb0b2ad9-222a-45b9-929a-9c6df42d7b81 req-77136ae5-9106-4dc8-9acf-c6eac404b250 service nova] Creating event network-changed:aee9c657-7046-45d6-8577-79a49e62eebe for instance 07a37a09-e42f-439b-87e7-076600b21d05 on n-h2-849796-1 Jul 18 02:32:31.110484 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cb0b2ad9-222a-45b9-929a-9c6df42d7b81 req-77136ae5-9106-4dc8-9acf-c6eac404b250 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298337 Jul 18 02:32:31.115260 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1809/3665] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:31.244189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:31.245454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:31.259565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.260993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.265265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.266148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.772331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:31.778565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:31.832516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.836556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:31.845314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:31.854296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:32.417598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:32.482596 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a294eb7-1e65-4fcd-9d03-3301145dd021 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1315 microversion: 2.1 time: 1.238598 Jul 18 02:32:32.486997 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1857/3666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:31 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1315 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:33.041023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:33.101446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58bbed16-d0a6-4a70-8a3e-622c94c289cb tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.348414 Jul 18 02:32:33.104011 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1810/3667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:31 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:33.515281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:33.516176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:33.519621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:33.542166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.542166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:33.542166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:33.542166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.122526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:34.123511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:34.137960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.142621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.143962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.157379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.364720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:34.402805 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad430d58-683f-4aca-95c8-3266b950c31f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1501 microversion: 2.1 time: 0.891251 Jul 18 02:32:34.414634 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1858/3668] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:33 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1501 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:34.442542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83fd3140-3c60-4801-89f7-223287689365 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:34.486287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fd3140-3c60-4801-89f7-223287689365 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.487040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fd3140-3c60-4801-89f7-223287689365 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.584862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-83fd3140-3c60-4801-89f7-223287689365 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Going to try to stop instance {{(pid=119439) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:32:34.764380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83fd3140-3c60-4801-89f7-223287689365 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645/action" status: 202 len: 0 microversion: 2.1 time: 0.346099 Jul 18 02:32:34.772020 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1859/3669] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:32:34 2022] POST /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:32:34.792450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:34.796258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:34.829348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.831240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:34.835069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:34.836378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:35.427729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:35.454188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-30f99a30-d447-4932-91c1-4eec5a468875 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.669314 Jul 18 02:32:35.456606 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1860/3670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:34 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:35.501770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:35.545961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6cea1f0-a557-456c-a2cc-dc8683a72e56 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.428922 Jul 18 02:32:35.561355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1811/3671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:34 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:36.504755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.514153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.549316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.550945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.553647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.555339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.579591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:36.582600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:36.619555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:36.624004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.624795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:36.626226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:36.633355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:37.464675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:37.479549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c283b67-a58d-4f2c-9fb0-2acfee0893c3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.008800 Jul 18 02:32:37.480170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1861/3672] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:36 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:37.784771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:37.826570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-386f8288-040c-4646-ad2b-ba58061b8fd0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.262979 Jul 18 02:32:37.833013 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1812/3673] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:36 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:38.505832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:38.509641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:38.533359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.535233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.536878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.539073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.620464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:38.856479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:38.858961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:38.901054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.902460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:38.910857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:38.919272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:39.117818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:39.135468 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-296878e9-097a-4a26-aab3-3042ce195ab6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.639943 Jul 18 02:32:39.146104 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1862/3674] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:38 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:39.165333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-567957130", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6f952be8-6f6e-459d-8121-359fd441fe79"}], "security_groups": [{"name": "tempest-securitygroup--270585048"}], "key_name": "tempest-keypair-1976653803", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:39.403949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] validate_networks() for [('6f952be8-6f6e-459d-8121-359fd441fe79', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:39.724465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:39.754537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e26b51cc-3df7-4c64-be50-a9ecde7c5c4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 0.910606 Jul 18 02:32:39.756226 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1813/3675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:38 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:40.178178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:40.178986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:40.185089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:40.205692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.213976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.215570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.216294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.224327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=82 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:40.444569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:40.474832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for user 35b2f13c4ffd4e3a8046c4c92b3ef37f and project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: dict_keys(['metadata_items']) {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:40.525422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:40.526637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:40.549253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:40.550408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:40.553299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:40.582611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.583798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.586126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.588079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:40.627061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:40.656161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Getting quotas for user 35b2f13c4ffd4e3a8046c4c92b3ef37f and project 7dcb92c2c8b4454aa2218bf9ccae3d95. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:40.714219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:40.721120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:40.934505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29529378-e67c-4206-85f8-0ed0d9ed1373 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.785632 Jul 18 02:32:40.935199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1863/3676] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:40.964657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:40.980634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:40.999024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:40.999595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.000486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:41.005153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:41.472729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:41.544305 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d03a3457-e08a-46e4-970f-e2c996238a88 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.363062 Jul 18 02:32:41.547613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1814/3677] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:40 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:41.573414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc3da070-0fd5-43ab-8acb-a5faed244d31 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:41.581645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc3da070-0fd5-43ab-8acb-a5faed244d31 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:41.964372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:41.989316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc3da070-0fd5-43ab-8acb-a5faed244d31 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:42.001093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc3da070-0fd5-43ab-8acb-a5faed244d31 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1269 microversion: 2.1 time: 0.446799 Jul 18 02:32:42.006340 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1815/3678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:41 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1269 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:42.045578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-960ad61d-d123-4f64-85fe-1c51feec3eb2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 1.097739 Jul 18 02:32:42.060052 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1864/3679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:40 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:42.589079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:42.594393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:42.647009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.648114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.650212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:42.655809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:42.758048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-666385883", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:42.904554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] validate_networks() for [('257361c5-377c-4f9d-9e23-eb73b84a9673', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:43.749347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:43.766740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea073e8b-1153-4b93-b8bf-7236d2ac07a4 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.192542 Jul 18 02:32:43.770777 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1865/3680] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:42 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:43.788177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:43.789150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:43.802870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.803704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.804816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:43.810079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:43.989633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:44.004161 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-361ee730-468e-48e4-afbc-e5f6f02f1a94 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1321 microversion: 2.1 time: 0.231503 Jul 18 02:32:44.025557 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1866/3681] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:43 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:44.043463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:44.047037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:44.063128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.063872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.065761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.066485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:44.874302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:44.902049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08bb8c0d-76a1-4cd0-8b1e-8139fd487d39 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 0.871282 Jul 18 02:32:44.907845 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1867/3682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:44 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:44.924304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fd16f5f4-a91d-4a02-b473-936f27c39b3c req-356d8c4c-55ad-4006-956e-54522383afb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a37a09-e42f-439b-87e7-076600b21d05", "name": "network-vif-plugged", "status": "completed", "tag": "aee9c657-7046-45d6-8577-79a49e62eebe"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:44.970973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fd16f5f4-a91d-4a02-b473-936f27c39b3c req-356d8c4c-55ad-4006-956e-54522383afb5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:44.972005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fd16f5f4-a91d-4a02-b473-936f27c39b3c req-356d8c4c-55ad-4006-956e-54522383afb5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.031684 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fd16f5f4-a91d-4a02-b473-936f27c39b3c req-356d8c4c-55ad-4006-956e-54522383afb5 service nova] Creating event network-vif-plugged:aee9c657-7046-45d6-8577-79a49e62eebe for instance 07a37a09-e42f-439b-87e7-076600b21d05 on n-h2-849796-1 Jul 18 02:32:45.047605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fd16f5f4-a91d-4a02-b473-936f27c39b3c req-356d8c4c-55ad-4006-956e-54522383afb5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137594 Jul 18 02:32:45.048698 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1868/3683] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:45.068685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:45.070432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:45.085405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.088252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.093584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.095598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.363933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:45.364817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:45.365905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:45.366946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:45.368795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:45.426322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.429552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.432635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.433339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.521414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Getting quotas for project f015daca8b6946559c7d8469e06f348b. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:45.533117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Getting quotas for user 89b5cab2bb314366b0a93f796865de10 and project f015daca8b6946559c7d8469e06f348b. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:45.559938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:45.565179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:45.696035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bff4d7ea-9dc4-4712-8e32-28535cd27d63 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.546819 Jul 18 02:32:45.709886 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1816/3684] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:32:45.741111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:45.746100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:45.785319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.788677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:45.793892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:45.796177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.097275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:46.113078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:46.127047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-514d1aa2-d5b3-4e3f-80ee-7d42a7034361 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.070973 Jul 18 02:32:46.128021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a8b9f40-dd98-4fc2-833a-22905b4f6dc9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1327 microversion: 2.1 time: 0.409539 Jul 18 02:32:46.128730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1817/3685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:45 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1327 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:46.137705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1869/3686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:45 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:46.153838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c1ebfb1-6b20-41fd-b5bb-95a67ea43361 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:46.156857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c1ebfb1-6b20-41fd-b5bb-95a67ea43361 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:46.300030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-105286907", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "deba971e-5bd4-4e18-8e25-af5f1a378561"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:46.394178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c1ebfb1-6b20-41fd-b5bb-95a67ea43361 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:46.402632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] validate_networks() for [('deba971e-5bd4-4e18-8e25-af5f1a378561', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:46.403658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c1ebfb1-6b20-41fd-b5bb-95a67ea43361 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1222 microversion: 2.1 time: 0.262952 Jul 18 02:32:46.417326 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1818/3687] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:46 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:46.426129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:46.432479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:46.451941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.452674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.454994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:46.457246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:46.995331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:47.010805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c47c1ac-f6d0-425a-8812-2b64f2e33d1d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1313 microversion: 2.1 time: 0.591659 Jul 18 02:32:47.011592 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1819/3688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:46 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1313 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:47.151242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:47.152308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:47.162167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.167277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.168157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.168613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.402973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:47.425742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-acb25d61-9580-4ccb-ba1a-ca5da0621fef tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1327 microversion: 2.1 time: 0.281055 Jul 18 02:32:47.431831 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1820/3689] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:47 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1327 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:47.455632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:47.456272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:47.491816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.494916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.503044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.503771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.678965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:47.681507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:47.683199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:47.684544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:47.685623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:47.746591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.747529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.749439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:47.750501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:47.794648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:47.810137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for user ac14269ddbfd45c197426ecdcc0b8025 and project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:47.843961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:47.849274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:47.920111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:47.939187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc70b2a0-57ee-40b5-8647-33bbc704230b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.488873 Jul 18 02:32:47.953486 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1821/3690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:47 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:47.981412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:47.986443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:47.995488 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1b6ab86-97dd-4a42-bf7f-ae1e2461e2f8 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856268 Jul 18 02:32:48.002739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1870/3691] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:48.017215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.019746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.021558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.030603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.042424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:48.045311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:48.073193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.073660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.074486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.074948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.153854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'flavor' on Instance uuid 9bd37eff-f3dd-4623-9c73-d351db4348c2 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:32:48.562706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:48.663504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96b859c7-87f8-45dc-b966-fbcf8b7db0f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1274 microversion: 2.1 time: 0.656060 Jul 18 02:32:48.678031 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1871/3692] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:48 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1274 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:48.739834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:48.748372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:48.804408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.823160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.834069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:48.836349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:48.959567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e8128680-fe18-401e-82c4-643b8c16567a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/action" status: 200 len: 32 microversion: 2.1 time: 1.003581 Jul 18 02:32:48.960770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1822/3693] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:32:47 2022] POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/action => generated 32 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:32:49.041493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-488752468", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "deba971e-5bd4-4e18-8e25-af5f1a378561"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:49.277711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] validate_networks() for [('deba971e-5bd4-4e18-8e25-af5f1a378561', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:49.895220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:49.921321 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a26957a7-cd3f-4bff-a4bc-b181338b7231 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1499 microversion: 2.1 time: 1.218230 Jul 18 02:32:49.922249 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1872/3694] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:48 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1499 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:49.936672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:49.941676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:49.963445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:49.964111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:49.965384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:49.966033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:50.754844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:50.776358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-971efcf6-0118-41cd-9e2d-9cdddc8b5c01 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.852184 Jul 18 02:32:50.777375 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1873/3695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:49 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:50.794542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:50.795577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:50.809646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.813705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:50.815637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:50.817890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:52.459708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:52.472734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf871c70-b5aa-440b-b9f1-28109f3e65e5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 1.684896 Jul 18 02:32:52.473415 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1874/3696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:50 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:52.488972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:52.489935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:52.504434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:52.505066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:52.509291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:52.510153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.279283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:53.280456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:53.281304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:53.282322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:53.283790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:53.310905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.312591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.315022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.316201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.367401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:53.381892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for user ac14269ddbfd45c197426ecdcc0b8025 and project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:53.417615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:53.422914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:53.526156 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c5f69db-cd3b-4e11-93e4-f260dae00777 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.544690 Jul 18 02:32:53.526894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1823/3697] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:53.541409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:53.545066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:53.560704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.565907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.567222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.567915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.918244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:53.957577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-332796a2-bd69-41bb-98f8-72bd120826d8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.481036 Jul 18 02:32:53.967578 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1875/3698] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:52 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:53.976381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:53.979004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:53.995793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.996264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:53.998058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:53.999260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.072338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lazy-loading 'flavor' on Instance uuid 07a37a09-e42f-439b-87e7-076600b21d05 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:32:54.293711 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e15a8ad9-e288-4def-940c-62cc37ec0def tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "POST /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05/action" status: 200 len: 32 microversion: 2.1 time: 0.330375 Jul 18 02:32:54.297083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1876/3699] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:32:53 2022] POST /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:32:54.306501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:54.310678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:54.328889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.330631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.332188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.332625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.569360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:54.584806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8817cfbe-b685-429c-a4ab-8dd16d976437 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 1.054614 Jul 18 02:32:54.606594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1824/3700] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:53 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:54.618946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:54.626171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:54.646100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.647608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:54.648667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:54.650325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:55.089824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:55.165343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2a60af3-26d9-43d3-bc55-a1c6b1109d0e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.548469 Jul 18 02:32:55.167823 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1825/3701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:54 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:55.187221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-98571425", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "451", "networks": [{"uuid": "deba971e-5bd4-4e18-8e25-af5f1a378561"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:55.295889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] validate_networks() for [('deba971e-5bd4-4e18-8e25-af5f1a378561', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:32:56.052910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:32:56.053647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:32:56.054005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:32:56.054529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:32:56.055027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:32:56.067635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.068167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.069050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.069506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.093772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:32:56.099748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Getting quotas for user ac14269ddbfd45c197426ecdcc0b8025 and project 3fdfc68e191e45c8bb31e70d621f660d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:32:56.116261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:32:56.119293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:32:56.178139 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45c0a22f-7549-48bf-aacd-b5f216cdde1f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008159 Jul 18 02:32:56.187997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1826/3702] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:32:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:32:56.193985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.194961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.203511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.204287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.205343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.206058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.472244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:56.483427 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e170e47-ecdc-4725-bc9d-c2a3162d7a02 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.293528 Jul 18 02:32:56.485214 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1827/3703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:56.490832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4572aacc-dfa8-4b0d-96b7-27b6d7a05e4c req-ce1a304d-ce58-4c37-8bbb-e916d4894e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db046266-0d2e-477b-be4d-312ce05dbb26", "tag": "b8ef8346-9129-4486-9f88-76106866c0ed"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:56.501871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4572aacc-dfa8-4b0d-96b7-27b6d7a05e4c req-ce1a304d-ce58-4c37-8bbb-e916d4894e66 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.502252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4572aacc-dfa8-4b0d-96b7-27b6d7a05e4c req-ce1a304d-ce58-4c37-8bbb-e916d4894e66 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.514046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:56.518926 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4572aacc-dfa8-4b0d-96b7-27b6d7a05e4c req-ce1a304d-ce58-4c37-8bbb-e916d4894e66 service nova] Creating event network-changed:b8ef8346-9129-4486-9f88-76106866c0ed for instance db046266-0d2e-477b-be4d-312ce05dbb26 on n-h1-849796-1 Jul 18 02:32:56.526298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4572aacc-dfa8-4b0d-96b7-27b6d7a05e4c req-ce1a304d-ce58-4c37-8bbb-e916d4894e66 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039840 Jul 18 02:32:56.527388 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1828/3704] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:56.533848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e29e4456-9958-4205-9462-d0bc507af30e tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 2.233646 Jul 18 02:32:56.536809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1877/3705] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:54 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:56.548807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.549681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.550416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.551542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.560463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.560941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.561850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.562808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.586390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.589086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.590097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.590790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.794260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:56.811341 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40873640-8cbb-4ab1-9a44-c097f8dc6730 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.282113 Jul 18 02:32:56.813873 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1829/3706] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:56.823314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.825337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.838648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.839360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.841675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.842708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.935578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:56.945133 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c8c0b89-6023-415d-b03c-d2b4432f370b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1223 microversion: 2.1 time: 0.129566 Jul 18 02:32:56.945763 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1830/3707] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:56.952113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:56.953175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:56.960209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.960670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:56.961558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:56.962816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.137188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:57.146844 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7fe04ae3-7003-46a6-afca-79c38959bcda tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.198611 Jul 18 02:32:57.147460 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1831/3708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:57.527676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:57.529679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:57.545579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.547354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.550962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.552255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.775635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:57.827958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=16 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:57.886410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:57.937711 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2272f94-7910-4871-a514-34fdd8654a8b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 1.395986 Jul 18 02:32:57.942734 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1878/3709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:56 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:57.976707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:57.978585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:57.992683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.994847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:57.997613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:57.999026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.008550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:58.061781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:58.077943 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44cc38b0-ce2f-4af0-b427-9be328d35276 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.569412 Jul 18 02:32:58.078706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1832/3710] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:57 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:58.090486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.091673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.103840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.104483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.105671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.108449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.185147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:58.502181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:58.540589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c259d72-80bd-4dc6-848c-fa59ca0827db tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.456645 Jul 18 02:32:58.543213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1833/3711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:58.556496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.557264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.564545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.565049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.565854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.566294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.667653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:58.691453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e372c8cf-17da-4789-a382-7d1d93e6df30 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.746078 Jul 18 02:32:58.692744 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1879/3712] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:57 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:58.706030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:58.718171 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1eb145e7-9663-41f7-9f9f-8da9c2c9a074 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1223 microversion: 2.1 time: 0.173410 Jul 18 02:32:58.718973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1834/3713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1223 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:58.745250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.746667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.753524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.754427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.755843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.756887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.964526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.966462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:58.977297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.978346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.979689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.980511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.334378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:59.354982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5055f37d-4410-48fb-8577-b700881661f2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 0.399447 Jul 18 02:32:59.356484 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1835/3714] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:59.366004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:59.369750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:59.391117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.391581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.392418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.392956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.690206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:59.704599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c8d7abf-15e7-4585-a4e0-ce9cd5691c5e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 1.010028 Jul 18 02:32:59.707633 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1880/3715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:59.720269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-cd7864e9-7348-4389-962d-bbb4b8768e79 req-af5e50a7-a8bf-42a8-8368-b4aca968994e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:32:59.745550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cd7864e9-7348-4389-962d-bbb4b8768e79 req-af5e50a7-a8bf-42a8-8368-b4aca968994e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.753188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cd7864e9-7348-4389-962d-bbb4b8768e79 req-af5e50a7-a8bf-42a8-8368-b4aca968994e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.772791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-cd7864e9-7348-4389-962d-bbb4b8768e79 req-af5e50a7-a8bf-42a8-8368-b4aca968994e service nova] Creating event network-changed:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:32:59.795793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-cd7864e9-7348-4389-962d-bbb4b8768e79 req-af5e50a7-a8bf-42a8-8368-b4aca968994e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086578 Jul 18 02:32:59.797183 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1881/3716] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:59.803392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:59.812156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:32:59.827299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.830649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.834734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:59.841766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:59.945638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:32:59.978455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1e93d94-0546-446a-94dd-7d9abfbf84e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.613067 Jul 18 02:32:59.988647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1836/3717] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:32:59.998931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:00.000416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:00.038727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.046738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.056407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.059888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.820188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:00.832646 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07f464c8-f8ee-4121-81e4-a331350f9d1b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.850703 Jul 18 02:33:00.844607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1837/3718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:00.851417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:00.852850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:00.860542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.861362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.863781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.865003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:01.054773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:01.071433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c2b2f9f-8aee-42f3-8af8-d2591b65272c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1277 microversion: 2.1 time: 0.223895 Jul 18 02:33:01.073574 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1838/3719] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:00 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:01.095498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:01.101227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:01.124007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:01.127613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:01.138045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:01.148794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:01.151237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:01.160451 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e775762-dd21-4a8a-9f6c-83280f0412d9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 1.358395 Jul 18 02:33:01.163185 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1882/3720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:01.183894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:01.186634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:01.198394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:01.199399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:01.200740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:01.202288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.520593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:02.548797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67b0d707-0ddc-4388-81cc-82c735db81cf tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 1.382619 Jul 18 02:33:02.550789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1883/3721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:01 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:02.561972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:02.564650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:02.573436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.575099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.576323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.577174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.752039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:02.778526 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1cbc160-33ba-4660-adf9-5361a3b105bb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 1.702852 Jul 18 02:33:02.793488 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1839/3722] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:01 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:02.817050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:02.818311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:02.828152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.829953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.831414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:02.832598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:02.929332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:02.964017 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-106d25a0-eb9a-46da-8c41-6b31dd74eaae tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.410213 Jul 18 02:33:02.965921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1884/3723] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:02 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:02.975866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:02.978513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:02.999567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.000890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.003169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.004384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.178144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:03.193164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5a28e05-5c33-40f5-9bfd-fcb5930946fa tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1277 microversion: 2.1 time: 0.224770 Jul 18 02:33:03.208991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1885/3724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:02 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:03.215617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:03.216138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:03.223030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.223536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.224352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.224818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.620990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:03.670668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3718439-ad30-4e35-93ed-849b2483e156 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.873084 Jul 18 02:33:03.692963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1840/3725] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:02 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:03.692963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-93e581e6-5229-4461-bb8f-65a9c0cc9c1a req-b31f7b5f-3cb0-49c9-8276-3f97fc3c67ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3dfe2e1-7b24-4479-812c-19010d3b8502", "tag": "396a072d-1b82-4355-be44-e69d79d5825f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:03.698273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:03.707885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93e581e6-5229-4461-bb8f-65a9c0cc9c1a req-b31f7b5f-3cb0-49c9-8276-3f97fc3c67ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.708598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93e581e6-5229-4461-bb8f-65a9c0cc9c1a req-b31f7b5f-3cb0-49c9-8276-3f97fc3c67ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.724687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-93e581e6-5229-4461-bb8f-65a9c0cc9c1a req-b31f7b5f-3cb0-49c9-8276-3f97fc3c67ea service nova] Creating event network-changed:396a072d-1b82-4355-be44-e69d79d5825f for instance f3dfe2e1-7b24-4479-812c-19010d3b8502 on n-h1-849796-1 Jul 18 02:33:03.732446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-93e581e6-5229-4461-bb8f-65a9c0cc9c1a req-b31f7b5f-3cb0-49c9-8276-3f97fc3c67ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052507 Jul 18 02:33:03.733120 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1841/3726] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:03.740103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:03.741653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:03.751859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.752685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.754276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:03.754964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:03.985115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:04.001720 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-99fe362b-7cc3-4737-a042-d012d7ef536c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1511 microversion: 2.1 time: 0.801867 Jul 18 02:33:04.011897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1886/3727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:03 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1511 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:04.017327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:04.018350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:04.023080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:04.037864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:04.038780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:04.040245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:04.048245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:04.371069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:04.418884 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c2cb1ce-fad5-46b2-a3f0-f851113a6a79 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.683527 Jul 18 02:33:04.442022 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1842/3728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:03 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:04.449872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:04.451434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:04.467924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:04.471471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:04.474969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:04.476545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.104708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:05.117251 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bdc955ad-e430-4ff0-aca8-8647325e9903 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 1.103874 Jul 18 02:33:05.119745 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1887/3729] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:04 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:05.131851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.137915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.148868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.149744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.152726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.153546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.421636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:05.441077 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee3419cd-47b4-4967-a8f1-6f2fddc96050 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 1.002813 Jul 18 02:33:05.443090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1843/3730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:04 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:05.462707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-46a68c9a-9857-484c-b952-bb2fcde7ac13 req-bc60b83f-2250-43ac-af96-00332fc646de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db046266-0d2e-477b-be4d-312ce05dbb26", "name": "network-vif-plugged", "status": "completed", "tag": "b8ef8346-9129-4486-9f88-76106866c0ed"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:05.491729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-46a68c9a-9857-484c-b952-bb2fcde7ac13 req-bc60b83f-2250-43ac-af96-00332fc646de service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.493944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-46a68c9a-9857-484c-b952-bb2fcde7ac13 req-bc60b83f-2250-43ac-af96-00332fc646de service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.522633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-46a68c9a-9857-484c-b952-bb2fcde7ac13 req-bc60b83f-2250-43ac-af96-00332fc646de service nova] Creating event network-vif-plugged:b8ef8346-9129-4486-9f88-76106866c0ed for instance db046266-0d2e-477b-be4d-312ce05dbb26 on n-h1-849796-1 Jul 18 02:33:05.536882 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-46a68c9a-9857-484c-b952-bb2fcde7ac13 req-bc60b83f-2250-43ac-af96-00332fc646de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090338 Jul 18 02:33:05.538940 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1844/3731] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:05.552836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.556140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.575596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.577370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.591010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.596871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.917992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:05.928750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-926daaa3-8fe6-461b-b784-a154923715d2 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.807261 Jul 18 02:33:05.933777 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1888/3732] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:05 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:05.966966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:05.970027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:05.983084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.984334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:05.986658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:05.988832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:06.080714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:06.110447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=22 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:06.407195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:06.423823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee971386-f73a-4098-8fb9-e7e86795e554 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.881351 Jul 18 02:33:06.426764 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1845/3733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:05 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:06.437226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:06.439188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:06.452190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:06.453562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:06.456578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:06.457969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:06.928366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:06.959505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-412132f5-fa5d-439a-a6f9-e2b3b5183421 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1488 microversion: 2.1 time: 1.006130 Jul 18 02:33:06.979184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:06.980477 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1889/3734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:05 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1488 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:07.001570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:07.010595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:07.027061 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49e04696-b9eb-471b-8e96-5ff81cabfb53 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.597838 Jul 18 02:33:07.029200 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1846/3735] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:06 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:07.047005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:07.047990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:07.052145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.053286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.054822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.060977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.066035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.067418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.068479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.070989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.611437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:07.637424 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-127f5be3-52e1-43f9-9d16-112997eb9b60 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.596049 Jul 18 02:33:07.645247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1847/3736] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:07 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:07.657196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:07.658337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:07.672366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.673356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.675169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.676313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.844892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:07.856574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45fcd27d-1d42-4473-b598-02693f9035ae tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 0.873264 Jul 18 02:33:07.859400 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1890/3737] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:06 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:07.868046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:07.877277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:07.889512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.889980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.890800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:07.891257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:07.935112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:08.124515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:08.156745 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4184b170-f689-4b12-8b61-4ae5c59391b7 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.509971 Jul 18 02:33:08.180963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1848/3738] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:07 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:08.193356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:08.193701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f6cd008b-5945-4a01-9054-4e12de544a1c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 204 len: 0 microversion: 2.1 time: 0.329348 Jul 18 02:33:08.194435 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1891/3739] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:07 2022] DELETE /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:08.195171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:08.201398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9ca5ad80-5c88-4502-abc0-4ddeec3e0e0e req-cf430a49-1e85-4b04-b5ee-8acad5785c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a86106-e355-4393-88a5-ab6420797766", "tag": "a9318193-0a2d-423c-999e-dd789fbcb5b4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:08.209681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.216917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.217969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.226019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.232413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ca5ad80-5c88-4502-abc0-4ddeec3e0e0e req-cf430a49-1e85-4b04-b5ee-8acad5785c59 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.232855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ca5ad80-5c88-4502-abc0-4ddeec3e0e0e req-cf430a49-1e85-4b04-b5ee-8acad5785c59 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.286915 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9ca5ad80-5c88-4502-abc0-4ddeec3e0e0e req-cf430a49-1e85-4b04-b5ee-8acad5785c59 service nova] Creating event network-changed:a9318193-0a2d-423c-999e-dd789fbcb5b4 for instance 62a86106-e355-4393-88a5-ab6420797766 on n-h1-849796-1 Jul 18 02:33:08.295573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9ca5ad80-5c88-4502-abc0-4ddeec3e0e0e req-cf430a49-1e85-4b04-b5ee-8acad5785c59 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098518 Jul 18 02:33:08.303777 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1892/3740] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:08.317117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:08.317645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:08.340794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.341305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.342183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.342645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.656357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:08.672800 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85184f0f-1bb6-42ca-9b1a-83fdf481cfda tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.501556 Jul 18 02:33:08.676165 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1849/3741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:08 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:08.702259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d587a444-7085-4bc2-81f0-82c63f699c6b req-add614c0-9c6c-4eb1-b1e1-8715d20c77a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f31075-84fa-48ad-a045-155d0c8020cc", "tag": "edc82532-17d0-4933-9aec-64f8ab4b6960"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:08.723940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d587a444-7085-4bc2-81f0-82c63f699c6b req-add614c0-9c6c-4eb1-b1e1-8715d20c77a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.726501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d587a444-7085-4bc2-81f0-82c63f699c6b req-add614c0-9c6c-4eb1-b1e1-8715d20c77a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.749136 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d587a444-7085-4bc2-81f0-82c63f699c6b req-add614c0-9c6c-4eb1-b1e1-8715d20c77a6 service nova] Creating event network-changed:edc82532-17d0-4933-9aec-64f8ab4b6960 for instance b0f31075-84fa-48ad-a045-155d0c8020cc on n-h2-849796-1 Jul 18 02:33:08.756550 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d587a444-7085-4bc2-81f0-82c63f699c6b req-add614c0-9c6c-4eb1-b1e1-8715d20c77a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076009 Jul 18 02:33:08.758015 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1850/3742] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:08.766014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:08.768407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:08.777566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.781270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:08.782828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:08.783941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.208903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:09.231084 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f03e75a-9e60-4cfd-b92d-8955f0850ce8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.924674 Jul 18 02:33:09.232196 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1893/3743] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:08 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:09.237407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:09.238441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:09.246526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.247431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.248564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.249350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.438563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:09.459948 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eec17cc1-676b-43e0-b217-2f42df2f7b11 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1494 microversion: 2.1 time: 0.699949 Jul 18 02:33:09.474685 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1851/3744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:08 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1494 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:09.491540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:09.493717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:09.506498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.507775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.510282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.511480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.521757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:09.733277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:09.749108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fead2e0-7dd8-41ad-985d-cfe9ed6ea8d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.515349 Jul 18 02:33:09.757632 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1894/3745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:09 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:09.765032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:09.770372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:09.792010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.795719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.797007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:09.799020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:09.878531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:10.024859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:10.056829 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3008cecf-1a5d-42a3-84a5-c8638e4f99e4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 0.572493 Jul 18 02:33:10.058835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1852/3746] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:09 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:10.121370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:10.122430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:10.145804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.148156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.150123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.150874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.432779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:10.452559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f54ad0a-c968-4cf9-a5c3-9a1af1880c70 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.692039 Jul 18 02:33:10.455282 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1895/3747] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:09 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:10.468524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f0e33477-1995-4637-9db8-d3a249b46e86 req-908b63c3-afa9-46cc-a70a-8d1b223ad603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "name": "network-vif-plugged", "status": "completed", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:10.492391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f0e33477-1995-4637-9db8-d3a249b46e86 req-908b63c3-afa9-46cc-a70a-8d1b223ad603 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.494875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f0e33477-1995-4637-9db8-d3a249b46e86 req-908b63c3-afa9-46cc-a70a-8d1b223ad603 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.527758 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f0e33477-1995-4637-9db8-d3a249b46e86 req-908b63c3-afa9-46cc-a70a-8d1b223ad603 service nova] Creating event network-vif-plugged:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:33:10.535751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f0e33477-1995-4637-9db8-d3a249b46e86 req-908b63c3-afa9-46cc-a70a-8d1b223ad603 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076164 Jul 18 02:33:10.538371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1896/3748] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:10.548560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:10.549508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:10.565869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.566515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.569682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:10.579074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:10.975832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:10.989070 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-209f8661-16bc-40ab-a751-6de0cf814b86 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.928298 Jul 18 02:33:10.993927 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1853/3749] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:10 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:11.004569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.005250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:11.013379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.014223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.015214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.015851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.029490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:11.058278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b567b041-0924-4c24-b4e9-3e3d5f1a24c5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.516530 Jul 18 02:33:11.068802 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1897/3750] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:10 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:11.070403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.072567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:11.105132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.105692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.106647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.107173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.342834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:11.351133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23d100b6-9063-4788-bf3e-2bfe800fe44f tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.289537 Jul 18 02:33:11.360680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:11.361883 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1898/3751] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:11 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:11.366964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.368371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:11.372054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10149f64-18de-4b1a-acc7-8e3f9a4a9cea tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1494 microversion: 2.1 time: 0.376922 Jul 18 02:33:11.372674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1854/3752] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:10 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1494 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:11.380769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f69d963-75cf-43fe-961d-fde111a21219 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Action: 'create', calling method: .version_select at 0x7fab043e84c0>, body: {"keypair": {"name": "tempest-keypair-1081031527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsDcb8qtfWVy8s1KDZwlgbVg/80sZI+0ZjXEPJcyZB2MP/40lZ3YcmdKn7dx+DDrflW6yQtoYIrbgKRPpOBVwVZnvlgNa0nRKhYPDhRcJ+sR+GW9nVJXSlu37SiPYLEgQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:11.385488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.385975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.386816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.387312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.408170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6f69d963-75cf-43fe-961d-fde111a21219 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Getting quotas for project b6ef9389578f4aca8233533171198ee6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:33:11.414887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6f69d963-75cf-43fe-961d-fde111a21219 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Getting quotas for user a9990f4c3c694c37bec6d04f56d27287 and project b6ef9389578f4aca8233533171198ee6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:33:11.452743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f69d963-75cf-43fe-961d-fde111a21219 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.075938 Jul 18 02:33:11.453557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1855/3753] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:33:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:33:11.472360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.473224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:11.481514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.482469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.483846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.484607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.850503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:11.872676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-487d01ce-0c3e-4f01-ad73-0ea2e843e4cc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.404799 Jul 18 02:33:11.873941 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1856/3754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:11 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:12.023215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.024753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:12.052989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.053471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.055323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.055488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.190834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.213484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3efc803d-fa91-4b2f-a77d-c180756c4aee tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 0.850065 Jul 18 02:33:12.214908 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1899/3755] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:11 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.220232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.221229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:12.230165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.231068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.232221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.233038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.407293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.418617 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f10e7ada-312b-437d-97b5-0be95814eda9 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1394 microversion: 2.1 time: 0.400321 Jul 18 02:33:12.429865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1857/3756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1394 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.437839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-da0db6df-a325-4361-9def-31aa057d60ea req-228fcd8b-d2f9-456e-9e57-46be7e0efbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e6d9b6-49e4-44e3-ba58-f134bbbcb645", "name": "network-vif-deleted", "tag": "858a341e-3306-4e34-a11e-ca45175f0396"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:12.454738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da0db6df-a325-4361-9def-31aa057d60ea req-228fcd8b-d2f9-456e-9e57-46be7e0efbe6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.455201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da0db6df-a325-4361-9def-31aa057d60ea req-228fcd8b-d2f9-456e-9e57-46be7e0efbe6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.471585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-da0db6df-a325-4361-9def-31aa057d60ea req-228fcd8b-d2f9-456e-9e57-46be7e0efbe6 service nova] Creating event network-vif-deleted:858a341e-3306-4e34-a11e-ca45175f0396 for instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 on n-h1-849796-1 Jul 18 02:33:12.488055 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-da0db6df-a325-4361-9def-31aa057d60ea req-228fcd8b-d2f9-456e-9e57-46be7e0efbe6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054445 Jul 18 02:33:12.490967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1858/3757] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:12.501437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.503894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:12.519388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.519853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.521315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.521800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.586538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.609938 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18785197-309e-403f-9480-606421544c33 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.393225 Jul 18 02:33:12.613040 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1900/3758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.624895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.628902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:12.642957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.644112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.646198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.647304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.943105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:12.976764 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c47c2616-66ef-4a3c-a127-70791f72c301 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.480939 Jul 18 02:33:12.979060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1859/3759] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:12.994410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:13.001610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-41e59607-a8eb-41f1-846c-17fc1cecc7a5 req-283b1677-9ea3-4690-9653-c622700c2e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3dfe2e1-7b24-4479-812c-19010d3b8502", "name": "network-vif-plugged", "status": "completed", "tag": "396a072d-1b82-4355-be44-e69d79d5825f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:13.007586 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a0674f0-66c1-4777-a8fb-44201ebf57ca tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 200 len: 1452 microversion: 2.1 time: 0.392206 Jul 18 02:33:13.008684 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1901/3760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 1452 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:13.022715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-41e59607-a8eb-41f1-846c-17fc1cecc7a5 req-283b1677-9ea3-4690-9653-c622700c2e3f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.024656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-41e59607-a8eb-41f1-846c-17fc1cecc7a5 req-283b1677-9ea3-4690-9653-c622700c2e3f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.025648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.026264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.038864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.039500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.041335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.048574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.067474 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-41e59607-a8eb-41f1-846c-17fc1cecc7a5 req-283b1677-9ea3-4690-9653-c622700c2e3f service nova] Creating event network-vif-plugged:396a072d-1b82-4355-be44-e69d79d5825f for instance f3dfe2e1-7b24-4479-812c-19010d3b8502 on n-h1-849796-1 Jul 18 02:33:13.084283 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-41e59607-a8eb-41f1-846c-17fc1cecc7a5 req-283b1677-9ea3-4690-9653-c622700c2e3f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101919 Jul 18 02:33:13.086685 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1860/3761] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:13.239631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.241531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.256461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.258477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.259741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.261064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.741632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:13.752436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c009b845-fc87-4aa7-9c87-ab357f20065f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.741623 Jul 18 02:33:13.763649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1902/3762] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:13.769124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.770875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.786530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.787810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.789846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.790926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.917978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:13.932029 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3b69fe2-1599-4bdb-9851-bdbbd1d81295 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1322 microversion: 2.1 time: 0.701236 Jul 18 02:33:13.933059 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1861/3763] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1322 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:13.948962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:13.950275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:13.963225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.964300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:13.965959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:13.966878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.360276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:14.383989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2410bb7-daa0-4ef8-81d8-7d22bdaf494e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.444766 Jul 18 02:33:14.385534 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1862/3764] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:14.395432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:14.397162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:14.413254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.415062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.416814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.418645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.537116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:14.561703 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c9be1a1-cb60-4cd2-8a2f-f4bcae767ba5 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1575 microversion: 2.1 time: 0.795964 Jul 18 02:33:14.563886 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1903/3765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:13 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1575 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:14.573834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:14.575502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:14.592528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.595806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.597821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.599041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.634642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 HTTP/1.1 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '46e6d9b6-49e4-44e3-ba58-f134bbbcb645'} Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:14.638106 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:14.650685 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:14.656756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:14.666974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-792f804c-6e49-4784-8796-bd8578da0e95 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 404 len: 111 microversion: 2.1 time: 0.088005 Jul 18 02:33:14.668006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1904/3766] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:14 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:14.683423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:14.684861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:14.716387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.717731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.719552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:14.722038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:14.947541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:14.966716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f79cb47-e2aa-429c-9b0c-2a18f6a57f75 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.578368 Jul 18 02:33:14.968264 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1863/3767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:14 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:14.978495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:14.979721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:14.982957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b640bc5e-fda4-4751-805f-959cc282cb13 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309737 Jul 18 02:33:14.983470 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1905/3768] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:33:14 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:14.988738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-773283655", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:15.003294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.004445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.005988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.006857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.090032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] validate_networks() for [('7b6bc0ad-816c-4b86-85c0-0c8f264c0fc8', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:33:15.515930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:15.544817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0dfdece7-7ad7-4d36-8b97-c8c5e058b680 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.573661 Jul 18 02:33:15.548892 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1864/3769] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:14 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:15.562861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:15.567590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:15.578846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.579697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:15.582456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:15.583276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.050790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:16.068447 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1eeba6e6-3f67-48ff-afdc-05d787bd5222 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1518 microversion: 2.1 time: 0.515654 Jul 18 02:33:16.070126 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1865/3770] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:15 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1518 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:16.080200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:16.081759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:16.096021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.097015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.099183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.100312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.445617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:16.461602 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-819fc178-99c4-466c-8edb-18c204780f89 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1735 microversion: 2.1 time: 0.388103 Jul 18 02:33:16.462505 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1866/3771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:16 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:16.472974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:16.475065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:16.486884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.487546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.488681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.489310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.747213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:33:16.748760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:33:16.749587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:33:16.750071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:33:16.750572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:33:16.765026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.765861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.766943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:16.767390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:16.792625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:33:16.802390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Getting quotas for user 8e60eeaf31c649adac6b993cf50c9373 and project b8560a71383b47aea3448472abfc9714. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:33:16.828250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:33:16.831347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:33:17.006023 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0d1c08e-916a-42e5-9535-996f1ec2b212 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.016845 Jul 18 02:33:17.013481 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1906/3772] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:33:17.066786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:17.071456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:17.097109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.098643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.100639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.101940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.129168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:17.154605 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b1654d4-2608-49aa-95bf-d2bd2acb7ff1 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.688538 Jul 18 02:33:17.157944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1867/3773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:16 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:17.171166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1709881594", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fc5ffb84-431d-473f-927c-e9432afb8711"}, {"port": "e9ca6de3-664a-4714-950c-3622cc7b1828", "tag": "port-1"}, {"port": "430974f5-0c03-40de-95f0-2ea6f0fa51ab", "tag": "port-2"}, {"uuid": "62ee4297-2645-4a21-a705-9cadbaa29755", "tag": "net-1"}, {"uuid": "62ee4297-2645-4a21-a705-9cadbaa29755"}, {"uuid": "6cec5681-fee9-4ce7-9253-6a100489feff", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6cec5681-fee9-4ce7-9253-6a100489feff", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d0525069-41a0-461e-a50d-e442f6e9050a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8d6aa029-517d-4601-9cbd-eddf910fd0fa", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9a68777e-4ec2-4eb0-9e9a-7a056c08dbd2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--30627044"}], "key_name": "tempest-keypair-1081031527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:17.175992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lazy-loading 'flavor' on Instance uuid 3929008e-af78-4e8c-a040-5d841ec96898 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:17.489229 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5013a360-f2c6-4b94-b8b8-38504f0bc74a tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action" status: 200 len: 32 microversion: 2.1 time: 0.460633 Jul 18 02:33:17.491556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1907/3774] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:17 2022] POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:33:17.504230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:17.507701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:17.523223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.525075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.529778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:17.530774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:17.619236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] validate_networks() for [('fc5ffb84-431d-473f-927c-e9432afb8711', None, None, None, None, None), (None, None, 'e9ca6de3-664a-4714-950c-3622cc7b1828', None, None, None), (None, None, '430974f5-0c03-40de-95f0-2ea6f0fa51ab', None, None, None), ('62ee4297-2645-4a21-a705-9cadbaa29755', None, None, None, None, None), ('62ee4297-2645-4a21-a705-9cadbaa29755', None, None, None, None, None), ('6cec5681-fee9-4ce7-9253-6a100489feff', '10.2.2.100', None, None, None, None), ('6cec5681-fee9-4ce7-9253-6a100489feff', '10.2.2.200', None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:33:18.007718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:18.029296 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-efcafb78-a34a-4e69-b3f5-5ef40268a67c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.535138 Jul 18 02:33:18.030611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1908/3775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:17 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:18.036004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c5cc54a5-a80a-4712-8011-1e78b74f0298 req-88fd2473-554a-4056-868a-ae0f4f47d4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f31075-84fa-48ad-a045-155d0c8020cc", "name": "network-vif-plugged", "status": "completed", "tag": "edc82532-17d0-4933-9aec-64f8ab4b6960"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:18.070901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c5cc54a5-a80a-4712-8011-1e78b74f0298 req-88fd2473-554a-4056-868a-ae0f4f47d4d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:18.072065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c5cc54a5-a80a-4712-8011-1e78b74f0298 req-88fd2473-554a-4056-868a-ae0f4f47d4d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:18.101523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c5cc54a5-a80a-4712-8011-1e78b74f0298 req-88fd2473-554a-4056-868a-ae0f4f47d4d0 service nova] Creating event network-vif-plugged:edc82532-17d0-4933-9aec-64f8ab4b6960 for instance b0f31075-84fa-48ad-a045-155d0c8020cc on n-h2-849796-1 Jul 18 02:33:18.123987 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c5cc54a5-a80a-4712-8011-1e78b74f0298 req-88fd2473-554a-4056-868a-ae0f4f47d4d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091310 Jul 18 02:33:18.142437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1909/3776] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:18.172448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:18.174041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:18.202159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:18.203019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:18.204765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:18.205476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:18.422403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:18.435223 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d508dd00-cd13-4bb8-b169-899314adddaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1210 microversion: 2.1 time: 0.289962 Jul 18 02:33:18.442337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1910/3777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:18 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1210 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:18.468185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:18.469662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:18.501920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:18.502450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:18.505231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:18.507766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.341324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:19.356596 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-985facf3-a486-4d9d-a87e-7ec63847b4e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1715 microversion: 2.1 time: 0.911999 Jul 18 02:33:19.357541 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1911/3778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:18 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1715 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:19.363971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:19.364873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:19.373998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.389315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.392729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.396720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.845018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:19.861534 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e706ffa1-5530-4a28-a364-52dca92ebbc0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.502532 Jul 18 02:33:19.862609 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1912/3779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:19 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:19.874549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:19.875670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:19.891090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.899466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.900780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:19.901468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:19.905249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:20.384239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:20.412075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36045f04-4f5b-42a8-9b09-e0425331b3a4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.547793 Jul 18 02:33:20.424519 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1913/3780] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:19 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:20.458478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:20.469161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:20.489259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:20.494957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:20.496911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:20.499977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:20.865103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:20.921704 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ed8d8f7-8834-4949-980e-fd75555ab511 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1575 microversion: 2.1 time: 0.486126 Jul 18 02:33:20.925156 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1914/3781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:20 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1575 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:20.958526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8699eb58-a7f9-4d28-9bcf-193e16d6595c req-422d18ac-a3c0-4740-85b0-926d00aafea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db046266-0d2e-477b-be4d-312ce05dbb26", "tag": "b8ef8346-9129-4486-9f88-76106866c0ed"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:20.998186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8699eb58-a7f9-4d28-9bcf-193e16d6595c req-422d18ac-a3c0-4740-85b0-926d00aafea6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.000517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8699eb58-a7f9-4d28-9bcf-193e16d6595c req-422d18ac-a3c0-4740-85b0-926d00aafea6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.052445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8699eb58-a7f9-4d28-9bcf-193e16d6595c req-422d18ac-a3c0-4740-85b0-926d00aafea6 service nova] Creating event network-changed:b8ef8346-9129-4486-9f88-76106866c0ed for instance db046266-0d2e-477b-be4d-312ce05dbb26 on n-h1-849796-1 Jul 18 02:33:21.069981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8699eb58-a7f9-4d28-9bcf-193e16d6595c req-422d18ac-a3c0-4740-85b0-926d00aafea6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138032 Jul 18 02:33:21.074835 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1915/3782] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:21.097221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.110165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:21.133863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.138358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.140065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.140895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.424018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:21.564128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:21.582421 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98c27348-2263-4661-a0d9-4f80181b3394 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.505038 Jul 18 02:33:21.584991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1916/3783] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:21 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:21.605690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.606937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:21.620964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.621798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.623253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.624060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.854599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:21.875747 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bcf7a72d-738c-43aa-b496-3f7c3a8bccd6 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.288572 Jul 18 02:33:21.903714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1917/3784] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:21 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:21.922787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:21.923537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:21.942831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.947175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:21.948321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:21.948789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.124477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Cannot 'detach_volume' instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 while it is in vm_state rescued Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments/3673f2f9-bd15-40b6-b110-5882913021bb HTTP/1.1 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'detach_volume' instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 while it is in vm_state rescued Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '9bd37eff-f3dd-4623-9c73-d351db4348c2', 'id': '3673f2f9-bd15-40b6-b110-5882913021bb'} Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 while it is in vm_state rescued Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.126865 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 while it is in vm_state rescued Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:22.144022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 409 to user: Cannot 'detach_volume' instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 while it is in vm_state rescued {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:22.145707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd6abdf8-a67f-4ec1-84f5-18941578cd15 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments/3673f2f9-bd15-40b6-b110-5882913021bb" status: 409 len: 152 microversion: 2.1 time: 0.238027 Jul 18 02:33:22.149754 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1918/3785] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:33:21 2022] DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments/3673f2f9-bd15-40b6-b110-5882913021bb => generated 152 bytes in 242 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:33:22.152181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:22.152941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:22.169335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.169901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.171966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.174159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.766885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:22.780714 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8bdfd028-9438-4bfc-bdc8-91f1e1f777d8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.632470 Jul 18 02:33:22.781668 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1919/3786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:22 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:22.788388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:22.790491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:22.799210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.800079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:22.801493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:22.802355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.433012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:23.444884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9996dc7c-d86c-46ab-8a69-5249ec7d0f3a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.661533 Jul 18 02:33:23.446144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1920/3787] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:22 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:23.452823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:23.453613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:23.464135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.465089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.466534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.467269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.569785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-265029be-d487-4fd2-96d3-11ed48865baa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/action" status: 202 len: 0 microversion: 2.1 time: 0.121289 Jul 18 02:33:23.571494 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1921/3788] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:23 2022] POST /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:23.607146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:23.609625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:23.643639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.645554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.653089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:23.653977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:23.965208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:23.983795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a15bea8e-9e09-4986-94c1-9047d416b1d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.410131 Jul 18 02:33:23.985889 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1922/3789] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:23 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:23.996174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6711af21-ffa3-4002-a3c4-bc5b12bb2ba0 req-03b0fc5e-8f3f-4339-8fd2-cab1572e86ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a86106-e355-4393-88a5-ab6420797766", "name": "network-vif-plugged", "status": "completed", "tag": "a9318193-0a2d-423c-999e-dd789fbcb5b4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:24.013021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6711af21-ffa3-4002-a3c4-bc5b12bb2ba0 req-03b0fc5e-8f3f-4339-8fd2-cab1572e86ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.014068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6711af21-ffa3-4002-a3c4-bc5b12bb2ba0 req-03b0fc5e-8f3f-4339-8fd2-cab1572e86ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.044959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6711af21-ffa3-4002-a3c4-bc5b12bb2ba0 req-03b0fc5e-8f3f-4339-8fd2-cab1572e86ad service nova] Creating event network-vif-plugged:a9318193-0a2d-423c-999e-dd789fbcb5b4 for instance 62a86106-e355-4393-88a5-ab6420797766 on n-h1-849796-1 Jul 18 02:33:24.054172 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6711af21-ffa3-4002-a3c4-bc5b12bb2ba0 req-03b0fc5e-8f3f-4339-8fd2-cab1572e86ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065742 Jul 18 02:33:24.057028 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1923/3790] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:24.072028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:24.078369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:33:24.079256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:33:24.079541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:33:24.080072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:33:24.081406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:33:24.081858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:24.098905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.100141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.102537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.103810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.112282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.120146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.125068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.126134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.178378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Getting quotas for project b6ef9389578f4aca8233533171198ee6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:33:24.205033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Getting quotas for user a9990f4c3c694c37bec6d04f56d27287 and project b6ef9389578f4aca8233533171198ee6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:33:24.659985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:33:24.664128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d0525069-41a0-461e-a50d-e442f6e9050a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8d6aa029-517d-4601-9cbd-eddf910fd0fa',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a68777e-4ec2-4eb0-9e9a-7a056c08dbd2',volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:33:24.835291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:24.852278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49b8b1ce-164a-42f1-a587-6e71d64c965f tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.792627 Jul 18 02:33:24.862057 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1924/3791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:24 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:24.869655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-96eb4f96-134b-4324-9351-2fb5db852d7e req-7bad0031-03a6-4917-9e29-683b3f7626ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7299d59-8e54-49ae-a5bd-bd6889273992", "tag": "b5347dcc-1744-4dc8-ad68-6183a8c21dbd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:24.879694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-96eb4f96-134b-4324-9351-2fb5db852d7e req-7bad0031-03a6-4917-9e29-683b3f7626ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.880429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-96eb4f96-134b-4324-9351-2fb5db852d7e req-7bad0031-03a6-4917-9e29-683b3f7626ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.896065 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-96eb4f96-134b-4324-9351-2fb5db852d7e req-7bad0031-03a6-4917-9e29-683b3f7626ee service nova] Creating event network-changed:b5347dcc-1744-4dc8-ad68-6183a8c21dbd for instance b7299d59-8e54-49ae-a5bd-bd6889273992 on n-h2-849796-1 Jul 18 02:33:24.903455 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-96eb4f96-134b-4324-9351-2fb5db852d7e req-7bad0031-03a6-4917-9e29-683b3f7626ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039698 Jul 18 02:33:24.905383 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1925/3792] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:24.912293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:24.913517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:24.921681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.922827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:24.939984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:24.940989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.194851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7274bd89-bd75-4ba5-b0b5-7ba686da7c65 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 8.034993 Jul 18 02:33:25.207972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1868/3793] 10.222.0.67 () {62 vars in 1188 bytes} [Mon Jul 18 02:33:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 8049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:33:25.217074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:25.239079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:25.246376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:25.261317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.261790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.262856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.263328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.269341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1a9f50d-4fb7-4376-b7e0-0bdfa4added3 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1723 microversion: 2.1 time: 0.362245 Jul 18 02:33:25.279272 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1926/3794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:24 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:25.295763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:25.297425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:25.302310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:25.315716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.316816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.320752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.322636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.564657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:25.577497 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06077dd4-0d92-4778-ab32-4753342c0a67 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.366813 Jul 18 02:33:25.589499 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1869/3795] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:25 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:25.595679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:25.596860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:25.609360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.610375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.611826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:25.612493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:25.858955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:25.884500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2918430f-4993-4100-b933-b0b1f4cfa0bf tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.292688 Jul 18 02:33:25.901455 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1870/3796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:25 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:25.912541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:25.913748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.010362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.022975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.024948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.026117 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e41d8bd6-5daa-4fbc-a8be-9961ce8157c1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1286 microversion: 2.42 time: 0.123108 Jul 18 02:33:26.027033 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1871/3797] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:25 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:26.047134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.048359 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-980f3fb4-60d6-4376-95a0-edd892d7e834 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1485 microversion: 2.1 time: 0.766696 Jul 18 02:33:26.050338 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1927/3798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:25 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1485 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:26.051467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.052172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.062972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.065421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.066134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.066874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.076627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:26.078448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.088393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.088878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.090368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.090368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.193168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb0aea37-dd9d-41c9-a75b-993bb37b0da6 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "POST /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05/action" status: 202 len: 0 microversion: 2.1 time: 0.120391 Jul 18 02:33:26.194910 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1928/3799] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:26 2022] POST /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:26.209055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.211578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.225112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.225944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.227931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.228716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.338509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.347297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:26.366404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0574bf88-900a-4321-ab0c-69b6df67d369 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.336738 Jul 18 02:33:26.367901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1872/3800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:26.373242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.373921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.385116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.385680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.386385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.386920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.553379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.565122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6eb27993-1958-4a96-9ff8-af91395c558b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1723 microversion: 2.1 time: 0.196009 Jul 18 02:33:26.565830 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1873/3801] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:26.597494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.598564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.605726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.606186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.607082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.607491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.741638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.747004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:26.761558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfdd421d-fa43-449e-9881-c1b5944b8e25 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1493 microversion: 2.1 time: 0.561548 Jul 18 02:33:26.763089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1929/3802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1493 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:26.766589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:26.775347 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4003a457-490d-42d8-b418-50cade76600f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.181998 Jul 18 02:33:26.776128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1874/3803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:26.918079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:26.919023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:26.921842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:26.922712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:26.932909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.933634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:26.934538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:26.935087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.053976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.055401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.062361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.062822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.064003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.064466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.192436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.206590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.207518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.208849 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b709136-2a1d-4b7e-b8cc-2aa5fce37a0d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1528 microversion: 2.42 time: 0.158954 Jul 18 02:33:27.210049 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1875/3804] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1528 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:33:27.236060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.254991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-283a0a1d-f67c-41e4-9807-971ea1d19080 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.342622 Jul 18 02:33:27.256724 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1930/3805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:26 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:27.390065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.391150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.402010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.402570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.403499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.404166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.589686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.591472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.600368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.601170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.603993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.604748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.743776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.760854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a55badca-cfed-4422-88de-aef72a677818 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.375168 Jul 18 02:33:27.762493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1876/3806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:27.786589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.787905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.793070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:27.809842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.811286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.813310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.813993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.871215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:27.902315 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba08ad76-153b-4d60-90d2-5fd0a9f32c37 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1723 microversion: 2.1 time: 0.318312 Jul 18 02:33:27.905602 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1931/3807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:27.916440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:27.918553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:27.931988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.932978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:27.934637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:27.935560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.048745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:28.060994 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae3a43c2-370d-4b53-a660-379df7c7afb8 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1493 microversion: 2.1 time: 0.282007 Jul 18 02:33:28.070816 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1877/3808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1493 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:28.200275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:28.226427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7e37c77-3259-466d-a723-4c87d982f78c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.317440 Jul 18 02:33:28.228342 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1932/3809] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:27 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:28.253284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:28.253284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:28.267641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.268103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.275751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:28.276787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:28.284879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.285142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.302679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.303949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.307197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.309823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.412027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:28.425812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:28.427382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:28.434801 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c43fe37-7d77-42d8-bcd5-d6f4e1d0c585 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1528 microversion: 2.42 time: 0.194174 Jul 18 02:33:28.450638 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1878/3810] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:28 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1528 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:28.796564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:28.798457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:28.814984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.817182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:28.819233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:28.822417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.082157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:29.102479 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42c8be81-cd3a-4fc5-ac9c-52074e027403 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.315119 Jul 18 02:33:29.103609 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1879/3811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:28 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:29.126447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:29.127305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:29.144593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.145847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.146914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.147477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.150360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:29.162259 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81d5886c-656c-4fcb-83d2-3f1c225b6a4e tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1319 microversion: 2.1 time: 0.891065 Jul 18 02:33:29.179587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1933/3812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:28 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1319 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:29.188725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:29.190661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:29.199144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.199639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.200503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.201358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.505106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:29.583498 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5a245ae5-58c9-4f0a-995a-4ec46a0942aa tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1729 microversion: 2.1 time: 0.466269 Jul 18 02:33:29.584875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1880/3813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:29 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1729 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:29.591479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:29.592116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:29.621596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.623894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:29.626146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:29.627297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.059338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.074565 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36df538f-6dec-40fe-993a-885e1672d40a tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1493 microversion: 2.1 time: 0.892386 Jul 18 02:33:30.076199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1934/3814] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:29 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1493 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:30.112114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.113380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:30.130825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.132137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.134705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.135896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.353460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.368513 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f7b3603d-8c81-43a1-a473-220df8203144 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.781501 Jul 18 02:33:30.381235 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1881/3815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:29 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:30.394048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.401140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:30.422671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.423611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.432701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.433556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.527057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.560210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.563936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:30.577934 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5052a912-5b97-4f0d-97db-55d406f5296a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1594 microversion: 2.42 time: 0.498524 Jul 18 02:33:30.603412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1935/3816] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:30 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1594 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:30.622293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.623517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:30.656964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.657790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.659328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.660160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.783737 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-056b4957-501b-4871-a87b-c2c140144efe tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.398030 Jul 18 02:33:30.794028 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1882/3817] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:33:30 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:30.800871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:30.802724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:30.812575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.815917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:30.822626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:30.846943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.436852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:31.445672 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b43b1ad-1f6a-4db6-8982-7fe06d866856 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1511 microversion: 2.1 time: 0.650092 Jul 18 02:33:31.446304 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1883/3818] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:30 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:31.461828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:31.463041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:31.475853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.489825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:31.491052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:31.491723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.061879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:32.089299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6cf5afca-705d-4b6c-9e37-a25b030cf0e9 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 1.475569 Jul 18 02:33:32.108431 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1936/3819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:30 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:32.133720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:32.136433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:32.165505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.166126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.167598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.168610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.474983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:32.487725 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-946481ce-7006-4a50-bf93-8b4c3b5452d2 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1493 microversion: 2.1 time: 1.040286 Jul 18 02:33:32.501481 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1884/3820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:31 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1493 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:32.513591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:32.516344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:32.535657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.539744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.541043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.541741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.876530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:32.896853 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d97124e5-e25a-4d11-aff3-0dd6c4d9fcc2 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.785881 Jul 18 02:33:32.897956 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1937/3821] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:32 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:32.909411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:32.909411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:32.919584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.922224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:32.923358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:32.924015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.365718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.374859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.384299 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7395b5f-f3f1-4e61-8746-6cb6ea97df2a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1512 microversion: 2.1 time: 0.881505 Jul 18 02:33:33.392114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1885/3822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:32 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:33.406765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:33.407732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.417970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.418643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.419137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.419826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.420276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.423876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:33.429618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb2c8143-efdd-4b82-af7b-4ff42cbe157b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1660 microversion: 2.42 time: 0.529224 Jul 18 02:33:33.431250 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1938/3823] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:32 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1660 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:33.440576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:33.442005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:33.455978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.457685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:33.459944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:33.462118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.157178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:34.446761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:34.469917 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3276157-3dca-48fc-8557-41eff9a5ad98 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1511 microversion: 2.1 time: 1.036258 Jul 18 02:33:34.470553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1939/3824] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:33 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1511 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:34.480448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.484866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:34.509668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.510151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.518385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.519191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.925777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:34.948992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0dd1541d-6c14-4b2b-b0d6-ecab5c284bcf tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 1.555251 Jul 18 02:33:34.961369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1886/3825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:33 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:34.972580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:34.976683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:34.988384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.989613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:34.992442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:34.993456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.240533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.254948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7092f914-eef1-4495-918a-bd9b605c2162 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1493 microversion: 2.1 time: 0.782175 Jul 18 02:33:35.255587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1940/3826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:34 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1493 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:35.279543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:35.280263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:35.293812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.296332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.297385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.297858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.511186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.552993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1eb086c1-dcc6-4c67-aa72-81ff7c20f081 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.587692 Jul 18 02:33:35.556897 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1887/3827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:34 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:35.584420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:35.606090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.607876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:35.665919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.666562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.667066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.669857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.671125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.690750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.692833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:35.697123 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2113163c-d2fc-42fd-8f5d-0c9c8b61caf3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1705 microversion: 2.42 time: 0.429375 Jul 18 02:33:35.705095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1941/3828] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:35 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1705 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:35.721696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a14a6b5f-3427-4d76-8412-77aafb46d4c0 req-a6b873e8-c127-4543-93ef-ecaee232c122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:35.747833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a14a6b5f-3427-4d76-8412-77aafb46d4c0 req-a6b873e8-c127-4543-93ef-ecaee232c122 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.748300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a14a6b5f-3427-4d76-8412-77aafb46d4c0 req-a6b873e8-c127-4543-93ef-ecaee232c122 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.798420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a14a6b5f-3427-4d76-8412-77aafb46d4c0 req-a6b873e8-c127-4543-93ef-ecaee232c122 service nova] Creating event network-changed:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:33:35.815401 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a14a6b5f-3427-4d76-8412-77aafb46d4c0 req-a6b873e8-c127-4543-93ef-ecaee232c122 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108570 Jul 18 02:33:35.816299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1942/3829] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:35.915364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:35.968105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:35.969545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:35.983939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.988115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:35.989288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:35.989927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.077095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:36.187146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.220855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.222501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.336723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:36.350298 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34c364f6-b295-4802-b452-179b10a59c6b tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.386803 Jul 18 02:33:36.350932 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1943/3830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:35 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:36.365843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-74d272ea-47fe-470b-aa85-8165f35eaeb4 req-e61f52c2-7c49-4e05-956c-627b1ddfc5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7299d59-8e54-49ae-a5bd-bd6889273992", "name": "network-vif-plugged", "status": "completed", "tag": "b5347dcc-1744-4dc8-ad68-6183a8c21dbd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:36.383750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74d272ea-47fe-470b-aa85-8165f35eaeb4 req-e61f52c2-7c49-4e05-956c-627b1ddfc5e6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.384548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74d272ea-47fe-470b-aa85-8165f35eaeb4 req-e61f52c2-7c49-4e05-956c-627b1ddfc5e6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.413092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-74d272ea-47fe-470b-aa85-8165f35eaeb4 req-e61f52c2-7c49-4e05-956c-627b1ddfc5e6 service nova] Creating event network-vif-plugged:b5347dcc-1744-4dc8-ad68-6183a8c21dbd for instance b7299d59-8e54-49ae-a5bd-bd6889273992 on n-h2-849796-1 Jul 18 02:33:36.424091 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-74d272ea-47fe-470b-aa85-8165f35eaeb4 req-e61f52c2-7c49-4e05-956c-627b1ddfc5e6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071070 Jul 18 02:33:36.424737 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1944/3831] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:36.439042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:36.441909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:36.450502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.451244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.452425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.453120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.559175 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-115f4abd-357d-4572-acd3-c3c179c7438f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.998958 Jul 18 02:33:36.560072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1888/3832] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:33:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:36.583779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:36.584332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:36.592272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.592739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.595476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:36.595943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:36.671872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:37.569731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.582713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a64849a9-a7d4-4744-bb64-6adc254c8bbd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 1.003295 Jul 18 02:33:37.587779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.605285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1889/3833] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:36 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:37.611721 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d476f03e-32ac-4f31-9a8f-2d6b8f20fd6d tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1499 microversion: 2.1 time: 1.178723 Jul 18 02:33:37.612823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1945/3834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:36 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1499 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:37.617561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.623170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:37.624766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:37.627531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.628624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-105286907', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:37.633990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.634829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.635810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.636431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.641859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.642379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.643217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.643671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:37.799288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:37.888049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:37.895923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:37.896382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.141283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.157301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.161029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.164380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-774a3581-ff63-4780-a3db-a914c567611f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1750 microversion: 2.42 time: 0.549390 Jul 18 02:33:38.176737 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1946/3835] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:37 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1750 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:38.184441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.185427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:38.194815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.195949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.198577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.199343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.440586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c869d50-a71e-45cb-9be6-f6748403bc88 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-105286907" status: 200 len: 1515 microversion: 2.1 time: 0.833668 Jul 18 02:33:38.453256 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1890/3836] 10.222.0.67 () {58 vars in 1260 bytes} [Mon Jul 18 02:33:37 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-105286907 => generated 1515 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:38.453256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.453256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:38.464783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.465653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.467095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.467913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.514404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:38.618296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.623007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:38.636050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf6b77bf-00dc-4713-b86a-7ee42d228f39 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.456445 Jul 18 02:33:38.649603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1947/3837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:38 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:38.660647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f46e640a-250e-4607-a4a0-804daf85f3c1 req-b2460521-2084-4c60-9ff9-f8076fb48d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:38.673922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f46e640a-250e-4607-a4a0-804daf85f3c1 req-b2460521-2084-4c60-9ff9-f8076fb48d86 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.674764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f46e640a-250e-4607-a4a0-804daf85f3c1 req-b2460521-2084-4c60-9ff9-f8076fb48d86 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.710439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f46e640a-250e-4607-a4a0-804daf85f3c1 req-b2460521-2084-4c60-9ff9-f8076fb48d86 service nova] Creating event network-changed:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:33:38.713523 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6361e3e9-23d4-4bc0-8806-a0a2b1b211d3 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "DELETE /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 204 len: 0 microversion: 2.1 time: 0.269018 Jul 18 02:33:38.717453 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1891/3838] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:38 2022] DELETE /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:38.722709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.730141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:38.731634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:38.739304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.740338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.743424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.744211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.748750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f46e640a-250e-4607-a4a0-804daf85f3c1 req-b2460521-2084-4c60-9ff9-f8076fb48d86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096663 Jul 18 02:33:38.751888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1948/3839] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:38.791654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:38.794360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:38.816831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.825877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.832679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:38.834075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:38.887806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:38.999811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:39.012753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.013622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.360124 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35bb4042-b880-48de-bf66-6b74bc9a7efe tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.642363 Jul 18 02:33:39.363281 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1892/3840] 10.222.0.67 () {58 vars in 1172 bytes} [Mon Jul 18 02:33:38 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:39.380978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:39.385844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:39.402950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.404832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.407541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.408696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.436159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:39.464571 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9806cc60-b7f7-44cf-bf71-87a392a97963 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.701687 Jul 18 02:33:39.482195 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1949/3841] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:38 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:39.495412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:39.496518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:39.509576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.510410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:39.511855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:39.512665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.019048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.046775 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57672f66-b04f-4664-8781-bb6c5a93866c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.680302 Jul 18 02:33:40.070522 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1893/3842] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:39 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:40.086775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.096840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.098284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.servers [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Removing options 'limit' from query {{(pid=119440) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:33:40.100484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:40.114805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.115979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.118740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.119974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.201862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.215365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.215662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.237682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.255022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.258726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.261385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5562dc24-dc27-4aa3-b48e-1df415e04e28 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1795 microversion: 2.42 time: 0.777442 Jul 18 02:33:40.262232 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1950/3843] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:39 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1795 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:40.275367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.276142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:40.288252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.289742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.290956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.291599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.608382 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78dc364d-e236-4033-8104-f755c4e8ac29 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.533901 Jul 18 02:33:40.609025 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1894/3844] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:40.625380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.625380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:40.635729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.638044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.641643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.642001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.648654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.669304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3360e099-3401-4ba7-bc65-f160ea457c76 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.404568 Jul 18 02:33:40.687067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1951/3845] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:40.704290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:40.712824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:40.715359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:40.726984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.727942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.729658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:40.730593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:40.943987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:41.094197 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b7ec4a2-1efd-426a-8e1b-5a8fc9d1dd57 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?status=active" status: 200 len: 1008 microversion: 2.1 time: 0.404466 Jul 18 02:33:41.095325 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1952/3846] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers?status=active => generated 1008 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.116317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.118090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:41.130448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.131673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.134741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.135848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.183583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.223436 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce3bf2c6-09bf-4e22-a328-c494d2c78cfb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.612742 Jul 18 02:33:41.224535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1895/3847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:40 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.260443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.277236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.278047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.servers [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Removing options 'limit' from query {{(pid=119440) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:33:41.279333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:41.300793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.302643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.304836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.306939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.356960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:41.418999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.423743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea4e78fe-e38c-4511-a797-809598a8d8eb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1008 microversion: 2.1 time: 0.186219 Jul 18 02:33:41.426446 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1896/3848] 10.222.0.67 () {58 vars in 1149 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers?limit=100000 => generated 1008 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.437990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.439419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:41.439597 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9cc6045-dbc2-4d1c-a2e8-b7837d03cc13 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.330359 Jul 18 02:33:41.452310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.452310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.452310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.452310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.465892 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1953/3849] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.475484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.484373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.486424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:41.495483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.495930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.497116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.500978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.545266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:41.584721 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ab90cbe-b5fe-4e9a-9076-46560862029a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1008 microversion: 2.1 time: 0.117349 Jul 18 02:33:41.585397 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1954/3850] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers => generated 1008 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:41.598340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.603861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.604996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:41.622367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.623601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.625331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.626250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.801797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:41.877500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.892730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.895550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.901878 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f50d7e1b-7f2a-4398-9b7b-643c9e455c41 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1840 microversion: 2.42 time: 0.473494 Jul 18 02:33:41.903204 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1897/3851] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1840 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:41.912196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.916577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:41.935718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.936455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.937497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:41.938155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:41.974164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-370e196a-2629-40ad-9a21-fd43d5e985bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.367507 Jul 18 02:33:41.975789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1955/3852] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:41.990801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:41.997479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:41.997937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.servers [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Removing options 'limit' from query {{(pid=119439) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:33:41.998928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:42.007907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.008583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.009452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.010186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.044861 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fcffd087-70c3-4786-9b25-dd6e8d9e26a1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.058758 Jul 18 02:33:42.053635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1956/3853] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:42.059794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:42.064707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.065748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-105286907', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:42.073351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.073959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.075091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.075666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.200955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:42.296990 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7c4a2ac-d2ad-4214-85a9-08a659ccf041 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-105286907" status: 200 len: 345 microversion: 2.1 time: 0.240850 Jul 18 02:33:42.306869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1957/3854] 10.222.0.67 () {58 vars in 1239 bytes} [Mon Jul 18 02:33:42 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-105286907 => generated 345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:42.314715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:42.316028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:42.329835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.330758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.331893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.332627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.656020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.667624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b866364-1395-4fab-b0bc-ec4a769465fb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1314 microversion: 2.1 time: 0.762159 Jul 18 02:33:42.668892 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1898/3855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:41 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:42.675611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-771c0788-9a43-4ce4-8346-778385eaf431 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:42.687124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:42.691395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-771c0788-9a43-4ce4-8346-778385eaf431 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.692383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-771c0788-9a43-4ce4-8346-778385eaf431 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.731589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9491f59f-179d-4a2a-b7e3-34d1c1c7e2dd tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.422352 Jul 18 02:33:42.735388 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1958/3856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:42 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:42.749001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:42.754768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:42.785102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.787013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.788531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:42.789443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:42.878352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-771c0788-9a43-4ce4-8346-778385eaf431 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:33:43.043771 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-771c0788-9a43-4ce4-8346-778385eaf431 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "POST /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502/action" status: 202 len: 0 microversion: 2.1 time: 0.371202 Jul 18 02:33:43.045759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1899/3857] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:42 2022] POST /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:43.074960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.076399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.100436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.105568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.108277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.109648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.191256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.207374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f613a99-85e1-4d5c-a51f-f2aad8b81dc0 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1505 microversion: 2.1 time: 0.469869 Jul 18 02:33:43.208290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1959/3858] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:42 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:43.221153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.224725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.276763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.278378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.282612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.284658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.656229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.677412 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d606d60-63c8-43b9-8191-94ee52578272 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 0.465304 Jul 18 02:33:43.678355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1960/3859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:43.718276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.720462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-33dadd15-e6b6-470e-a489-bde6890ec7bb req-0ce2dc67-b5aa-4196-9239-da63d67bdf2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "f7d7e49d-7458-4074-b355-2b81c955082c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:43.746997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33dadd15-e6b6-470e-a489-bde6890ec7bb req-0ce2dc67-b5aa-4196-9239-da63d67bdf2f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.747326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33dadd15-e6b6-470e-a489-bde6890ec7bb req-0ce2dc67-b5aa-4196-9239-da63d67bdf2f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.774759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.776750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:43.780591 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b591c440-584c-4795-87a5-c932355d9c70 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1840 microversion: 2.42 time: 0.732411 Jul 18 02:33:43.783294 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1900/3860] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1840 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:43.786831 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-33dadd15-e6b6-470e-a489-bde6890ec7bb req-0ce2dc67-b5aa-4196-9239-da63d67bdf2f service nova] Creating event network-changed:f7d7e49d-7458-4074-b355-2b81c955082c for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:43.790067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.790569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.796186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-33dadd15-e6b6-470e-a489-bde6890ec7bb req-0ce2dc67-b5aa-4196-9239-da63d67bdf2f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102648 Jul 18 02:33:43.801240 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1961/3861] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:43.802882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.803622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.805426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.805994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.815496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:43.820382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:43.845339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.846561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.848256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:43.850319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:43.871709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:44.291661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:44.317046 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc83c088-1c47-4ee7-89f0-722c8c43b42a tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1500 microversion: 2.1 time: 0.531974 Jul 18 02:33:44.320332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1901/3862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1500 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:44.340386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:44.342274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:44.363373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.364608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.367408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.368993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.502752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:44.519698 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4cb8e067-6e1b-4f34-afd2-e96ca1cd06ac tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 200 len: 1463 microversion: 2.1 time: 0.197056 Jul 18 02:33:44.520362 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1902/3863] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:44 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 1463 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:44.528366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:44.528910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:44.541588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.542043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.542874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.543514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.587398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lazy-loading 'flavor' on Instance uuid b7299d59-8e54-49ae-a5bd-bd6889273992 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:33:44.714564 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10fa1ce6-6acd-4630-93fd-e3358a40c9c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "POST /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992/action" status: 202 len: 0 microversion: 2.1 time: 0.189523 Jul 18 02:33:44.715635 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1903/3864] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:44 2022] POST /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:44.724364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:44.725374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:44.743173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.743819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.744908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:44.745722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:44.947075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.044755 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61ad3d25-ccd0-4381-af7f-f0e385d7480c tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 1.241993 Jul 18 02:33:45.047400 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1962/3865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:43 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:45.057893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:45.058939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:45.083332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.086179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.088039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.088631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.129259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.175397 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d84ccbc6-4e51-4def-a47c-4fa784333711 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 0.454145 Jul 18 02:33:45.177526 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1904/3866] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:44 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:45.206791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:45.215214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:45.240763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.246209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.248252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:45.248981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:45.971580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.991083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.995340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:45.996621 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e6b3b205-3d63-4e4f-883d-e46cc95b46c3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1861 microversion: 2.42 time: 0.814037 Jul 18 02:33:45.997258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1905/3867] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:45 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1861 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:46.002454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-491f7ce0-d9ca-4d07-a2cd-ec6d7c81d650 req-10539053-42fe-4ea9-90ce-e506c0e0d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a37a09-e42f-439b-87e7-076600b21d05", "name": "network-vif-deleted", "tag": "aee9c657-7046-45d6-8577-79a49e62eebe"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:46.014420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-491f7ce0-d9ca-4d07-a2cd-ec6d7c81d650 req-10539053-42fe-4ea9-90ce-e506c0e0d9bf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.015144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-491f7ce0-d9ca-4d07-a2cd-ec6d7c81d650 req-10539053-42fe-4ea9-90ce-e506c0e0d9bf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.028851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-491f7ce0-d9ca-4d07-a2cd-ec6d7c81d650 req-10539053-42fe-4ea9-90ce-e506c0e0d9bf service nova] Creating event network-vif-deleted:aee9c657-7046-45d6-8577-79a49e62eebe for instance 07a37a09-e42f-439b-87e7-076600b21d05 on n-h2-849796-1 Jul 18 02:33:46.035106 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-491f7ce0-d9ca-4d07-a2cd-ec6d7c81d650 req-10539053-42fe-4ea9-90ce-e506c0e0d9bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036282 Jul 18 02:33:46.037549 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1906/3868] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:46.046172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.047946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: 07a37a09-e42f-439b-87e7-076600b21d05] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.057912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.059486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.060675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.061368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.079773 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] HTTP exception thrown: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Request method failure captured: Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 HTTP/1.1 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MXmK3-C7ydWiW0JMR_-dGqhvrvMCYxCAm7lHyKQOY9KglM8eItxchtpMc8ZrxjLtr9G8v6_aLZfoL2j9fohKUTt_-Ch6ebBKVkxQr1KGN7dcrZdHbQWFlQTr0BmssDFI0TuYPdaOdm3WVhvUUpwHvSXpqqmwy-8EQWz5APSfTjUZeE Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: db2500ccf386475583649c645294e0b8 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/db2500ccf386475583649c645294e0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_db2500ccf386475583649c645294e0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/db2500ccf386475583649c645294e0b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/db2500ccf386475583649c645294e0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: db2500ccf386475583649c645294e0b8 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueTestJSON-1493232386-project Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 021c3e5665f74561b93527eddf4956fd Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueTestJSON-1493232386-project Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '07a37a09-e42f-439b-87e7-076600b21d05'} Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:46.082234 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. Jul 18 02:33:46.089927 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:46.094086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Returning 404 to user: Instance 07a37a09-e42f-439b-87e7-076600b21d05 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:46.095575 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3ab374b-7cde-476d-9a08-751fb9727801 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05" status: 404 len: 111 microversion: 2.1 time: 0.055636 Jul 18 02:33:46.096739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1907/3869] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/07a37a09-e42f-439b-87e7-076600b21d05 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:46.102388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ac0b35f2-eda4-4d80-88c4-30086018216d req-eeaeef2a-1368-42dc-8bc0-b1db61a0036e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "e9ca6de3-664a-4714-950c-3622cc7b1828"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:46.138183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ac0b35f2-eda4-4d80-88c4-30086018216d req-eeaeef2a-1368-42dc-8bc0-b1db61a0036e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.140482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ac0b35f2-eda4-4d80-88c4-30086018216d req-eeaeef2a-1368-42dc-8bc0-b1db61a0036e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.141187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.156882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d792a4a7-d189-43e1-94c5-b6c11ce9f300 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1508 microversion: 2.1 time: 1.106248 Jul 18 02:33:46.159518 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1963/3870] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:45 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1508 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:46.166460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ac0b35f2-eda4-4d80-88c4-30086018216d req-eeaeef2a-1368-42dc-8bc0-b1db61a0036e service nova] Creating event network-changed:e9ca6de3-664a-4714-950c-3622cc7b1828 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:46.170953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.171874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.173056 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ac0b35f2-eda4-4d80-88c4-30086018216d req-eeaeef2a-1368-42dc-8bc0-b1db61a0036e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074629 Jul 18 02:33:46.174673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1908/3871] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:46.180612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.181560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.189113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.192797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.193578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.195223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.196020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.202927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.204395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.205216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.230002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:46.400586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0c3511b-9e8c-4ca7-8b1a-2594f780ba4e tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 204 len: 0 microversion: 2.1 time: 0.223651 Jul 18 02:33:46.401933 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1909/3872] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:46 2022] DELETE /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:46.429977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.431339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.454873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.455575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.457061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.457865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.718720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:46.724002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:46.743421 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a93253f9-931e-44e5-9dfa-18466ed0c4dc tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.579140 Jul 18 02:33:46.756281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1964/3873] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:46.776665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:46.777819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:46.791102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.792324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:46.796101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:46.796701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.157133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.178193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eeb49b10-69a4-4d5c-b4bc-8e3cf7a05df7 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1491 microversion: 2.1 time: 0.416832 Jul 18 02:33:47.193937 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1965/3874] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1491 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:47.219130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.220708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.235288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.237951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.239785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.240858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.346705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.362887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c777549b-8900-4747-a30f-f3165e446fa1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 0.954216 Jul 18 02:33:47.370431 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1910/3875] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:46 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:47.386472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.395378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.420638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.421932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.427251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.428451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.680327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.706959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.710503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.716127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5437c29-79bf-46d0-8bc8-51e57dc6c06e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 0.519573 Jul 18 02:33:47.721197 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1966/3876] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:47.802844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.806167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.842888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.844019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.846311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.847398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.912702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:47.925234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f7a1d7f8-3a44-4f1f-afa2-925143615050 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1491 microversion: 2.1 time: 0.552826 Jul 18 02:33:47.925864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1911/3877] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1491 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:47.967526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:47.968038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:47.982634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.983015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:47.983842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:47.984294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.075667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:33:48.279856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f20a585b-3fee-40b3-810e-e69a105bfa71 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 204 len: 0 microversion: 2.1 time: 0.315786 Jul 18 02:33:48.281677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1912/3878] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:47 2022] DELETE /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:33:48.287587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:48.289558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:48.302904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:48.307348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.307828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.311189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.311748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.629096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.638157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:48.651983 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62531a64-3c5d-473c-a00c-0bc8bcd30689 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.866392 Jul 18 02:33:48.652494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69fe6a87-5a74-4d86-a35f-24aa170aea9c tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1491 microversion: 2.1 time: 0.365368 Jul 18 02:33:48.656987 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1913/3879] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:48 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1491 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:48.657495 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1967/3880] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:47 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:48.670957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:48.673799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:48.677678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c6346e7e-7e69-4b3b-a626-514af7e674b2 req-bdd848da-2238-458d-b964-ea9d0f76a3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "430974f5-0c03-40de-95f0-2ea6f0fa51ab"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:48.688471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.691385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.692244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.692697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.698174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6346e7e-7e69-4b3b-a626-514af7e674b2 req-bdd848da-2238-458d-b964-ea9d0f76a3d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.698632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6346e7e-7e69-4b3b-a626-514af7e674b2 req-bdd848da-2238-458d-b964-ea9d0f76a3d0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.747027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c6346e7e-7e69-4b3b-a626-514af7e674b2 req-bdd848da-2238-458d-b964-ea9d0f76a3d0 service nova] Creating event network-changed:430974f5-0c03-40de-95f0-2ea6f0fa51ab for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:48.753435 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c6346e7e-7e69-4b3b-a626-514af7e674b2 req-bdd848da-2238-458d-b964-ea9d0f76a3d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093554 Jul 18 02:33:48.754390 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1968/3881] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:48.760386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:48.761306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:48.768869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.769373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:48.770211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:48.770755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.126956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:49.182958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:49.187832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2afbc14c-ef9e-4cdb-9409-c4f1e12198f2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1497 microversion: 2.1 time: 0.528572 Jul 18 02:33:49.193421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1914/3882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:48 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1497 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:49.204009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-562b79b3-4c27-4907-913a-153acf946a3d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 0.447924 Jul 18 02:33:49.205597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1969/3883] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:48 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:49.213769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:49.218158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:49.234348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.235571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.238182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.239665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.325576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:49.674371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:49.675219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:49.690412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.690890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:49.695905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:49.697701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.034987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.046021 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4878108-7935-49dd-9a8f-f1d72ffe6150 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1491 microversion: 2.1 time: 0.375417 Jul 18 02:33:50.053937 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1970/3884] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:49 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1491 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:33:50.061241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:50.061241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:50.087232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.096031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.097931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.099456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.189507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.198384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:50.209426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.215743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.221098 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3c13fe9-ec8c-45c5-b3e6-c34bf500c9e3 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 1.020497 Jul 18 02:33:50.223431 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1915/3885] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:49 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:50.234285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:50.238943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:50.272143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.274305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.276500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.278714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.651999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:50.668826 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0d4950d9-54d5-437d-80e9-c597441f5ed4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.619864 Jul 18 02:33:50.669488 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1971/3886] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:50 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:50.682741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:50.684615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:50.699673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.706815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:50.714907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:50.715668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.063993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.091171 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ef23551-f642-4b73-9f8e-9c5f6887b8a3 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1497 microversion: 2.1 time: 0.864828 Jul 18 02:33:51.102460 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1916/3887] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:50 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1497 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:51.124406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.126401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:51.148333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.154551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.165790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.166963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.330446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:51.664331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021c3e5665f74561b93527eddf4956fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2500ccf386475583649c645294e0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.676429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0119d530-c2f8-4c06-8102-c8d98e7d30bc tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 200 len: 1491 microversion: 2.1 time: 0.571965 Jul 18 02:33:51.687776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1917/3888] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:51 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 1491 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:51.695340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6f11ae53-994b-47f6-beda-15c59e27e2ab req-24159787-5678-4dba-8e71-bb5d25379413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "533cb380-6f08-4fc3-a9b1-2c50cfb06fa8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:51.707162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6f11ae53-994b-47f6-beda-15c59e27e2ab req-24159787-5678-4dba-8e71-bb5d25379413 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.707909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6f11ae53-994b-47f6-beda-15c59e27e2ab req-24159787-5678-4dba-8e71-bb5d25379413 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.722515 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6f11ae53-994b-47f6-beda-15c59e27e2ab req-24159787-5678-4dba-8e71-bb5d25379413 service nova] Creating event network-changed:533cb380-6f08-4fc3-a9b1-2c50cfb06fa8 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:51.729179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6f11ae53-994b-47f6-beda-15c59e27e2ab req-24159787-5678-4dba-8e71-bb5d25379413 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039275 Jul 18 02:33:51.730481 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1918/3889] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:51.736766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.737798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:51.759657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.760463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.761515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.762151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.765820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:51.782025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ba3eac9-6c48-406c-a158-c38a99caa51f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 1.111155 Jul 18 02:33:51.787258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1972/3890] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:50 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:51.799500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:51.805357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:51.818241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.818712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:51.819655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:51.820245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.138194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:52.449816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:52.463768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:52.467379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:52.470001 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0b5a5bc-5d88-45a4-897f-56f732043465 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 0.738101 Jul 18 02:33:52.481882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1919/3891] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:51 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:52.489808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4f4d1d98-525c-4617-9d55-5d61540a8c57 req-980568e5-738d-4b0e-8d65-baa8ed4235b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b67d8b5b-5a28-4326-a0c3-1225b60bf0c3", "name": "network-vif-deleted", "tag": "6462d721-aa4c-4115-8a3d-c54f24e09c29"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:52.501079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4f4d1d98-525c-4617-9d55-5d61540a8c57 req-980568e5-738d-4b0e-8d65-baa8ed4235b2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.501952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4f4d1d98-525c-4617-9d55-5d61540a8c57 req-980568e5-738d-4b0e-8d65-baa8ed4235b2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.516537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4f4d1d98-525c-4617-9d55-5d61540a8c57 req-980568e5-738d-4b0e-8d65-baa8ed4235b2 service nova] Creating event network-vif-deleted:6462d721-aa4c-4115-8a3d-c54f24e09c29 for instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 on n-h2-849796-1 Jul 18 02:33:52.525435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4f4d1d98-525c-4617-9d55-5d61540a8c57 req-980568e5-738d-4b0e-8d65-baa8ed4235b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041542 Jul 18 02:33:52.526490 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1920/3892] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:52.551441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:52.552961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:52.573368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.574923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.578213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:52.579675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:52.976181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.007559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d7f13a3-299c-45d7-bad3-108707347b87 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 1.218264 Jul 18 02:33:53.008567 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1973/3893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:51 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:53.033654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.035356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] [instance: b67d8b5b-5a28-4326-a0c3-1225b60bf0c3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.047794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.048632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.050519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.051189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.085494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.105475 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] HTTP exception thrown: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Request method failure captured: Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 HTTP/1.1 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MXmK3-C7ydWiW0JMR_-dGqhvrvMCYxCAm7lHyKQOY9KglM8eItxchtpMc8ZrxjLtr9G8v6_aLZfoL2j9fohKUTt_-Ch6ebBKVkxQr1KGN7dcrZdHbQWFlQTr0BmssDFI0TuYPdaOdm3WVhvUUpwHvSXpqqmwy-8EQWz5APSfTjUZeE Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: db2500ccf386475583649c645294e0b8 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/db2500ccf386475583649c645294e0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_db2500ccf386475583649c645294e0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/db2500ccf386475583649c645294e0b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/db2500ccf386475583649c645294e0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: db2500ccf386475583649c645294e0b8 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerRescueTestJSON-1493232386 Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerRescueTestJSON-1493232386-project Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 021c3e5665f74561b93527eddf4956fd Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerRescueTestJSON-1493232386-project Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b67d8b5b-5a28-4326-a0c3-1225b60bf0c3'} Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:53.109108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. Jul 18 02:33:53.126774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:53.128340 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0623033a-4cad-4830-9fb0-5d062e7eb907 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1497 microversion: 2.1 time: 0.582587 Jul 18 02:33:53.128340 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1921/3894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:52 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1497 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:53.128807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] Returning 404 to user: Instance b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:53.128807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-090e3ba5-3039-4528-adea-e506384705e4 tempest-ServerRescueTestJSON-1493232386 tempest-ServerRescueTestJSON-1493232386-project] 10.222.0.67 "GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3" status: 404 len: 111 microversion: 2.1 time: 0.114566 Jul 18 02:33:53.136630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.137846 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1974/3895] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:53 2022] GET /compute/v2.1/servers/b67d8b5b-5a28-4326-a0c3-1225b60bf0c3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:53.144292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.159646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.160384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.162128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.163173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.499778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:53.501607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:53.512232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.514307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.516022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.517478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:53.947302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:53.958416 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a2c5995-b1aa-4624-8633-c0f4c4a6e1b4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1522 microversion: 2.1 time: 0.835026 Jul 18 02:33:53.959785 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1922/3896] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:53 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1522 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:53.967187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-59931603-c840-4fe9-894a-146b058a2dc4 req-25d8e0ca-1390-4f16-b725-85f38718f9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "cc5ffa71-1d83-4a8d-816b-8ad73e0f9861"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:53.985728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-59931603-c840-4fe9-894a-146b058a2dc4 req-25d8e0ca-1390-4f16-b725-85f38718f9e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:53.986524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-59931603-c840-4fe9-894a-146b058a2dc4 req-25d8e0ca-1390-4f16-b725-85f38718f9e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.027560 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-59931603-c840-4fe9-894a-146b058a2dc4 req-25d8e0ca-1390-4f16-b725-85f38718f9e8 service nova] Creating event network-changed:cc5ffa71-1d83-4a8d-816b-8ad73e0f9861 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:54.034960 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-59931603-c840-4fe9-894a-146b058a2dc4 req-25d8e0ca-1390-4f16-b725-85f38718f9e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072881 Jul 18 02:33:54.036903 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1923/3897] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:54.044084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.045195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.055727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.057889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.060378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.061135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.450393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.515021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.519864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.529965 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b5b477d-c5b9-4ffd-828f-5b282f9ff4f4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 1.037066 Jul 18 02:33:54.558189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1975/3898] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:53 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:54.571294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:54.576485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:54.589834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:54.598120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.599313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.602351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.603481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.851514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.856155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e60eeaf31c649adac6b993cf50c9373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8560a71383b47aea3448472abfc9714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:54.864198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0192cc76-a52d-486a-aa44-ba126a611011 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1524 microversion: 2.1 time: 0.825554 Jul 18 02:33:54.864851 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1924/3899] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1524 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:54.896732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-752ded02-7213-4326-9476-dcdaeebc713e req-b5e7a2d0-8cfe-4cf9-9b8b-54d45bff98f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7299d59-8e54-49ae-a5bd-bd6889273992", "name": "network-vif-deleted", "tag": "b5347dcc-1744-4dc8-ad68-6183a8c21dbd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:54.924764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-752ded02-7213-4326-9476-dcdaeebc713e req-b5e7a2d0-8cfe-4cf9-9b8b-54d45bff98f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:54.932663 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-57dac193-d689-4f87-87b2-fd323fadabaa tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 200 len: 1455 microversion: 2.1 time: 0.372051 Jul 18 02:33:54.934269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-752ded02-7213-4326-9476-dcdaeebc713e req-b5e7a2d0-8cfe-4cf9-9b8b-54d45bff98f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:54.948428 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1976/3900] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 1455 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:54.971049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-752ded02-7213-4326-9476-dcdaeebc713e req-b5e7a2d0-8cfe-4cf9-9b8b-54d45bff98f8 service nova] Creating event network-vif-deleted:b5347dcc-1744-4dc8-ad68-6183a8c21dbd for instance b7299d59-8e54-49ae-a5bd-bd6889273992 on n-h2-849796-1 Jul 18 02:33:54.989360 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-752ded02-7213-4326-9476-dcdaeebc713e req-b5e7a2d0-8cfe-4cf9-9b8b-54d45bff98f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102945 Jul 18 02:33:54.990360 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1925/3901] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:55.001569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.023249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.081797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.083182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.089577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.090769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.568262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.569193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.588801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.593746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.596342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.599859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.649074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.660174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c281932-e652-495f-86e6-ac92a83b2006 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1499 microversion: 2.1 time: 0.684351 Jul 18 02:33:55.664733 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1977/3902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:54 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1499 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:55.681954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.685767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:55.695276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:33:55.706626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.709720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.716744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.717427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.802138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:33:55.926291 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a77404b-27ac-4d55-9523-9fb7b83041b5 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.251570 Jul 18 02:33:55.931308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1978/3903] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 18 02:33:55 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:33:55.946493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:55.947518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:55.954658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.955482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:55.956532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:55.958818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:56.114828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:56.138605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:56.144893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:56.147382 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dbf64620-59a8-41dc-9f6f-b5e8829dbae9 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 0.587248 Jul 18 02:33:56.151854 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1926/3904] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:55 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:33:56.160669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b64c511-d64c-48bf-9078-47f4c9a3a549 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:56.181762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b64c511-d64c-48bf-9078-47f4c9a3a549 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:56.182762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b64c511-d64c-48bf-9078-47f4c9a3a549 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:56.239993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b64c511-d64c-48bf-9078-47f4c9a3a549 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Going to try to start instance {{(pid=119440) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:33:56.381153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b64c511-d64c-48bf-9078-47f4c9a3a549 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "POST /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502/action" status: 202 len: 0 microversion: 2.1 time: 0.226581 Jul 18 02:33:56.386390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1927/3905] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:56 2022] POST /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:33:56.399171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:56.401703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:56.420241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:56.420950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:56.430062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:56.430753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:56.462496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 HTTP/1.1 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b7299d59-8e54-49ae-a5bd-bd6889273992'} Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:56.464448 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54a45c4c-41ea-4915-858c-720095a7a3c7 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 404 len: 111 microversion: 2.1 time: 0.077877 Jul 18 02:33:56.469968 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1928/3906] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:56 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:56.498786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:56.503755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:56.516625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:56.519400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:56.520331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:56.525470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.156160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:57.173776 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d59dd7f-ef9c-460f-98f1-d238e53f4cdd tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1508 microversion: 2.1 time: 0.680289 Jul 18 02:33:57.174755 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1929/3907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:56 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1508 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:57.181316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6ed9e748-164b-4196-bb71-90ceb4d580a8 req-fdde7d5a-294c-40f0-a84b-1f541b7ae110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "731990ba-af53-444f-890d-a035111c7987"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:57.193135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ed9e748-164b-4196-bb71-90ceb4d580a8 req-fdde7d5a-294c-40f0-a84b-1f541b7ae110 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.194178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ed9e748-164b-4196-bb71-90ceb4d580a8 req-fdde7d5a-294c-40f0-a84b-1f541b7ae110 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.212113 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6ed9e748-164b-4196-bb71-90ceb4d580a8 req-fdde7d5a-294c-40f0-a84b-1f541b7ae110 service nova] Creating event network-changed:731990ba-af53-444f-890d-a035111c7987 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:33:57.219155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6ed9e748-164b-4196-bb71-90ceb4d580a8 req-fdde7d5a-294c-40f0-a84b-1f541b7ae110 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042949 Jul 18 02:33:57.220017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1930/3908] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:57.236355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:57.251000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:57.253239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:57.259828 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec88be31-f1ad-43da-a2ea-0a684afb2382 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1504 microversion: 2.1 time: 1.325796 Jul 18 02:33:57.261253 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1979/3909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:55 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1504 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:57.272137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:57.274113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.276843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:57.278007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.279703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.302198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.309829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.313799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.316442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:57.317238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:57.363218 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 HTTP/1.1 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b7299d59-8e54-49ae-a5bd-bd6889273992'} Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:57.364590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3178457-8b13-4c7c-8655-e22a2f457bd2 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 404 len: 111 microversion: 2.1 time: 0.144286 Jul 18 02:33:57.369491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1931/3910] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:57 2022] DELETE /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:57.380209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c8c50ed-306d-45e7-b452-d20b25019da3 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'create', calling method: .version_select at 0x7fab043465e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1313504381", "description": "tempest-description-925804864"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:58.227659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.249995 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c8c50ed-306d-45e7-b452-d20b25019da3 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.877808 Jul 18 02:33:58.257816 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1932/3911] 10.222.0.67 () {60 vars in 1179 bytes} [Mon Jul 18 02:33:57 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:58.262845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.264785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:58.266104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:58.268674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: b7299d59-8e54-49ae-a5bd-bd6889273992] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:58.278517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-751f0a4b-7320-4772-808d-d273693a396c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 1.013542 Jul 18 02:33:58.279129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1980/3912] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:57 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:58.295709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:58.298347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.299291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.300371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.301159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.302551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:58.343322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.349144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.351371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.353290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 HTTP/1.1 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b7299d59-8e54-49ae-a5bd-bd6889273992'} Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:58.355313 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. Jul 18 02:33:58.359912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:33:58.360431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.372901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance b7299d59-8e54-49ae-a5bd-bd6889273992 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:58.375159 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f7a9dd9-85d9-4fa0-90a5-ee3d0f461f3e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992" status: 404 len: 111 microversion: 2.1 time: 0.115817 Jul 18 02:33:58.383707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1933/3913] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:58 2022] GET /compute/v2.1/servers/b7299d59-8e54-49ae-a5bd-bd6889273992 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:58.402768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1313504381"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:33:58.404765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:58.453337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.469954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:58.478595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:58.482857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.170875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.184523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15568406-0ffb-4294-9524-900886ef9b2f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1508 microversion: 2.1 time: 0.901339 Jul 18 02:33:59.185450 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1981/3914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:58 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1508 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:33:59.197231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:59.198328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:59.215407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.215885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.217021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.217663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.250005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 HTTP/1.1 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '46e6d9b6-49e4-44e3-ba58-f134bbbcb645'} Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:59.252297 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.258095 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.260174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:59.261408 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6155e83c-b390-4646-aef9-c48a8768c3a1 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 404 len: 111 microversion: 2.1 time: 0.074716 Jul 18 02:33:59.265617 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1982/3915] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:59 2022] DELETE /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:59.274566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:59.275706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 46e6d9b6-49e4-44e3-ba58-f134bbbcb645] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:59.283015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.283858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.291937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.302414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.308914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:59.329564 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 HTTP/1.1 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '46e6d9b6-49e4-44e3-ba58-f134bbbcb645'} Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:33:59.333941 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. Jul 18 02:33:59.342851 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:33:59.346394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 46e6d9b6-49e4-44e3-ba58-f134bbbcb645 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:33:59.347910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49ea2582-b727-40b5-aedd-d2e17aac7d2c tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645" status: 404 len: 111 microversion: 2.1 time: 0.080338 Jul 18 02:33:59.352408 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1983/3916] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:33:59 2022] GET /compute/v2.1/servers/46e6d9b6-49e4-44e3-ba58-f134bbbcb645 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:33:59.359178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:59.360352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:33:59.404687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.405650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.406736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:59.408492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:59.412754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Adding security group 110dfd34-f29b-43d0-82e4-7e192b71e62f to port 27bf92cc-9b07-4d90-88f2-6f455317fe1b Jul 18 02:33:59.924873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.950101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.955061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:33:59.958858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13e5cc54-39d4-4f12-9a51-83a90c61cb8e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 0.604700 Jul 18 02:33:59.963028 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1984/3917] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:33:59 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:00.004416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.006422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.032366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.033224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.040588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.041394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.082809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed HTTP/1.1 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '33060fc5-8a98-4fa7-88b7-b45721489fed'} Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:00.093066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.100336 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.104449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:00.108025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb9a0e2f-2a74-4dc9-9641-fd73263ccedd tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 404 len: 111 microversion: 2.1 time: 0.143477 Jul 18 02:34:00.110434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1985/3918] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:33:59 2022] DELETE /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:00.149444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-06946112-0da7-4ffb-9dcd-ce7c1a6706c9 req-195c3179-af24-45ef-92a3-a5d41b87c080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "452fbbf4-726a-466a-a5bd-e4980bde7526"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:00.196725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-06946112-0da7-4ffb-9dcd-ce7c1a6706c9 req-195c3179-af24-45ef-92a3-a5d41b87c080 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.198394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-06946112-0da7-4ffb-9dcd-ce7c1a6706c9 req-195c3179-af24-45ef-92a3-a5d41b87c080 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.234934 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-06946112-0da7-4ffb-9dcd-ce7c1a6706c9 req-195c3179-af24-45ef-92a3-a5d41b87c080 service nova] Creating event network-changed:452fbbf4-726a-466a-a5bd-e4980bde7526 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:00.252207 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-06946112-0da7-4ffb-9dcd-ce7c1a6706c9 req-195c3179-af24-45ef-92a3-a5d41b87c080 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131970 Jul 18 02:34:00.254022 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1986/3919] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:00.273109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.274159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 33060fc5-8a98-4fa7-88b7-b45721489fed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.296579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.299090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.303065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.304942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.353831 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed HTTP/1.1 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '33060fc5-8a98-4fa7-88b7-b45721489fed'} Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.356102 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. Jul 18 02:34:00.362894 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.371263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 33060fc5-8a98-4fa7-88b7-b45721489fed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:00.372483 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-efd9342c-1518-4e0d-b99b-43b6ae23a49e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed" status: 404 len: 111 microversion: 2.1 time: 0.112465 Jul 18 02:34:00.373655 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1987/3920] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:00 2022] GET /compute/v2.1/servers/33060fc5-8a98-4fa7-88b7-b45721489fed => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:00.380959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.384241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.408104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.408970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.411149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.412444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.859924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:00.869529 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7d5a6c0-7b4a-4de9-8c47-6ceaa11ca894 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1512 microversion: 2.1 time: 0.493834 Jul 18 02:34:00.870463 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1988/3921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:00 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:00.876045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.876820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.886432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.888906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.891146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.891933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.910797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 HTTP/1.1 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '746178a7-9071-46a0-bcb0-020f58d4d4d3'} Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:00.912774 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.918831 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.921100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:00.922267 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1bdaba62-0ef7-4541-bc6f-e451fc79bddb tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 404 len: 111 microversion: 2.1 time: 0.050295 Jul 18 02:34:00.923410 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1989/3922] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:00 2022] DELETE /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:00.931581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.935697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:00.936437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.servers [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Removing options 'limit' from query {{(pid=119439) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 18 02:34:00.937567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:00.939418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.940245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.941352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.942013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.943821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2996acbf-7be1-4634-a5fb-ef4c187384e9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019114 Jul 18 02:34:00.945699 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1990/3923] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Jul 18 02:34:00 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:34:00.951116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:00.952384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 746178a7-9071-46a0-bcb0-020f58d4d4d3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:00.962513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.963421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.964970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:00.966014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:00.997774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 HTTP/1.1 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '746178a7-9071-46a0-bcb0-020f58d4d4d3'} Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:00.999635 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 746178a7-9071-46a0-bcb0-020f58d4d4d3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba0acdeb-868f-4a17-9832-03c1af960856 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3" status: 404 len: 111 microversion: 2.1 time: 0.056902 Jul 18 02:34:01.015235 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1991/3924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:00 2022] GET /compute/v2.1/servers/746178a7-9071-46a0-bcb0-020f58d4d4d3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:01.016802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:01.019672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:01.028531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.029444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:01.031046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.031745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:01.287865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:01.302363 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2414e633-9c2d-43aa-b987-49cdb0e95709 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1512 microversion: 2.1 time: 0.293018 Jul 18 02:34:01.310224 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1992/3925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:01 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:01.322575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:01.327846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:01.349193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.350263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:01.353125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:01.353866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.002755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.022595 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d6c8d6a-7fa4-48a3-ab9e-8498897c99fb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action" status: 202 len: 0 microversion: 2.1 time: 3.636077 Jul 18 02:34:02.023599 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1934/3926] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:33:58 2022] POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action => generated 0 bytes in 3639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:34:02.032049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:02.032825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:02.034816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.040583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:02.044276 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-747d47e1-1925-45a5-8c9c-b9d6b61d736a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1882 microversion: 2.42 time: 0.732185 Jul 18 02:34:02.045972 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 HTTP/1.1 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7c18f3ec-1338-4415-b397-96eb12bc24e4'} Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:02.047901 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:02.052726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:02.055578 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1993/3927] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:01 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1882 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:02.060992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:02.062195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:02.063405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10eb0bb6-d1fa-438a-bf59-08905594c004 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4" status: 404 len: 111 microversion: 2.1 time: 0.035409 Jul 18 02:34:02.068648 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1935/3928] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:02 2022] DELETE /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:02.075124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:02.079523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1313504381"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:02.093383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:02.102251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.109342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.112272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.116734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.124462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.125614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.126922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:02.128811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:02.660996 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Removing security group 110dfd34-f29b-43d0-82e4-7e192b71e62f from port 27bf92cc-9b07-4d90-88f2-6f455317fe1b Jul 18 02:34:03.054976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:03.095608 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d4c6d77-46e8-47af-9afa-9423d378e72b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1511 microversion: 2.1 time: 1.038197 Jul 18 02:34:03.103431 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1994/3929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:02 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1511 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:03.119074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:03.122258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: 7c18f3ec-1338-4415-b397-96eb12bc24e4] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:03.137392 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 HTTP/1.1 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '7c18f3ec-1338-4415-b397-96eb12bc24e4'} Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:03.140833 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:03.151342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:03.151342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:03.151342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:03.151342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. Jul 18 02:34:03.151342 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:03.154471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance 7c18f3ec-1338-4415-b397-96eb12bc24e4 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:03.156463 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7733ce6c-fee7-432f-bf46-11c6ecf8055e tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4" status: 404 len: 111 microversion: 2.1 time: 0.050742 Jul 18 02:34:03.158335 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1995/3930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:03 2022] GET /compute/v2.1/servers/7c18f3ec-1338-4415-b397-96eb12bc24e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:03.183943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-11f11173-0e58-4acc-92a1-127ba7c0e6dd req-edc0e7b2-3c75-4818-a1a3-a91369fdd7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:03.229871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-11f11173-0e58-4acc-92a1-127ba7c0e6dd req-edc0e7b2-3c75-4818-a1a3-a91369fdd7ac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.231264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-11f11173-0e58-4acc-92a1-127ba7c0e6dd req-edc0e7b2-3c75-4818-a1a3-a91369fdd7ac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.276157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-11f11173-0e58-4acc-92a1-127ba7c0e6dd req-edc0e7b2-3c75-4818-a1a3-a91369fdd7ac service nova] Creating event network-changed:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:34:03.302770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-11f11173-0e58-4acc-92a1-127ba7c0e6dd req-edc0e7b2-3c75-4818-a1a3-a91369fdd7ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139872 Jul 18 02:34:03.308623 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1996/3931] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:03.316719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:03.316719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:03.343587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.344214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:03.345418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:03.346171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.141404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:04.155744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:04.161344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:04.166118 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a5c5ee6-10b1-4fc0-880f-bd6cc4169b14 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.855023 Jul 18 02:34:04.177374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1997/3932] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:03 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:04.188471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:04.192251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:04.204406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.205441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.206689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:04.207387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:04.677229 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd32624c-2eeb-4598-bf23-dfd15945d8d9 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action" status: 202 len: 0 microversion: 2.1 time: 2.600163 Jul 18 02:34:04.684232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1936/3933] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:34:02 2022] POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action => generated 0 bytes in 2614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:34:04.692315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-002bc944-c4af-4440-b372-27b240a0e9f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'create', calling method: .version_select at 0x7fab042be040>, body: {"pool": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:04.919879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:04.957753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6efd912c-1831-45f6-9a78-29b91d359ce9 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1511 microversion: 2.1 time: 0.774974 Jul 18 02:34:04.958781 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1998/3934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:04 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1511 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:04.979500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:04.994021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:04.995437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:05.509683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:05.511725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:05.513661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:05.514796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:05.888686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:06.048393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9763a4b5-45d7-416d-a1f1-0bb5c48bca9d tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 1.075495 Jul 18 02:34:06.056693 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 1999/3935] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 18 02:34:04 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:06.060855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:06.062266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:06.073879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.074736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.076355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.077508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.718795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:06.736672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:06.744029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:06.753205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90bb7f4e-6942-47c0-9182-ba4f3e191456 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.700922 Jul 18 02:34:06.755860 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2000/3936] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:06 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:06.765190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fc21bb5f-2e6f-46ea-acaf-8aaa1a4e6887 req-c984728d-170d-4992-ba1e-9e9070227920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:06.776978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fc21bb5f-2e6f-46ea-acaf-8aaa1a4e6887 req-c984728d-170d-4992-ba1e-9e9070227920 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.777912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fc21bb5f-2e6f-46ea-acaf-8aaa1a4e6887 req-c984728d-170d-4992-ba1e-9e9070227920 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.792777 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fc21bb5f-2e6f-46ea-acaf-8aaa1a4e6887 req-c984728d-170d-4992-ba1e-9e9070227920 service nova] Creating event network-changed:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:34:06.799928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fc21bb5f-2e6f-46ea-acaf-8aaa1a4e6887 req-c984728d-170d-4992-ba1e-9e9070227920 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040342 Jul 18 02:34:06.801327 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2001/3937] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:06.810392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:06.811475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:06.819763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.820483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:06.821485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:06.822063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.449881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.462117 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-255d76ff-28e5-41e2-9878-649751de9445 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1512 microversion: 2.1 time: 0.658526 Jul 18 02:34:07.464158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2002/3938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:06 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1512 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:07.483874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:07.486139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:07.508752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:07.510875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.514463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:07.518177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.934680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:07.948397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5839eb9a-aaaf-4f34-afc5-94b7244d1957 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1511 microversion: 2.1 time: 0.472565 Jul 18 02:34:07.949280 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2003/3939] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:07 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:07.959478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:07.961291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:07.986155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:07.989423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:07.991567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:07.992469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.619005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.640748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.643306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:08.644507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35741e9f-fe92-4a7f-9be9-2b5e27b9f149 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.694064 Jul 18 02:34:08.645120 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2004/3940] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:07 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:08.655903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:08.656836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:08.677067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.684064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.685296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:08.685961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:08.981647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.001741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89ef1574-7854-4dcc-bf77-36736030717a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1511 microversion: 2.1 time: 0.349590 Jul 18 02:34:09.002674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2005/3941] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:08 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:09.027319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:09.031155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.041470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:09.054643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.055143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.058393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.058872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.142459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:09.171537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:09.227844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:09.243929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.245189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.698208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5faa4d05-37c0-4b15-ac89-f85d790e2d15 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.674361 Jul 18 02:34:09.699921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2006/3942] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:34:09 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:09.719769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:09.721326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:09.745332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.746585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.754782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.755545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.791247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df HTTP/1.1 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ccd682eb-1bfc-42db-a303-7ab92bfe47df'} Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:09.795812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-106c699d-5d60-47e9-ae98-0d16a5fa8e69 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 404 len: 111 microversion: 2.1 time: 0.092681 Jul 18 02:34:09.804023 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2007/3943] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:09 2022] DELETE /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:09.832881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:09.838011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:09.856731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.857496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:09.858590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:09.859249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.102500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-002bc944-c4af-4440-b372-27b240a0e9f4 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.416719 Jul 18 02:34:10.109405 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1937/3944] 10.222.0.67 () {60 vars in 1169 bytes} [Mon Jul 18 02:34:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:10.114666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:10.119673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:10.121681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:10.390030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:10.447790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:10.452673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:10.456821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fa92415-6d01-4769-a917-842f3b02e991 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.658616 Jul 18 02:34:10.458716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2008/3945] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:09 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:10.469358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.469358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.469974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.470154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.492594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:10.494661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: ccd682eb-1bfc-42db-a303-7ab92bfe47df] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:10.519774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.520615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.521848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.523869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.543988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df HTTP/1.1 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ccd682eb-1bfc-42db-a303-7ab92bfe47df'} Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:10.546558 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. Jul 18 02:34:10.551678 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:10.553872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance ccd682eb-1bfc-42db-a303-7ab92bfe47df could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:10.555933 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36d3fdcc-e8d9-4822-9b53-a846c3a05986 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df" status: 404 len: 111 microversion: 2.1 time: 0.083731 Jul 18 02:34:10.557193 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2009/3946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:10 2022] GET /compute/v2.1/servers/ccd682eb-1bfc-42db-a303-7ab92bfe47df => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:10.563048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.216"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:10.566468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:10.577137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.577584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.578524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.578993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.612915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Acquired lock "refresh_cache-3929008e-af78-4e8c-a040-5d841ec96898" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:34:10.761999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:10.942647 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5ea0756-17c9-402d-806b-5147b371a434 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1008 microversion: 2.1 time: 0.831437 Jul 18 02:34:10.944704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1938/3947] 10.222.0.67 () {58 vars in 1149 bytes} [Mon Jul 18 02:34:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1008 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:10.961848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:10.963245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:10.977963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.980573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:10.982404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:10.983473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.029855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 HTTP/1.1 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd042b93d-9a21-41d5-8adb-8e1f68e3f086'} Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:11.045120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.055192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.061004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:11.061004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1db6f057-50af-4cea-b53b-45bb20678463 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 404 len: 111 microversion: 2.1 time: 0.113327 Jul 18 02:34:11.066931 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1939/3948] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:10 2022] DELETE /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:11.074952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:11.083383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:11.085732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:11.101842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.102703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.104393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.105264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.360339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:11.372621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:11.471559 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ce286e1-9b19-447d-8eff-25825aac1cbb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1008 microversion: 2.1 time: 0.402619 Jul 18 02:34:11.473419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1940/3949] 10.222.0.67 () {58 vars in 1211 bytes} [Mon Jul 18 02:34:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1008 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:11.496227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:11.497256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] [instance: d042b93d-9a21-41d5-8adb-8e1f68e3f086] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:11.507346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.507964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.508797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.510243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.534089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] HTTP exception thrown: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Request method failure captured: Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 HTTP/1.1 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MTbVJ_PyFcHEzBAM-Fi1lkwgyLA4OkursrmZFOCSes-El1B6GsnlMeRS4qj4KnAfY-P-AcNoZ1OOk3vmg_M_tmKsY0zL18zbQKDmqBGq7vazZDE0KKVoZ71x_W-kpQxRExTmGmLrVxFapMJ_JBogHaqz8b0FITu8GU05nHao7Fe5Jg Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8560a71383b47aea3448472abfc9714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8560a71383b47aea3448472abfc9714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8560a71383b47aea3448472abfc9714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b8560a71383b47aea3448472abfc9714 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1586940364 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8e60eeaf31c649adac6b993cf50c9373 Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-1586940364-project Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd042b93d-9a21-41d5-8adb-8e1f68e3f086'} Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:11.535822 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. Jul 18 02:34:11.544827 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:11.547895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] Returning 404 to user: Instance d042b93d-9a21-41d5-8adb-8e1f68e3f086 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:11.555722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c95ac4b-7e42-48dd-a8b3-574b193fa0b8 tempest-DeleteServersTestJSON-1586940364 tempest-DeleteServersTestJSON-1586940364-project] 10.222.0.67 "GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086" status: 404 len: 111 microversion: 2.1 time: 0.080410 Jul 18 02:34:11.557372 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1941/3950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:11 2022] GET /compute/v2.1/servers/d042b93d-9a21-41d5-8adb-8e1f68e3f086 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:11.566415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:11.573733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:11.575144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:11.582261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.583069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.584181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.585509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.731523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:11.870968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96de6038-8c57-45d8-b88a-84ab9fc9057b tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1008 microversion: 2.1 time: 0.311646 Jul 18 02:34:11.877555 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1942/3951] 10.222.0.67 () {58 vars in 1195 bytes} [Mon Jul 18 02:34:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1008 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:11.889501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:11.890169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:11.911035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.911516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:11.912386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:11.912975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.125923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:13.152689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:13.159182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:13.165873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f909fda6-29a9-4727-bfbd-ca28adb26b5c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.286990 Jul 18 02:34:13.179272 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1943/3952] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:11 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:13.184743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:13.189413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:13.190110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': '-105286907', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:13.198226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.198945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.199823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.200389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.813553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:13.959738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb8f4d2c-d745-4fc3-8da0-c984df17f646 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=-105286907" status: 200 len: 345 microversion: 2.1 time: 0.778797 Jul 18 02:34:13.962084 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1944/3953] 10.222.0.67 () {58 vars in 1155 bytes} [Mon Jul 18 02:34:13 2022] GET /compute/v2.1/servers?name=-105286907 => generated 345 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:13.979030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:13.986976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:13.988221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:13.998743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.999512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.000986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.001984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.139908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:14.210470 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c2b3f404-6129-4239-978e-b648dd9a0557 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1008 microversion: 2.1 time: 0.238393 Jul 18 02:34:14.210803 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1945/3954] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 18 02:34:13 2022] GET /compute/v2.1/servers?name=-instance => generated 1008 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:14.216372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:14.216869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:14.224146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.224890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.226616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.227421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.657345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.667972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.669710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.671116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75800e52-2b63-4c3d-a422-ece524bfe928 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.459010 Jul 18 02:34:14.671704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1946/3955] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:14 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:14.676846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:14.682321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:14.683441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-10528690', 'deleted': False, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:14.690318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.691419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.692842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.693689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.794578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:14.868870 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17b7e3b6-96d0-4d40-b89b-30bf7a80be7a tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-10528690" status: 200 len: 345 microversion: 2.1 time: 0.195087 Jul 18 02:34:14.873286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1947/3956] 10.222.0.67 () {58 vars in 1225 bytes} [Mon Jul 18 02:34:14 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-10528690 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:14.880427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:14.880756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:14.887950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.888293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.888897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.889394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.923921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:15.086858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-128dfb53-a031-4602-9ea6-6ab3b5e707bb tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "DELETE /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 204 len: 0 microversion: 2.1 time: 0.209367 Jul 18 02:34:15.088472 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1948/3957] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:14 2022] DELETE /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:34:15.106511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:15.108514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:15.124095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.124095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.124095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.124095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.364958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:15.376559 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a4fe22b-7fc2-4160-84ea-744992f059e4 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1517 microversion: 2.1 time: 0.280961 Jul 18 02:34:15.382172 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1949/3958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:15 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:15.692944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:15.693782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:15.702786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.703337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:15.704357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:15.705095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.020118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.041619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.044997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:16.047527 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51fe3b0b-02d4-4bae-a37e-9f3fe126faea tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.358653 Jul 18 02:34:16.048769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1950/3959] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:15 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:16.406974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:16.409927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:16.422145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:16.424835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.426604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:16.429152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:16.974009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:17.001372 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93001e20-80b6-40d9-b26a-9ff5e085e85c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1517 microversion: 2.1 time: 0.602463 Jul 18 02:34:17.008383 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1951/3960] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:16 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1517 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:17.087152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:17.093262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:17.119571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:17.127628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:17.128758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:17.129317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:17.242163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:34:18.102181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.117912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.125492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:18.127084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a600908d-0abe-4873-ac6c-23b8333996cf tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.058108 Jul 18 02:34:18.130107 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1952/3961] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:17 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:18.143874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1a1b25fd-1450-41dc-bda4-2951dc23d45a req-379a49b3-b641-46b2-b6c7-9f2dffac8b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:18.172077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1a1b25fd-1450-41dc-bda4-2951dc23d45a req-379a49b3-b641-46b2-b6c7-9f2dffac8b68 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.173251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1a1b25fd-1450-41dc-bda4-2951dc23d45a req-379a49b3-b641-46b2-b6c7-9f2dffac8b68 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.207135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1a1b25fd-1450-41dc-bda4-2951dc23d45a req-379a49b3-b641-46b2-b6c7-9f2dffac8b68 service nova] Creating event network-changed:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:34:18.222035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1a1b25fd-1450-41dc-bda4-2951dc23d45a req-379a49b3-b641-46b2-b6c7-9f2dffac8b68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090301 Jul 18 02:34:18.226741 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1953/3962] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:18.232414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:18.233209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:18.307822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.309983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:18.312063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:18.315273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:19.072412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:19.225835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:19.387751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:19.399030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:19.409623 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f85cf0f1-2a6c-4c1e-abf3-50e676ae88e0 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 200 len: 1517 microversion: 2.1 time: 1.181457 Jul 18 02:34:19.411305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1954/3963] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:18 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 1517 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:19.421827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:19.423601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:19.437381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:19.457828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.458287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:19.460098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:19.460883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:20.571670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=67 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:21.202627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.237990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.246438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:21.272355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Updating instance_info_cache with network_info: [{"id": "27bf92cc-9b07-4d90-88f2-6f455317fe1b", "address": "fa:16:3e:f9:ed:39", "network": {"id": "257361c5-377c-4f9d-9e23-eb73b84a9673", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1952187725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f015daca8b6946559c7d8469e06f348b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap27bf92cc-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:34:21.287100 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80671e25-6084-4976-a477-1ff2d4760757 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.837153 Jul 18 02:34:21.289002 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1955/3964] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:19 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:21.301364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-49188ea9-74b1-4ce9-83c7-e67e88c0d034 req-8098517b-6614-40a1-9011-78b3f379bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a86106-e355-4393-88a5-ab6420797766", "name": "network-vif-deleted", "tag": "a9318193-0a2d-423c-999e-dd789fbcb5b4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:21.315297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Releasing lock "refresh_cache-3929008e-af78-4e8c-a040-5d841ec96898" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:34:21.316529 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-121c1ade-b18a-4f59-8284-aca66e8820e8 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action" status: 202 len: 0 microversion: 2.1 time: 10.758111 Jul 18 02:34:21.317385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2010/3965] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:34:10 2022] POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action => generated 0 bytes in 10759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:34:21.324849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:21.326601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: 62a86106-e355-4393-88a5-ab6420797766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:21.335816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49188ea9-74b1-4ce9-83c7-e67e88c0d034 req-8098517b-6614-40a1-9011-78b3f379bf78 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.336783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-49188ea9-74b1-4ce9-83c7-e67e88c0d034 req-8098517b-6614-40a1-9011-78b3f379bf78 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.340776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.341572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.342579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.343306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.361785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] HTTP exception thrown: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Request method failure captured: Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 HTTP/1.1 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MZMq2r88y4hpWlEaqIM-eIIo6dpF9LhGekiFMvULMH2bILWxOjGHRb0TZt-2tgSa8pX9WfSSG5qr99QRjv_R7po8boAuhgfiXTIL6oDDcmFVzfrvP4MG13N2O0I3Eyxf61gpnZBR3vP-fmySahsnbF-evqS5DCM16xxEilHof-N4XQ Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ac14269ddbfd45c197426ecdcc0b8025 Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '62a86106-e355-4393-88a5-ab6420797766'} Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:21.363667 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. Jul 18 02:34:21.369180 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:21.369797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-49188ea9-74b1-4ce9-83c7-e67e88c0d034 req-8098517b-6614-40a1-9011-78b3f379bf78 service nova] Creating event network-vif-deleted:a9318193-0a2d-423c-999e-dd789fbcb5b4 for instance 62a86106-e355-4393-88a5-ab6420797766 on n-h1-849796-1 Jul 18 02:34:21.370856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Returning 404 to user: Instance 62a86106-e355-4393-88a5-ab6420797766 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:21.371948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ccfdbd76-c7ff-4dce-ac59-9dc8db414ade tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766" status: 404 len: 111 microversion: 2.1 time: 0.053349 Jul 18 02:34:21.373148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2011/3966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:21 2022] GET /compute/v2.1/servers/62a86106-e355-4393-88a5-ab6420797766 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:21.378909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.216"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:21.386122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-49188ea9-74b1-4ce9-83c7-e67e88c0d034 req-8098517b-6614-40a1-9011-78b3f379bf78 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094073 Jul 18 02:34:21.386784 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1956/3967] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:21.392681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:21.393319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:21.400842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.401328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.402243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.402910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.444591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:21.602109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e35b79c9-ef3c-4722-9b2a-18a78dd454bc tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 204 len: 0 microversion: 2.1 time: 0.212643 Jul 18 02:34:21.603127 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1957/3968] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:21 2022] DELETE /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:21.620205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:21.622147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:21.635093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.635885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:21.637421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:21.638442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.023846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:22.048119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.049849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.052612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.054209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.222510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:22.242846 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11ad958d-a03b-4b93-a988-9165dc56c46f tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1517 microversion: 2.1 time: 0.632031 Jul 18 02:34:22.251286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1958/3969] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:21 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1517 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:22.324381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:22.330562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:22.348720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.359431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.361664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:22.363016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:22.985826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Acquired lock "refresh_cache-3929008e-af78-4e8c-a040-5d841ec96898" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:34:23.266565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.306359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.309988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.312330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-531e1159-9394-4dad-81bb-e7a8934301bd tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.996961 Jul 18 02:34:23.313464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1959/3970] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:22 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:23.337744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:23.351698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:23.374318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:23.375124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:23.378289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:23.379153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:23.907588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:23.939409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82efe21b-483b-4b4e-8ad6-8e7a1543c717 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1517 microversion: 2.1 time: 0.619145 Jul 18 02:34:23.940585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1960/3971] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:23 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1517 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:24.365666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:24.368105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:24.387054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.393128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.395041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:24.396542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:24.724258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:25.079798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.112741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.119819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.122574 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30b5e68d-808d-4be8-8b06-ee11d60e1493 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.778545 Jul 18 02:34:25.128050 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1961/3972] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:24 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:25.146941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:25.149308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:25.174297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:25.175248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:25.176778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:25.177748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:25.604122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:25.624393 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4fc51915-f9eb-4013-a5d5-848b722d5d81 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1517 microversion: 2.1 time: 0.494976 Jul 18 02:34:25.645074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1962/3973] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:25 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1517 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:26.158545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:26.159541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:26.172605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:26.175934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:26.177126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:26.178604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:26.842038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:26.856892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:26.866065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:26.869595 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfffcddb-7477-490a-bf5d-10c8e407cf0b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.714756 Jul 18 02:34:26.885015 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1963/3974] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:26 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:26.911843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7693738d-6e55-40aa-87de-ba18a8f6a179 req-5c91bd3d-4fed-4120-a5c2-011d1365ef3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f31075-84fa-48ad-a045-155d0c8020cc", "name": "network-vif-deleted", "tag": "edc82532-17d0-4933-9aec-64f8ab4b6960"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:26.966560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7693738d-6e55-40aa-87de-ba18a8f6a179 req-5c91bd3d-4fed-4120-a5c2-011d1365ef3d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:26.967613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7693738d-6e55-40aa-87de-ba18a8f6a179 req-5c91bd3d-4fed-4120-a5c2-011d1365ef3d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.063004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7693738d-6e55-40aa-87de-ba18a8f6a179 req-5c91bd3d-4fed-4120-a5c2-011d1365ef3d service nova] Creating event network-vif-deleted:edc82532-17d0-4933-9aec-64f8ab4b6960 for instance b0f31075-84fa-48ad-a045-155d0c8020cc on n-h2-849796-1 Jul 18 02:34:27.087270 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7693738d-6e55-40aa-87de-ba18a8f6a179 req-5c91bd3d-4fed-4120-a5c2-011d1365ef3d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198379 Jul 18 02:34:27.089917 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1964/3975] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:27.101415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:27.103400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:27.137484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:27.138823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.139978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:27.140720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.218858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:27.219634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:27.220516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lazy-loading 'fault' on Instance uuid b0f31075-84fa-48ad-a045-155d0c8020cc {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:27.534175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Building network info cache for instance {{(pid=119439) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 18 02:34:27.564735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:27.579514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d45bdf3-cd9f-4079-993f-d0b206945e8c tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 200 len: 1310 microversion: 2.1 time: 0.486759 Jul 18 02:34:27.591768 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1965/3976] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:27 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 1310 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:28.180748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-933239790", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:28.297028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] validate_networks() for [('bc3757aa-50bd-407f-9426-b53b0e6bdb8f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:34:29.480011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:29.482062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:29.483144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:29.485279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:29.486130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:29.511726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:29.512854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:29.514821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:29.516146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:29.556897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Getting quotas for project 607decefd93648458479c655fcc651bc. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:29.569750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Getting quotas for user 368018b1936a4ec99e16412a5139b575 and project 607decefd93648458479c655fcc651bc. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:29.597022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:34:29.602902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:34:29.784811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eaafb336-bef6-48cd-89fe-e2737ef2dacb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923048 Jul 18 02:34:29.786627 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1966/3977] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:34:29.807376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:29.812285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:29.856342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:29.857202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:29.858659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:29.859461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.150348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Updating instance_info_cache with network_info: [{"id": "27bf92cc-9b07-4d90-88f2-6f455317fe1b", "address": "fa:16:3e:f9:ed:39", "network": {"id": "257361c5-377c-4f9d-9e23-eb73b84a9673", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1952187725-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f015daca8b6946559c7d8469e06f348b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap27bf92cc-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:34:30.166574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Releasing lock "refresh_cache-3929008e-af78-4e8c-a040-5d841ec96898" {{(pid=119439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:34:30.168196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74545e94-55a3-4bbf-82ab-be66cebfd6fa tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action" status: 202 len: 0 microversion: 2.1 time: 8.793408 Jul 18 02:34:30.174245 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2012/3978] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:34:21 2022] POST /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898/action => generated 0 bytes in 8796 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 18 02:34:30.176118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:30.176979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: b0f31075-84fa-48ad-a045-155d0c8020cc] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:30.213692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.216202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.222660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.227472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.270434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] HTTP exception thrown: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Request method failure captured: Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc HTTP/1.1 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MZMq2r88y4hpWlEaqIM-eIIo6dpF9LhGekiFMvULMH2bILWxOjGHRb0TZt-2tgSa8pX9WfSSG5qr99QRjv_R7po8boAuhgfiXTIL6oDDcmFVzfrvP4MG13N2O0I3Eyxf61gpnZBR3vP-fmySahsnbF-evqS5DCM16xxEilHof-N4XQ Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ac14269ddbfd45c197426ecdcc0b8025 Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b0f31075-84fa-48ad-a045-155d0c8020cc'} Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:30.275184 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:34:30.283801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Returning 404 to user: Instance b0f31075-84fa-48ad-a045-155d0c8020cc could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:30.286472 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a9fe8a5-ea96-44cf-b528-7cec1674ea51 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc" status: 404 len: 111 microversion: 2.1 time: 0.114510 Jul 18 02:34:30.289101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2013/3979] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:30 2022] GET /compute/v2.1/servers/b0f31075-84fa-48ad-a045-155d0c8020cc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:30.308217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11411161-0770-4574-8718-fd86db20054e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:30.309787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11411161-0770-4574-8718-fd86db20054e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:30.522772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11411161-0770-4574-8718-fd86db20054e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:30.554955 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11411161-0770-4574-8718-fd86db20054e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1216 microversion: 2.1 time: 0.261388 Jul 18 02:34:30.566377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:30.570485 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2014/3980] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:30 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1216 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:30.585371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:30.585371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:30.585371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f98d8c57-226e-4deb-9bc8-6cfc87582d3a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.795761 Jul 18 02:34:30.601274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-134d6638-95ff-4f95-8f63-445378377f54 req-4db5bd1d-33b5-475b-aff4-5613c2ceabe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:30.604594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1967/3981] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:29 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:30.628181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-134d6638-95ff-4f95-8f63-445378377f54 req-4db5bd1d-33b5-475b-aff4-5613c2ceabe3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.630213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-134d6638-95ff-4f95-8f63-445378377f54 req-4db5bd1d-33b5-475b-aff4-5613c2ceabe3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.631926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-639f2d32-0152-480c-9c4e-c3d285b0063b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '.version_select at 0x7fab04593af0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:30.667305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-134d6638-95ff-4f95-8f63-445378377f54 req-4db5bd1d-33b5-475b-aff4-5613c2ceabe3 service nova] Creating event network-changed:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:34:30.679441 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-134d6638-95ff-4f95-8f63-445378377f54 req-4db5bd1d-33b5-475b-aff4-5613c2ceabe3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089723 Jul 18 02:34:30.681258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2015/3982] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:30.692822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:30.693948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:30.706544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.708092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.710421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:30.712271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:30.778500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:31.042578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d86f2785-335e-44ad-b6d0-d397b4b88aea tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 204 len: 0 microversion: 2.1 time: 0.358762 Jul 18 02:34:31.044313 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2016/3983] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:30 2022] DELETE /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:31.064579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:31.065851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:31.121099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.122008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:31.123464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.124262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:31.626739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:31.669338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71074247-2001-4f14-b94c-76b7c5967457 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1518 microversion: 2.1 time: 0.616787 Jul 18 02:34:31.669649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2017/3984] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:31 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1518 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:31.690350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:31.694910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:31.731587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.733049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:31.735644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:31.736870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:32.026679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:32.054707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f376f8fe-3497-4b3f-85f3-b4b5fa271ef5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1268 microversion: 2.1 time: 0.380146 Jul 18 02:34:32.071268 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2018/3985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:31 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1268 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:32.091642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:32.093515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:32.107855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:32.109221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:32.111432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:32.112521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:32.617230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-639f2d32-0152-480c-9c4e-c3d285b0063b tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/29e3aab6-8750-40c0-b1f8-d413c91bca63" status: 202 len: 0 microversion: 2.1 time: 2.005380 Jul 18 02:34:32.621664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1968/3986] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:34:30 2022] DELETE /compute/v2.1/os-floating-ips/29e3aab6-8750-40c0-b1f8-d413c91bca63 => generated 0 bytes in 2016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:34:32.645374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfec670d-ec30-4f3f-ad35-2da8e6bf3a2f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '.version_select at 0x7fab04593040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:33.299178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:33.312805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:33.324360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:33.326482 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fd0dbf1-f393-4e67-b4a5-bd8cf19e239d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.253366 Jul 18 02:34:33.340701 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2019/3987] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:32 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:33.356541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:33.357212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:33.392203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.396684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.404315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.407042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.587202 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfec670d-ec30-4f3f-ad35-2da8e6bf3a2f tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/110dfd34-f29b-43d0-82e4-7e192b71e62f" status: 202 len: 0 microversion: 2.1 time: 0.955768 Jul 18 02:34:33.589162 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1969/3988] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:34:32 2022] DELETE /compute/v2.1/os-security-groups/110dfd34-f29b-43d0-82e4-7e192b71e62f => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:34:33.598485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:33.610175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:33.631910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.633215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.634166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.634932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.815766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:33.825795 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4047a9ca-b667-4a0b-8eaa-d9f07f5ff356 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1274 microversion: 2.1 time: 0.234442 Jul 18 02:34:33.827244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1970/3989] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:33 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:33.832716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:33.833671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:33.841410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.842208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.843261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:33.843912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:33.897794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:34.062733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:34.312240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56e71018-4e32-4063-9881-1d6ad26e5bbb tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 204 len: 0 microversion: 2.1 time: 0.463274 Jul 18 02:34:34.316518 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1971/3990] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:33 2022] DELETE /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:34.413483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac14269ddbfd45c197426ecdcc0b8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc68e191e45c8bb31e70d621f660d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:34.445489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d8e5aea-9132-41f6-88cd-1d8eb723d0d1 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 200 len: 1518 microversion: 2.1 time: 1.092926 Jul 18 02:34:34.447374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2020/3991] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:33 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 1518 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:34.464259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8280a104-3004-453a-adb6-9c8994f15eac req-1ebcf812-5ba3-480b-ad6b-bd0f5aaa48f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3dfe2e1-7b24-4479-812c-19010d3b8502", "name": "network-vif-deleted", "tag": "396a072d-1b82-4355-be44-e69d79d5825f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:34.497069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8280a104-3004-453a-adb6-9c8994f15eac req-1ebcf812-5ba3-480b-ad6b-bd0f5aaa48f5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:34.497838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8280a104-3004-453a-adb6-9c8994f15eac req-1ebcf812-5ba3-480b-ad6b-bd0f5aaa48f5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:34.533672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8280a104-3004-453a-adb6-9c8994f15eac req-1ebcf812-5ba3-480b-ad6b-bd0f5aaa48f5 service nova] Creating event network-vif-deleted:396a072d-1b82-4355-be44-e69d79d5825f for instance f3dfe2e1-7b24-4479-812c-19010d3b8502 on n-h1-849796-1 Jul 18 02:34:34.543704 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8280a104-3004-453a-adb6-9c8994f15eac req-1ebcf812-5ba3-480b-ad6b-bd0f5aaa48f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093922 Jul 18 02:34:34.546114 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2021/3992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:34.569744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:34.571448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:34.628245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:34.630593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:34.635815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:34.637873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:34.850705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-551892077", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:34.935976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:34.937870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:34.939134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:34.939809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:34.941275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:34.954567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:34.955464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:34.956599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:34.957676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:34.988201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Getting quotas for project d98c5d5c89284e588aadf894bde47962. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:34.998228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Getting quotas for user 943ae647ab584dff8904134b179ebce3 and project d98c5d5c89284e588aadf894bde47962. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:35.017363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:34:35.019707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:34:35.211635 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4fa9851d-e347-47a8-a1f2-64539dded034 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.889233 Jul 18 02:34:35.213336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1972/3993] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:34:35.230594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:35.231828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:35.252896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.254037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.255641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.257549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.377590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.402344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2183df6-8098-4f4d-aefb-1bd8003302c0 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1510 microversion: 2.1 time: 0.853257 Jul 18 02:34:35.404441 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2022/3994] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:34 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1510 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:35.435554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:35.439185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:35.458497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.463953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.470450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.471632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.757757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.783567 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86ea3071-89c8-418c-8d43-2d3ceeb40adc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1274 microversion: 2.1 time: 0.374216 Jul 18 02:34:35.784710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.786145 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2023/3995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:35 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1274 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:35.812969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.817554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:35.822320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94bbc299-af40-40c3-b3db-a7b04136183c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.605660 Jul 18 02:34:35.822492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:35.823305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1973/3996] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:35 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:35.825721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:35.837572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:35.838909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] [instance: f3dfe2e1-7b24-4479-812c-19010d3b8502] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:35.875153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.875828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.876599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:35.877100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:35.925938 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] HTTP exception thrown: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Request method failure captured: Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 HTTP/1.1 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MZMq2r88y4hpWlEaqIM-eIIo6dpF9LhGekiFMvULMH2bILWxOjGHRb0TZt-2tgSa8pX9WfSSG5qr99QRjv_R7po8boAuhgfiXTIL6oDDcmFVzfrvP4MG13N2O0I3Eyxf61gpnZBR3vP-fmySahsnbF-evqS5DCM16xxEilHof-N4XQ Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fdfc68e191e45c8bb31e70d621f660d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 3fdfc68e191e45c8bb31e70d621f660d Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1947582172 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: ac14269ddbfd45c197426ecdcc0b8025 Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ListServerFiltersTestJSON-1947582172-project Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'f3dfe2e1-7b24-4479-812c-19010d3b8502'} Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:35.931930 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. Jul 18 02:34:35.937136 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:35.942246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] Returning 404 to user: Instance f3dfe2e1-7b24-4479-812c-19010d3b8502 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:35.945320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24438811-0db0-495d-a7fd-a66a97158be3 tempest-ListServerFiltersTestJSON-1947582172 tempest-ListServerFiltersTestJSON-1947582172-project] 10.222.0.67 "GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502" status: 404 len: 111 microversion: 2.1 time: 0.118711 Jul 18 02:34:35.947344 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1974/3997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:35 2022] GET /compute/v2.1/servers/f3dfe2e1-7b24-4479-812c-19010d3b8502 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:34:36.127992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.140589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.143501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.148427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bf17652-5967-4d63-a700-6a7e03b5d986 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1277 microversion: 2.47 time: 0.355378 Jul 18 02:34:36.171860 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2024/3998] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:35 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:36.273395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1502045782", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:36.375812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:36.376252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:36.376740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:36.377203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:36.377632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:36.403987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.404518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.405410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.406177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.430090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:36.431100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:36.455513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.456259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.456852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.457358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.480566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Getting quotas for project d98c5d5c89284e588aadf894bde47962. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:34:36.487705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Getting quotas for user 943ae647ab584dff8904134b179ebce3 and project d98c5d5c89284e588aadf894bde47962. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:34:36.507332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:36.536751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:34:36.544698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:34:36.611112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a13c433-7a90-4383-aebc-48b0a05a4246 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.342038 Jul 18 02:34:36.612070 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1975/3999] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:34:36.627050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eac1c3a3-09cf-485d-ad28-b90b945d3c36 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:36.628288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eac1c3a3-09cf-485d-ad28-b90b945d3c36 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:36.701045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:36.732361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eac1c3a3-09cf-485d-ad28-b90b945d3c36 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "PUT /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 992 microversion: 2.47 time: 0.109604 Jul 18 02:34:36.738197 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1976/4000] 10.222.0.67 () {62 vars in 1296 bytes} [Mon Jul 18 02:34:36 2022] PUT /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 992 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:34:36.766484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:36.767592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:36.917465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.931864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.933704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:36.938494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d79812e1-929c-446e-9c53-e2d17d01bdf2 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1278 microversion: 2.47 time: 0.176850 Jul 18 02:34:36.941104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1977/4001] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:36 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:36.951981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:36.955527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:36.973601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.977740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:36.979109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:36.979787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:37.260440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:37.278977 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c9bb394-8dda-4347-9d2b-a5f14a9e7d15 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1510 microversion: 2.1 time: 0.852366 Jul 18 02:34:37.278977 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2025/4002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:36 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1510 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:37.300255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:37.300864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:37.332985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:37.335201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:37.337107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:37.344238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.105685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.125410 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b63a28be-8bdd-4c33-b152-8aca9c6f0056 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 1.182305 Jul 18 02:34:38.128136 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1978/4003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:36 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:38.150436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:38.152117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:38.166366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.167472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.169861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.170910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.347146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.383417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.391702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.399553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4bc70df4-4bf9-4020-ae68-847cb4cb5aee tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1282 microversion: 2.47 time: 0.267516 Jul 18 02:34:38.417414 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1979/4004] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:38 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:38.422553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:38.423203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:38.443312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.444494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.445589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:38.446141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:38.832167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.854235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.856302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:38.857599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8a783a5e-5b68-4604-a84d-6cc1cde60e42 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.577827 Jul 18 02:34:38.858186 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2026/4005] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:37 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:39.097454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.133947 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd5bd9ec-c8d5-483f-8616-2948e1397611 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1510 microversion: 2.1 time: 0.714609 Jul 18 02:34:39.136095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1980/4006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:38 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1510 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:39.157026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:39.157997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:39.171617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.178498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.180385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.181098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.433083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:39.434179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:39.450279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.451103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.452726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.454463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.698360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.711988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fab1e6b-9bd6-4af6-9a9e-02d6970f500a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.559192 Jul 18 02:34:39.714084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2027/4007] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:39 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:39.715360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.728052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.735297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9f45519c-78de-479d-bc14-016a3c7b3f68 req-f2a62a67-63bc-4ed8-950f-27eb9710f8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929008e-af78-4e8c-a040-5d841ec96898", "name": "network-vif-deleted", "tag": "27bf92cc-9b07-4d90-88f2-6f455317fe1b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:39.737815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:39.739538 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c22de985-89be-4ed3-a92f-87f91722d50d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1274 microversion: 2.47 time: 0.311986 Jul 18 02:34:39.740947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1981/4008] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:39 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1274 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:39.760869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9f45519c-78de-479d-bc14-016a3c7b3f68 req-f2a62a67-63bc-4ed8-950f-27eb9710f8c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.761792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9f45519c-78de-479d-bc14-016a3c7b3f68 req-f2a62a67-63bc-4ed8-950f-27eb9710f8c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.804009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9f45519c-78de-479d-bc14-016a3c7b3f68 req-f2a62a67-63bc-4ed8-950f-27eb9710f8c0 service nova] Creating event network-vif-deleted:27bf92cc-9b07-4d90-88f2-6f455317fe1b for instance 3929008e-af78-4e8c-a040-5d841ec96898 on n-h2-849796-1 Jul 18 02:34:39.815122 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9f45519c-78de-479d-bc14-016a3c7b3f68 req-f2a62a67-63bc-4ed8-950f-27eb9710f8c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097701 Jul 18 02:34:39.816590 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2028/4009] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:39.910708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:39.915411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:39.964796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.965404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:39.966971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:39.967672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.169581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:40.170413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:40.189276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.189738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.190869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.191579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.365544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:40.399584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe2d971f-6a38-4f22-83bd-f2d1c556ac91 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1468 microversion: 2.1 time: 0.232774 Jul 18 02:34:40.413081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2029/4010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:40 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:40.730450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:40.747238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:40.753883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:40.757376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:40.764502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:40.769955 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb89987f-7251-442a-8464-cb23bfac7d46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.875715 Jul 18 02:34:40.777742 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1982/4011] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:39 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:40.793643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:40.794347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.795621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.798007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:40.801321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.805280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.841520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.842399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:40.843848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:40.844974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.376502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:41.397344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:41.406434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:41.410528 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd57fdd8-8f5b-4f75-9535-8e9e6743bed3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1330 microversion: 2.47 time: 0.631145 Jul 18 02:34:41.414287 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1983/4012] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:40 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1330 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:41.433427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:41.434187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:41.446832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.447568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.449075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.450900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.640015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:41.648355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'services' on Instance uuid 9bd37eff-f3dd-4623-9c73-d351db4348c2 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:41.661774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e023e198-7850-4234-8152-8d9a7a34bb22 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.924057 Jul 18 02:34:41.677555 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2030/4013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:40 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:41.691164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:41.692957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:41.714170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.714949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.716681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.717920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.793660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.794958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.798794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lazy-loading 'fault' on Instance uuid 3929008e-af78-4e8c-a040-5d841ec96898 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:41.864436 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8be53940-5614-481c-88d4-c65e172e2f3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments/3673f2f9-bd15-40b6-b110-5882913021bb" status: 202 len: 0 microversion: 2.1 time: 0.447341 Jul 18 02:34:41.867986 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1984/4014] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:34:41 2022] DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments/3673f2f9-bd15-40b6-b110-5882913021bb => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:34:41.876805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:41.879030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:41.891263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.892185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:41.893422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:41.894422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.017083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.032117 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d0136f3-3177-4e6e-8eb5-cf8c56606aca tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1312 microversion: 2.1 time: 0.351470 Jul 18 02:34:42.042760 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2031/4015] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:41 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:42.045864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2dc0a66d-96c3-41c5-b74c-b7b3df978631 req-693cea80-51cb-43db-89ba-e6d23ea7754e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:42.063360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2dc0a66d-96c3-41c5-b74c-b7b3df978631 req-693cea80-51cb-43db-89ba-e6d23ea7754e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.068201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2dc0a66d-96c3-41c5-b74c-b7b3df978631 req-693cea80-51cb-43db-89ba-e6d23ea7754e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.081875 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2dc0a66d-96c3-41c5-b74c-b7b3df978631 req-693cea80-51cb-43db-89ba-e6d23ea7754e service nova] Creating event network-changed:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:34:42.089180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2dc0a66d-96c3-41c5-b74c-b7b3df978631 req-693cea80-51cb-43db-89ba-e6d23ea7754e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054480 Jul 18 02:34:42.090316 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2032/4016] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:42.098106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:42.101228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:42.109827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.110765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.111937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.112726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.164417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-853649fc-cd51-4cf8-9fbf-5363d0225a5b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072415 Jul 18 02:34:42.169402 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2033/4017] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:42 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:42.455246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:42.463054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:42.495804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.498861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.505115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.507907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.552422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.631206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.651414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.657117 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88f6a8fe-cbce-4b44-8aec-573a07c0f5f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.786872 Jul 18 02:34:42.664333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1985/4018] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:41 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:42.725950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:42.728131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:42.786497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.800417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.807882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:42.809247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:42.907940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.923100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.927369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:42.932251 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a9ec993-c926-41f6-91fa-a718f9796152 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1330 microversion: 2.47 time: 0.493559 Jul 18 02:34:42.948286 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2034/4019] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:42 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1330 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:43.061797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:43.063566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:43.087053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.088662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.092493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.095194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.184895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.186176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.187624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lazy-loading 'fault' on Instance uuid 3929008e-af78-4e8c-a040-5d841ec96898 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:43.399437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:43.432718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b5cab2bb314366b0a93f796865de10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f015daca8b6946559c7d8469e06f348b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:43.446609 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a88d2d8-0d9b-49ab-bbfe-65d5a0a8f6da tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 200 len: 1312 microversion: 2.1 time: 0.399945 Jul 18 02:34:43.453409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15257cf5-99e0-4f77-a38c-8eae6c18dfe6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.752066 Jul 18 02:34:43.456954 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1986/4020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:42 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:43.466851 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2035/4021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:43 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:43.497448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:43.502296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:43.542510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.545160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.548017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.552370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.660658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80adaa25-6a4c-422b-83b6-03a3668ac406 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199093 Jul 18 02:34:43.662115 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1987/4022] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:43 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:43.684534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:43.686092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:43.699350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.700089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.701179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.701825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.962274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:43.966618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:43.989622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.991913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:43.996850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:43.999781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.245578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.278761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.293823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.296643 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c2fe2ef-af4e-4245-911e-4af904a8c609 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1336 microversion: 2.47 time: 0.343733 Jul 18 02:34:44.310136 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1988/4023] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:43 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1336 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:44.485266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:44.496287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] [instance: 3929008e-af78-4e8c-a040-5d841ec96898] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:44.516509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.517698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.520835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.532720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.578601 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] HTTP exception thrown: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Request method failure captured: Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 HTTP/1.1 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MZJvmdCm9Mp3PhZDMNFQNPGxNa_kUxVhPGjfza_95xpzpA4_BghLlfgc24wlByBQFKndKgnCMOMkE3y4xePs7WaBUxgsltH3uxsjjzkciwa2sWDEePmo9H54mCYb9vanplcyh0B3RcD4zQZ0gAfz_Nhz6AaOfjJjXOVgwsFdGa4Fv4 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f015daca8b6946559c7d8469e06f348b Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-394542185 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f015daca8b6946559c7d8469e06f348b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f015daca8b6946559c7d8469e06f348b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f015daca8b6946559c7d8469e06f348b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f015daca8b6946559c7d8469e06f348b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-394542185 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f015daca8b6946559c7d8469e06f348b Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-394542185 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueTestJSONUnderV235-394542185-project Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 89b5cab2bb314366b0a93f796865de10 Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-394542185-project Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3929008e-af78-4e8c-a040-5d841ec96898'} Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:44.582003 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:44.587829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] Returning 404 to user: Instance 3929008e-af78-4e8c-a040-5d841ec96898 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:44.588686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.596089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0069e736-ff55-47e6-b75e-95543bd44302 tempest-ServerRescueTestJSONUnderV235-394542185 tempest-ServerRescueTestJSONUnderV235-394542185-project] 10.222.0.67 "GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898" status: 404 len: 111 microversion: 2.1 time: 0.107424 Jul 18 02:34:44.597673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1989/4024] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:44 2022] GET /compute/v2.1/servers/3929008e-af78-4e8c-a040-5d841ec96898 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:34:44.605948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.607131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:44.607695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:44.608047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:44.617167 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed8eaf79-dda4-4dd4-b28b-399c5d8455f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.929504 Jul 18 02:34:44.619767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.620564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.622033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.622813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.625168 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2036/4025] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:43 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:44.702529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:44.703682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:44.732315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.737907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.742275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:44.750810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:44.907834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a0d57b8-2fad-464a-9896-646143af56b0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233631 Jul 18 02:34:44.916900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2037/4026] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:44 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:44.982819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2ebf6c72-5ec0-4267-8c58-9d374e258028 req-41142214-bbbe-4271-bed2-79f891d11a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "cc5ffa71-1d83-4a8d-816b-8ad73e0f9861"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:45.001684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2ebf6c72-5ec0-4267-8c58-9d374e258028 req-41142214-bbbe-4271-bed2-79f891d11a18 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.002576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2ebf6c72-5ec0-4267-8c58-9d374e258028 req-41142214-bbbe-4271-bed2-79f891d11a18 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.029049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2ebf6c72-5ec0-4267-8c58-9d374e258028 req-41142214-bbbe-4271-bed2-79f891d11a18 service nova] Creating event network-vif-plugged:cc5ffa71-1d83-4a8d-816b-8ad73e0f9861 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:45.038576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2ebf6c72-5ec0-4267-8c58-9d374e258028 req-41142214-bbbe-4271-bed2-79f891d11a18 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058962 Jul 18 02:34:45.040576 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2038/4027] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:45.337465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:45.338200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:45.357834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.364060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.370051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.371505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.391378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:45.407077 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc1a5ae4-8ea1-4e27-80a9-7d09fb6bc8d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.807732 Jul 18 02:34:45.407639 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1990/4028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:44 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:45.467627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:45.479197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:45.486094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:45.498937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4e6d4d2-fed9-4e2b-8107-65c02971d80c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1336 microversion: 2.47 time: 0.166798 Jul 18 02:34:45.512182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2039/4029] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:45 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:45.642987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:45.650110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:45.667587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.678877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.680886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.694229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.923714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:45.924718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:45.946383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.946867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:45.947753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:45.948221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.032350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bca0f67d-31d9-487f-aad6-f2f2b815e2a4 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112947 Jul 18 02:34:46.036526 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2040/4030] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:45 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:46.436561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:46.438197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:46.439335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:46.452319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:46.454770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:46.455457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.456555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:46.457228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.647317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.662647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.664671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.666321 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-086b48b2-5b18-4555-befe-4da6c31530fa tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.030988 Jul 18 02:34:46.667774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1991/4031] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:45 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:46.682673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:46.683583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:46.699387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:46.700178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.701212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:46.704444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:46.760839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:46.787439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.799783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf31f57b-4c29-419d-bba4-17c07ac2ce7e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.377146 Jul 18 02:34:46.802093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2041/4032] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:46 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:46.920282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.933415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=20 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:46.936638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.938355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:46.951157 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-18fe49d9-e369-4fec-b5d0-7f2c69dfa008 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1336 microversion: 2.47 time: 0.281946 Jul 18 02:34:46.963602 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1992/4033] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:46 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1336 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:47.049763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:47.052539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:47.071543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.073852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.076853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.079266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.160233 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-69585aee-0179-45b6-b15d-a07a0c694dd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113661 Jul 18 02:34:47.163748 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2042/4034] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:47 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:47.686968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:47.688267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:47.702158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.713648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.718981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.719721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.830084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:47.830922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:47.841656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.845717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.846814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:47.847406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:47.908185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:48.192846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.210239 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4cded08b-5424-4b6f-9574-e81a65eb6bb5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.382659 Jul 18 02:34:48.211980 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2043/4035] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:47 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:48.218208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:48.219290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:48.248967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.255271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.258996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.260533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.478569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.505318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.525342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.532549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0183c343-70ba-4542-8a37-581c022c4cec tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1336 microversion: 2.47 time: 0.317504 Jul 18 02:34:48.547047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2044/4036] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:48 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1336 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:48.558616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:48.571944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.577419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Searching by: {'deleted': False, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:48.590315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.591125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.594153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.594897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.656486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:48.733890 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19d1b3f4-7bd6-48a1-846b-39645defb025 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.183796 Jul 18 02:34:48.735260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2045/4037] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:34:48 2022] GET /compute/v2.1/servers => generated 333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:48.748540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:48.750027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:48.768812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.769322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.770137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.770597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.869975 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ae2f142-55ad-4ce2-986b-fbb1c3052bdb tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133111 Jul 18 02:34:48.870907 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2046/4038] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:48 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:48.876497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:48.885641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:48.893044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Searching by: {'deleted': False, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:34:48.913982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.917147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.918288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:48.925575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:48.999920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:34:49.112367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:49.129548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:49.130019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:49.616672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:49.645368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:49.651379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:49.655317 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-adfa4ee2-981f-4e86-a07e-8cc35220a8bb tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.971377 Jul 18 02:34:49.657221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1993/4039] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:47 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:49.679896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:49.681410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:49.698674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:49.699440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:49.702623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:49.703858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:49.754367 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4db9dad8-0cc6-4817-9efa-4454970f7d4a tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.881252 Jul 18 02:34:49.757333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2047/4040] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:34:48 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:49.796518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:49.800494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:49.848827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:49.851817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:49.856753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:49.858039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.084676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:50.125972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:50.134875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:50.141074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81c6158f-45f6-446b-a60d-d63f096ffd98 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1336 microversion: 2.47 time: 0.380254 Jul 18 02:34:50.145112 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2048/4041] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:49 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1336 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:50.169934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00dfd3a7-6cf8-43ed-b656-425cd331ea9b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:50.210775 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00dfd3a7-6cf8-43ed-b656-425cd331ea9b tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062855 Jul 18 02:34:50.214551 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2049/4042] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:34:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:50.246502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:50.253395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:50.291605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.293254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.298929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.312539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.436832 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98e002d6-1c96-4732-a6e4-cc61f847e92b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215702 Jul 18 02:34:50.437932 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2050/4043] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:50 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:50.563171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:50.567658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:50.579073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.579523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.586899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.587401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.660114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:50.665809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:50.673191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46760972-922a-415a-9a2a-0c792780c00a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 1.013952 Jul 18 02:34:50.689644 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1994/4044] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:49 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:50.695666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:50.707281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:50.735147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.735627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.736568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.737555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.806027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:50.837577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a4c7ac59-3b89-4d4b-b018-0889bd1ba27c tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "DELETE /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 204 len: 0 microversion: 2.1 time: 0.290421 Jul 18 02:34:50.840785 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2051/4045] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:50 2022] DELETE /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:50.859006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:50.862646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:50.899108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.901750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:50.905886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:50.907796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.630446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:51.645131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:51.648108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:51.649477 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5af00df-1ad5-462a-9a7e-7b225d18b923 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.958429 Jul 18 02:34:51.650090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1995/4046] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:50 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:51.679184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:51.679870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:51.699178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.699647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.700481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.700969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.829281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:51.843821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd092672-e1a1-44c1-b464-08a55e4fc779 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1700 microversion: 2.1 time: 0.998155 Jul 18 02:34:51.844639 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2052/4047] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:50 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1700 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:51.857677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:51.858669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:51.872517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.872517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.872517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:51.872517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:51.964196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a12a740-c181-4b9f-8c60-b5d14c10ab6d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118232 Jul 18 02:34:51.964754 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2053/4048] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:51 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:51.988424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:51.989124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:52.031729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.032239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.042231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.042794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.186811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:52.202642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:52.204174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:52.205510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17a302e7-fcfc-439a-90fc-35e4aa8b1c52 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1357 microversion: 2.47 time: 0.531264 Jul 18 02:34:52.232332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1996/4049] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:51 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1357 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:52.237660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:52.239186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:52.261741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.262221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.269374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.269864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.452978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:34:52.460563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:34:52.461595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:34:52.462206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:34:52.462818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:34:52.590232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:52.601944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd99eb1e-2d0c-4f18-9468-67aafbc146f3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.617403 Jul 18 02:34:52.608434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:52.616437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2054/4050] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:51 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:52.629089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0cc6201a-6078-488f-9b60-525f63af7f85 req-545ea3dd-65a5-41fc-9424-af33692a477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "731990ba-af53-444f-890d-a035111c7987"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:52.630165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.631659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.633004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.633662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.648214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0cc6201a-6078-488f-9b60-525f63af7f85 req-545ea3dd-65a5-41fc-9424-af33692a477a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.648674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0cc6201a-6078-488f-9b60-525f63af7f85 req-545ea3dd-65a5-41fc-9424-af33692a477a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.684883 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0cc6201a-6078-488f-9b60-525f63af7f85 req-545ea3dd-65a5-41fc-9424-af33692a477a service nova] Creating event network-vif-plugged:731990ba-af53-444f-890d-a035111c7987 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:52.701299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0cc6201a-6078-488f-9b60-525f63af7f85 req-545ea3dd-65a5-41fc-9424-af33692a477a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081731 Jul 18 02:34:52.702934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2055/4051] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:52.704026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ed8714e7-1251-41b9-b004-785f6555070b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "POST /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766/action" status: 202 len: 1079 microversion: 2.47 time: 0.470338 Jul 18 02:34:52.705400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1997/4052] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:34:52 2022] POST /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766/action => generated 1079 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:34:52.716378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:52.719067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:52.722712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:52.723807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:52.734482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.735292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.735903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.736667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.737434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.738584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:52.741400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:52.741881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.105135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.160242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.180441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.184861 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13595f65-fb0f-4e75-8b94-a8a59344a65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.467199 Jul 18 02:34:53.191454 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1998/4053] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:52 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:53.207533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:53.213438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.227135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.227939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.229432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.230083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.443663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.468402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.471396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.473599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da56a6d4-3827-4f4e-a37d-f9cc5586668f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.767857 Jul 18 02:34:53.485671 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2056/4054] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:52 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:53.485671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:53.486230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.499724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.500540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.502240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.503066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.584180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32ca4cf1-67fc-47c2-a721-fd5924950e0c tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107120 Jul 18 02:34:53.585579 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2057/4055] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:34:53 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:34:53.627216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:53.628189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.665743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.666555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.668052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.674867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.832883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:53.858590 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75608da4-2a26-47cc-9dcd-6a592e4b7901 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1700 microversion: 2.1 time: 0.662468 Jul 18 02:34:53.860352 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 1999/4056] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:53 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1700 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:53.866753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:53.869064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.878493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.879548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.881477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.882289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.954716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Cannot 'reboot' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action HTTP/1.1 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 28 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: {"reboot": {"type": "HARD"}} Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'reboot' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3db28d67-4e43-4c24-aaf9-e26279f86242', 'body': {'reboot': {'type': 'HARD'}}} Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:34:53.956241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 409 to user: Cannot 'reboot' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:53.962427 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11f29166-7672-46ce-9b81-54df30967cfd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action" status: 409 len: 145 microversion: 2.1 time: 0.096033 Jul 18 02:34:53.969421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2000/4057] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:34:53 2022] POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action => generated 145 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:34:53.977542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:53.979545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:53.990496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.991730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:53.994945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:53.996251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.072976 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Cannot 'rebuild' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action HTTP/1.1 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 65 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'rebuild' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3db28d67-4e43-4c24-aaf9-e26279f86242', 'body': {'rebuild': {'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef'}}} Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:34:54.078371 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued Jul 18 02:34:54.085907 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:34:54.091196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 409 to user: Cannot 'rebuild' instance 3db28d67-4e43-4c24-aaf9-e26279f86242 while it is in vm_state rescued {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:34:54.098624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b3e7fb7c-4a4b-449d-a996-6aca3efa1dd1 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action" status: 409 len: 146 microversion: 2.1 time: 0.122512 Jul 18 02:34:54.101479 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2001/4058] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:34:53 2022] POST /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242/action => generated 146 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:34:54.125946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:54.127030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:54.128087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:54.148436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.148737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b1f7869-81f7-45cf-a1db-4fc87e047397 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.525549 Jul 18 02:34:54.150778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.153688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.154419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.159658 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2058/4059] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:53 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:54.201858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:34:54.235793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:54.236423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:54.248844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.249959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.252452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.254081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.273243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:54.417724 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d073e017-12ad-4867-9fab-d6a4b2a33fb7 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 204 len: 0 microversion: 2.1 time: 0.308816 Jul 18 02:34:54.420244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2002/4060] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:34:54 2022] DELETE /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:34:54.435269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:54.440052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:54.458696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:54.473209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:54.481249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:54.486741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3289ba19-b5ee-4316-aacc-0f8db3c0f65b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.255444 Jul 18 02:34:54.493629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2059/4061] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:54 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:54.499333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:54.502687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.503303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.507870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.508470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.508878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:54.535347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.536197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:54.538468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:54.543039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.065543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.086024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.088840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.091107 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f3ef3b8-f553-4ebd-8040-9a43ceb39e1b tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.595624 Jul 18 02:34:55.092832 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2060/4062] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:54 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:55.098936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-16e5a8b0-30a1-4006-aade-d0c4012d4faa req-e3a40264-d618-4003-b417-f5b162a124d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "452fbbf4-726a-466a-a5bd-e4980bde7526"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:55.115853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-16e5a8b0-30a1-4006-aade-d0c4012d4faa req-e3a40264-d618-4003-b417-f5b162a124d1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.117119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-16e5a8b0-30a1-4006-aade-d0c4012d4faa req-e3a40264-d618-4003-b417-f5b162a124d1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.157767 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-16e5a8b0-30a1-4006-aade-d0c4012d4faa req-e3a40264-d618-4003-b417-f5b162a124d1 service nova] Creating event network-vif-plugged:452fbbf4-726a-466a-a5bd-e4980bde7526 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:55.167954 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-16e5a8b0-30a1-4006-aade-d0c4012d4faa req-e3a40264-d618-4003-b417-f5b162a124d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073441 Jul 18 02:34:55.170297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2061/4063] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:55.177047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:55.179049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:55.189512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.190390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.193356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.194375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.299791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.316371 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb580672-d1c7-4c2b-8b10-8535ae7b2769 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1633 microversion: 2.1 time: 0.143792 Jul 18 02:34:55.329321 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2062/4064] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:55 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1633 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:55.340874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:55.344262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:55.375176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.375836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.376859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.377409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.760091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.772186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-44136761-95a3-4557-a831-1e59295d2fdf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.441219 Jul 18 02:34:55.773929 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2063/4065] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:55 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:55.790068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:55.791429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:55.816714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.821040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.822337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:55.824204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:55.893950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:55.912147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef22a485-8f56-4b66-9511-e1abfe16cf71 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1689 microversion: 2.1 time: 1.482841 Jul 18 02:34:55.913850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2003/4066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:54 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1689 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:56.112263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:56.112907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:56.127351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.127814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.135319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.138184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.155182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.170442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.174772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.176066 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3547994-cca0-47b6-a425-128818bcc1bf tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.400803 Jul 18 02:34:56.189202 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2064/4067] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:55 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:56.337270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:56.338369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:56.361129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.385113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.386577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.390502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.588611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.602165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.604509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.606262 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9871c94f-57a8-4526-aacf-a4a2c1fb442e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.498693 Jul 18 02:34:56.619765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2004/4068] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:56 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:34:56.633509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:56.644995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7da4c25c-58ee-48e3-b199-f27988dde53d tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1633 microversion: 2.1 time: 0.313614 Jul 18 02:34:56.646482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2065/4069] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:56 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1633 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:56.807361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:56.808694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:56.820795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.825090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.827043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.829177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.913779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-015c6169-04bf-4802-bab6-2608e62d6c4b req-71feb23a-c0dd-4a7c-a464-721ab257eb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db046266-0d2e-477b-be4d-312ce05dbb26", "name": "network-vif-deleted", "tag": "b8ef8346-9129-4486-9f88-76106866c0ed"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:56.933175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-015c6169-04bf-4802-bab6-2608e62d6c4b req-71feb23a-c0dd-4a7c-a464-721ab257eb95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:56.933830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-015c6169-04bf-4802-bab6-2608e62d6c4b req-71feb23a-c0dd-4a7c-a464-721ab257eb95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:56.959486 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-015c6169-04bf-4802-bab6-2608e62d6c4b req-71feb23a-c0dd-4a7c-a464-721ab257eb95 service nova] Creating event network-vif-deleted:b8ef8346-9129-4486-9f88-76106866c0ed for instance db046266-0d2e-477b-be4d-312ce05dbb26 on n-h1-849796-1 Jul 18 02:34:56.975627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-015c6169-04bf-4802-bab6-2608e62d6c4b req-71feb23a-c0dd-4a7c-a464-721ab257eb95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065693 Jul 18 02:34:56.977496 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2066/4070] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:34:56.989061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:56.992026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:57.009223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.012259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.013317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.018176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.211340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:57.231160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6bc8ced1-8cde-44e7-9014-216a3b02ccc4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.428217 Jul 18 02:34:57.234830 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2005/4071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:56 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:34:57.247667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:57.249752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:57.260441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.261678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.276849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.279012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.305531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:57.560853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:57.589456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:57.591826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:57.595537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c973e7a0-b354-4631-9522-bd4f2a321412 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.358039 Jul 18 02:34:57.596962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2006/4072] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:57 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:57.604841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "name": "network-vif-plugged", "status": "completed", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "533cb380-6f08-4fc3-a9b1-2c50cfb06fa8"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "e9ca6de3-664a-4714-950c-3622cc7b1828"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "f7d7e49d-7458-4074-b355-2b81c955082c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:57.620690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.621674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.649002 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Creating event network-vif-plugged:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:34:57.650487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Creating event network-vif-plugged:533cb380-6f08-4fc3-a9b1-2c50cfb06fa8 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:57.652346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Creating event network-vif-plugged:e9ca6de3-664a-4714-950c-3622cc7b1828 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:57.653433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] Creating event network-vif-plugged:f7d7e49d-7458-4074-b355-2b81c955082c for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:34:57.686515 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dc39d90b-6bae-456d-b7ea-ef5be41d667b req-b762b0a3-99cf-41e8-ae3d-9fbf87e5aeeb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.086668 Jul 18 02:34:57.687749 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2007/4073] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:34:57.698026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:57.699450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:57.737981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.742642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:57.746882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:57.748262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.129105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.147120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.152261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.153832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c1aea736-bcba-4a3d-a96b-21d7c9e9225a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.462934 Jul 18 02:34:58.157229 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2008/4074] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:57 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:58.169975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:58.172498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:58.206623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.206809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.207979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.212055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.300569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.303138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.304029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lazy-loading 'fault' on Instance uuid db046266-0d2e-477b-be4d-312ce05dbb26 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:34:58.463201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.488152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a6626b0-6a3f-4144-b1f6-ab74174508ab tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1689 microversion: 2.1 time: 1.508483 Jul 18 02:34:58.498821 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2067/4075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:56 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1689 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:58.538367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:58.547013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:58.569629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.591310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.602770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.604048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.664316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b2f13c4ffd4e3a8046c4c92b3ef37f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcb92c2c8b4454aa2218bf9ccae3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.676152 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29ae5fbd-abeb-4868-8521-5a6203841290 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 200 len: 1359 microversion: 2.1 time: 0.516338 Jul 18 02:34:58.678576 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2009/4076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:58 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 1359 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:58.686045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:58.687018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:58.704309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.710265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.711487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:58.713529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:58.919632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.936814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:58.953763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.961964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:58.971411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36dd6edd-8c47-4133-bc1f-9ba29ee6ed37 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.290824 Jul 18 02:34:58.983229 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2010/4077] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:58 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:59.105058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:59.192820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:59.193480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:59.214414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.215507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:59.215810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.216449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:59.313365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:59.334260 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94b0ea2c-b5ce-4fb2-9c3f-b8830de6fcf5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1316 microversion: 2.1 time: 0.822983 Jul 18 02:34:59.350454 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2068/4078] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:58 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1316 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:34:59.533830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:59.539118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:34:59.569845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.573917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:59.576296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:59.579231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:59.967103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:34:59.986807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d5cafb3-b9fd-4bba-9539-ae5efd0c404b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1689 microversion: 2.1 time: 0.460785 Jul 18 02:35:00.009007 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2069/4079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:59 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1689 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:00.029616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:00.031505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] [instance: db046266-0d2e-477b-be4d-312ce05dbb26] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:00.045082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.046354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.048273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.049473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.092053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] HTTP exception thrown: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Request method failure captured: Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 HTTP/1.1 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MY41_jp5DkyAXRA9zOD0_UovdYBfaq9-JMAcSo5pnY64AGl8hI2UKVPeCJ8SJ2LyW5-BiFvSvg932YxqSRhhZ2aLs-k43TgqLqPWEKF2HFsUINLepQESO4J-o8AwrRCydIBtZAgvW_RDjTYVkor8CXeTu7cvk1fPSSkkXPbmou_C7I Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7dcb92c2c8b4454aa2218bf9ccae3d95 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-170163627 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7dcb92c2c8b4454aa2218bf9ccae3d95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7dcb92c2c8b4454aa2218bf9ccae3d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7dcb92c2c8b4454aa2218bf9ccae3d95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7dcb92c2c8b4454aa2218bf9ccae3d95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-170163627 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7dcb92c2c8b4454aa2218bf9ccae3d95 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-170163627 Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-170163627-project Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 35b2f13c4ffd4e3a8046c4c92b3ef37f Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-170163627-project Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'db046266-0d2e-477b-be4d-312ce05dbb26'} Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:00.096119 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. Jul 18 02:35:00.111010 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:00.119233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Returning 404 to user: Instance db046266-0d2e-477b-be4d-312ce05dbb26 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:00.121518 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29a7a811-a63c-4d45-9ecf-0779f2aea760 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26" status: 404 len: 111 microversion: 2.1 time: 0.128297 Jul 18 02:35:00.123254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2070/4080] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:34:59 2022] GET /compute/v2.1/servers/db046266-0d2e-477b-be4d-312ce05dbb26 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:00.140275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.150450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-33f690ff-6adc-402f-9345-76cd8a81de87 req-f0691c51-216d-4554-ab97-3a25173f6485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-plugged", "status": "completed", "tag": "430974f5-0c03-40de-95f0-2ea6f0fa51ab"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:00.189935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33f690ff-6adc-402f-9345-76cd8a81de87 req-f0691c51-216d-4554-ab97-3a25173f6485 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.191850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-33f690ff-6adc-402f-9345-76cd8a81de87 req-f0691c51-216d-4554-ab97-3a25173f6485 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.194963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.206418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.213021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d21ab4a7-1f03-4b74-abf8-8d6de26e3a8c tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 1.025013 Jul 18 02:35:00.216228 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2011/4081] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:34:59 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:00.225705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:00.226726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:00.240376 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-33f690ff-6adc-402f-9345-76cd8a81de87 req-f0691c51-216d-4554-ab97-3a25173f6485 service nova] Creating event network-vif-plugged:430974f5-0c03-40de-95f0-2ea6f0fa51ab for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:35:00.243118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.244051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.250084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.250911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.254996 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-33f690ff-6adc-402f-9345-76cd8a81de87 req-f0691c51-216d-4554-ab97-3a25173f6485 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128927 Jul 18 02:35:00.261626 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2071/4082] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:00.292002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c86e42f5-a894-48ca-a99f-fe4fadc455a7 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] Calling method '.version_select at 0x7fab047401f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:00.371999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c86e42f5-a894-48ca-a99f-fe4fadc455a7 tempest-ServersTestJSON-170163627 tempest-ServersTestJSON-170163627-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976653803" status: 202 len: 0 microversion: 2.1 time: 0.107888 Jul 18 02:35:00.376199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2072/4083] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976653803 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:35:00.394285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:00.401809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:00.431375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.433866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.435759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:00.436851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:00.527190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.541975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.544064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:00.545669 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21af0c3e-22ed-4653-a013-5070089fa930 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.327441 Jul 18 02:35:00.546760 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2012/4084] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:00 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:01.021646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:01.023249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:01.044772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.051541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.054129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.054985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.149347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:01.167628 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa87bded-bf84-4810-bed8-add3c17e08aa tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.785230 Jul 18 02:35:01.169108 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2073/4085] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:01.247945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:01.248739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:01.262221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.262938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.265460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:01.266383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:01.749734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:01.766379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:01.769659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:01.772604 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83b0d678-7d79-4142-a27d-b827699aae56 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1870 microversion: 2.42 time: 0.528741 Jul 18 02:35:01.784124 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2074/4086] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:01 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1870 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:01.799754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1751134582", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:01.908483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] validate_networks() for [('bc3757aa-50bd-407f-9426-b53b0e6bdb8f', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:02.282343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:02.300454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-114178af-c8d3-4a0b-ade1-7eb2471042e8 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 200 len: 1689 microversion: 2.1 time: 1.283162 Jul 18 02:35:02.304768 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2013/4087] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:01 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 1689 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:02.317330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:02.319532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:02.359287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:02.363451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:02.368539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:02.369775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:02.961412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:02.984720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:02.998369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:03.004958 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2510cd2e-60da-4427-be2f-6522c453cfc3 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.697864 Jul 18 02:35:03.025272 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2014/4088] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:02 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:03.285508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:03.286254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:03.287483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:03.288533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:03.288992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:03.301017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:03.301475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:03.302853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:03.303626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:03.330238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Getting quotas for project 607decefd93648458479c655fcc651bc. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:03.338811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Getting quotas for user 368018b1936a4ec99e16412a5139b575 and project 607decefd93648458479c655fcc651bc. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:03.373186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:03.377582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:03.433752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0c899b0-46d4-4e26-8bdb-6d90929dc62f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Action: 'create', calling method: .version_select at 0x7fab04415b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1042466642", "metadata": {"Type": "work"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:03.466963 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01af2e0b-656a-4d79-9c43-af66d127776c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678756 Jul 18 02:35:03.469226 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2075/4089] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:35:03.477405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:03.478850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:03.495122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:03.495978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:03.497249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:03.498855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.581108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:04.619822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:04.625939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:04.628305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0741e25a-7379-40d4-a0da-5a24adf2e55a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2826 microversion: 2.42 time: 1.157314 Jul 18 02:35:04.650578 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2076/4090] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:03 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2826 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:04.674597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:04.676607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 9bd37eff-f3dd-4623-9c73-d351db4348c2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:04.698577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.700036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.702675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.707288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.718311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0c899b0-46d4-4e26-8bdb-6d90929dc62f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.690872 Jul 18 02:35:04.719445 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2015/4091] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Jul 18 02:35:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1694 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 02:35:04.741710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26405fb1-1c0a-4df5-b37e-946c35c6c498 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:04.751311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 HTTP/1.1 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9bd37eff-f3dd-4623-9c73-d351db4348c2'} Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:04.757381 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. Jul 18 02:35:04.774807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:04.778364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26405fb1-1c0a-4df5-b37e-946c35c6c498 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:04.779927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 404 to user: Instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:04.783124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-395f0c36-293a-499d-b348-adc210a19753 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2" status: 404 len: 111 microversion: 2.1 time: 0.128185 Jul 18 02:35:04.792627 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2077/4092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:04 2022] GET /compute/v2.1/servers/9bd37eff-f3dd-4623-9c73-d351db4348c2 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:04.812295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b535aee9-f9f5-449a-8ad2-138c47d926a4 req-44304687-f469-458a-9fd3-06ef592ed077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd37eff-f3dd-4623-9c73-d351db4348c2", "name": "network-vif-deleted", "tag": "87ee7eca-bd5f-4bb1-9144-c5fce1805345"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:04.831883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b535aee9-f9f5-449a-8ad2-138c47d926a4 req-44304687-f469-458a-9fd3-06ef592ed077 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.834917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b535aee9-f9f5-449a-8ad2-138c47d926a4 req-44304687-f469-458a-9fd3-06ef592ed077 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.866162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b535aee9-f9f5-449a-8ad2-138c47d926a4 req-44304687-f469-458a-9fd3-06ef592ed077 service nova] Creating event network-vif-deleted:87ee7eca-bd5f-4bb1-9144-c5fce1805345 for instance 9bd37eff-f3dd-4623-9c73-d351db4348c2 on n-h1-849796-1 Jul 18 02:35:04.893024 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b535aee9-f9f5-449a-8ad2-138c47d926a4 req-44304687-f469-458a-9fd3-06ef592ed077 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080586 Jul 18 02:35:04.896315 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2078/4093] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:04.923736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:04.926356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:04.971338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.975871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:04.983077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:04.984084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:05.169499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26405fb1-1c0a-4df5-b37e-946c35c6c498 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:05.183051 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26405fb1-1c0a-4df5-b37e-946c35c6c498 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1217 microversion: 2.1 time: 0.461916 Jul 18 02:35:05.183665 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2016/4094] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:04 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1217 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:05.194038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:05.194553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:05.217992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:05.218467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:05.219317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:05.219772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:05.290889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:05.330957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:05.343573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:05.347888 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08a2e381-fb92-4e55-a420-3410087071a4 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.448483 Jul 18 02:35:05.369217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2079/4095] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:04 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:05.370233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75aeae50-e6a9-42a2-a298-32c7d3ca24b1 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04740dc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:05.500442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75aeae50-e6a9-42a2-a298-32c7d3ca24b1 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.146636 Jul 18 02:35:05.501173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2080/4096] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:05 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:05.508122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09ea2544-39b5-4052-885c-66be4e80d0b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '.version_select at 0x7fab047825e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:05.562584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09ea2544-39b5-4052-885c-66be4e80d0b5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258267705" status: 202 len: 0 microversion: 2.1 time: 0.060251 Jul 18 02:35:05.565761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2081/4097] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258267705 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:35:05.764522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-579d999f-65c1-4298-87bd-b2fa384b9f46 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.575433 Jul 18 02:35:05.765368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2017/4098] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:35:05 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980/os-interface => generated 1830 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:06.219439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:06.220244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:06.245421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.245970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.246811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.247277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.383691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:06.393556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:06.396525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:06.410882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4948cf6b-46f0-4715-9bc9-c51706b3e5cc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1287 microversion: 2.1 time: 0.196295 Jul 18 02:35:06.414881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2082/4099] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:06 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1287 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:06.419146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.426392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.428785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:06.429837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:06.545987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73d4b099-1ff5-4288-9488-baafd3e488f9 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04765a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:06.735928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73d4b099-1ff5-4288-9488-baafd3e488f9 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.219580 Jul 18 02:35:06.736888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2083/4100] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:06 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:07.155397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:07.186137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:07.190443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:07.195011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d89bb1cd-8bd8-488b-a6c9-760a57abb885 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.815489 Jul 18 02:35:07.198119 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2018/4101] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:06 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:07.444132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:07.444132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:07.467197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:07.468311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:07.471680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:07.473296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:07.622430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:07.758597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61ffe33d-8f51-4679-9b19-e1a403e72bbb tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab043e8280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:07.811067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:07.864043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2dd701ff-6108-47fb-9a00-fec8f8167376 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1275 microversion: 2.1 time: 0.423540 Jul 18 02:35:07.867218 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2084/4102] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:07 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1275 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:07.910178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61ffe33d-8f51-4679-9b19-e1a403e72bbb tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 354 microversion: 2.1 time: 0.160779 Jul 18 02:35:07.910820 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2019/4103] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:07 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:07.924308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0b7e6df-f7d8-4b37-a90d-f28bf7c1a813 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04782a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.052606 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0b7e6df-f7d8-4b37-a90d-f28bf7c1a813 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 354 microversion: 2.1 time: 0.132385 Jul 18 02:35:08.053478 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2085/4104] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:07 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:08.071617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88ae272c-0a0e-4d95-86f1-878a760c47dc tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04937a60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.203483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88ae272c-0a0e-4d95-86f1-878a760c47dc tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 202 len: 0 microversion: 2.1 time: 0.137712 Jul 18 02:35:08.205080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2020/4105] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:35:08 2022] DELETE /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:35:08.215391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df79e206-fab9-430b-b791-7cfaa23b19e5 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04761790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.229771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.230944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:08.318365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:08.323654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:08.324461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:08.341753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:08.342603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:08.391745 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df79e206-fab9-430b-b791-7cfaa23b19e5 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.180491 Jul 18 02:35:08.393506 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2086/4106] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:08.884863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.885916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:08.902399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:08.905671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:08.907874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:08.908912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:09.185930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:09.219014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:09.230183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:09.232507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40a32ce4-13ac-42d1-bade-4f6a05a3d6de tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 1.012142 Jul 18 02:35:09.239134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2021/4107] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:09.264246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:09.293799 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6ff5e992-2157-4eb6-b0eb-11717fea0816 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1275 microversion: 2.1 time: 0.413401 Jul 18 02:35:09.304393 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2087/4108] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1275 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:09.415161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-afffae55-be5e-4ab5-9289-217becb3e3da tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab045bb8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.548072 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-afffae55-be5e-4ab5-9289-217becb3e3da tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.143370 Jul 18 02:35:09.557818 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2022/4109] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:10.260115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:10.261069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:10.300220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.302366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:10.308392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.312308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:10.324456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:10.332385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:10.368240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.371248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:10.373211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:10.374441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:10.757986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:10.797704 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0d81d80-7f97-46a9-a582-98f612f056b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1275 microversion: 2.1 time: 0.481017 Jul 18 02:35:10.799198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2023/4110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:10 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1275 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:11.029065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2088691231", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "96923dd4-fe55-4383-99e2-cdefe552d157"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:11.232682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:11.235224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] validate_networks() for [('96923dd4-fe55-4383-99e2-cdefe552d157', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:11.299529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:11.314875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:11.318745 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a6b3192-9133-4256-8d8c-dc98d6a01098 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 1.064201 Jul 18 02:35:11.333916 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2088/4111] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:10 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:11.342909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b343a49d-7c42-4c4f-a78a-80529830c686 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab04782040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:11.571537 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b343a49d-7c42-4c4f-a78a-80529830c686 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.250554 Jul 18 02:35:11.572227 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2089/4112] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:11 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:11.828607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:11.831144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:11.855274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:11.858760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:11.862499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:11.865675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:12.100377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:12.117419 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae32d710-1f3e-4327-b2e0-005b9bebe11d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1275 microversion: 2.1 time: 0.302189 Jul 18 02:35:12.128569 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2090/4113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:11 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1275 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:12.354370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:12.355431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:12.410638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:12.432769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:12.434668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:12.435476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:12.759433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:12.790965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:12.794099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:12.796391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-607b3156-bb0a-4790-bec3-0d60fdda5ae1 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.451599 Jul 18 02:35:12.830537 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2091/4114] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:12 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:12.840263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50f43e9f-fa33-48c4-9492-3e9274277279 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab047d2a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:12.956290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50f43e9f-fa33-48c4-9492-3e9274277279 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.123627 Jul 18 02:35:12.958469 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2092/4115] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:12 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:13.140596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:13.146163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:13.197552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:13.198891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:13.201938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:13.213470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:13.318858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:13.356233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:13.369519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:13.378507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9e694d2-7b9e-4adb-90c9-b4c17248fb85 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1275 microversion: 2.1 time: 0.245652 Jul 18 02:35:13.379119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2093/4116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:13 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:13.835485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:13.836126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:13.855316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:13.855925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:13.856810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:13.861272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:14.047048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:14.066110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:14.072518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:14.074339 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1659fb08-8c2b-484a-a072-2568134d3dda tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.243666 Jul 18 02:35:14.087264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2094/4117] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:13 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:14.093233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9bc16280-a980-492e-9633-c6996c23e210 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab0486a700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:14.240464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9bc16280-a980-492e-9633-c6996c23e210 tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 200 len: 353 microversion: 2.1 time: 0.150717 Jul 18 02:35:14.241539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2095/4118] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:14 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:14.408898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:14.413253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:14.429824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:14.460564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:14.464898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:14.468807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.071183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:15.100453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04a0d56c-c9b7-4930-935b-e6407f4a16ce tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 0.706980 Jul 18 02:35:15.103316 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2096/4119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:14 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:15.134036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:15.139093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:15.146982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:15.169474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:15.170250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.171315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:15.173618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.175407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:15.372327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:15.385466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:15.391186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:15.394759 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7daee155-00b4-4035-91a9-a271fe3b6ed0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.287114 Jul 18 02:35:15.396844 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2097/4120] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:15 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:15.413778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26d5e1fa-e745-44cc-9ed8-eee358ab113f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Calling method '.version_select at 0x7fab048b6280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:15.526248 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-26d5e1fa-e745-44cc-9ed8-eee358ab113f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] HTTP exception thrown: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26d5e1fa-e745-44cc-9ed8-eee358ab113f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Request method failure captured: Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 HTTP/1.1 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MbV3zlwkKx_y1YC0mxPBmU8UZoJM7NRDADWDD4WKa0jjHVPi_IW-PBXcabqC2AZnlTEOC2wj7Wlf4iN-n7__Fb3iWTkj_44ydtF_bz0Ow5b9UR0qYcAZ6WULk18NqObZpXNKqFOt8Sp0M3Hi3JkhW0fOIqOFgipxPUKDgXJsCeSXkg Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: ed7db93be226423fb2099fe2314b5ed0 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesGetTestJSON-1823900101 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ed7db93be226423fb2099fe2314b5ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ed7db93be226423fb2099fe2314b5ed0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ed7db93be226423fb2099fe2314b5ed0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ed7db93be226423fb2099fe2314b5ed0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesGetTestJSON-1823900101 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: ed7db93be226423fb2099fe2314b5ed0 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesGetTestJSON-1823900101 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesGetTestJSON-1823900101-project Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ec5d4476da4449a1ad7df40c35188489 Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesGetTestJSON-1823900101-project Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'fdb99b9d-1268-4437-9c71-5064d672f221'} Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. (HTTP 404) (Request-ID: req-275c15aa-af5d-4baf-ac3b-6f51d99ef42d) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:15.533859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. Jul 18 02:35:15.543689 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:15.556349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26d5e1fa-e745-44cc-9ed8-eee358ab113f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] Returning 404 to user: Volume fdb99b9d-1268-4437-9c71-5064d672f221 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:15.559479 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26d5e1fa-e745-44cc-9ed8-eee358ab113f tempest-VolumesGetTestJSON-1823900101 tempest-VolumesGetTestJSON-1823900101-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221" status: 404 len: 109 microversion: 2.1 time: 0.153608 Jul 18 02:35:15.562622 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2098/4121] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:15 2022] GET /compute/v2.1/os-volumes/fdb99b9d-1268-4437-9c71-5064d672f221 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:16.132980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:16.139779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:16.188652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:16.194403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:16.204635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:16.213635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:16.695341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:16.710108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdf6374d-6a3d-4b02-9cb4-2f616b65e0d6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 0.593161 Jul 18 02:35:16.714159 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2099/4122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:16 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:16.732373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:16.733655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:16.752385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:16.753455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:16.754557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:16.756588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:16.981087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:17.009194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:17.016160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:17.021914 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f860aafd-78a7-47c3-870a-d8f2958d4561 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.305014 Jul 18 02:35:17.062928 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2100/4123] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:16 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:17.071164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1c90a3f1-7a6f-478c-8ce4-936b4bd1e564 req-c30e118a-89fc-49c2-a5b7-1da65490eca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "tag": "f7d7e49d-7458-4074-b355-2b81c955082c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:17.102320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1c90a3f1-7a6f-478c-8ce4-936b4bd1e564 req-c30e118a-89fc-49c2-a5b7-1da65490eca4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.103286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1c90a3f1-7a6f-478c-8ce4-936b4bd1e564 req-c30e118a-89fc-49c2-a5b7-1da65490eca4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.132380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:17.133275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:17.133275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:17.133647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:17.134119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:17.159264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.161154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.164983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.165811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.196399 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1c90a3f1-7a6f-478c-8ce4-936b4bd1e564 req-c30e118a-89fc-49c2-a5b7-1da65490eca4 service nova] Creating event network-changed:f7d7e49d-7458-4074-b355-2b81c955082c for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:35:17.219861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Getting quotas for project 43bd08714ba44756824cce3a19c7ffa9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:17.230710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1c90a3f1-7a6f-478c-8ce4-936b4bd1e564 req-c30e118a-89fc-49c2-a5b7-1da65490eca4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163740 Jul 18 02:35:17.235712 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2101/4124] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:17.237398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Getting quotas for user f9e9a96aca244212b403d989adea9029 and project 43bd08714ba44756824cce3a19c7ffa9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:17.274681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Going to run 2 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:17.284151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 75766d7b-60aa-469f-9461-5603cb542e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:17.355372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=75766d7b-60aa-469f-9461-5603cb542e27,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:17.485396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-569a8474-20c4-4ddc-91c7-fb83f61dbb74 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.673050 Jul 18 02:35:17.499933 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2024/4125] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 6686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:35:17.519047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:17.542776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:17.547597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Searching by: {'deleted': False, 'project_id': '43bd08714ba44756824cce3a19c7ffa9'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:35:17.615225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.616028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.618452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.619297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.656227 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d8c14225-4f4a-480d-9911-509d470d428d tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.157314 Jul 18 02:35:17.657674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2102/4126] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:35:17 2022] GET /compute/v2.1/servers => generated 677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:17.669009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88f37177-d9ac-4e98-9a24-d7f466055a35 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:17.670059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88f37177-d9ac-4e98-9a24-d7f466055a35 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:17.750885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:17.752312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:17.766228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.772915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:17.778442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:17.779211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:18.658566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:18.701252 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-130b3f44-82ab-4058-bf58-15818df37a87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 0.958278 Jul 18 02:35:18.703492 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2103/4127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:17 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:18.728205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:18.733963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:18.749175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:18.750130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:18.753450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:18.757900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:19.065737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:19.096538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:19.105382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:19.109337 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86195abe-2591-4ca6-9a5c-0cbbe49ce198 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.398676 Jul 18 02:35:19.131629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2104/4128] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:18 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:19.561847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88f37177-d9ac-4e98-9a24-d7f466055a35 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:19.603222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88f37177-d9ac-4e98-9a24-d7f466055a35 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1220 microversion: 2.1 time: 1.938266 Jul 18 02:35:19.625674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2025/4129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:17 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1220 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:19.742193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:19.745585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:19.780197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:19.788975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:19.793392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:19.796156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.186983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:20.194940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:20.238147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.242460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.244424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.249582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.478817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:20.512256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:20.520368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:20.529237 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2bb92d63-ad72-42ba-9182-743162a1d878 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1366 microversion: 2.47 time: 0.377018 Jul 18 02:35:20.532702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2026/4130] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:20 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:20.657368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:20.665304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:20.691869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.692305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.697506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.699993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.987817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.031276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8bbaa42d-54dc-4fe5-9499-9cc4d80489bf tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1216 microversion: 2.1 time: 0.394782 Jul 18 02:35:21.035426 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2027/4131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:20 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1216 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:21.089491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6072bd5f-eb09-4f34-8520-c050e8400129 req-d418ca01-1d77-487e-aff4-7eff8a6bfd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10674860-cbe9-4c9b-930d-3d2d4f3ecaed", "tag": "73b1b020-4e43-4ad4-a3c5-b1f816531607"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:21.134909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6072bd5f-eb09-4f34-8520-c050e8400129 req-d418ca01-1d77-487e-aff4-7eff8a6bfd66 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:21.140552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6072bd5f-eb09-4f34-8520-c050e8400129 req-d418ca01-1d77-487e-aff4-7eff8a6bfd66 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.235435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6072bd5f-eb09-4f34-8520-c050e8400129 req-d418ca01-1d77-487e-aff4-7eff8a6bfd66 service nova] Creating event network-changed:73b1b020-4e43-4ad4-a3c5-b1f816531607 for instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed on n-h1-849796-1 Jul 18 02:35:21.263174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6072bd5f-eb09-4f34-8520-c050e8400129 req-d418ca01-1d77-487e-aff4-7eff8a6bfd66 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194288 Jul 18 02:35:21.264400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2028/4132] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:21.578278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.580879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:21.605551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:21.609780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.611996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:21.615356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.664880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.688623 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f00bc93-72f8-4d77-b561-9d7b8c2234fb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 1.955364 Jul 18 02:35:21.691049 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2105/4133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:19 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:21.844238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.870978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.875763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.878073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4739d0d0-36e9-43fa-98da-041e1b3bac6f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1372 microversion: 2.47 time: 0.314852 Jul 18 02:35:21.897012 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2029/4134] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:21 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:22.057251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.060255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:22.097349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.101308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.102533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.103322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.421651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:22.442838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89371d4b-399c-42b6-abc1-e24d2ffb1333 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1278 microversion: 2.1 time: 0.393507 Jul 18 02:35:22.461840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2106/4135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1278 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:22.742436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.749325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:22.795102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.796204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.797807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.811313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.928259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.933250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:22.967533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.968324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.969834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.970630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.255959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.277043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.281159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.282864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ade7cdd-a184-4c5d-a35c-9b7fdf1b7b95 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1372 microversion: 2.47 time: 0.373847 Jul 18 02:35:23.316911 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2107/4136] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1372 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:23.385520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.393995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:23.400288 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a55c16b-200e-46c3-a85b-e10f9d3a93bf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 0.689629 Jul 18 02:35:23.414486 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2030/4137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:23.493733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.494589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:23.508695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.509468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.510533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.511191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.539015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:23.617457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.618358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:23.633363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.634400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.635810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.636573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.715747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.722716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:23.726642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cfca8c0c-8255-41da-8a57-3fa47923319b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1278 microversion: 2.1 time: 0.254763 Jul 18 02:35:23.727396 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2108/4138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:23 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:23.922957 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12451922-c3df-482c-86a1-d1696b6a6204 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 204 len: 0 microversion: 2.1 time: 0.313536 Jul 18 02:35:23.926241 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2031/4139] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:35:23 2022] DELETE /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:35:23.935861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.936479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:23.953808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.954275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.955106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.955552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.326548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:24.327874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:24.352079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.352944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.354451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.355244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.811496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:24.833364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ebfd0aa3-bab7-4c2a-bdc6-45f87660fd07 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1507 microversion: 2.1 time: 0.901277 Jul 18 02:35:24.838416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2109/4140] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:23 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1507 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:24.855761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:24.878375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:24.882967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:24.902987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:24.904302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.905603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.907473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:24.908612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:24.931182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:24.933715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e79f8cce-dd4b-4d80-85c5-dd6c039c1988 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1372 microversion: 2.47 time: 0.615088 Jul 18 02:35:24.971571 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2032/4141] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:24 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1372 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:25.002713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:25.003916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:25.050736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.052300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.060349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.061171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.774354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:25.795712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bbf0013-d052-4573-9e70-f1829122e3f7 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1278 microversion: 2.1 time: 0.821478 Jul 18 02:35:25.796441 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2033/4142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:24 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1278 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:25.865296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:25.866754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:25.884518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.886199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.888970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.890764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.758715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.769224 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5a6d26a-af9a-4601-a872-a7f40667d583 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 1.929498 Jul 18 02:35:26.769841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2110/4143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:24 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:26.786913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.787563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.806830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.822856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-faf3cb94-4372-4608-b6c2-dcfdbf6ad45b tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1507 microversion: 2.1 time: 0.960724 Jul 18 02:35:26.823750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2034/4144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:25 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1507 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:26.842263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.842682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.843503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.843961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.850214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.850841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.863450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.864534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.865422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.866342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.190103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:27.243702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.256647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.258614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.264433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa3c9edd-bdd7-422f-8829-46d49b1da01d tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1372 microversion: 2.47 time: 0.482232 Jul 18 02:35:27.271528 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2111/4145] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:26 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:27.354981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.378787 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f03d1321-ae92-4f42-9438-927977932059 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1278 microversion: 2.1 time: 0.549855 Jul 18 02:35:27.380647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2035/4146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:26 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1278 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:27.793599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.794783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.805357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:27.830983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.832157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.839818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.841068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.849115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.849747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.856600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.857179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.857921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.858378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.193906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.209549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b474403-e457-468d-8070-fa4d4597dd3a tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1465 microversion: 2.1 time: 0.364355 Jul 18 02:35:28.211750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2036/4147] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1465 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:28.304611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.305274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.325220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.326348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.329291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.330485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.483885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.514438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.521295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.524643 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ebd0377-a8d3-4d71-a4eb-11e665718515 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1357 microversion: 2.47 time: 0.224536 Jul 18 02:35:28.534973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2037/4148] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:28.549104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.550279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.566003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.566463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.572371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.575760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.891362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.908298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38ea3502-0d1e-4f19-bb61-d9f913017a76 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1278 microversion: 2.1 time: 0.371418 Jul 18 02:35:28.925045 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2038/4149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1278 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:28.927491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.938045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.941154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Searching by: {'deleted': False, 'project_id': 'd98c5d5c89284e588aadf894bde47962'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:35:28.967137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.970520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.972211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.976452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.071867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.087557 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2aedf5bc-074e-4f89-88af-e9af01b07ac2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 1.297510 Jul 18 02:35:29.089779 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2112/4150] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:29.105006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-102280be-627a-4217-87db-fe6f4bce863d req-2fc50368-798a-40a3-92c4-12e1cd0ccad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db28d67-4e43-4c24-aaf9-e26279f86242", "name": "network-vif-deleted", "tag": "f0295ae4-0d75-4cb3-875f-7ba4bf9afd49"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:29.132332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-102280be-627a-4217-87db-fe6f4bce863d req-2fc50368-798a-40a3-92c4-12e1cd0ccad7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.134897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-102280be-627a-4217-87db-fe6f4bce863d req-2fc50368-798a-40a3-92c4-12e1cd0ccad7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.161009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-102280be-627a-4217-87db-fe6f4bce863d req-2fc50368-798a-40a3-92c4-12e1cd0ccad7 service nova] Creating event network-vif-deleted:f0295ae4-0d75-4cb3-875f-7ba4bf9afd49 for instance 3db28d67-4e43-4c24-aaf9-e26279f86242 on n-h2-849796-1 Jul 18 02:35:29.179272 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-102280be-627a-4217-87db-fe6f4bce863d req-2fc50368-798a-40a3-92c4-12e1cd0ccad7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087807 Jul 18 02:35:29.180164 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2113/4151] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:29.237493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.241251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.273693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.275672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.278502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.279122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.338488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:35:29.391591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.392747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.393977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lazy-loading 'fault' on Instance uuid 3db28d67-4e43-4c24-aaf9-e26279f86242 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:29.575445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.592452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.593588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.624846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.628711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.728974 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c69a5f75-b71a-4e1f-a50e-3c7c59c50b22 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.815231 Jul 18 02:35:29.730119 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2039/4152] 10.222.0.67 () {60 vars in 1186 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:29.763541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-032f1084-1d69-408d-a8b9-922429623d76 req-b62b3bfb-237c-431e-91af-b46773e2f976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10674860-cbe9-4c9b-930d-3d2d4f3ecaed", "name": "network-vif-plugged", "status": "completed", "tag": "73b1b020-4e43-4ad4-a3c5-b1f816531607"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:29.788786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-032f1084-1d69-408d-a8b9-922429623d76 req-b62b3bfb-237c-431e-91af-b46773e2f976 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.790114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-032f1084-1d69-408d-a8b9-922429623d76 req-b62b3bfb-237c-431e-91af-b46773e2f976 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.796395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.819230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-032f1084-1d69-408d-a8b9-922429623d76 req-b62b3bfb-237c-431e-91af-b46773e2f976 service nova] Creating event network-vif-plugged:73b1b020-4e43-4ad4-a3c5-b1f816531607 for instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed on n-h1-849796-1 Jul 18 02:35:29.826809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0f9d4e06-a3c6-4cc5-a37d-bc893b082aa6 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 200 len: 1311 microversion: 2.1 time: 0.593908 Jul 18 02:35:29.828538 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2114/4153] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 1311 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:29.850447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.853609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.855922 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-032f1084-1d69-408d-a8b9-922429623d76 req-b62b3bfb-237c-431e-91af-b46773e2f976 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108984 Jul 18 02:35:29.856850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2040/4154] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:29.881687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.882589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.888460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.889368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.946370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.947362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.969846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:29.994344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.007053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.008040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.008511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.285433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a3d3209-1bc3-43ac-a78a-558ae7eb058e tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "DELETE /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 204 len: 0 microversion: 2.47 time: 0.454686 Jul 18 02:35:30.286872 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2115/4155] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:35:29 2022] DELETE /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:35:30.296218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.297166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.314860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.315698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.316742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.317989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.747288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.777045 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66212f1f-1e05-463b-8602-f17dfd49b2bb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.839791 Jul 18 02:35:30.782261 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2041/4156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:30.795467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.800468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.819890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.821991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.823560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.824372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.943490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.955890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.958001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.960579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29bad3eb-6f01-4d64-89c3-1c461f2925a8 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1363 microversion: 2.47 time: 0.177044 Jul 18 02:35:30.991242 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2042/4157] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:31.002911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.005721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: 3db28d67-4e43-4c24-aaf9-e26279f86242] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.006298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.019967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ac2c53b-8c95-4e48-8106-ef39961c40a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1317 microversion: 2.1 time: 0.731527 Jul 18 02:35:31.021299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2116/4158] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:31.022838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.023310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.024229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.024641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.057144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 HTTP/1.1 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3db28d67-4e43-4c24-aaf9-e26279f86242'} Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:31.068996 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 404 to user: Instance 3db28d67-4e43-4c24-aaf9-e26279f86242 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2792657f-1aa5-4ab5-b49d-796d60e29d4e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242" status: 404 len: 111 microversion: 2.1 time: 0.079552 Jul 18 02:35:31.078381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2043/4159] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/3db28d67-4e43-4c24-aaf9-e26279f86242 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:31.084139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.084139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.094418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.096207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.097257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.099602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.171780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:31.242224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dabb1ae9-1ccb-4714-b7b3-feffa9aab741 req-22128d75-eb3a-43bc-9f7a-76c80510bfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75766d7b-60aa-469f-9461-5603cb542e27", "tag": "65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:31.292723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dabb1ae9-1ccb-4714-b7b3-feffa9aab741 req-22128d75-eb3a-43bc-9f7a-76c80510bfac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.293861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dabb1ae9-1ccb-4714-b7b3-feffa9aab741 req-22128d75-eb3a-43bc-9f7a-76c80510bfac service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.321443 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dabb1ae9-1ccb-4714-b7b3-feffa9aab741 req-22128d75-eb3a-43bc-9f7a-76c80510bfac service nova] Creating event network-changed:65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e for instance 75766d7b-60aa-469f-9461-5603cb542e27 on n-h1-849796-1 Jul 18 02:35:31.333050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dabb1ae9-1ccb-4714-b7b3-feffa9aab741 req-22128d75-eb3a-43bc-9f7a-76c80510bfac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100599 Jul 18 02:35:31.335504 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2044/4160] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:31.436859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea89e345-53a7-4250-80ad-1443cb1c7d06 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 204 len: 0 microversion: 2.1 time: 0.358740 Jul 18 02:35:31.441005 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2117/4161] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:35:31 2022] DELETE /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:35:31.453945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.456382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.466702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.467280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.468202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.469049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.803243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.807172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.853673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.855049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.859661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.860742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.864816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.873423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-925ca638-20b5-4b42-af22-948930564ddd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.425611 Jul 18 02:35:31.877781 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2045/4162] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:31.995877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.997386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.032181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.036849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.039863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.042007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.234689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.246520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.248423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.250148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ccddc125-62df-4768-9fdc-6919a36c9b84 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1363 microversion: 2.47 time: 0.272565 Jul 18 02:35:32.251454 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2046/4163] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:32.257402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.258383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.266578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.267442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.268506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.269324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.278771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:32.577147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.599749 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd993650-85a9-4539-a3d6-d119ccfb58b0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1506 microversion: 2.1 time: 0.345427 Jul 18 02:35:32.602874 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2047/4164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:32.633070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.634676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.649683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.651296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.653471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.654451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.750924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:32.947241 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9bfa8a2c-24f8-4418-8ff3-cbee0450abb8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 204 len: 0 microversion: 2.1 time: 0.312001 Jul 18 02:35:32.953844 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2048/4165] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:35:32 2022] DELETE /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:35:32.964660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.966008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.977027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.977827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.979101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.979859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.283015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.315573 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-399a1d2c-e552-4242-af54-7a540373783d tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.359614 Jul 18 02:35:33.318071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2049/4166] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:33.336607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:33.338551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:33.347728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.348827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.350167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.350629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.659324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.669241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.671533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62eb2cec-c005-4de7-838a-a6641d1fe4fe tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 1.875435 Jul 18 02:35:33.674617 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2118/4167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:33.681896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a015828-2230-4b6c-bc31-8710591ca8a7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1512 microversion: 2.1 time: 0.361898 Jul 18 02:35:33.685161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:33.686629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:33.691245 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2050/4168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:33 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:33.705724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.709122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.710598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.711073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.806015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.807359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.808605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lazy-loading 'fault' on Instance uuid 56538387-392a-446f-a479-a05257560766 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:34.099803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.124505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.129325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.133473 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a59b855-a647-4876-bb01-817653987f6b tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 200 len: 1368 microversion: 2.47 time: 0.456225 Jul 18 02:35:34.146229 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2119/4169] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:33 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 1368 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:34.352858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.354623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.374526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.375589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.377895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.380796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.701917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.705344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.719205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.720539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.722437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.723979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.784449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.797770 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-042533a5-1364-4cba-8e98-05dad057360e tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 0.456979 Jul 18 02:35:34.801512 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2051/4170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:34.814226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.816275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.832088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.833295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.835625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.836066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.340388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:35.377552 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-faa95982-2de5-4b22-9b83-da3d8f641e31 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.572477 Jul 18 02:35:35.389134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2052/4171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:35.398493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.399884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 56538387-392a-446f-a479-a05257560766] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.421031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.422582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.429895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.430842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.490172 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] HTTP exception thrown: Instance 56538387-392a-446f-a479-a05257560766 could not be found. Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Request method failure captured: Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 HTTP/1.1 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ma5TTEuQQXuJFPsxzs_vUlnw1ERJZXyT7v1xSVGy0vsvi0S9xWIlSOCvAqGYRgkjAm9znLuIrWdeuel2wBGkosL7bF1h7Db5i4GgbRi1MrhialiCL843apR2n3ovN0aDQ8NbUa5ZEVt_LPoyDg-l7nmm9aYGSZF_b5G9MNcl8Kux_Y Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d98c5d5c89284e588aadf894bde47962 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerShowV247Test-812519461 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d98c5d5c89284e588aadf894bde47962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerShowV247Test-812519461 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d98c5d5c89284e588aadf894bde47962 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerShowV247Test-812519461 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerShowV247Test-812519461-project Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 943ae647ab584dff8904134b179ebce3 Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerShowV247Test-812519461-project Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 56538387-392a-446f-a479-a05257560766 could not be found. Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '56538387-392a-446f-a479-a05257560766'} Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56538387-392a-446f-a479-a05257560766 could not be found. Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56538387-392a-446f-a479-a05257560766 could not be found. Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:35.492389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56538387-392a-446f-a479-a05257560766 could not be found. Jul 18 02:35:35.496107 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:35.508108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:35.508825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Returning 404 to user: Instance 56538387-392a-446f-a479-a05257560766 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:35.511736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4aeb9695-bc14-4fd1-a890-67c991b9f96c tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766" status: 404 len: 111 microversion: 2.47 time: 0.119660 Jul 18 02:35:35.515268 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2053/4172] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:35 2022] GET /compute/v2.1/servers/56538387-392a-446f-a479-a05257560766 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:35.535390 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94cbfed9-3632-40fd-bbcc-8e518f024786 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1512 microversion: 2.1 time: 0.839033 Jul 18 02:35:35.539077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-46583380-dade-434b-b0a6-1c85197ad772 req-c14e0065-524f-44e8-91b6-926111be0a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c3facc-43ba-4180-bbdf-513444dad69e", "tag": "9d7ea5ae-b73a-442e-8d7c-cec8b385ee58"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:35.545492 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2120/4173] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1512 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:35.575332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.576668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.592001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-46583380-dade-434b-b0a6-1c85197ad772 req-c14e0065-524f-44e8-91b6-926111be0a47 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.592873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-46583380-dade-434b-b0a6-1c85197ad772 req-c14e0065-524f-44e8-91b6-926111be0a47 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.606718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.609653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.620395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.621840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.665759 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-46583380-dade-434b-b0a6-1c85197ad772 req-c14e0065-524f-44e8-91b6-926111be0a47 service nova] Creating event network-changed:9d7ea5ae-b73a-442e-8d7c-cec8b385ee58 for instance 86c3facc-43ba-4180-bbdf-513444dad69e on n-h2-849796-1 Jul 18 02:35:35.693324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-46583380-dade-434b-b0a6-1c85197ad772 req-c14e0065-524f-44e8-91b6-926111be0a47 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172672 Jul 18 02:35:35.698689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2054/4174] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:35.717739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:35.728033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:35.823288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.833601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.859368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:35.865930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.870795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.874160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.879294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.019238 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-53ba7ce0-ad5c-4418-82bd-79fb421ebcb0 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 204 len: 0 microversion: 2.47 time: 0.467087 Jul 18 02:35:36.019238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2121/4175] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:35:35 2022] DELETE /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:35:36.030232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1dd14803-9f14-401d-b7c2-d5e480e2cbcc req-1836ff59-6033-4ee5-b2e9-d3e6bbe0c4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad144596-42e9-47bb-b290-8febab20f782", "name": "network-vif-unplugged", "status": "completed", "tag": "b3d63561-3126-48d6-ace6-741e16cd2332"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:36.071033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1dd14803-9f14-401d-b7c2-d5e480e2cbcc req-1836ff59-6033-4ee5-b2e9-d3e6bbe0c4f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.071901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1dd14803-9f14-401d-b7c2-d5e480e2cbcc req-1836ff59-6033-4ee5-b2e9-d3e6bbe0c4f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.121145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1dd14803-9f14-401d-b7c2-d5e480e2cbcc req-1836ff59-6033-4ee5-b2e9-d3e6bbe0c4f4 service nova] Creating event network-vif-unplugged:b3d63561-3126-48d6-ace6-741e16cd2332 for instance ad144596-42e9-47bb-b290-8febab20f782 on n-h1-849796-1 Jul 18 02:35:36.127050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1dd14803-9f14-401d-b7c2-d5e480e2cbcc req-1836ff59-6033-4ee5-b2e9-d3e6bbe0c4f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108938 Jul 18 02:35:36.129017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2122/4176] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:36.163991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:36.165602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:36.190664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.195052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.196486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.196987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.530635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.566247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.587184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.589638 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be7e259f-4057-4338-82f6-51ebb3495e65 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1362 microversion: 2.47 time: 0.454518 Jul 18 02:35:36.590697 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2123/4177] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:36 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:36.607520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:36.608775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:36.648581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.649534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.650950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.651723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.110133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.129332 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94bbba50-72f3-4201-99c9-ac1e237c71d0 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1523 microversion: 2.1 time: 1.310702 Jul 18 02:35:37.143062 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2055/4178] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:35 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1523 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:37.157123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.158703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:37.175465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.178307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.181659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.184860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.914061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.960766 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cabf3d91-26c7-4f5e-b36d-2aa5ae0847d2 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 1.367988 Jul 18 02:35:37.962788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2124/4179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:36 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:37.980162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.985141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.997132 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-375fcdad-5047-433c-9f1b-5640ced9a640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1512 microversion: 2.1 time: 0.852562 Jul 18 02:35:38.000216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:38.001633 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2056/4180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1512 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:38.041733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.043388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.047209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.047697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.152436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:38.153271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:38.166306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.166827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.167740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.168210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.212689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.224724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.226591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.229870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea3fc654-5dcb-4278-a19e-1c2aaf361898 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1362 microversion: 2.47 time: 0.265234 Jul 18 02:35:38.230871 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2125/4181] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:38.240695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8dd192cb-4a8d-4a4d-9a0c-bc06fcfb1d52 req-d7fba788-f17d-4f69-bc95-0cb4af671e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad144596-42e9-47bb-b290-8febab20f782", "name": "network-vif-deleted", "tag": "b3d63561-3126-48d6-ace6-741e16cd2332"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:38.269605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8dd192cb-4a8d-4a4d-9a0c-bc06fcfb1d52 req-d7fba788-f17d-4f69-bc95-0cb4af671e8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.271728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8dd192cb-4a8d-4a4d-9a0c-bc06fcfb1d52 req-d7fba788-f17d-4f69-bc95-0cb4af671e8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.321558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8dd192cb-4a8d-4a4d-9a0c-bc06fcfb1d52 req-d7fba788-f17d-4f69-bc95-0cb4af671e8d service nova] Creating event network-vif-deleted:b3d63561-3126-48d6-ace6-741e16cd2332 for instance ad144596-42e9-47bb-b290-8febab20f782 on n-h1-849796-1 Jul 18 02:35:38.331146 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8dd192cb-4a8d-4a4d-9a0c-bc06fcfb1d52 req-d7fba788-f17d-4f69-bc95-0cb4af671e8d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097829 Jul 18 02:35:38.332106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2126/4182] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:38.369888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5664e98b90c4542b9186b42ca89d99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e44aa1cfa64cc2a6786cc755ae7f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.402065 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4548dec-d825-473c-a2f5-d74532764fd5 tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 200 len: 1481 microversion: 2.1 time: 0.254400 Jul 18 02:35:38.414525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2057/4183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 1481 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:38.983877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:38.984990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.018955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.021942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.026463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.028437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.035529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.044595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.080071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.085265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.090607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.091961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.092850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:39.566261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:39.583180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.599695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e66655d-b752-4b14-a6fc-692c7d8dffec tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.616002 Jul 18 02:35:39.602658 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2127/4184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:39.620981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-74e44f0f-061e-465e-a888-898fd74f6d08 req-20c36e88-b5e1-4e33-8ca6-96b4881ffb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10674860-cbe9-4c9b-930d-3d2d4f3ecaed", "name": "network-vif-unplugged", "status": "completed", "tag": "73b1b020-4e43-4ad4-a3c5-b1f816531607"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:39.633253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74e44f0f-061e-465e-a888-898fd74f6d08 req-20c36e88-b5e1-4e33-8ca6-96b4881ffb38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.634137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74e44f0f-061e-465e-a888-898fd74f6d08 req-20c36e88-b5e1-4e33-8ca6-96b4881ffb38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.651031 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-74e44f0f-061e-465e-a888-898fd74f6d08 req-20c36e88-b5e1-4e33-8ca6-96b4881ffb38 service nova] Creating event network-vif-unplugged:73b1b020-4e43-4ad4-a3c5-b1f816531607 for instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed on n-h1-849796-1 Jul 18 02:35:39.657134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-74e44f0f-061e-465e-a888-898fd74f6d08 req-20c36e88-b5e1-4e33-8ca6-96b4881ffb38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051096 Jul 18 02:35:39.658674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2128/4185] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:39.667102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.668160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.677705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.679002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.680278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.681058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.731450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.732288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.733225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lazy-loading 'fault' on Instance uuid 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:39.837761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.866771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.871136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.872460 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c31f6adb-39ca-448b-b841-213a74df9d03 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1367 microversion: 2.47 time: 0.212402 Jul 18 02:35:39.877225 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2129/4186] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:39.885374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.886651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] [instance: ad144596-42e9-47bb-b290-8febab20f782] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.894652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.897137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.898789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.899546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.921373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] HTTP exception thrown: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Request method failure captured: Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 HTTP/1.1 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MUdcE7aiAveyIb4ZjOLyCVTxGu_3mUziP2m9Gb55P1R3QhnUVbJTTdJ32n4Wo7xxkqU25rum7LcX_3BTVo9LR3sDhQctO7-aRwyhgPMMXbtvy4QDJbgM_3s5FOLYQQIJqPgGH8B_elqj5-xNrLJ0cgcpDgeFKtOH1w6yiBmQBxke10 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e44aa1cfa64cc2a6786cc755ae7f1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 56e44aa1cfa64cc2a6786cc755ae7f1c Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1277179182 Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a5664e98b90c4542b9186b42ca89d99c Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1277179182-project Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ad144596-42e9-47bb-b290-8febab20f782'} Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:39.923938 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. Jul 18 02:35:39.930005 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:39.933364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] Returning 404 to user: Instance ad144596-42e9-47bb-b290-8febab20f782 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:39.934670 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5aa1a0d4-2dcc-49a4-8afd-8fac443264fd tempest-ServerRescueNegativeTestJSON-1277179182 tempest-ServerRescueNegativeTestJSON-1277179182-project] 10.222.0.67 "GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782" status: 404 len: 111 microversion: 2.1 time: 0.053560 Jul 18 02:35:39.935874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2130/4187] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/ad144596-42e9-47bb-b290-8febab20f782 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:39.943118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.956954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30a1c2a6-a399-42b7-9c62-403e26cf52f5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 200 len: 1512 microversion: 2.1 time: 0.930902 Jul 18 02:35:39.958967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2058/4188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 1512 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:40.217029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4a39fe08-1956-4fa8-9c64-df307acc63a0 req-34c761b0-2b7f-4f41-aace-a16c8db1a01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10674860-cbe9-4c9b-930d-3d2d4f3ecaed", "name": "network-vif-deleted", "tag": "73b1b020-4e43-4ad4-a3c5-b1f816531607"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:40.230485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a39fe08-1956-4fa8-9c64-df307acc63a0 req-34c761b0-2b7f-4f41-aace-a16c8db1a01b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.230950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a39fe08-1956-4fa8-9c64-df307acc63a0 req-34c761b0-2b7f-4f41-aace-a16c8db1a01b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.282057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4a39fe08-1956-4fa8-9c64-df307acc63a0 req-34c761b0-2b7f-4f41-aace-a16c8db1a01b service nova] Creating event network-vif-deleted:73b1b020-4e43-4ad4-a3c5-b1f816531607 for instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed on n-h1-849796-1 Jul 18 02:35:40.293904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4a39fe08-1956-4fa8-9c64-df307acc63a0 req-34c761b0-2b7f-4f41-aace-a16c8db1a01b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083274 Jul 18 02:35:40.295429 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2131/4189] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:40.632267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:40.638380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:40.663411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.664260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.676617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.677503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.915221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:40.916507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:40.949392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.950546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.952138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.957085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.096859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.102781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.103337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lazy-loading 'fault' on Instance uuid 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:41.193991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.214707 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ff3e531-8301-44ab-8691-923b6467bb45 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.590670 Jul 18 02:35:41.247199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2059/4190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:40 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:41.274850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.276797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.308720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.309915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.311620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.312657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.315549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.343169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.354561 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:35:41.355549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed HTTP/1.1 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '10674860-cbe9-4c9b-930d-3d2d4f3ecaed'} Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:41.358855 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:35:41.367562 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:41.368415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5f0a8b0-9e7b-427b-83b8-4424fd11e415 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1367 microversion: 2.47 time: 0.455480 Jul 18 02:35:41.370443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:41.373027 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d688670-3c44-4865-8f54-9dbdb291669a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 404 len: 111 microversion: 2.1 time: 0.121280 Jul 18 02:35:41.379760 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2132/4191] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:40 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:41.386252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2060/4192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:41.395363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.397203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.410028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.411620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.413578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.414669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.937567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fc1f661c-d314-4537-9b15-300b1ef85253 req-46c96646-67db-45d6-b553-c9bec2fd2fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75766d7b-60aa-469f-9461-5603cb542e27", "name": "network-vif-plugged", "status": "completed", "tag": "65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:41.958380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fc1f661c-d314-4537-9b15-300b1ef85253 req-46c96646-67db-45d6-b553-c9bec2fd2fa7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.967475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fc1f661c-d314-4537-9b15-300b1ef85253 req-46c96646-67db-45d6-b553-c9bec2fd2fa7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.045079 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fc1f661c-d314-4537-9b15-300b1ef85253 req-46c96646-67db-45d6-b553-c9bec2fd2fa7 service nova] Creating event network-vif-plugged:65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e for instance 75766d7b-60aa-469f-9461-5603cb542e27 on n-h1-849796-1 Jul 18 02:35:42.050026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.062306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fc1f661c-d314-4537-9b15-300b1ef85253 req-46c96646-67db-45d6-b553-c9bec2fd2fa7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128185 Jul 18 02:35:42.063786 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2061/4193] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:42.066028 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da35546b-8681-42fa-906e-b11094cd4b72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.682737 Jul 18 02:35:42.104813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2133/4194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:42.279730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.281126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.310088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.310907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.319689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.326262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.399184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.399983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.415571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.419669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.420813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.421764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.578402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:42.588582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.591691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.594043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lazy-loading 'fault' on Instance uuid 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:35:43.034141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.059355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d7dec0c-8cd2-4564-90f2-529838caaf78 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.809223 Jul 18 02:35:43.059810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.085474 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2062/4195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:43.097687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.102302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f41fa74-70db-4d14-9f4e-8f58c9056403 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:43.107234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '943ae647ab584dff8904134b179ebce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98c5d5c89284e588aadf894bde47962', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f41fa74-70db-4d14-9f4e-8f58c9056403 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 163 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": 12345, "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 12345 Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:43.112608 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f41fa74-70db-4d14-9f4e-8f58c9056403 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:43.125263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f41fa74-70db-4d14-9f4e-8f58c9056403 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.028434 Jul 18 02:35:43.126380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5cefac08-1a3e-47ed-a073-f3aedcc6411f tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 200 len: 1367 microversion: 2.47 time: 0.721377 Jul 18 02:35:43.126466 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2063/4196] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:43.126535 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2134/4197] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 1367 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:43.134537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:43.135952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:43.163115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.163839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.166953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.167573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.670321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.681299 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e644ce8-1a2d-4c6b-b91b-3b927c47d9dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.558680 Jul 18 02:35:43.704808 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2064/4198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:43 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:43.707644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:43.711633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:43.771974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.775571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.784207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.788857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.091770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:44.093043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:44.106962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.111848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.115649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.116425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.489417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.497373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:44.516123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c4e6d03b-523f-4787-8a76-7966d5047bdd tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.429708 Jul 18 02:35:44.521827 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2065/4199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:44 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:44.537744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:44.551937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] [instance: 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:44.581999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.583316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.585995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.588105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.626528 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] HTTP exception thrown: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Request method failure captured: Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c HTTP/1.1 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ma5TTEuQQXuJFPsxzs_vUlnw1ERJZXyT7v1xSVGy0vsvi0S9xWIlSOCvAqGYRgkjAm9znLuIrWdeuel2wBGkosL7bF1h7Db5i4GgbRi1MrhialiCL843apR2n3ovN0aDQ8NbUa5ZEVt_LPoyDg-l7nmm9aYGSZF_b5G9MNcl8Kux_Y Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.47 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d98c5d5c89284e588aadf894bde47962 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerShowV247Test-812519461 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d98c5d5c89284e588aadf894bde47962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d98c5d5c89284e588aadf894bde47962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerShowV247Test-812519461 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d98c5d5c89284e588aadf894bde47962 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerShowV247Test-812519461 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerShowV247Test-812519461-project Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 943ae647ab584dff8904134b179ebce3 Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerShowV247Test-812519461-project Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2a03bdf2-9034-4c73-a5d3-d53d4b885b7c'} Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:44.633128 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:44.642080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] Returning 404 to user: Instance 2a03bdf2-9034-4c73-a5d3-d53d4b885b7c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:44.644635 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8688ac71-0860-431c-b430-3692821e8b81 tempest-ServerShowV247Test-812519461 tempest-ServerShowV247Test-812519461-project] 10.222.0.67 "GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c" status: 404 len: 111 microversion: 2.47 time: 0.117855 Jul 18 02:35:44.646010 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2066/4200] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:44 2022] GET /compute/v2.1/servers/2a03bdf2-9034-4c73-a5d3-d53d4b885b7c => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:44.763551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.794770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf667c0a-c2ed-40bd-9de3-7bb6d8d9cafc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.096839 Jul 18 02:35:44.813306 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2135/4201] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:43 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:45.557400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:45.558884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:45.572310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.577155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.578219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.580453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.366390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.398324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8160608f-cea5-4805-8380-b03728f7424b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 0.847262 Jul 18 02:35:46.400124 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2067/4202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:45 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:47.418149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:47.418789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:47.438776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.440694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.442818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.450100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:48.672289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.688386 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9acd4f27-f48b-4791-97f7-51487d64c17b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 1.274496 Jul 18 02:35:48.720164 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2136/4203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:47 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:48.850350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-884ccb4d-53a7-403c-956f-fd658fa4b380 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224092149", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "23996811-50c1-4cca-b587-7c25aab997b4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:48.992250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-884ccb4d-53a7-403c-956f-fd658fa4b380 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-884ccb4d-53a7-403c-956f-fd658fa4b380 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 358 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224092149", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "23996811-50c1-4cca-b587-7c25aab997b4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: exception: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1224092149', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '23996811-50c1-4cca-b587-7c25aab997b4'}], 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:49.001273 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-884ccb4d-53a7-403c-956f-fd658fa4b380 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Block Device 23996811-50c1-4cca-b587-7c25aab997b4 is not bootable. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-884ccb4d-53a7-403c-956f-fd658fa4b380 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.170597 Jul 18 02:35:49.009546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2068/4204] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:49.020528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.024039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.042919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.043951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.045675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.046842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.266982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f9d8762c-132f-4f39-84c5-8230b10c3428 req-fbb0b7c9-4012-4aef-badd-d77ab9ae4540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c3facc-43ba-4180-bbdf-513444dad69e", "name": "network-vif-plugged", "status": "completed", "tag": "9d7ea5ae-b73a-442e-8d7c-cec8b385ee58"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:49.288259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f9d8762c-132f-4f39-84c5-8230b10c3428 req-fbb0b7c9-4012-4aef-badd-d77ab9ae4540 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.289205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f9d8762c-132f-4f39-84c5-8230b10c3428 req-fbb0b7c9-4012-4aef-badd-d77ab9ae4540 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.302975 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f9d8762c-132f-4f39-84c5-8230b10c3428 req-fbb0b7c9-4012-4aef-badd-d77ab9ae4540 service nova] Creating event network-vif-plugged:9d7ea5ae-b73a-442e-8d7c-cec8b385ee58 for instance 86c3facc-43ba-4180-bbdf-513444dad69e on n-h2-849796-1 Jul 18 02:35:49.310059 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f9d8762c-132f-4f39-84c5-8230b10c3428 req-fbb0b7c9-4012-4aef-badd-d77ab9ae4540 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047327 Jul 18 02:35:49.311322 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2069/4205] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:49.721655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.723940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.741844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.742326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.743166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.743630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.134050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.174755 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f747f62-9383-4479-b66f-62591c56bef9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.158557 Jul 18 02:35:50.183888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2137/4206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:49 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:50.226604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:50.231393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:50.272268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.275923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.280747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.295876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.708829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.718332 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5fb1de8-61a2-4d45-8086-668c67580663 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 1.002832 Jul 18 02:35:50.721393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2070/4207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:49 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:51.084886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1826041233", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "2a666e43-2399-4a46-b1b3-1599a2758e72"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:51.195682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] validate_networks() for [('2a666e43-2399-4a46-b1b3-1599a2758e72', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:51.507934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.526472 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac9fd4db-9926-4fe7-bd5a-ddd906ddc800 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.318542 Jul 18 02:35:51.530888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2138/4208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:50 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:51.782468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2099858291", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:52.011701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:52.013181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:52.018646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:52.021367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:52.022062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:52.052393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.053154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.054176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.054818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.068152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:52.084464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Getting quotas for project 0d3614883eef45cab75db3e8c2b07abd. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:52.093031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Getting quotas for user 3362a377b3e14fe792125394435b9d94 and project 0d3614883eef45cab75db3e8c2b07abd. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:52.113333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:52.120763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:52.248905 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-152aeb08-2d0d-4d2b-b6b2-234492cb253b tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.701741 Jul 18 02:35:52.251810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2139/4209] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:35:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:35:52.266321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:52.271446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:52.292658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.295199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.298595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.299538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.420455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.434687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-389df3cf-5dd0-4f35-8db1-13997fe1b1de tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1320 microversion: 2.1 time: 1.177523 Jul 18 02:35:53.435402 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2140/4210] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:52 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1320 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:53.451831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:53.461429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:53.544805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.547996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.551515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.553395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.811419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.833453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.846991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.851105 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4915078b-cbbd-4355-b270-1b76f64bd53f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1282 microversion: 2.57 time: 0.411716 Jul 18 02:35:53.856080 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2141/4211] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:53 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1282 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:54.064602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:54.065810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:54.067712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:54.069268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:54.069745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:54.136812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.139364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.144265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.145275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.264318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:54.291159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for user d16c783d9ed84e9ab2535e921975ce5d and project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:54.330543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:54.342819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:54.476433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.486594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.502313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.503669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.506747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.507972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.569873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d60efd0a-d7c1-40a4-a640-76d8e53a88c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.702678 Jul 18 02:35:54.578661 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2071/4212] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:35:54.611162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-794623ca-e491-4bf4-8eb9-2e4dcc2aca16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.615328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-794623ca-e491-4bf4-8eb9-2e4dcc2aca16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:55.239858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-794623ca-e491-4bf4-8eb9-2e4dcc2aca16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.265510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-794623ca-e491-4bf4-8eb9-2e4dcc2aca16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1218 microversion: 2.1 time: 0.661330 Jul 18 02:35:55.277860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2072/4213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1218 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:55.296652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:55.303124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:55.331194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.336796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.343294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.346884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.555687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.574473 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c6be443-6381-42c2-a987-7287bffe028b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 200 len: 1509 microversion: 2.1 time: 1.111139 Jul 18 02:35:55.586914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.589902 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2142/4214] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 1509 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:55.596101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:55.597113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 75766d7b-60aa-469f-9461-5603cb542e27] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:55.603552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.605375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.606605 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69551109-d3fd-4db1-b572-f931a964697a tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1336 microversion: 2.57 time: 0.327424 Jul 18 02:35:55.607213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2073/4215] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:55 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1336 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:55.608596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.611815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.614834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.616013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.200619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.238474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a92340fe-79b9-4855-b5c6-4cae529d975f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/75766d7b-60aa-469f-9461-5603cb542e27" status: 200 len: 1508 microversion: 2.1 time: 0.646615 Jul 18 02:35:56.263959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2143/4216] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:55 2022] GET /compute/v2.1/servers/75766d7b-60aa-469f-9461-5603cb542e27 => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:56.307795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.308862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 75766d7b-60aa-469f-9461-5603cb542e27] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.315532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-91b34148-6892-4215-b720-444a69044104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.325681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-91b34148-6892-4215-b720-444a69044104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.375260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.379545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.381135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.386695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.481022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 75766d7b-60aa-469f-9461-5603cb542e27] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:56.625543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-91b34148-6892-4215-b720-444a69044104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.642945 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-91b34148-6892-4215-b720-444a69044104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1218 microversion: 2.1 time: 0.352187 Jul 18 02:35:56.649829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2144/4217] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:56.681811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd1dff76-7bd0-49f9-b073-3e123d92fe5a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1472206511", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "destination_type": "local"}, {"source_type": "volume", "uuid": "34879c1d-fbb8-40de-b6d2-3f15718cf439", "destination_type": "invalid"}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd1dff76-7bd0-49f9-b073-3e123d92fe5a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 495 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1472206511", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "destination_type": "local"}, {"source_type": "volume", "uuid": "34879c1d-fbb8-40de-b6d2-3f15718cf439", "destination_type": "invalid"}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1472206511', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '34879c1d-fbb8-40de-b6d2-3f15718cf439', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'invalid' Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:56.696836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 18 02:35:56.701065 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:56.704161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd1dff76-7bd0-49f9-b073-3e123d92fe5a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:56.707955 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd1dff76-7bd0-49f9-b073-3e123d92fe5a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.055433 Jul 18 02:35:56.710448 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2145/4218] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:56 2022] POST /compute/v2.1/servers => generated 155 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:56.726310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a2df321-41e2-461a-b2d5-40aa8a7f07eb tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "DELETE /compute/v2.1/servers/75766d7b-60aa-469f-9461-5603cb542e27" status: 204 len: 0 microversion: 2.1 time: 0.438815 Jul 18 02:35:56.727283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2074/4219] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:35:56 2022] DELETE /compute/v2.1/servers/75766d7b-60aa-469f-9461-5603cb542e27 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:35:56.736951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.737695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.741571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.742394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.776731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.778755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.779425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.780193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.781388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.782508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.782962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.790351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.033354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:57.075323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:57.089422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:57.094489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84db0355-ad3c-4933-8949-8bf7e0a160b6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1336 microversion: 2.57 time: 0.381457 Jul 18 02:35:57.106173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2146/4220] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1336 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:57.139985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:57.148332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:57.172845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.173715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.177684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.179775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.388017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 86c3facc-43ba-4180-bbdf-513444dad69e] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:35:57.777444 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5749961e-9f56-461f-9513-ef805215f073 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "DELETE /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e" status: 204 len: 0 microversion: 2.1 time: 0.665010 Jul 18 02:35:57.780418 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2147/4221] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:35:57 2022] DELETE /compute/v2.1/servers/86c3facc-43ba-4180-bbdf-513444dad69e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:35:57.798553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:57.805511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:57.822501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.823785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:57.826436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:57.828741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.052629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:58.062741 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f8b94dd-80af-44c9-a4be-71f0a58912da tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.333643 Jul 18 02:35:58.070455 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2075/4222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:58.100916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:58.102638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:58.121767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.122951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.126990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.127876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.752837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:58.763889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20afdf6a-68da-47ed-bc5f-fc58dfbb496e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1278 microversion: 2.1 time: 0.980851 Jul 18 02:35:58.764508 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2148/4223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:57 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1278 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:58.799331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:58.802164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:58.840455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.845477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.853620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.854933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:59.324582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:59.345012 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-673f197a-065e-41ea-91a3-34510314e6bb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.250062 Jul 18 02:35:59.351088 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2076/4224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:58 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:59.354828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:59.358749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-269352844", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "96923dd4-fe55-4383-99e2-cdefe552d157"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:59.417449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:59.434567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:59.442167 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3326e417-bd78-4c45-a5bd-7f7c27c26729 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1336 microversion: 2.57 time: 0.661056 Jul 18 02:35:59.455304 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2149/4225] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:58 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1336 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:59.659603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] validate_networks() for [('96923dd4-fe55-4383-99e2-cdefe552d157', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:59.780951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56ec3521-6926-437a-92de-f8e52d477c8f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1630871788", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56ec3521-6926-437a-92de-f8e52d477c8f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 492 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1630871788", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1630871788', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 18 02:35:59.798830 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 18 02:35:59.805081 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:35:59.813263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56ec3521-6926-437a-92de-f8e52d477c8f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:59.813263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-56ec3521-6926-437a-92de-f8e52d477c8f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.038116 Jul 18 02:35:59.813263 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2150/4226] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:59 2022] POST /compute/v2.1/servers => generated 624 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:35:59.838056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:59.850706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:59.878749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:59.879869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:59.895086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:59.901964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:00.091593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:00.134748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5e8cbc6-a394-43bf-aacc-7f357baa989f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1276 microversion: 2.1 time: 0.316228 Jul 18 02:36:00.136387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2151/4227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:59 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:00.156133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:00.157133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:00.180629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:00.193885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:00.195620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:00.196510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:01.083207 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:36:01.084052 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 02:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Jul 18 02:36:01.443478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:01.471624 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee847ff7-3dec-4de8-aac3-d40aac5bc54a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.333347 Jul 18 02:36:01.481085 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2152/4228] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:01.525477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:01.542456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:01.563558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:01.564449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:01.567662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:01.568979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.013434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:02.033890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:02.037938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:02.044568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e5012cb-4037-4eef-9e86-9dbafc4bffb4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1357 microversion: 2.57 time: 0.559000 Jul 18 02:36:02.045378 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2153/4229] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:01 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1357 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:02.070932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b1c69074-505f-47f4-872b-92b9eb001016 req-8487f65d-a119-4581-b675-fe37af5869e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c3facc-43ba-4180-bbdf-513444dad69e", "name": "network-vif-deleted", "tag": "9d7ea5ae-b73a-442e-8d7c-cec8b385ee58"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:02.080814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:02.102055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1c69074-505f-47f4-872b-92b9eb001016 req-8487f65d-a119-4581-b675-fe37af5869e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.102524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1c69074-505f-47f4-872b-92b9eb001016 req-8487f65d-a119-4581-b675-fe37af5869e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.130899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b1c69074-505f-47f4-872b-92b9eb001016 req-8487f65d-a119-4581-b675-fe37af5869e8 service nova] Creating event network-vif-deleted:9d7ea5ae-b73a-442e-8d7c-cec8b385ee58 for instance 86c3facc-43ba-4180-bbdf-513444dad69e on n-h2-849796-1 Jul 18 02:36:02.138331 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b1c69074-505f-47f4-872b-92b9eb001016 req-8487f65d-a119-4581-b675-fe37af5869e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081368 Jul 18 02:36:02.140414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2154/4230] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:02.164766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:02.166637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:02.190417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.191228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.192006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.195438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.434231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:02.472168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-245bb3f1-1f1f-4f23-8483-2f698a659007 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1276 microversion: 2.1 time: 0.318951 Jul 18 02:36:02.473322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2155/4231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:02 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:02.491463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:02.492823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:02.502552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.503295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.505621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.506645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.670758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:02.671542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:02.672689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:02.673616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:02.674301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:02.709693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.710512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.714959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.717205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.777779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Getting quotas for project 43bd08714ba44756824cce3a19c7ffa9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:02.786618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Getting quotas for user f9e9a96aca244212b403d989adea9029 and project 43bd08714ba44756824cce3a19c7ffa9. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:02.806104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Going to run 2 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:02.809284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:02.861276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=85aceb0f-346a-4759-b451-deecfe4c15f8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:02.952336 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d2ed058-71b4-4650-a7a9-b0ed08c5e7a8 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.598007 Jul 18 02:36:02.954283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2077/4232] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 3600 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 18 02:36:02.961893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:02.964001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:02.975843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.977012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:02.978552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:02.979154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.111349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:03.125737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ddb9bc8-02bf-43c8-ac37-ff0f77659d8c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.642962 Jul 18 02:36:03.126355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2156/4233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:02 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:03.131748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:03.142060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:03.142993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Searching by: {'deleted': False, 'project_id': '43bd08714ba44756824cce3a19c7ffa9'} {{(pid=119439) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:36:03.195567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.196050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.196974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.197643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.233174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:03.233944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:03.234835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:03.235579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:03.236326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:03.291905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.multi_cell_list [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119439) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:36:03.411731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b441125a-f1eb-425a-b111-3ba8fc220064 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.283902 Jul 18 02:36:03.431258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2157/4234] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 02:36:03 2022] GET /compute/v2.1/servers => generated 1003 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:03.464033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e913655-9139-4746-9dc8-f7381e889c26 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:03.465332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e913655-9139-4746-9dc8-f7381e889c26 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:03.528844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:03.571421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.572380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.575173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.577188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.708364 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad4a20df-a7c3-48b9-9d67-816345db24b9 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "POST /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f/action" status: 202 len: 1138 microversion: 2.57 time: 0.748461 Jul 18 02:36:03.709331 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2078/4235] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Jul 18 02:36:02 2022] POST /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f/action => generated 1138 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:36:03.724529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:03.726496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:03.759603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.760962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.784419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.789185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.844840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e913655-9139-4746-9dc8-f7381e889c26 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:03.860575 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e913655-9139-4746-9dc8-f7381e889c26 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1217 microversion: 2.1 time: 0.426703 Jul 18 02:36:03.865808 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2158/4236] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:03 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1217 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:03.899323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80e117d3-e67a-44cd-8ba2-59595f2c7b1b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80e117d3-e67a-44cd-8ba2-59595f2c7b1b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 416 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:03.902130 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80e117d3-e67a-44cd-8ba2-59595f2c7b1b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-80e117d3-e67a-44cd-8ba2-59595f2c7b1b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019268 Jul 18 02:36:03.904852 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2159/4237] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:03 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:03.912610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c7ecd967-5cc9-40e9-be23-9bf2ebf5108a req-fec58396-22c6-444e-a053-13cacad84075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75766d7b-60aa-469f-9461-5603cb542e27", "name": "network-vif-deleted", "tag": "65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:03.944676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c7ecd967-5cc9-40e9-be23-9bf2ebf5108a req-fec58396-22c6-444e-a053-13cacad84075 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:03.947632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c7ecd967-5cc9-40e9-be23-9bf2ebf5108a req-fec58396-22c6-444e-a053-13cacad84075 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:03.981992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:03.991597 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c7ecd967-5cc9-40e9-be23-9bf2ebf5108a req-fec58396-22c6-444e-a053-13cacad84075 service nova] Creating event network-vif-deleted:65d8b760-6ff7-4e37-b6d9-0d9d52cf6b9e for instance 75766d7b-60aa-469f-9461-5603cb542e27 on n-h1-849796-1 Jul 18 02:36:04.016478 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c7ecd967-5cc9-40e9-be23-9bf2ebf5108a req-fec58396-22c6-444e-a053-13cacad84075 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107982 Jul 18 02:36:04.020496 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2160/4238] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:04.041060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:04.043685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:04.077308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.077835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.079464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.081002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.384068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:04.442547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:04.454908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:04.468043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bdc1034-02e7-408f-8e12-f7a4e36a1038 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.438852 Jul 18 02:36:04.476840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2161/4239] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:04 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:04.502358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:04.507282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:04.539351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.542840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.545290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:04.550069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:04.937511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:04.955659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e800c11-e12d-4f26-a25c-30983052b1ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.473536 Jul 18 02:36:04.958123 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2162/4240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:04 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:04.975073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c83ce246-1e55-4940-80c2-76632b4d129e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:04.977201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c83ce246-1e55-4940-80c2-76632b4d129e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:05.096794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:05.121663 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7400c26c-f82f-4025-b7b1-b4901dd2ef43 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 1.411359 Jul 18 02:36:05.133684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2079/4241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:03 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:05.153268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:05.155036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:05.170650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.171847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.173742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.174773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.301067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c83ce246-1e55-4940-80c2-76632b4d129e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:05.313527 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c83ce246-1e55-4940-80c2-76632b4d129e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1217 microversion: 2.1 time: 0.350577 Jul 18 02:36:05.316430 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2163/4242] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:04 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:05.491526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:05.492792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:05.514463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.516529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.518051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:05.519999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:05.762055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:05.776028 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f2ac31ca-7ff2-44d2-ba31-a5137560c0dc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.640369 Jul 18 02:36:05.780569 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2080/4243] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:05 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:06.010633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8bd65f1-8e83-4ac2-969b-822c4c0cd337 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-112818575", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": -1, "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:06.039581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:06.045358 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c8bd65f1-8e83-4ac2-969b-822c4c0cd337 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Flavor -1 could not be found. Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8bd65f1-8e83-4ac2-969b-822c4c0cd337 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 205 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-112818575", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": -1, "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: exception: Flavor -1 could not be found. Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-112818575', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': -1, 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:06.055001 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 18 02:36:06.063422 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:06.070096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8bd65f1-8e83-4ac2-969b-822c4c0cd337 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:06.072125 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8bd65f1-8e83-4ac2-969b-822c4c0cd337 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.067644 Jul 18 02:36:06.078941 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2081/4244] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:06.100441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:06.103249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:06.107131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.122706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.125761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.128119 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d884b4e9-ee0e-40dc-967b-4dd933baeb7f tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.641902 Jul 18 02:36:06.130550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2164/4245] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:05 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:36:06.139970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.146497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.158791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:06.163902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:06.165405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.170249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.199272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.210119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.213518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.214625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.885199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.909961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0325e469-ec56-414e-97f8-e917b40cc34a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.828603 Jul 18 02:36:06.918233 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2082/4246] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:06 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:06.919521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:06.936310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:06.938057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:06.952414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.954748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.955270 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5db2d310-8477-48fa-a95c-ae884a66004d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.806847 Jul 18 02:36:06.969100 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2165/4247] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:06 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:06.971613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.972728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.979060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:06.982544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:07.009292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.010475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.011911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.012727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.399153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:07.429235 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f20d7aa-e4be-42a2-a349-05b5a92cb4d1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1275 microversion: 2.1 time: 0.509061 Jul 18 02:36:07.433589 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2083/4248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:06 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1275 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:07.440384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:07.441387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:07.450305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.451053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.473277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.474167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.545218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:07.789588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:07.809557 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-754f203e-10a8-4671-89de-761d9ab3b76c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.848898 Jul 18 02:36:07.814467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2166/4249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:06 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:07.999950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:08.002978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:08.034446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.037643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.040660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.043470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.277952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.288525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.291236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.292668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9170af7-c91a-407d-a43e-667ed6e73c87 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.857655 Jul 18 02:36:08.293363 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2084/4250] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:07 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:08.304664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65269f0d-d91a-4e6b-aec2-42c5a282836c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1975728982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65269f0d-d91a-4e6b-aec2-42c5a282836c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 173 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1975728982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1975728982', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi -1 Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:36:08.311693 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65269f0d-d91a-4e6b-aec2-42c5a282836c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65269f0d-d91a-4e6b-aec2-42c5a282836c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019221 Jul 18 02:36:08.315872 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2085/4251] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:08.324877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:08.325534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:08.334381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.334847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.335660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.336316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.603268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.615045 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad619736-15d7-4407-9ecf-b4e053c7d07d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.293891 Jul 18 02:36:08.616072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2086/4252] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:08 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:08.634122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:08.634791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:08.642361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.643235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.644488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.645276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.052200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.068353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.070586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.080549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7965149b-b0ca-422b-859b-d873998d5b3f tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2945 microversion: 2.42 time: 0.462864 Jul 18 02:36:09.092968 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2087/4253] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:08 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2945 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:09.092968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.092968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.104770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.105867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.107849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.108681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.278449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.289035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69c28bb1-2d41-48c6-8891-f8ac9725f39e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1275 microversion: 2.1 time: 0.205625 Jul 18 02:36:09.289659 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2088/4254] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:09.294970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.295589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.302246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.307030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.308387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.309484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.310151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.317943 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76477566-0f94-47bc-9b14-9bf1dcf5bc19 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 1.328613 Jul 18 02:36:09.319677 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2167/4255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:07 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:09.326388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-85750959-7bc8-4d76-8716-983f700abffe req-9051c33f-7924-4db0-b4c2-dfbd4bc133f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8e00fd-17bd-4772-95c6-795a37e38f44", "tag": "1560bc1c-816a-4864-83f4-3b6bf969195c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:09.338637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-85750959-7bc8-4d76-8716-983f700abffe req-9051c33f-7924-4db0-b4c2-dfbd4bc133f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.339267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-85750959-7bc8-4d76-8716-983f700abffe req-9051c33f-7924-4db0-b4c2-dfbd4bc133f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.358032 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-85750959-7bc8-4d76-8716-983f700abffe req-9051c33f-7924-4db0-b4c2-dfbd4bc133f8 service nova] Creating event network-changed:1560bc1c-816a-4864-83f4-3b6bf969195c for instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 on n-h2-849796-1 Jul 18 02:36:09.365781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-85750959-7bc8-4d76-8716-983f700abffe req-9051c33f-7924-4db0-b4c2-dfbd4bc133f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043730 Jul 18 02:36:09.366786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2168/4256] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:09.377563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.377563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.388615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.389290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.390246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.390812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.739729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.760549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-369607cb-fad7-4843-a066-f985df96da8e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.468987 Jul 18 02:36:09.761823 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-235d5f7c-6752-4acc-8f2b-4396769eeed1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.391896 Jul 18 02:36:09.779976 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2169/4258] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980/os-interface => generated 1830 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:09.780603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2089/4258] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:09.803819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.804560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.826422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.826799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.827787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.828419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.033959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ee5604-c6ea-464c-9f9b-fdf24ce53c61 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-608818336", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:10.042949 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b1ee5604-c6ea-464c-9f9b-fdf24ce53c61 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ee5604-c6ea-464c-9f9b-fdf24ce53c61 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 215 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-608818336", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-608818336', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:10.052723 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1ee5604-c6ea-464c-9f9b-fdf24ce53c61 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1ee5604-c6ea-464c-9f9b-fdf24ce53c61 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030778 Jul 18 02:36:10.059410 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2170/4259] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:10 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:10.072899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:10.073969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:10.089203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.090407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.092592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.093364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.110051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.136964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.142621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.148829 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fcd0a0a6-dab5-4867-9ecf-dc553a20e3bb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.355319 Jul 18 02:36:10.152836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2090/4260] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:10.319031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:10.320231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:10.345756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.347879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.353850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.356322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.948688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.971294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1c44a48-fc5a-44f0-90f0-4b37fbfe6952 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.665901 Jul 18 02:36:10.976651 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2091/4261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:10 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:10.992844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:10.997619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.013433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.015019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.018014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.019454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.493946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:11.508542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a4ce9e3-c21c-4c1e-9863-f541ba9aff62 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.447077 Jul 18 02:36:11.515117 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2171/4262] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:10 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:11.521799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:11.526965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.551802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.556766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.559798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.567677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.810494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:11.849887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-702519da-f6cc-4a12-a658-f030967ffd06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.867262 Jul 18 02:36:11.871198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:11.879134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2092/4263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:10 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:11.881838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:11.889786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:11.897562 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d29b721-e88b-48f9-9e1c-91fb38035569 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.380763 Jul 18 02:36:11.898749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2172/4264] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:11 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:11.912760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:11.914015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.935115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.936031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.942350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.943792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.994729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:11.995839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:12.007452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:12.032507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:12.033406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.035364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:12.036484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.430192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:12.446835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15ea2ff7-9913-4075-a547-fccb2166bef1 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.458744 Jul 18 02:36:12.447458 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2173/4265] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:11 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:12.751850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:12.801336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:12.885980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:12.887535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:12.899256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:12.900012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.901185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:12.901805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.917711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:12.946039 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cfa8d5b0-2a1d-4030-9591-d742d172d048 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.062994 Jul 18 02:36:12.947100 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2093/4266] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:11 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:12.973345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:12.974380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:12.999548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.001396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.002987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.003932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.204297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:13.402339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:13.419137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:13.419137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:13.420332 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3388392f-78a9-4a38-97f2-a4dd95afe6f6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.471858 Jul 18 02:36:13.427091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2094/4267] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:12 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:13.446870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1872317191", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-key-1966582772", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:13.722484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:13.773242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70f31120-159b-4620-85a8-d80181566737 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.884809 Jul 18 02:36:13.774206 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2174/4268] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:12 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:13.795018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:13.800249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:13.823502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.824882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.825948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.826590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.152680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] validate_networks() for [('bc3757aa-50bd-407f-9426-b53b0e6bdb8f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:14.489394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.502334 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-807fe56c-de39-443d-9345-234d3b4bd7db tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.726838 Jul 18 02:36:14.504189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2175/4269] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:13 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:14.518298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:14.523564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:14.532193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.533162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.534196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.535381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.901037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.918128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.924742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.930552 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8f901c1-4d56-4ab3-bb93-be3dcdeb27d5 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.424826 Jul 18 02:36:14.931970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2176/4270] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:14 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:14.950712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:14.951857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:14.977335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.978004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.979793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.980235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.030802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Invalid key_name provided. Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 247 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1872317191", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-key-1966582772", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid key_name provided. Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1872317191', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'key_name': 'tempest-key-1966582772', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1966582772 not found for user 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:15.034295 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid key_name provided. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ab1ac1f-12bf-4fe6-887b-ad1e27d6a289 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.607819 Jul 18 02:36:15.038333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2095/4271] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 1609 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:15.055714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:15.058351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:15.080231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.084737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.086378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.089278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.307155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:15.604335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:15.669820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7313e74-6d20-468c-8164-610c0b1d3d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.706369 Jul 18 02:36:15.670476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2177/4272] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:14 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:15.685697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:15.686333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:15.695197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:15.700657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.701161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.706107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.707274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.710305 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e54b04a-f413-4091-91cf-714c4c2d85e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.667511 Jul 18 02:36:15.716961 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2096/4273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:15 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:15.755290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:15.758861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:15.780487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.796327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.797870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.802076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.578000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:16.592307 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eee7d78c-7da6-4f2a-abf0-55f40109b68d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.848084 Jul 18 02:36:16.594928 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2097/4274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:15 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:16.615020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5ebd6ee2-8c3d-4200-81c6-fc62025b24b9 req-c9054d77-032c-455e-9269-ce0cf8d6a13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f", "tag": "d7cdff8f-32b1-42c2-8484-262818ce5856"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:16.646164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5ebd6ee2-8c3d-4200-81c6-fc62025b24b9 req-c9054d77-032c-455e-9269-ce0cf8d6a13a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.646971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5ebd6ee2-8c3d-4200-81c6-fc62025b24b9 req-c9054d77-032c-455e-9269-ce0cf8d6a13a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.685780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5ebd6ee2-8c3d-4200-81c6-fc62025b24b9 req-c9054d77-032c-455e-9269-ce0cf8d6a13a service nova] Creating event network-changed:d7cdff8f-32b1-42c2-8484-262818ce5856 for instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f on n-h1-849796-1 Jul 18 02:36:16.696316 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5ebd6ee2-8c3d-4200-81c6-fc62025b24b9 req-c9054d77-032c-455e-9269-ce0cf8d6a13a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093912 Jul 18 02:36:16.698227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2098/4275] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:16.704499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:16.705613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:16.714698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.715531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.716873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.717607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:17.062416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:17.083436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:17.100113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:17.102617 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-320740a4-9ab9-4038-9ada-41793d1ffd44 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.402544 Jul 18 02:36:17.103669 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2099/4276] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:16 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:17.140091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:17.148245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:17.167227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:17.167693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:17.169421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:17.170113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:17.462832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:17.483820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f2e0328d-4e05-4178-9d06-c9c7586c97ff tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 1.810282 Jul 18 02:36:17.489769 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2178/4277] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:15 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:17.509264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337131097", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:17.752049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:17.763215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cab9228-dd63-498b-a243-811eda7faef0 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.640321 Jul 18 02:36:17.772185 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2100/4278] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:17 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:17.912662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cbef1c54-2cc5-462d-9554-28dac5e80a44 req-3495ce61-97c4-474a-989e-cba97dca358d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85aceb0f-346a-4759-b451-deecfe4c15f8", "tag": "8af1f819-460e-4dea-95a3-2765c8c305fd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:17.923165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cbef1c54-2cc5-462d-9554-28dac5e80a44 req-3495ce61-97c4-474a-989e-cba97dca358d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:17.924126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cbef1c54-2cc5-462d-9554-28dac5e80a44 req-3495ce61-97c4-474a-989e-cba97dca358d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:17.967919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cbef1c54-2cc5-462d-9554-28dac5e80a44 req-3495ce61-97c4-474a-989e-cba97dca358d service nova] Creating event network-changed:8af1f819-460e-4dea-95a3-2765c8c305fd for instance 85aceb0f-346a-4759-b451-deecfe4c15f8 on n-h2-849796-1 Jul 18 02:36:17.974657 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cbef1c54-2cc5-462d-9554-28dac5e80a44 req-3495ce61-97c4-474a-989e-cba97dca358d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066409 Jul 18 02:36:17.981575 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2101/4279] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:36:18.125745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.security_group_api [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Neutron security group does_not_exist not found {{(pid=119439) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 18 02:36:18.126781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.144266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.145635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 258 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337131097", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1337131097', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 18 02:36:18.152089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.163232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:18.182117 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb2a100b-7b63-4270-b1cf-3b5c16f4a247 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.662514 Jul 18 02:36:18.182117 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2179/4280] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:17 2022] POST /compute/v2.1/servers => generated 106 bytes in 676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:18.195700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.196731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.197988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.200274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.201878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.205536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.230587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.231551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.233209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.241892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.406639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:18.420463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:18.426506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:18.435583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0638a7a-1b25-4107-ae9f-34b2e2264de7 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.301475 Jul 18 02:36:18.454630 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2102/4281] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:18 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:36:18.518538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.520127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.532567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.537124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.540666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.541558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.143198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:19.155214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c294e695-29ab-44c6-b940-11cb290fbe4e tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.641093 Jul 18 02:36:19.156466 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2103/4282] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:18 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:19.166804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:19.168008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:19.178353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:19.179133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.181238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:19.182018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.239310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:19.303577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:19.337283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16535377-16df-457c-b330-7586980aec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.161589 Jul 18 02:36:19.360967 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2180/4283] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:18 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:19.394478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:19.405570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:19.419277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:19.420089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.421211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:19.421855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:19.455557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:20.272529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:20.300236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4dd84e51-8e34-4525-bf2d-8418b1eb4339 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.915155 Jul 18 02:36:20.305455 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2181/4284] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:19 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:20.320514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:20.341936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:20.384476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:20.406215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c747b1d5-52fc-4110-be3e-48c083e4d9e9 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 1.241765 Jul 18 02:36:20.407249 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2104/4285] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:19 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:20.414915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.420851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:20.422248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:20.423669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:20.426710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.427398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:20.442911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.444008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:20.447330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:20.450474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.177486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:21.200003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:21.201598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:21.203702 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ca17815-ccb2-4e36-9fd3-de7a713897c4 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.897523 Jul 18 02:36:21.224845 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2182/4286] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:20 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:21.224845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:21.224845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 3dc0acd8-d665-4407-a7f9-1f453ea30801] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:21.265983 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/3dc0acd8-d665-4407-a7f9-1f453ea30801 HTTP/1.1 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '3dc0acd8-d665-4407-a7f9-1f453ea30801'} Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:21.309173 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:21.329517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 3dc0acd8-d665-4407-a7f9-1f453ea30801 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:21.337942 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b519d43f-0b21-4daa-8a8f-641b671a716a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3dc0acd8-d665-4407-a7f9-1f453ea30801" status: 404 len: 111 microversion: 2.1 time: 0.131950 Jul 18 02:36:21.344973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2183/4287] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:21 2022] DELETE /compute/v2.1/servers/3dc0acd8-d665-4407-a7f9-1f453ea30801 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:21.350131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:21.358347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:21.380385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.381809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.383633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.384573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.512144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:21.525033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a710b9b7-5b6e-4ad0-bf4a-e4ecad1a1bac tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 1.116380 Jul 18 02:36:21.525802 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2105/4288] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:20 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:21.531054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4931d6a9-d0ec-4af4-a6a6-9f3cdaf9d490 req-bfe04a93-645e-4c7a-9911-2ef1685ab8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e00fd-17bd-4772-95c6-795a37e38f44", "name": "network-vif-plugged", "status": "completed", "tag": "1560bc1c-816a-4864-83f4-3b6bf969195c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:21.555941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4931d6a9-d0ec-4af4-a6a6-9f3cdaf9d490 req-bfe04a93-645e-4c7a-9911-2ef1685ab8fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.559527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4931d6a9-d0ec-4af4-a6a6-9f3cdaf9d490 req-bfe04a93-645e-4c7a-9911-2ef1685ab8fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.589760 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4931d6a9-d0ec-4af4-a6a6-9f3cdaf9d490 req-bfe04a93-645e-4c7a-9911-2ef1685ab8fc service nova] Creating event network-vif-plugged:1560bc1c-816a-4864-83f4-3b6bf969195c for instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 on n-h2-849796-1 Jul 18 02:36:21.627738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4931d6a9-d0ec-4af4-a6a6-9f3cdaf9d490 req-bfe04a93-645e-4c7a-9911-2ef1685ab8fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099859 Jul 18 02:36:21.633198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2106/4289] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:21.666614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:21.668215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:21.684724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.686143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.688216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:21.689022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:21.961460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:21.997943 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-474dfbcb-e38f-43e6-b2ca-97234dc2aa2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.652477 Jul 18 02:36:22.006230 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2184/4290] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:21 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:22.027658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.031912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:22.060057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.060531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.061744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.062221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.234947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.260722 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa6726f6-e256-4d89-b618-27d9aa96d167 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.624921 Jul 18 02:36:22.272852 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2107/4291] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:21 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:22.280409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.281292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:22.289782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.290528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.291585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.292231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.458244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.495558 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18c60f08-e672-4fa7-83b0-99080523b9a4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.477716 Jul 18 02:36:22.496468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2185/4292] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:22 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:22.497620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.513575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.521497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.523370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5299568a-673b-458a-a58d-96a50f857f06 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.248784 Jul 18 02:36:22.526293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2108/4293] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:22 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:22.530125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.530970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:36:22.531880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9223372036854775808 could not be found. Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9223372036854775808'} Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:22.541247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:22.545253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:22.548763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.549627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:22.551515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32be3842-4268-4f90-a431-58ce2db83ec8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.030161 Jul 18 02:36:22.557516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2186/4294] 10.222.0.67 () {58 vars in 1187 bytes} [Mon Jul 18 02:36:22 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:22.571426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.571716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.572628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:22.573957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.576096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.577643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.610955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.613102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.614786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.615593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.921224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:22.931497 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b3750fd-4897-44fb-979f-0293e7be0a7b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.369011 Jul 18 02:36:22.932118 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2187/4295] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:22 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:22.954624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:22.955352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:22.964234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.964432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:22.965803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:22.966532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.041740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:23.060125 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-265d4626-4825-4305-8baa-0185cf3ffd4b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.520297 Jul 18 02:36:23.060838 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2109/4296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:22 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:23.280747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:23.281413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:23.297508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.297964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.302831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.305843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.618829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:23.632051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:23.639302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-77d08ce2-1e56-4524-8bec-2349f867ca35 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.692590 Jul 18 02:36:23.646482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2188/4297] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:22 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:23.669590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:23.670528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:23.676357 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1c3a66e-b7a1-46f1-a813-8762a2143754 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.398836 Jul 18 02:36:23.687880 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2110/4298] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:23 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:23.696591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:23.699068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Failed to fetch instance by id -1 {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:36:23.701933 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance -1 could not be found. Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance -1 could not be found. Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '-1'} Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:23.713481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:23.723225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:23.723225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:23.723225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 18 02:36:23.723225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:23.724037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.724037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.724037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.724037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.724997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:23.724997 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef8a5e40-464b-47b6-81e5-111640468d72 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.038889 Jul 18 02:36:23.724997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2111/4299] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:36:23 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:23.777516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:23.783109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:23.817098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.818078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:23.819560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:23.820672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.102895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:24.136702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:24.146297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:24.155675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e335b60-b0ad-47b1-9b0d-7e352a49605c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.504321 Jul 18 02:36:24.157560 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2189/4300] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:23 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:24.211943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:24.218537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:24.237420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.238873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.240670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.241823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.421996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:24.445962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a367a6c-7d79-4479-969c-f40019ffdc14 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.708419 Jul 18 02:36:24.446872 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2112/4301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:23 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:24.466763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:24.467653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:24.479153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.481086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.482756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.483645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:24.918624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:24.934798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-747ee58c-2129-4d60-bdba-66fb25414d58 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.472106 Jul 18 02:36:24.935504 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2113/4302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:24 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:24.944024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d170046b-6c02-4f3d-98b7-136b04c525a2 req-c2e82289-f326-4379-93bb-0dcd31ea3a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cdff8f-32b1-42c2-8484-262818ce5856"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:24.968413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d170046b-6c02-4f3d-98b7-136b04c525a2 req-c2e82289-f326-4379-93bb-0dcd31ea3a8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:24.969255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d170046b-6c02-4f3d-98b7-136b04c525a2 req-c2e82289-f326-4379-93bb-0dcd31ea3a8d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.016561 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d170046b-6c02-4f3d-98b7-136b04c525a2 req-c2e82289-f326-4379-93bb-0dcd31ea3a8d service nova] Creating event network-vif-plugged:d7cdff8f-32b1-42c2-8484-262818ce5856 for instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f on n-h1-849796-1 Jul 18 02:36:25.046980 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d170046b-6c02-4f3d-98b7-136b04c525a2 req-c2e82289-f326-4379-93bb-0dcd31ea3a8d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089498 Jul 18 02:36:25.048219 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2114/4303] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:25.079727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:25.101141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:25.111867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.117580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.126108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.133506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.176222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.198360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed08c11b-4874-4387-8d01-8fb85d250949 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 1.014124 Jul 18 02:36:25.211912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2190/4304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:24 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:25.231224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:25.248410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: e4edc0e8-b70e-41cd-993a-bcde0d0b3e40] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:25.301820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/e4edc0e8-b70e-41cd-993a-bcde0d0b3e40/action HTTP/1.1 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 19 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: {"forceDelete": {}} Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e4edc0e8-b70e-41cd-993a-bcde0d0b3e40', 'body': {'forceDelete': {}}} Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:25.317382 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:25.321071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:25.321071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:25.321071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. Jul 18 02:36:25.321071 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:25.321071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance e4edc0e8-b70e-41cd-993a-bcde0d0b3e40 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:25.329473 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb695e21-fff9-4f0a-872d-425a5b401035 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/e4edc0e8-b70e-41cd-993a-bcde0d0b3e40/action" status: 404 len: 111 microversion: 2.1 time: 0.102642 Jul 18 02:36:25.332023 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2191/4305] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:25 2022] POST /compute/v2.1/servers/e4edc0e8-b70e-41cd-993a-bcde0d0b3e40/action => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:25.346742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:25.348485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:25.366299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.367873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.370582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.371780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.723905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.740414 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ea03db9-6e13-4e01-9b09-cfa3ca894785 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1318 microversion: 2.1 time: 0.690300 Jul 18 02:36:25.741040 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2115/4306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:25 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:25.755813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:25.756440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:25.763267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.763992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.764989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:25.765584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:25.794122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.811613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.813652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:25.819683 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-765c6c65-96db-4270-9c7a-8e838bba2a99 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.485124 Jul 18 02:36:25.820767 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2192/4307] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:25 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:25.980038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:26.032963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a32393d7-2d32-4e35-a84e-72e483959377 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.281465 Jul 18 02:36:26.045465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2116/4308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:25 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:26.086348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:26.088478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:26.101333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.104571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.106768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.107971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.233475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:26.237913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:26.266425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.268334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.274262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.278915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.539532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:26.565070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbc6ad80-6f87-4505-a7f3-68235a0d98c0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.488416 Jul 18 02:36:26.576043 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2193/4309] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:26 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:26.826754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:26.849915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56d75159-9601-48b5-a0ab-892f1d23b14f tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1317 microversion: 2.1 time: 0.624551 Jul 18 02:36:26.853963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2117/4310] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:26 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:26.868105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:26.871811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: cc6529f8-b63d-471c-84ca-0ee5ecf0af96] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:26.886628 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/cc6529f8-b63d-471c-84ca-0ee5ecf0af96/action HTTP/1.1 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 39 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: {"os-getConsoleOutput": {"length": 10}} Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cc6529f8-b63d-471c-84ca-0ee5ecf0af96', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:26.897643 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. Jul 18 02:36:26.901611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:26.904227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance cc6529f8-b63d-471c-84ca-0ee5ecf0af96 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:26.906082 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fef9566d-206f-43f5-b316-ced8399c2961 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/cc6529f8-b63d-471c-84ca-0ee5ecf0af96/action" status: 404 len: 111 microversion: 2.1 time: 0.049944 Jul 18 02:36:26.911301 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2118/4311] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:26 2022] POST /compute/v2.1/servers/cc6529f8-b63d-471c-84ca-0ee5ecf0af96/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:26.918880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:26.920981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:26.941162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.943405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:26.946750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:26.948461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.190060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.205679 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-47183a9e-0cfc-4521-b266-11ec76c2ae8b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1509 microversion: 2.1 time: 0.292779 Jul 18 02:36:27.207232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2119/4312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:26 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:27.223460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:27.225842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:27.240097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.244321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.245484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.246081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.376231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.393558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.399741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.401408 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a23a51f6-b581-4035-807b-b10aa77e52eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.192528 Jul 18 02:36:27.414580 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2120/4313] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:27 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:27.420213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:27.421275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:27.427408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-128007537", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:27.429538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.430262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.431240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.431843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.657146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:27.687650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.697887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43ab5e3e-03bc-487e-9dc6-f6add1499150 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.281851 Jul 18 02:36:27.699156 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2121/4314] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:27 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:27.717752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:27.718905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:27.727819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.728630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.730893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:27.731570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:27.951577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:27.975110 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e7da4c09-d12d-4661-bda5-7616154e3880 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1509 microversion: 2.1 time: 0.260843 Jul 18 02:36:27.977080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2122/4315] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:27 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:27.998413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:28.000903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:28.016458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:28.018059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:28.020818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:28.023253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:28.575521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:28.593213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-759fcac4-1c16-4f2d-b188-0a3af5dd2224 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.614119 Jul 18 02:36:28.593920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2123/4316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:27 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:28.621466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:28.623292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:28.643055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:28.643866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:28.648244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:28.648821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:28.701610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:28.983231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:28.983979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:28.984133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:28.984694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:28.985241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:29.011030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.011720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.012849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.013793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.056268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:29.066805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:29.083580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:29.084744 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13e8af21-ed05-452a-b33d-12f774f7b055 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1506 microversion: 2.1 time: 0.476666 Jul 18 02:36:29.085935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2124/4317] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:28 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:29.100835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:29.102704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.122330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.123053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.124074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.124696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.140506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:29.144453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:29.244532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a80dfee-4f02-4a3d-a23b-1459120d17f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.663429 Jul 18 02:36:29.249150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2194/4318] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:36:29.311533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:29.312765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.362911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.363923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.365416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.366230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.384534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:29.393150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:29.395436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:29.396796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:29.407660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:29.608336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.618192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.619143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.621563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.622450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.661242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-814cbfbc-7048-41da-8e89-9c7e27bcf2ef tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "POST /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44/action" status: 202 len: 1111 microversion: 2.1 time: 0.572233 Jul 18 02:36:29.674245 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2125/4319] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:29 2022] POST /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44/action => generated 1111 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:36:29.681480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:29.682748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 43ce0245-7425-43fd-9b49-9eb36576dfee] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.691972 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/43ce0245-7425-43fd-9b49-9eb36576dfee HTTP/1.1 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '43ce0245-7425-43fd-9b49-9eb36576dfee'} Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:29.697680 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:29.701871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:29.701871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:29.701871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:29.701871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. Jul 18 02:36:29.701871 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:29.704067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 43ce0245-7425-43fd-9b49-9eb36576dfee could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:29.705505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c1b19c78-ccf5-4964-b094-8d73a0c1ff5b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/43ce0245-7425-43fd-9b49-9eb36576dfee" status: 404 len: 111 microversion: 2.1 time: 0.028972 Jul 18 02:36:29.708350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2126/4320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:29 2022] GET /compute/v2.1/servers/43ce0245-7425-43fd-9b49-9eb36576dfee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:29.717020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:29.718646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:29.729146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.730018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:29.731070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:29.731700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.223007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.274723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.291224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.293871 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e53e504a-d8ce-4e38-8e71-37a9419c6a3c tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 1.042387 Jul 18 02:36:30.294933 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2195/4321] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:29 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:30.318695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.324291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:30.325315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:30.342187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.343199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.344257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.344902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.347513 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7de1bf09-0b8e-4c9b-bf0f-2f56cfebf8a3 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1317 microversion: 2.1 time: 0.634762 Jul 18 02:36:30.351527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2127/4322] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:29 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:30.374838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:30.376028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:30.435444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.437935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.443298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.443958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.484291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.493844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49aa04a3-af29-4111-ae7e-18315adfdd07 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1188 microversion: 2.1 time: 0.197412 Jul 18 02:36:30.494597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2196/4323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:30 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1188 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:30.502022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:30.503529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:30.511327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.512069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.513111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.513756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.765649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.782303 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65a0e60b-a726-4e79-8e03-763bf0569ce7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.284152 Jul 18 02:36:30.801156 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2197/4324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:30 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:30.808467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:30.809610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:30.817601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.818469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.819798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:30.820512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:30.875494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:30.890064 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70c146ea-705e-4f10-99e2-ed08f4507a00 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.536876 Jul 18 02:36:30.890757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2128/4325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:30 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:31.059983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.073712 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98250819-54a1-4686-81ad-4e630e1b10ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.270626 Jul 18 02:36:31.080189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2198/4326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:30 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:31.326126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:31.327097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:31.341052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.341528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.342346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.342797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.368765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:31.370564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:31.400444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.402943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.406475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.408284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.528149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.557165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.559493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.561431 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36830190-57ec-4b38-a4be-e7e6f2aecfd1 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.240591 Jul 18 02:36:31.565682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2129/4327] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:31 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:31.583838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b48b26f-efc7-4be4-8a91-db7fd2c6311b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763265809", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b48b26f-efc7-4be4-8a91-db7fd2c6311b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 238 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763265809", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1763265809', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:36:31.587878 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 18 02:36:31.592397 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:31.595568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b48b26f-efc7-4be4-8a91-db7fd2c6311b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:31.600829 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b48b26f-efc7-4be4-8a91-db7fd2c6311b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020939 Jul 18 02:36:31.607732 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2130/4328] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:31.621227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:31.623526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:31.644959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:31.654934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.655442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.656306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.659803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.814996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.843755 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4050efd2-1c3c-417f-9790-1c653c5c2da4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1250 microversion: 2.1 time: 0.232554 Jul 18 02:36:31.850093 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2131/4329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:31 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1250 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:31.873619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:31.882011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:31.910937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.912985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.913182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.919295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.123867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:32.147082 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2010a9d-6651-441e-82a1-79c77c3d72ab tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1317 microversion: 2.1 time: 0.784292 Jul 18 02:36:32.149291 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2199/4330] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:31 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:32.162677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0c756c33-194a-4860-a61d-b6178bcdf282 req-d23a4f97-814f-4626-b297-0503da571658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aceb0f-346a-4759-b451-deecfe4c15f8", "name": "network-vif-plugged", "status": "completed", "tag": "8af1f819-460e-4dea-95a3-2765c8c305fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:32.183030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0c756c33-194a-4860-a61d-b6178bcdf282 req-d23a4f97-814f-4626-b297-0503da571658 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.184342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0c756c33-194a-4860-a61d-b6178bcdf282 req-d23a4f97-814f-4626-b297-0503da571658 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.215458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:32.218359 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0c756c33-194a-4860-a61d-b6178bcdf282 req-d23a4f97-814f-4626-b297-0503da571658 service nova] Creating event network-vif-plugged:8af1f819-460e-4dea-95a3-2765c8c305fd for instance 85aceb0f-346a-4759-b451-deecfe4c15f8 on n-h2-849796-1 Jul 18 02:36:32.224176 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b82caf6-0ab9-4b25-b9c0-ccab38959bbe tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.372415 Jul 18 02:36:32.224784 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2132/4331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:31 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:32.232183 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0c756c33-194a-4860-a61d-b6178bcdf282 req-d23a4f97-814f-4626-b297-0503da571658 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080410 Jul 18 02:36:32.234435 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2200/4332] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:32.234779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:32.239719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:32.262692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:32.266221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:32.278782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.282746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.283887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.286774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.293287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.293612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.295116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.295590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.592144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:32.610563 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa9a597f-a4c9-4402-9b73-4d33b7713a5d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.383993 Jul 18 02:36:32.611998 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2133/4333] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:32 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:32.626840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:32.629179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:32.651895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.652997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.656916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.658176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.056204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.091062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ddedaf4a-9fac-47bf-bb80-8de4ca803677 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.832454 Jul 18 02:36:33.097865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2201/4334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:32 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:33.116122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:33.121589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:33.139390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.141671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.152555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.165036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.290439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:33.397436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.410648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.412368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.420783 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8011d2f9-0565-481e-8747-094df5f4a6da tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.805399 Jul 18 02:36:33.421440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2134/4335] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:32 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:33.435261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:33.436116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:33.446267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.451363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.461285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.463502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.466282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.476705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13a5accf-61c8-42cb-acb7-cf2be81a2022 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1250 microversion: 2.1 time: 0.373378 Jul 18 02:36:33.483080 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2202/4336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:33 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1250 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:33.497976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fad4f31a-f2d1-48b9-a4b3-cbef9b8b5867 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-62923744", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fad4f31a-f2d1-48b9-a4b3-cbef9b8b5867 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 233 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-62923744", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-62923744', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:33.536141 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fad4f31a-f2d1-48b9-a4b3-cbef9b8b5867 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fad4f31a-f2d1-48b9-a4b3-cbef9b8b5867 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.053085 Jul 18 02:36:33.543515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2203/4337] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:33 2022] POST /compute/v2.1/servers => generated 133 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:33.557718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:33.557718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:33.579161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.579680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.583565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.583565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.897345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.920030 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7fe442c-107d-4a8f-a912-59638e9c4401 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.372988 Jul 18 02:36:33.933409 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2204/4338] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:33 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:33.969015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:33.970185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.011752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.013001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.013985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.018188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.028282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.042139 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-739ee480-d06d-43e3-a397-d580306c4896 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1317 microversion: 2.1 time: 0.617577 Jul 18 02:36:34.054381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2135/4339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:33 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:34.060266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:34.070285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.102523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.103931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.111466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.112459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.421816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.455165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fee70f36-8af2-4a31-842c-a8068ee615f3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.514929 Jul 18 02:36:34.456306 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2205/4340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:33 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:34.473873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:34.474513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.496109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.496906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.500815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.501543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.544980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.557026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ba52ca9-9383-411c-9c57-f54809e1715d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.504136 Jul 18 02:36:34.564740 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2136/4341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:34 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:34.577566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:34.593643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.603560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.604014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.609503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.618514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.694897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.712442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.726521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.727810 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b98aadfa-1f84-4bcf-824b-02579bb33233 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1366 microversion: 2.57 time: 0.262777 Jul 18 02:36:34.728626 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2206/4342] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:34 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:34.734816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:34.735618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: c000d943-1d13-4dcd-b435-81f9b5afe69b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.750880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/c000d943-1d13-4dcd-b435-81f9b5afe69b/action HTTP/1.1 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 13 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: {"pause": {}} Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'c000d943-1d13-4dcd-b435-81f9b5afe69b', 'body': {'pause': {}}} Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:34.769616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:34.777465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:34.777465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:34.777465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. Jul 18 02:36:34.777465 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:34.779595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance c000d943-1d13-4dcd-b435-81f9b5afe69b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:34.781536 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b60cd7d-1ed2-474f-b015-5d11cc05e866 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/c000d943-1d13-4dcd-b435-81f9b5afe69b/action" status: 404 len: 111 microversion: 2.1 time: 0.051311 Jul 18 02:36:34.783216 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2207/4343] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:34 2022] POST /compute/v2.1/servers/c000d943-1d13-4dcd-b435-81f9b5afe69b/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:34.795826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:34.796962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.810805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.812208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.815093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.816685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.063266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:35.091583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3de598b-d0bc-4487-8be3-1436008741d5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.523762 Jul 18 02:36:35.092367 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2137/4344] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:34 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:35.102251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:35.104808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:35.120806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.121564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.122549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.125382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.153305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:35.168089 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-169bf4be-7ca9-434f-971b-fe2e497d8759 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.377785 Jul 18 02:36:35.170155 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2208/4345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:34 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:35.210208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:35.211772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:35.222587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.223136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.224026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.224525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.514900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:35.540561 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59cda132-61f1-48d4-859a-12d24fcf3a79 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1505 microversion: 2.1 time: 0.446327 Jul 18 02:36:35.547012 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2138/4346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:35 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:35.554454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:35.555412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:35.573515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.574310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.576049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.576999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.694396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:35.705017 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ba1256b-5365-4594-b076-46a7b8c05e4a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.501421 Jul 18 02:36:35.706238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2209/4347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:35 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:35.726990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:35.727871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:35.740205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.741183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.743076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.743876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.800635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:36.136974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df2109be-cf72-4a1e-a4ad-705c658f4c00 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "DELETE /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 204 len: 0 microversion: 2.1 time: 0.429050 Jul 18 02:36:36.138581 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2210/4348] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:35 2022] DELETE /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:36:36.148633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:36.149377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.159909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.160568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.161734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.162200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.356848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ccb0e329-bfa7-4f5b-8fa8-4b905dea352b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.215447 Jul 18 02:36:36.357725 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2211/4349] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:36 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:36:36.375329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:36.385848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:36.390481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.394180 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e20581a-11cb-4c7c-92ac-6f8923495327 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.845204 Jul 18 02:36:36.394924 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2139/4350] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:35 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:36.403571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:36.404515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.421258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.426957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.427185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.430944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.436978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.436978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.438142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.438300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.567116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:36.583735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:36.587457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:36.590112 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a597c2a-ab5d-42b0-9a44-a6881ff7ad41 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1384 microversion: 2.57 time: 0.231261 Jul 18 02:36:36.597894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2212/4351] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:36 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1384 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:36.605477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:36.606556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.631974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.632441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.633374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.633823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.683113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:36.883592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:36.912688 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-887ddac4-cc9c-4f68-b892-9f6cc4e9fa71 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 204 len: 0 microversion: 2.1 time: 0.313094 Jul 18 02:36:36.914307 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2213/4352] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:36 2022] DELETE /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:36:36.921926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:36.922930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.932653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.933314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.934211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.934673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.220084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.230509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef6b9b10-4d59-497d-9a86-beea9748f296 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.832666 Jul 18 02:36:37.231116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2140/4353] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:36 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:37.235855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3154bb9b-5410-40bc-a9f6-f3325d7c4b47 req-19112693-6646-48f1-ac7e-793f26c40e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b021fb3d-5d60-440b-9107-4c0324118543", "tag": "5c8cfdf3-6093-41bd-ab8d-db98d662edcd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:37.239811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.247244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3154bb9b-5410-40bc-a9f6-f3325d7c4b47 req-19112693-6646-48f1-ac7e-793f26c40e00 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.247950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3154bb9b-5410-40bc-a9f6-f3325d7c4b47 req-19112693-6646-48f1-ac7e-793f26c40e00 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.252887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-182206e5-dee6-4986-b45d-91dc653e4e19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1510 microversion: 2.1 time: 0.336807 Jul 18 02:36:37.256988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2214/4354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:36 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:37.271276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:37.271926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:37.285907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.286729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.287410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.287875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.288527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:37.339059 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3154bb9b-5410-40bc-a9f6-f3325d7c4b47 req-19112693-6646-48f1-ac7e-793f26c40e00 service nova] Creating event network-changed:5c8cfdf3-6093-41bd-ab8d-db98d662edcd for instance b021fb3d-5d60-440b-9107-4c0324118543 on n-h1-849796-1 Jul 18 02:36:37.354601 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3154bb9b-5410-40bc-a9f6-f3325d7c4b47 req-19112693-6646-48f1-ac7e-793f26c40e00 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121023 Jul 18 02:36:37.356743 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2141/4355] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:37.422614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:37.423421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:37.438924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.439940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.441304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.441902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.675724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.685625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fdd74dee-83fd-4e23-a00e-6d228438a523 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1511 microversion: 2.1 time: 0.429992 Jul 18 02:36:37.689688 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2215/4356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:37 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:37.709797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:37.710441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:37.724221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.724702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.725574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.726037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.818825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.847920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.848802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4587864-995f-4c42-88ec-b66c0fe0d9fd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.429985 Jul 18 02:36:37.850840 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2142/4357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:37 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:37.855211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:37.866763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.868847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.870447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce5b2bd9-a306-4b9b-a4f6-293955878367 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1372 microversion: 2.57 time: 0.178182 Jul 18 02:36:37.871238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2216/4358] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:37 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:38.251410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:38.253355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:38.267974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.270993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.272372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.280106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:38.281441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.283277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:38.324113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.329443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.332349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.335131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.601287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:38.634023 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-afcc1ef6-4f67-4240-8839-de20ddccbfca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.380014 Jul 18 02:36:38.634716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2143/4359] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:38 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:38.709385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:38.711163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:38.723748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.730232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.734217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.734685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.027413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:39.050518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.081670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.091573 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5d4fef9-09ab-477b-8446-262e18e1d288 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1511 microversion: 2.1 time: 0.387914 Jul 18 02:36:39.093274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2144/4360] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:38 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:39.095406 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b64ccc3-68e1-44bb-8de1-e8814e00ce36 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1490 microversion: 2.1 time: 0.823883 Jul 18 02:36:39.099643 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2217/4361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:38 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1490 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:39.100529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:39.102377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.110105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.110875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.112570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.113560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.140998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:39.148498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.158904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:39.197629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.215571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.216640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.220031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.390999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.404488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.407842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.413622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcb1d4de-8fc8-480f-8790-dd1584b99c02 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1372 microversion: 2.57 time: 0.290307 Jul 18 02:36:39.417405 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2218/4362] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:39 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:39.428742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:39.430617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.438025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.447884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.448768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.452960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.454217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-172b164c-ffec-44a0-ba09-a6e3b10331bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.358054 Jul 18 02:36:39.456361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.470750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2145/4363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:39 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:39.492288 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'pause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state paused Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 13 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: {"pause": {}} Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'pause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state paused Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'pause': {}}} Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state paused. Cannot pause while the instance is in this state. Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state paused Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:39.496235 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:39.500795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:39.500795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:39.500795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:39.500795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state paused Jul 18 02:36:39.500795 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:39.503901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'pause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state paused {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:39.505730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8162e80b-19ff-4ff4-877e-04d5ae3b2131 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 143 microversion: 2.1 time: 0.086722 Jul 18 02:36:39.506513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2219/4364] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:39 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 143 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:39.523483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:39.523483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.532977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.534681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.535858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.536312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.633983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4fbaf6b2-48fa-4c4f-bc36-1020a67e0640 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.119572 Jul 18 02:36:39.635211 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2146/4365] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:39 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:36:39.648820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:39.650124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.669015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:39.671764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.674245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.676207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.677862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.678970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.699230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.700185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.701875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.703458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.029015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.046736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ce6ad3a-26bb-4e96-937b-3a18871f91a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.389734 Jul 18 02:36:40.049303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2147/4366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:39 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:40.123092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:40.123731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:40.132632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.133568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.134063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.134536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.239669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.248694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b299422-ce70-47e0-b83a-d01c81b72278 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1469 microversion: 2.1 time: 0.131298 Jul 18 02:36:40.259508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2148/4367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:40 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1469 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:40.457935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:40.461629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:40.479478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.480241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.481845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.482654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.608308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.637976 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe8b2f01-c8da-443e-967c-dae383437ac4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1497 microversion: 2.1 time: 0.988810 Jul 18 02:36:40.639465 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2220/4368] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:39 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1497 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:40.660028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:40.661154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:40.688690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.689891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.691614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.698051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.799001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.838766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.842402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.844687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfb8de1c-0733-471b-93d6-d4cd58d00b13 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1372 microversion: 2.57 time: 0.402949 Jul 18 02:36:40.856977 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2149/4369] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:40 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:40.866887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-793f2d97-0051-48c8-aee5-05cecbe1f5a6 req-66cc1633-b190-48cc-a498-55fbf98c9261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aceb0f-346a-4759-b451-deecfe4c15f8", "name": "network-vif-deleted", "tag": "8af1f819-460e-4dea-95a3-2765c8c305fd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:40.900666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-793f2d97-0051-48c8-aee5-05cecbe1f5a6 req-66cc1633-b190-48cc-a498-55fbf98c9261 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.901438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-793f2d97-0051-48c8-aee5-05cecbe1f5a6 req-66cc1633-b190-48cc-a498-55fbf98c9261 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.942097 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-793f2d97-0051-48c8-aee5-05cecbe1f5a6 req-66cc1633-b190-48cc-a498-55fbf98c9261 service nova] Creating event network-vif-deleted:8af1f819-460e-4dea-95a3-2765c8c305fd for instance 85aceb0f-346a-4759-b451-deecfe4c15f8 on n-h2-849796-1 Jul 18 02:36:40.953691 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-793f2d97-0051-48c8-aee5-05cecbe1f5a6 req-66cc1633-b190-48cc-a498-55fbf98c9261 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093977 Jul 18 02:36:40.955591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2150/4370] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:41.074746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:41.078247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:41.092231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.093026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.093994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.095146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.187645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:41.208687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45d488b3-7bda-4d6e-b870-38ad2e58ef2a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.562809 Jul 18 02:36:41.221006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2221/4371] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:40 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:41.272994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:41.276630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:41.297722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.298979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.302839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.303786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.373350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.378856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.381807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lazy-loading 'fault' on Instance uuid 85aceb0f-346a-4759-b451-deecfe4c15f8 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:41.505944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:41.524341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b11c16b6-d8aa-4117-abf6-1c642ead11bc tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 200 len: 1307 microversion: 2.1 time: 0.260255 Jul 18 02:36:41.526331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2222/4372] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:41 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 1307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:41.577175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:41.591113 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c829ecf-b51d-4c2a-ad66-fbed1a15440c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.527853 Jul 18 02:36:41.592381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2151/4373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:41 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:41.666855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:41.667984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:41.687667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.688837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.691170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.693655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.877108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:41.877936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:41.887725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.888197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.889060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.889521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.048489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.063750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.066743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.068111 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78aa09ae-fcdd-47bd-872e-4902ac28cd36 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1372 microversion: 2.57 time: 0.195043 Jul 18 02:36:42.069062 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2152/4374] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:41 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:42.117940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.128254 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2623c83-24bb-46f1-9464-f5c51687dfc7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.466950 Jul 18 02:36:42.129290 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2223/4375] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:41 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:42.148032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.148657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.158030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.160093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.166445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.166445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.241700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.242345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.249863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.250552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.251916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.252616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.435872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.445301 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ee38d66-b9da-4908-9105-e41075146b4b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.301834 Jul 18 02:36:42.446282 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2153/4376] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:42.453600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-912350ee-f211-4ddf-a991-caf5bf21cbcd req-9b91d5fc-acc1-4e2e-a0b7-f15bb85a6141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f", "name": "network-vif-deleted", "tag": "d7cdff8f-32b1-42c2-8484-262818ce5856"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:42.466622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-912350ee-f211-4ddf-a991-caf5bf21cbcd req-9b91d5fc-acc1-4e2e-a0b7-f15bb85a6141 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.467467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-912350ee-f211-4ddf-a991-caf5bf21cbcd req-9b91d5fc-acc1-4e2e-a0b7-f15bb85a6141 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.486346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-912350ee-f211-4ddf-a991-caf5bf21cbcd req-9b91d5fc-acc1-4e2e-a0b7-f15bb85a6141 service nova] Creating event network-vif-deleted:d7cdff8f-32b1-42c2-8484-262818ce5856 for instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f on n-h1-849796-1 Jul 18 02:36:42.492973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-912350ee-f211-4ddf-a991-caf5bf21cbcd req-9b91d5fc-acc1-4e2e-a0b7-f15bb85a6141 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044154 Jul 18 02:36:42.493776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2154/4377] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:42.501441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:42.503099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.510706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.511177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.511977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.512421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.528596 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action HTTP/1.1 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 28 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: {"reboot": {"type": "SOFT"}} Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '10674860-cbe9-4c9b-930d-3d2d4f3ecaed', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:42.530768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e1cfb6a-e727-4e77-a0ea-1a6b7fd5b85b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action" status: 404 len: 111 microversion: 2.1 time: 0.036477 Jul 18 02:36:42.541705 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2155/4378] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:42 2022] POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:42.545136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.545802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.554027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.554494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.555307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.555765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.772255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.789502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0befe56-7b8a-44d0-bc0a-40ec9a76ed5e tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.554598 Jul 18 02:36:42.790635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.791136 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2224/4379] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:42.817953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.819430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: 85aceb0f-346a-4759-b451-deecfe4c15f8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.822373 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fd8d3cc-d2e9-45ce-b844-a4ed6f71de30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.281152 Jul 18 02:36:42.833624 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2156/4380] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:42.833624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.833624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.841866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.842114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.842907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.843351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.844302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.845072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.845416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.846221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.872053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] HTTP exception thrown: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Request method failure captured: Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 HTTP/1.1 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mbd5io5-OgOlCAhUwZ7fDHn_Ruy5PHD37fAx53Mto0OGrjP3gANcLdw_SGNKuXs11zxQjyOMe5UCJWFiCjTdm4ZjHi1XOiv9h_OlpAOB0GAM5p5Nd3Ew0mvgsjZMjKlPI8H9LcQSc-60wVUL8CZLqJqpdHBcsYc_tf3cJhdvJmWf3A Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 43bd08714ba44756824cce3a19c7ffa9 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 43bd08714ba44756824cce3a19c7ffa9 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MultipleCreateTestJSON-1001753795-project Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: f9e9a96aca244212b403d989adea9029 Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MultipleCreateTestJSON-1001753795-project Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '85aceb0f-346a-4759-b451-deecfe4c15f8'} Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:42.873704 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Returning 404 to user: Instance 85aceb0f-346a-4759-b451-deecfe4c15f8 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c697860-51f5-47ea-90d7-4df25e911c67 tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8" status: 404 len: 111 microversion: 2.1 time: 0.082613 Jul 18 02:36:42.885777 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2225/4381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/85aceb0f-346a-4759-b451-deecfe4c15f8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:42.887948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:42.888564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:42.897397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.897852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.898951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:42.899588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.092750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.102585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f192595-6f0e-4df3-8cb6-efe12d6bbf56 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.276978 Jul 18 02:36:43.118308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2157/4382] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:43.123477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.124116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.132350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.132805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.133825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.134267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.227333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.236666 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-847ad769-a898-421f-91f3-0b17fd8be1ed tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1470 microversion: 2.1 time: 0.131974 Jul 18 02:36:43.238372 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2158/4383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1470 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:43.246405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.247359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.270443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.272518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.275767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.276210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.302310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:43.317172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.342274 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee894246-fa18-473b-b35d-6e85191e623c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.459260 Jul 18 02:36:43.343247 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2226/4384] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:42 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:43.362711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:43.364826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 794dee10-0d66-4003-916d-706064e50b41] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.371737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/794dee10-0d66-4003-916d-706064e50b41/action HTTP/1.1 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 28 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: {"reboot": {"type": "SOFT"}} Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '794dee10-0d66-4003-916d-706064e50b41', 'body': {'reboot': {'type': 'SOFT'}}} Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. Jul 18 02:36:43.373788 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. Jul 18 02:36:43.379227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:43.381045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 794dee10-0d66-4003-916d-706064e50b41 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:43.382163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae346cd2-5872-43be-8c2f-567e46c440f2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/794dee10-0d66-4003-916d-706064e50b41/action" status: 404 len: 111 microversion: 2.1 time: 0.024364 Jul 18 02:36:43.386577 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2227/4385] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:43 2022] POST /compute/v2.1/servers/794dee10-0d66-4003-916d-706064e50b41/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:43.391096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.393672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.395464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.404583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.405364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.406372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.407238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.410986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.414214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.416507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e951fca2-9741-425e-a744-4148b23d8710 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1372 microversion: 2.57 time: 0.176561 Jul 18 02:36:43.429604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2159/4386] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:43.770301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.783427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aba1c7c9-a313-485b-b1c9-83db092c5b8b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.395281 Jul 18 02:36:43.785287 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2228/4387] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:43.807168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.808278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.826179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.827716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.838733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.840743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.841559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.842934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.844371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.844834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.845425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.845599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.151723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:44.184093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1b3da62f-361b-4775-8bb2-3d944eb7ecdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.385424 Jul 18 02:36:44.187183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2160/4388] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:44.211338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:44.213242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:44.254362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.257612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.258969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.263037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.692342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:44.718079 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2420d57-a3f5-4ad9-9464-02872ef98692 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.900357 Jul 18 02:36:44.722770 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2229/4389] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:44.751465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:44.755909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:44.779308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.781939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.785962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.787248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.810708 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action HTTP/1.1 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 65 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '10674860-cbe9-4c9b-930d-3d2d4f3ecaed', 'body': {'rebuild': {'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef'}}} Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 02:36:44.813070 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:36:44.818011 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:44.820258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:44.821358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5874879d-b0f1-4b4c-8842-b425b3d8a74b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action" status: 404 len: 111 microversion: 2.1 time: 0.091739 Jul 18 02:36:44.825161 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2230/4390] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:44 2022] POST /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:44.835505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:44.836152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:44.845119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.847189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.848606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.849356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.917010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.918218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.919028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lazy-loading 'fault' on Instance uuid bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:44.930184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:44.943724 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aaa60914-9b1c-47e3-9f57-0613e12be4fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.753749 Jul 18 02:36:44.945001 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2161/4391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:44 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:44.950340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:44.951303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:44.959488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.960210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.961270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.961889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.079732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e9a96aca244212b403d989adea9029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bd08714ba44756824cce3a19c7ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.100602 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4473716a-4fe7-4a73-b15e-1152fb17301b tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 200 len: 1307 microversion: 2.1 time: 0.274900 Jul 18 02:36:45.122218 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2231/4392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:44 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:45.138115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.141290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:45.164627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.167973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.171228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.173293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.231946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.279069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.282296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.289304 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af0662f6-dc05-468b-af31-2377ea6d5373 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1357 microversion: 2.57 time: 0.342465 Jul 18 02:36:45.290425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2162/4393] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:44 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:45.333579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.334387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:45.345704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.347562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.349339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.350489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.411836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:45.559146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.575561 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28ef5694-61cb-43ea-8a00-2ecae36c2d47 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.450604 Jul 18 02:36:45.576547 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2232/4394] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:45 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:45.605061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.606430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:45.620878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.621908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.623368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.624414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.676691 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56cfa1b3-26ae-4a3c-9a57-77b279f02b9e tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "DELETE /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 204 len: 0 microversion: 2.57 time: 0.353537 Jul 18 02:36:45.684209 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2163/4395] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:36:45 2022] DELETE /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:36:45.699790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.703609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:45.712305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.714218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.715231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.715879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.910966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.945368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.949513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.956037 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e912192e-0517-4871-9722-a26622abf8ab tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1363 microversion: 2.57 time: 0.267215 Jul 18 02:36:45.968521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2164/4396] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:45 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:45.977210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.979396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.000446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.003116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.006521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.007831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.063598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:46.082309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8436b2b-b286-4b14-a0b4-e3516dd14e11 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.483913 Jul 18 02:36:46.083605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2233/4397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:45 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:46.088755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:46.098066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.115058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.115896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.116950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.117623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.415214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:46.425279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f16a12b4-df57-4205-91e0-ba4fa203f3bf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.462318 Jul 18 02:36:46.429372 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2165/4398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:45 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:46.434507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:46.436663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: c6ed5466-05cb-4740-aa8a-60c6b50a7e44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.446290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/c6ed5466-05cb-4740-aa8a-60c6b50a7e44/action HTTP/1.1 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 65 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'c6ed5466-05cb-4740-aa8a-60c6b50a7e44', 'body': {'rebuild': {'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef'}}} Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 18 02:36:46.448158 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance c6ed5466-05cb-4740-aa8a-60c6b50a7e44 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40a60ae5-16e5-417b-80cc-8b4404bc0a05 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/c6ed5466-05cb-4740-aa8a-60c6b50a7e44/action" status: 404 len: 111 microversion: 2.1 time: 0.022249 Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2166/4399] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:46 2022] POST /compute/v2.1/servers/c6ed5466-05cb-4740-aa8a-60c6b50a7e44/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:46.457768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:46.461493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] [instance: bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.465906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.466614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.467575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.468172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.494402 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] HTTP exception thrown: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Request method failure captured: Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f HTTP/1.1 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mbd5io5-OgOlCAhUwZ7fDHn_Ruy5PHD37fAx53Mto0OGrjP3gANcLdw_SGNKuXs11zxQjyOMe5UCJWFiCjTdm4ZjHi1XOiv9h_OlpAOB0GAM5p5Nd3Ew0mvgsjZMjKlPI8H9LcQSc-60wVUL8CZLqJqpdHBcsYc_tf3cJhdvJmWf3A Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 43bd08714ba44756824cce3a19c7ffa9 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43bd08714ba44756824cce3a19c7ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 43bd08714ba44756824cce3a19c7ffa9 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1001753795 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-MultipleCreateTestJSON-1001753795-project Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: f9e9a96aca244212b403d989adea9029 Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-MultipleCreateTestJSON-1001753795-project Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f'} Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:46.499772 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] Returning 404 to user: Instance bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a35ffe7-bfd1-4096-8bc1-aaa8a569ad9a tempest-MultipleCreateTestJSON-1001753795 tempest-MultipleCreateTestJSON-1001753795-project] 10.222.0.67 "GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f" status: 404 len: 111 microversion: 2.1 time: 0.057152 Jul 18 02:36:46.511393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2167/4400] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:46 2022] GET /compute/v2.1/servers/bd5b1ccb-b5d3-43ec-aa90-c1d95df5bc9f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:46.530573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:46.532226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.545997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.547455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.550883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.552331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.707684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:46.725553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb49a4e0-523b-4b7c-81f4-111d4e374e69 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.640153 Jul 18 02:36:46.726574 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2234/4401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:46 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:46.984290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:46.987873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:47.010585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.011411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.012971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.013991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.056466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:47.310074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.355188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.359266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.362217 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6003b3ea-ced1-4b88-828f-51c194f1ffa6 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1363 microversion: 2.57 time: 0.387251 Jul 18 02:36:47.364691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2235/4402] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:46 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:36:47.460367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:47.461048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:47.480346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.480825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.481767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.482225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.586006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.615949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9de465ac-3e6a-437a-ac00-cb9b7b83d88b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.095629 Jul 18 02:36:47.635920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2168/4403] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:46 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:47.650889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:47.651749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:47.660982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.661420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.663434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.664253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.838583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.855125 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d2e622a-21bf-4455-bd69-f878a4a42c13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.406421 Jul 18 02:36:47.866978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2236/4404] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:47 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:47.872286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:47.873195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:47.881774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.882711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.884547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:47.885261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.211601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.222070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c00a41d5-5449-4d43-b0b1-1c592dc7bb59 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.353505 Jul 18 02:36:48.223598 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2237/4405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:47 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:48.396391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:48.397558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:48.404740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.405640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.406862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.408422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.417239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.436944 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf777a62-ef70-41cd-a0e4-2faf183e8b84 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.790980 Jul 18 02:36:48.437927 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2169/4406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:47 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:48.466729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.468323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.472575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lazy-loading 'fault' on Instance uuid 252283ed-e6b4-4c1f-b17a-1cd3c352c88f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:48.477029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:48.480912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: d852c72c-26dc-4689-b5fc-382b13d38822] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:48.552612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/d852c72c-26dc-4689-b5fc-382b13d38822/action HTTP/1.1 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: {"restore": {}} Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd852c72c-26dc-4689-b5fc-382b13d38822', 'body': {'restore': {}}} Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:48.570280 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:48.574586 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:48.574586 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:48.574586 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. Jul 18 02:36:48.574586 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:48.576837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance d852c72c-26dc-4689-b5fc-382b13d38822 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:48.579315 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6461baf9-6123-48bc-b3ea-22545e7c83c5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/d852c72c-26dc-4689-b5fc-382b13d38822/action" status: 404 len: 111 microversion: 2.1 time: 0.113145 Jul 18 02:36:48.583506 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2170/4407] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:48 2022] POST /compute/v2.1/servers/d852c72c-26dc-4689-b5fc-382b13d38822/action => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:36:48.589599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.614821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:48.615677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:48.617951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.629116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3362a377b3e14fe792125394435b9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3614883eef45cab75db3e8c2b07abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.630508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-196eb847-238d-4d72-9209-123159c0e1e0 tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 200 len: 1368 microversion: 2.57 time: 0.239955 Jul 18 02:36:48.631119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2238/4408] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:48 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:36:48.656233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.656997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.657860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.662717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.874357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:48.875231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:48.887585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.892497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.895428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.896218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.139395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:49.149936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-82c8b73b-26eb-47b6-b228-900e8f0b093b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.280340 Jul 18 02:36:49.150712 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2239/4409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:48 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:49.156290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a1724bc5-168e-4834-af7a-0c6f3ac55da5 req-caa84d42-8b7e-4272-b9e9-1b054729fc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b021fb3d-5d60-440b-9107-4c0324118543", "name": "network-vif-plugged", "status": "completed", "tag": "5c8cfdf3-6093-41bd-ab8d-db98d662edcd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:49.176889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a1724bc5-168e-4834-af7a-0c6f3ac55da5 req-caa84d42-8b7e-4272-b9e9-1b054729fc84 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.179075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a1724bc5-168e-4834-af7a-0c6f3ac55da5 req-caa84d42-8b7e-4272-b9e9-1b054729fc84 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.199854 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a1724bc5-168e-4834-af7a-0c6f3ac55da5 req-caa84d42-8b7e-4272-b9e9-1b054729fc84 service nova] Creating event network-vif-plugged:5c8cfdf3-6093-41bd-ab8d-db98d662edcd for instance b021fb3d-5d60-440b-9107-4c0324118543 on n-h1-849796-1 Jul 18 02:36:49.238578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a1724bc5-168e-4834-af7a-0c6f3ac55da5 req-caa84d42-8b7e-4272-b9e9-1b054729fc84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083497 Jul 18 02:36:49.240594 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2240/4410] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:49.271128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:49.273809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:49.299450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.301346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.302435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.303111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.519043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:49.535042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a32896f2-6d59-4704-8fe4-a19c4a34b6dd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.935799 Jul 18 02:36:49.535922 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2171/4411] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:48 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:49.553432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:49.554316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:49.571832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:49.572613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.572761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.573581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.574124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.584365 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae703f1e-4623-4d12-b6ed-8829ee70fd7b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.340667 Jul 18 02:36:49.585283 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2241/4412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:49 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:49.655804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:49.658223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] [instance: 252283ed-e6b4-4c1f-b17a-1cd3c352c88f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:49.671800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.673059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.675325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.676452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.716695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] HTTP exception thrown: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Request method failure captured: Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f HTTP/1.1 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1McG4xQXmhWnMQCyAalOgi_12YHD5fysn8oV8LDpucWidicRWdz4Hdx1dsD_fzaTloAwFEJ0H6hUXnegiy-67rWztjHmLNFv4qBINewlwrg6jfco-jNeeVtzhQUsalXabEPczDj17XPKEkycQfp0QeLJm16V4CC4pEVF-afkOEmHXk8 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.57 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 0d3614883eef45cab75db3e8c2b07abd Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerShowV257Test-385026762 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d3614883eef45cab75db3e8c2b07abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0d3614883eef45cab75db3e8c2b07abd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0d3614883eef45cab75db3e8c2b07abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0d3614883eef45cab75db3e8c2b07abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerShowV257Test-385026762 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 0d3614883eef45cab75db3e8c2b07abd Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerShowV257Test-385026762 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerShowV257Test-385026762-project Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 3362a377b3e14fe792125394435b9d94 Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerShowV257Test-385026762-project Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '252283ed-e6b4-4c1f-b17a-1cd3c352c88f'} Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:49.720366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] Returning 404 to user: Instance 252283ed-e6b4-4c1f-b17a-1cd3c352c88f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-934a634a-7413-4dc9-a825-b96e1624f3eb tempest-ServerShowV257Test-385026762 tempest-ServerShowV257Test-385026762-project] 10.222.0.67 "GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f" status: 404 len: 111 microversion: 2.57 time: 0.075965 Jul 18 02:36:49.734366 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2242/4413] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:36:49 2022] GET /compute/v2.1/servers/252283ed-e6b4-4c1f-b17a-1cd3c352c88f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:50.179784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:50.180472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:50.191210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.191730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.194839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.196649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.313790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:50.338578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b454e9c9-43ed-45e3-99d8-3e9c76be30d3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.789446 Jul 18 02:36:50.345023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2172/4414] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:49 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:50.371287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:50.375028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:50.398225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.400362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.402286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.403488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.498216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'restore' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: {"restore": {}} Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'restore' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'restore': {}}} Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state active. Cannot restore while the instance is in this state. Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:50.504084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:50.516578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:50.516578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:50.516578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:50.516578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:50.516578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:50.521545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'restore' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:50.532790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-024d0c2f-d1ac-40cd-a136-60c3252dacc3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 145 microversion: 2.1 time: 0.168946 Jul 18 02:36:50.536750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2173/4415] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:50 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 145 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:50.554712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:50.556806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:50.575843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.577789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.581459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.583675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.994697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.005531 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b64680e0-100b-4764-aa9a-c9e79093f867 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.832589 Jul 18 02:36:51.012367 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2243/4416] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:50 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:51.026684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:51.027437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.035593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.037192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.039227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.039893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.047395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.061262 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6cb535d2-dd48-45ed-acdb-0620db111a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.517426 Jul 18 02:36:51.067818 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2174/4417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:50 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:51.096225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:51.097712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.130353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.136888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.149307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.151420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.345125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.377031 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25bcf3f7-1fac-4d08-8daa-d72e003567e6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1292 microversion: 2.1 time: 0.361375 Jul 18 02:36:51.378964 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2244/4418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:51 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1292 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:51.782980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.798333 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-76fc683a-1e9b-4242-8bd3-aafe6d732177 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.718586 Jul 18 02:36:51.798923 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2175/4419] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:51 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:51.820095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:51.820989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 65db54bd-a30b-498b-b1fa-d380c1818557] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.827932 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/65db54bd-a30b-498b-b1fa-d380c1818557/action HTTP/1.1 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 14 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: {"resume": {}} Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '65db54bd-a30b-498b-b1fa-d380c1818557', 'body': {'resume': {}}} Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:51.839587 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 65db54bd-a30b-498b-b1fa-d380c1818557 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9698179f-7a8f-49a0-a9b7-6e997c233c89 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/65db54bd-a30b-498b-b1fa-d380c1818557/action" status: 404 len: 111 microversion: 2.1 time: 0.030848 Jul 18 02:36:51.859710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2245/4420] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:51 2022] POST /compute/v2.1/servers/65db54bd-a30b-498b-b1fa-d380c1818557/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:51.864683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:51.865815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.878038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.878764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.880429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.880769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.030795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.031503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.041948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.042666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.043658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.044185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.322123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:52.365108 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efb04c25-7be7-4a26-ab3f-08704680e04a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.509050 Jul 18 02:36:52.368209 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2176/4421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:51 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:52.407277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.411641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.417143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:52.428970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.429812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.431518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.432086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.432793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-361d6038-3517-457d-b493-5aeef42edc71 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.407207 Jul 18 02:36:52.434042 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2246/4422] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:52.456351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.457303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.466308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.467154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.468305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.468944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.500246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:52.725165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:52.747338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4f106d1-0393-415a-ba79-ff9a54135e95 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.299831 Jul 18 02:36:52.749253 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2247/4423] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:52.789178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:52.790945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.812311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.814224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.817423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.819007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.890137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'resume' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 14 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: {"resume": {}} Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'resume' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'resume': {}}} Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state active. Cannot resume while the instance is in this state. Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:52.896233 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'resume' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8af2bbd-d9bf-4578-9aae-f7dacf4ea940 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 144 microversion: 2.1 time: 0.126540 Jul 18 02:36:52.912780 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2248/4424] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:52 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 144 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:36:52.926334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.927887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.941564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.942759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.944507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.945797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:53.009262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:53.019908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1bfc8fa3-36d6-4186-98f1-ee24cf9c86e2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1473 microversion: 2.1 time: 0.625625 Jul 18 02:36:53.020872 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2177/4425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1473 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:53.398846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-528438733", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:53.422582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:53.529362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:53.555623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:53.559212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4ed79be-68b5-4871-ab79-db740fcd860c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.642845 Jul 18 02:36:53.569797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2249/4426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:53.579772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:53.589175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:53.612584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:53.612584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:53.613752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:53.614495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.194376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.208424 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6975b5d4-be20-4948-8d23-5c6cdc258541 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.637057 Jul 18 02:36:54.213760 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2250/4427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:53 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:54.225726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:54.229333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:54.246169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.249968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.251288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.275571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.793643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.823887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-57ca365d-5d1f-46dc-b895-d5f31b7af4ab tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.608231 Jul 18 02:36:54.829162 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2251/4428] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:54 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:55.142926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caafc256-12f4-4c7e-82cf-c3d40eedcd6a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caafc256-12f4-4c7e-82cf-c3d40eedcd6a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 160 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "bc3757aa-50bd-407f-9426-b53b0e6bdb8f"}]}} Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': '', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'networks': [{'uuid': 'bc3757aa-50bd-407f-9426-b53b0e6bdb8f'}]}}} Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '' Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:36:55.155594 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caafc256-12f4-4c7e-82cf-c3d40eedcd6a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:55.164643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-caafc256-12f4-4c7e-82cf-c3d40eedcd6a tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.033733 Jul 18 02:36:55.172430 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2252/4429] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:55 2022] POST /compute/v2.1/servers => generated 108 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:36:55.197986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:55.200325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:55.232012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.232971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.236863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.238058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.764353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:55.790986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9401d85-e999-4353-971b-3c5a48a80728 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.616705 Jul 18 02:36:55.827436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2253/4430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:55 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:55.848421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:55.851108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:55.870801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.871550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.873159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.873628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.238529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:56.240253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:56.240911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:56.241773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:56.242488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:56.274989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.276543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.279669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.280564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.301927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:56.325766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:56.333957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:56.350524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:56.353689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-259db4a9-1ede-493e-997b-582ee0550789 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1516 microversion: 2.1 time: 0.529969 Jul 18 02:36:56.358384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:56.385533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2254/4431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:55 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1516 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:56.400524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:56.411057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:56.432660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.435821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.442056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.442804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.446171 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0303b71d-8f10-4704-ad77-2ff6edd420f9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.053821 Jul 18 02:36:56.451998 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2178/4432] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:36:56.470171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:56.471448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:56.529723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:56.551814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:57.242560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:57.366671 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62706b56-6246-4854-a444-e3ee93996c33 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.979039 Jul 18 02:36:57.367600 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2255/4433] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:56 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:57.409041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:57.410919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.432968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.433660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.439016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.441631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.787755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:57.805157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b03585a-6975-4358-bd1d-7fa9e0d568ed tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.416694 Jul 18 02:36:57.807813 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.scheduler.client.report [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Deleted allocations for instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 Jul 18 02:36:57.815564 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Instance Mapping does not exist while attempting local delete cleanup. Jul 18 02:36:57.816613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c96b70a1-b932-4c28-9e9d-88f2a26025df tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564" status: 204 len: 0 microversion: 2.1 time: 1.359888 Jul 18 02:36:57.817251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2179/4434] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:56 2022] DELETE /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 => generated 0 bytes in 1362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:36:57.820070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2256/4435] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:57 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:57.847243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:57.847815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 31cb17dd-5a77-491c-a060-58c1ded5d63b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.856196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:57.857821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. Jul 18 02:36:57.867219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/31cb17dd-5a77-491c-a060-58c1ded5d63b/action HTTP/1.1 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 14 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: {"shelve": {}} Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '31cb17dd-5a77-491c-a060-58c1ded5d63b', 'body': {'shelve': {}}} Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:57.867687 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 31cb17dd-5a77-491c-a060-58c1ded5d63b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:57.871601 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-945350f3-05d0-4559-89c1-f952b139bad8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/31cb17dd-5a77-491c-a060-58c1ded5d63b/action" status: 404 len: 111 microversion: 2.1 time: 0.050896 Jul 18 02:36:57.872590 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2180/4436] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:57 2022] POST /compute/v2.1/servers/31cb17dd-5a77-491c-a060-58c1ded5d63b/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:57.888397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 HTTP/1.1 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '94c4a28b-b7ed-45df-8dd1-aebd92d0a564'} Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:57.901665 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:57.906302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:57.906302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:57.906302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:36:57.906302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:36:57.906588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:57.906693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:57.907954 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97743968-7452-4e3d-ba66-f0e9ff146a14 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564" status: 404 len: 111 microversion: 2.1 time: 0.071963 Jul 18 02:36:57.908505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.910870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2257/4437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:57 2022] GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:57.953659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.971617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.973588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:57.974440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:58.135340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-751155426", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:58.279945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:58.597316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:58.614714 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3fc1a18a-fdc2-4894-9e56-d13497507bfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.735333 Jul 18 02:36:58.615898 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2181/4438] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:57 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:58.647376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:58.648315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:58.660633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.662204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:58.663077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.663532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.307424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.321355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0678845b-ff47-46f4-82a2-deb6a0e38b08 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.679334 Jul 18 02:36:59.322412 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2182/4439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:58 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:59.329580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:59.331148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:59.354314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.355410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.358490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:59.359579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.362216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:59.363302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:59.364268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.364838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:59.366162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:59.394094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.395380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.399697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.401055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.475422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:59.484567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:59.493501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:59.514273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:59.517391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:59.645511 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5088359e-25cf-4762-bcfd-f939b27cec57 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506649 Jul 18 02:36:59.654624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2258/4440] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:36:59.864899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.873880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41dfc5e3-5a5f-44cc-be0b-c1a7461609a4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.550269 Jul 18 02:36:59.880105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2183/4441] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:59 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:59.901460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:59.902136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:59.909476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.910073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.912301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.916373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.982918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lazy-loading 'flavor' on Instance uuid b743c07d-cfcf-47a3-a5d3-99d0eee2d802 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:00.520821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb5ae6ac-d794-4382-a829-034c721d6374 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.638622 Jul 18 02:37:00.521999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2184/4442] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:59 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:37:00.528746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dcc2115f-4791-4a2c-bed2-7b4405a4b82c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.529965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dcc2115f-4791-4a2c-bed2-7b4405a4b82c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.663905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ef4bf79-0365-4b6c-912c-bb7f9b162979 tempest-ComputeTenantNetworksTest-1951763550 tempest-ComputeTenantNetworksTest-1951763550-project] Calling method '.version_select at 0x7fab05dd6e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.681279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dcc2115f-4791-4a2c-bed2-7b4405a4b82c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:00.703831 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dcc2115f-4791-4a2c-bed2-7b4405a4b82c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1220 microversion: 2.1 time: 0.180003 Jul 18 02:37:00.704898 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2185/4443] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:00.722988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.724136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.749332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.757592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.759368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.760385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.184679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:01.207896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-387f9279-32b0-4139-8ac2-333e6e000ff3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 0.500815 Jul 18 02:37:01.212916 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2186/4444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:01.223834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.224819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:01.251398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.253427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.254984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.255450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.520517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ef4bf79-0365-4b6c-912c-bb7f9b162979 tempest-ComputeTenantNetworksTest-1951763550 tempest-ComputeTenantNetworksTest-1951763550-project] 10.222.0.67 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.871975 Jul 18 02:37:01.521201 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2259/4445] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 02:36:59 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:01.535965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37ed54b9-1b58-4339-804a-a5c81941f95a tempest-ComputeTenantNetworksTest-1951763550 tempest-ComputeTenantNetworksTest-1951763550-project] Calling method '.version_select at 0x7fab05694550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.595323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:01.639524 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42d0c02e-c024-45f1-be29-fd5f67f306a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.424597 Jul 18 02:37:01.653906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2187/4446] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:01.740083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.741256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:01.772002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.772865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.778145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.781112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.907294 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37ed54b9-1b58-4339-804a-a5c81941f95a tempest-ComputeTenantNetworksTest-1951763550 tempest-ComputeTenantNetworksTest-1951763550-project] 10.222.0.67 "GET /compute/v2.1/os-tenant-networks/a009cae0-bf9b-4236-9498-e0bdd4eccd17" status: 200 len: 140 microversion: 2.1 time: 0.376641 Jul 18 02:37:01.909092 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2260/4447] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/os-tenant-networks/a009cae0-bf9b-4236-9498-e0bdd4eccd17 => generated 140 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:01.937695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8e40f131-9e7d-4d66-aeb8-a5de1fa1600e req-59a3f04b-f899-4e0f-9d11-a2128c9b2e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e00fd-17bd-4772-95c6-795a37e38f44", "name": "network-vif-unplugged", "status": "completed", "tag": "1560bc1c-816a-4864-83f4-3b6bf969195c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:01.965616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8e40f131-9e7d-4d66-aeb8-a5de1fa1600e req-59a3f04b-f899-4e0f-9d11-a2128c9b2e1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.973242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8e40f131-9e7d-4d66-aeb8-a5de1fa1600e req-59a3f04b-f899-4e0f-9d11-a2128c9b2e1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.998833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8e40f131-9e7d-4d66-aeb8-a5de1fa1600e req-59a3f04b-f899-4e0f-9d11-a2128c9b2e1c service nova] Creating event network-vif-unplugged:1560bc1c-816a-4864-83f4-3b6bf969195c for instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 on n-h2-849796-1 Jul 18 02:37:02.012671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.022669 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f2b26c85-7809-494a-9f67-ffa390ef1ba6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1272 microversion: 2.1 time: 0.290489 Jul 18 02:37:02.028063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2188/4448] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:02.028268 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8e40f131-9e7d-4d66-aeb8-a5de1fa1600e req-59a3f04b-f899-4e0f-9d11-a2128c9b2e1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095203 Jul 18 02:37:02.029938 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2261/4449] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:02.247510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:02.248343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:02.271738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.272194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.273117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.273512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.671078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:02.672585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:02.691557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.700705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.706288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.709111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.911877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.947035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-425dfbff-3250-48d4-bda9-8f0ecd3dfaf9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 0.706397 Jul 18 02:37:02.966474 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2189/4450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:02 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:03.054377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.055281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.073202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.075043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.078031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.079372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.135919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:03.156751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3896401-45ad-4338-a91e-d0c49c18d29f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.491238 Jul 18 02:37:03.159049 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2262/4451] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:02 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:03.361129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:03.389247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fafc7820-46ce-4285-8b47-c42c754d0a2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1278 microversion: 2.1 time: 0.340916 Jul 18 02:37:03.390230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2190/4452] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:03.983470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.985090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.998273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.999537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.002069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.003149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.179191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:04.180278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:04.191637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.192504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.194281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.195655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.677396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.698517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e3f21fca-cb60-4d39-914f-4596837f97bd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.523473 Jul 18 02:37:04.703504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.715966 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2191/4453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:04 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:04.732778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:04.733308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e91862cd-2e75-435d-a0e8-25312bd053ec tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 0.750649 Jul 18 02:37:04.734427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:04.751080 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2263/4454] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:04.752904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.754393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.757193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.758104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.907789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.928786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74091278-654e-4ac7-99f7-59050200913f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1278 microversion: 2.1 time: 0.205000 Jul 18 02:37:04.930390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2192/4455] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:04 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:05.170508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-74967f0e-e6bd-4921-8579-a7687ed31e1c req-3c995968-32cc-4e1e-9082-c1730d82897d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e00fd-17bd-4772-95c6-795a37e38f44", "name": "network-vif-plugged", "status": "completed", "tag": "1560bc1c-816a-4864-83f4-3b6bf969195c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:05.215873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74967f0e-e6bd-4921-8579-a7687ed31e1c req-3c995968-32cc-4e1e-9082-c1730d82897d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.223537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-74967f0e-e6bd-4921-8579-a7687ed31e1c req-3c995968-32cc-4e1e-9082-c1730d82897d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.309185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-74967f0e-e6bd-4921-8579-a7687ed31e1c req-3c995968-32cc-4e1e-9082-c1730d82897d service nova] Creating event network-vif-plugged:1560bc1c-816a-4864-83f4-3b6bf969195c for instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 on n-h2-849796-1 Jul 18 02:37:05.349272 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-74967f0e-e6bd-4921-8579-a7687ed31e1c req-3c995968-32cc-4e1e-9082-c1730d82897d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186558 Jul 18 02:37:05.355749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2264/4456] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:05.732863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.745908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.765763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.767051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.789337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.790102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.791489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.791997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.804350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.805221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.806686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.807495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.292912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:06.624957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.652063 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6af8ac5b-82d1-40c6-8a52-38ad3d4f8c25 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.925659 Jul 18 02:37:06.666419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2193/4457] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:06.679317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:06.681230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.710867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.711571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.713948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.714547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.857714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.877700 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf36d802-0e32-4dde-82b5-1bbf7083690c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 1.120008 Jul 18 02:37:06.879978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2265/4458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:07.216684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.246180 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da112562-f02b-464d-8fd1-ad7cbd081777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 0.581361 Jul 18 02:37:07.247213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2194/4459] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:06 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:07.686860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:07.688413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.716464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.716963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.722315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.724124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.953635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a021c5f5-c8ae-46ac-b37b-e26d84eaa248 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Action: 'create', calling method: .version_select at 0x7fab04d84d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1764492745", "metadata": {"Type": "work"}}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a021c5f5-c8ae-46ac-b37b-e26d84eaa248 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 122 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1764492745", "metadata": {"Type": "work"}}} Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1764492745', 'metadata': {'Type': 'work'}}}} Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:37:07.960654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a021c5f5-c8ae-46ac-b37b-e26d84eaa248 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:07.968878 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a021c5f5-c8ae-46ac-b37b-e26d84eaa248 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.831923 Jul 18 02:37:07.975252 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2266/4460] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Jul 18 02:37:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 843 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:37:07.981618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:07.982662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.993809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.994679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.995909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.996591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.352003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.358012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:08.370412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24f8f7ce-6507-47bb-b4e1-1c970632ed16 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1522 microversion: 2.1 time: 0.688464 Jul 18 02:37:08.371394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2195/4461] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:07 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1522 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:08.378513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-101e0f99-b4b5-464f-9b1c-278ebb0c7ddc tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Action: 'create', calling method: .version_select at 0x7fab04839430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-934565180", "metadata": {"Type": "work"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-101e0f99-b4b5-464f-9b1c-278ebb0c7ddc tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 119 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-934565180", "metadata": {"Type": "work"}}} Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-934565180', 'metadata': {'Type': 'work'}}}} Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi '0' Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:37:08.398585 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:37:08.404318 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.407294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-101e0f99-b4b5-464f-9b1c-278ebb0c7ddc tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:08.411838 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-101e0f99-b4b5-464f-9b1c-278ebb0c7ddc tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.036148 Jul 18 02:37:08.414954 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2196/4462] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Jul 18 02:37:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:37:08.432029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.433115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:08.446506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.448829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.453584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.454506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.569785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.583126 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-225f7bab-d9e2-4b09-aab3-681df2c87cdb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 0.606568 Jul 18 02:37:08.592736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2267/4463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:07 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:08.608384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-004478f1-1189-4096-bbfb-e2d378d969ab tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Action: 'create', calling method: .version_select at 0x7fab0a789f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69024598", "metadata": {"Type": "work"}}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-004478f1-1189-4096-bbfb-e2d378d969ab tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 117 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69024598", "metadata": {"Type": "work"}}} Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-69024598', 'metadata': {'Type': 'work'}}}} Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi '' Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:37:08.611751 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:37:08.615707 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.618347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-004478f1-1189-4096-bbfb-e2d378d969ab tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:08.619614 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-004478f1-1189-4096-bbfb-e2d378d969ab tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015729 Jul 18 02:37:08.625597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2268/4464] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Jul 18 02:37:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:37:08.635308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3390f1cb-fd04-478e-b964-e38d92836223 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Calling method '.version_select at 0x7fab048b6af0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.692686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3390f1cb-fd04-478e-b964-e38d92836223 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] HTTP exception thrown: Volume tempest-invalid-1560175637 could not be found. Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3390f1cb-fd04-478e-b964-e38d92836223 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1560175637 HTTP/1.1 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume tempest-invalid-1560175637 could not be found. Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'tempest-invalid-1560175637'} Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1560175637 could not be found. (HTTP 404) (Request-ID: req-27e122ef-8759-4456-b4ef-69dfeeff5d0a) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.698329 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1560175637 could not be found. Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1560175637 could not be found. Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1560175637 could not be found. Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3390f1cb-fd04-478e-b964-e38d92836223 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 404 to user: Volume tempest-invalid-1560175637 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:08.711411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3390f1cb-fd04-478e-b964-e38d92836223 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1560175637" status: 404 len: 99 microversion: 2.1 time: 0.076540 Jul 18 02:37:08.727921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2269/4465] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:37:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1560175637 => generated 99 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:37:08.731947 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca4fb823-34be-4a1e-8101-71ab2f0e7a96 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010234 Jul 18 02:37:08.741263 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2270/4466] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Jul 18 02:37:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:37:08.750381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c13b854d-6d39-4ee0-a46a-f524a946fbd3 tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005028 Jul 18 02:37:08.760705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2271/4467] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 02:37:08.766145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59cc5640-9657-44d7-a7a8-fb1064f6914a tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Calling method '.version_select at 0x7fab05819d30>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.812973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-59cc5640-9657-44d7-a7a8-fb1064f6914a tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] HTTP exception thrown: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59cc5640-9657-44d7-a7a8-fb1064f6914a tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-volumes/f562834e-4c49-4e4b-94d1-a95662b70931 HTTP/1.1 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f562834e-4c49-4e4b-94d1-a95662b70931'} Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. (HTTP 404) (Request-ID: req-ece13989-2027-497b-9354-5a35095477d2) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:37:08.824971 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59cc5640-9657-44d7-a7a8-fb1064f6914a tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 404 to user: Volume f562834e-4c49-4e4b-94d1-a95662b70931 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59cc5640-9657-44d7-a7a8-fb1064f6914a tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/f562834e-4c49-4e4b-94d1-a95662b70931" status: 404 len: 109 microversion: 2.1 time: 0.056088 Jul 18 02:37:08.828721 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2272/4468] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:37:08 2022] DELETE /compute/v2.1/os-volumes/f562834e-4c49-4e4b-94d1-a95662b70931 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:37:08.858571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd5d95a4-94de-41e8-baff-84d5e909c6ad tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Calling method '.version_select at 0x7fab0a789f70>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.950480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cd5d95a4-94de-41e8-baff-84d5e909c6ad tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] HTTP exception thrown: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd5d95a4-94de-41e8-baff-84d5e909c6ad tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Request method failure captured: Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-volumes/73338d57-4d75-4131-844f-c85f166a71ea HTTP/1.1 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdS4ctCjlRSgsBBqy7ICRcFHNCz-rzIIGSkgdS_3_vTYQcy-YgkmrC-x2dfhVDhb2ijoWJHOrN2WefBAl9MVnt-juXs_Qavk3gbPjqVru16yR0DUOMGywAJqHfC7K6FhtuZldxspXtMdPTtFBn9bEhtNgWymMmcngpXLivNv8CnXY8 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7f143c092e5049e9b5f8e5f0d3b3e9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 7f143c092e5049e9b5f8e5f0d3b3e9d9 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesNegativeTest-244537765 Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be90f4bc1574481687cb995324d9a0ae Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesNegativeTest-244537765-project Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '73338d57-4d75-4131-844f-c85f166a71ea'} Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. (HTTP 404) (Request-ID: req-6a511b8e-e0e4-4b23-adf9-02b54accb93a) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:37:08.957540 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. Jul 18 02:37:08.975377 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:37:08.986149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd5d95a4-94de-41e8-baff-84d5e909c6ad tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] Returning 404 to user: Volume 73338d57-4d75-4131-844f-c85f166a71ea could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:08.989683 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd5d95a4-94de-41e8-baff-84d5e909c6ad tempest-VolumesNegativeTest-244537765 tempest-VolumesNegativeTest-244537765-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/73338d57-4d75-4131-844f-c85f166a71ea" status: 404 len: 109 microversion: 2.1 time: 0.150397 Jul 18 02:37:08.997784 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2273/4469] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/os-volumes/73338d57-4d75-4131-844f-c85f166a71ea => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:37:09.035493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:09.044836 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba5df49e-eb38-41ae-a9f4-2d2b1cf6cf86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 0.624830 Jul 18 02:37:09.061975 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2197/4470] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:09.411338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:09.415135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.453070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:09.478832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.481826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.484035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.490786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.506211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.078262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-316f5ca7-e3e1-48ca-8343-d1e8d003d4c8 req-0ef3246f-dec4-49b0-b55f-9653607deeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a", "tag": "66d2ab0f-15cf-4af1-9e7d-d717b80d1bde"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:10.120009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-316f5ca7-e3e1-48ca-8343-d1e8d003d4c8 req-0ef3246f-dec4-49b0-b55f-9653607deeea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.125674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-316f5ca7-e3e1-48ca-8343-d1e8d003d4c8 req-0ef3246f-dec4-49b0-b55f-9653607deeea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.191416 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-316f5ca7-e3e1-48ca-8343-d1e8d003d4c8 req-0ef3246f-dec4-49b0-b55f-9653607deeea service nova] Creating event network-changed:66d2ab0f-15cf-4af1-9e7d-d717b80d1bde for instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a on n-h1-849796-1 Jul 18 02:37:10.217595 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-316f5ca7-e3e1-48ca-8343-d1e8d003d4c8 req-0ef3246f-dec4-49b0-b55f-9653607deeea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.801272 Jul 18 02:37:10.226638 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2198/4471] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:10.250569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.256334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:10.322712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.326485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.333958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.339021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.502795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:10.518669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c30bdd8-43d2-4fa0-a828-6aded3e3d9a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1507 microversion: 2.1 time: 1.119747 Jul 18 02:37:10.533966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2274/4472] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:09 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1507 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:10.541916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.542283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:10.567988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.568675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.574914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.575641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.702607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.931322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:10.950614 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e5a498d-eaf7-4f97-ac71-be3721aca130 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 0.414859 Jul 18 02:37:10.952466 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2275/4473] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:10.980220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.982742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.000486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.002463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.005427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.006685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.237033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.278405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7fd8519-2083-4a3c-9102-e73dbc7379ef tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 1.045824 Jul 18 02:37:11.279975 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2199/4474] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:11.476190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.494904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2819fc8-ea23-4272-9b99-349ad60aa824 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 200 len: 1507 microversion: 2.1 time: 0.540321 Jul 18 02:37:11.549267 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2276/4475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:11.560274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:11.561075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.599464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.600914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.603205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.604331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.669081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:37:11.822917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f86fe78a-1a08-4d54-9baa-9e4a790211ba tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 204 len: 0 microversion: 2.1 time: 0.267317 Jul 18 02:37:11.824286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2200/4476] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:37:11 2022] DELETE /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:37:11.979948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:11.983163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.998623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.000803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.002591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.003999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.143636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-813516057", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "2a666e43-2399-4a46-b1b3-1599a2758e72"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:12.297831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] validate_networks() for [('2a666e43-2399-4a46-b1b3-1599a2758e72', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:13.419385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.438862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72aeff96-a97b-4d86-a17e-fb7163a3d5fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 1.463825 Jul 18 02:37:13.452717 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2277/4477] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:11 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:13.469725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:13.474180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:13.497922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.498626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.499667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.501536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.212144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.232052 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ec2f62b-1bef-4198-8a32-49d665976644 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1532 microversion: 2.1 time: 0.771485 Jul 18 02:37:14.232765 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2278/4478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:13 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1532 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:14.459882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.460778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.471477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.472001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.472668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.477915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.744344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:14.745274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:14.745274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:14.745682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:14.746246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:14.772013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.772013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.772013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.772013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.819958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:14.834886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for user d16c783d9ed84e9ab2535e921975ce5d and project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:14.869724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:14.877966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:14.992973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b9ea11d-88da-476b-86c0-4b1c7f4abf1f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.860190 Jul 18 02:37:14.995591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2201/4479] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:37:15.010591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1671d82a-968c-45f2-99cd-a0d2510bbbb5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.011291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1671d82a-968c-45f2-99cd-a0d2510bbbb5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.187228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1671d82a-968c-45f2-99cd-a0d2510bbbb5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.208681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1671d82a-968c-45f2-99cd-a0d2510bbbb5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1217 microversion: 2.1 time: 0.203181 Jul 18 02:37:15.211479 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2202/4480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:15.265624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.266686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.281469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.286155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.287328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.287953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.632460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.640941 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e4038a02-fe42-427e-b87f-02451fd77d1d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1532 microversion: 2.1 time: 0.383459 Jul 18 02:37:15.641889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2203/4481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1532 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:16.240664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-261af194-f186-4847-88d4-741f69b8a42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.250077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-261af194-f186-4847-88d4-741f69b8a42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.306310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:16.349210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.397398 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bcd6e875-02fb-4748-9025-66ba847eba34 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 1.936161 Jul 18 02:37:16.401818 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2279/4482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:16.669266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.670198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.701770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.706289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.708748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.710003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.338725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-261af194-f186-4847-88d4-741f69b8a42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:17.358296 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-261af194-f186-4847-88d4-741f69b8a42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1217 microversion: 2.1 time: 1.125481 Jul 18 02:37:17.378978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2204/4483] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1217 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:17.378978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0e4311f1-6c64-4997-be61-67950bf044da req-49690d69-0979-485b-bc52-6b4e188783be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e00fd-17bd-4772-95c6-795a37e38f44", "name": "network-vif-deleted", "tag": "1560bc1c-816a-4864-83f4-3b6bf969195c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:17.383944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:17.417749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0e4311f1-6c64-4997-be61-67950bf044da req-49690d69-0979-485b-bc52-6b4e188783be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.426096 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b8c6014-be05-4785-acf5-6e08c09fb712 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1532 microversion: 2.1 time: 0.752010 Jul 18 02:37:17.438985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0e4311f1-6c64-4997-be61-67950bf044da req-49690d69-0979-485b-bc52-6b4e188783be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.444122 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2280/4484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1532 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:17.481435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-29fb4c42-9839-4373-a445-5f322a96f363 req-48b3dfc3-e4a6-4590-b32c-85e7d13c1887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "name": "network-vif-plugged", "status": "completed", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:17.498480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0e4311f1-6c64-4997-be61-67950bf044da req-49690d69-0979-485b-bc52-6b4e188783be service nova] Creating event network-vif-deleted:1560bc1c-816a-4864-83f4-3b6bf969195c for instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 on n-h2-849796-1 Jul 18 02:37:17.520968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0e4311f1-6c64-4997-be61-67950bf044da req-49690d69-0979-485b-bc52-6b4e188783be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149289 Jul 18 02:37:17.531811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2205/4485] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:17.553485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-29fb4c42-9839-4373-a445-5f322a96f363 req-48b3dfc3-e4a6-4590-b32c-85e7d13c1887 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.555497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:17.559542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-29fb4c42-9839-4373-a445-5f322a96f363 req-48b3dfc3-e4a6-4590-b32c-85e7d13c1887 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.562121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:17.584290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.590490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.592863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.593901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.624917 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-29fb4c42-9839-4373-a445-5f322a96f363 req-48b3dfc3-e4a6-4590-b32c-85e7d13c1887 service nova] Creating event network-vif-plugged:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:37:17.646937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-29fb4c42-9839-4373-a445-5f322a96f363 req-48b3dfc3-e4a6-4590-b32c-85e7d13c1887 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197320 Jul 18 02:37:17.649437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2281/4486] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:18.415011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:18.419570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:18.426804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.438789 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bc94b3a-c0a8-499d-be76-5892f40388dc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 0.904621 Jul 18 02:37:18.444240 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2206/4487] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:17 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:18.461149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:18.462301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:18.479344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.480221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.483978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.484689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.485589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.486112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.487235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.493153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.031216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.068108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1c3be80-99a0-4759-8aff-14c455bb2527 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1269 microversion: 2.1 time: 0.677227 Jul 18 02:37:19.070007 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2282/4488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:18 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1269 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:19.354776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.369084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a230b844-ff30-4982-84e6-528cb3c00347 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1532 microversion: 2.1 time: 0.912818 Jul 18 02:37:19.378390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2207/4489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:18 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1532 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:19.475810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:19.476527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:19.497892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.498420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.499511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.500587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.757486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7684796b-3283-42cf-a076-f0da8327e440 req-46583131-2cb6-4771-8297-eb40a6b9b562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a", "name": "network-vif-plugged", "status": "completed", "tag": "66d2ab0f-15cf-4af1-9e7d-d717b80d1bde"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:19.809867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7684796b-3283-42cf-a076-f0da8327e440 req-46583131-2cb6-4771-8297-eb40a6b9b562 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.811435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7684796b-3283-42cf-a076-f0da8327e440 req-46583131-2cb6-4771-8297-eb40a6b9b562 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.862305 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7684796b-3283-42cf-a076-f0da8327e440 req-46583131-2cb6-4771-8297-eb40a6b9b562 service nova] Creating event network-vif-plugged:66d2ab0f-15cf-4af1-9e7d-d717b80d1bde for instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a on n-h1-849796-1 Jul 18 02:37:19.878732 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7684796b-3283-42cf-a076-f0da8327e440 req-46583131-2cb6-4771-8297-eb40a6b9b562 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133799 Jul 18 02:37:19.880947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2208/4490] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:20.108440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.113274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.151566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.153002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.175077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.179303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.465831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.487025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c823634b-da15-430d-b23a-317bf5bd58a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1275 microversion: 2.1 time: 0.399226 Jul 18 02:37:20.489187 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2209/4491] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:20.502026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.507136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.528780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.530157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.534148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.535404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.970664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.990683 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0941c20f-b04e-4fab-a119-96c4d2d692d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 1.522847 Jul 18 02:37:20.991308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2283/4492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:19 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:21.165156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.190598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e23e4ab-3289-407f-a496-85125e3d9a10 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1532 microversion: 2.1 time: 0.697534 Jul 18 02:37:21.192332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2210/4493] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1532 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:21.541493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:21.542401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:21.562517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.562995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.575283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.575784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.015219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.015889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.029281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.034095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.035148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.035612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.278520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:22.290057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:22.326286 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba762647-0d08-497c-a1a6-45acedb85318 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1275 microversion: 2.1 time: 0.799213 Jul 18 02:37:22.327227 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2284/4494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:21 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1275 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:22.373593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.379132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.404868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.410617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.413527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.416395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.077824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.087165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-54eacaef-1b26-4554-a5c0-0e26f34f54c7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.733203 Jul 18 02:37:23.087774 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2285/4495] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.234933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.266228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd9fc579-7e7b-4fad-8f6c-730294da70ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1320 microversion: 2.1 time: 1.255826 Jul 18 02:37:23.284434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2211/4496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1320 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.376282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:23.383403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:23.413203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.414019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.417307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.424303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.113139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.119669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.170860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.171691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.173256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.174563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.604440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.644181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd0d9ea6-e07b-4b87-a549-a505f787750c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 1.293742 Jul 18 02:37:24.645678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2286/4497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:23 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:24.667681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.669190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.694831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.698331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.700127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.700619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.795489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:25.171003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.210355 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-782c81a0-9044-4300-aaf0-01f498eddb1c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.105620 Jul 18 02:37:25.230879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2212/4498] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:25.617392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.651528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c90e467-8128-4db7-a3ac-d2c8a550172f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1502 microversion: 2.1 time: 1.003324 Jul 18 02:37:25.652550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2287/4499] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1502 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:25.671700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:25.672409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:25.685017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.686617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.688412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.691365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.691638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:25.692324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:25.709911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.714935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.715958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.716617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.126104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.142961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5142c34d-eac2-440b-b178-a12ad45c6bf4 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 0.474983 Jul 18 02:37:26.158517 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2213/4500] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:25 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:26.558938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65317123-50ae-40e2-83d6-2c5bc76ee126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: .version_select at 0x7fab04329670>, body: {"keypair": {"name": "tempest-keypair-1071272261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDblcW3lUT8WTWqx6ushCPdP2KwNr5Ip+ZO2c1PzEuHm0HxfyQDK1eLTPGn6lBzVtJSw+7LT4miQYlXrI0SEytHu/IqrJyr369iDZ5oMM/s66IcYpDC0Xl7bEpcYGUP7qw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:26.648748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-65317123-50ae-40e2-83d6-2c5bc76ee126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:26.709494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-65317123-50ae-40e2-83d6-2c5bc76ee126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:26.723949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.737292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8025357e-ed3e-4f11-bc22-33916776e476 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1502 microversion: 2.1 time: 1.053257 Jul 18 02:37:26.738219 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2288/4501] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:25 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1502 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.755185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.756147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.774093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.774791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.775859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.776495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.953767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65317123-50ae-40e2-83d6-2c5bc76ee126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.783536 Jul 18 02:37:26.954947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2214/4502] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:26.964822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.965369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.988857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.007047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.011292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.013019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.132283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:37:27.383984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:27.537121 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4e28406-3fb2-4dae-808f-a24a367cc551 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 204 len: 0 microversion: 2.1 time: 0.559275 Jul 18 02:37:27.537121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2215/4503] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:37:26 2022] DELETE /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:37:27.561435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.561435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.584363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.584968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.588007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.589632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.798934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:27.812872 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-335c9d25-5cfc-443c-ad03-5c744386039b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.072097 Jul 18 02:37:27.813546 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2289/4504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:27.832628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.858261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.887754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.888964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.891001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.901752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.603692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:28.618217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa591ddd-0f0a-4870-b255-9016892b0d1c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 1.097535 Jul 18 02:37:28.627412 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2216/4505] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:28.839106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:28.840256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:28.904179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.913655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.923207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.925530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.295674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.345795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4af0e12d-c385-4f04-9932-1ce2b0940dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1508 microversion: 2.1 time: 1.508639 Jul 18 02:37:29.347023 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2290/4506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1508 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:29.655128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.655850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.668070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:29.674710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.675508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.678108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.680617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.362210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.430953 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5dafc86b-3cb9-477c-bdca-30d8fbeec7d9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.599084 Jul 18 02:37:30.431997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2217/4507] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:28 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:30.474683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1addb5c9-640b-4c83-aede-b889e4944588 req-b29e8162-76be-4d12-bfbc-88dc28174ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf", "tag": "55a1d0da-382f-4eef-8014-236f721c981f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:30.499704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1addb5c9-640b-4c83-aede-b889e4944588 req-b29e8162-76be-4d12-bfbc-88dc28174ada service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.504801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1addb5c9-640b-4c83-aede-b889e4944588 req-b29e8162-76be-4d12-bfbc-88dc28174ada service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.541890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1addb5c9-640b-4c83-aede-b889e4944588 req-b29e8162-76be-4d12-bfbc-88dc28174ada service nova] Creating event network-changed:55a1d0da-382f-4eef-8014-236f721c981f for instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf on n-h2-849796-1 Jul 18 02:37:30.559011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1addb5c9-640b-4c83-aede-b889e4944588 req-b29e8162-76be-4d12-bfbc-88dc28174ada service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102994 Jul 18 02:37:30.562341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2218/4508] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:30.582229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.589711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.609860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.612426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.615390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.616836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.911813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.929209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-281d5e76-728c-4e73-b215-b7f25e766443 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1508 microversion: 2.1 time: 1.365064 Jul 18 02:37:31.930238 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2219/4509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1508 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:31.948267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:31.949218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:31.975202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.976055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.977202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.978617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.469242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.539803 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd5e1167-e1fe-4fe0-b7ce-62ca26fe6ce7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 2.884988 Jul 18 02:37:32.552820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2291/4510] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 2902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:32.963404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.964335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.979989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.989316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.993751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.997534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.702616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.759598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d07a54e9-3d7e-4d1c-92fa-f5f66795ce40 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.827662 Jul 18 02:37:33.785523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2220/4511] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:31 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:33.808192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.820994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.892965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.897894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.902210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.902837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.057120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.067149 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be8a43c8-55ea-414e-be5f-e7205fc1ba9d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 200 len: 1508 microversion: 2.1 time: 2.106164 Jul 18 02:37:35.094598 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2292/4512] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 1508 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:35.134907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.143331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.181344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.184845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.192056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.193297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.489402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.551231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d4a99626-8b6f-4b53-b1fe-b232a5f46025 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 1.763649 Jul 18 02:37:35.559725 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2221/4513] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:35.580832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ccf55200-a7d2-4705-9ed6-e6b92ccbc49e req-cf531e1c-481b-4513-887a-1e7e69573116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a", "name": "network-vif-deleted", "tag": "66d2ab0f-15cf-4af1-9e7d-d717b80d1bde"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:35.617175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ccf55200-a7d2-4705-9ed6-e6b92ccbc49e req-cf531e1c-481b-4513-887a-1e7e69573116 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.618433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ccf55200-a7d2-4705-9ed6-e6b92ccbc49e req-cf531e1c-481b-4513-887a-1e7e69573116 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.702445 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ccf55200-a7d2-4705-9ed6-e6b92ccbc49e req-cf531e1c-481b-4513-887a-1e7e69573116 service nova] Creating event network-vif-deleted:66d2ab0f-15cf-4af1-9e7d-d717b80d1bde for instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a on n-h1-849796-1 Jul 18 02:37:35.746465 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ccf55200-a7d2-4705-9ed6-e6b92ccbc49e req-cf531e1c-481b-4513-887a-1e7e69573116 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180648 Jul 18 02:37:35.750749 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2222/4514] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:36.106181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.112389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.138287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.159652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.169677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.170994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.259168 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a HTTP/1.1 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a'} Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:36.283452 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:37:36.292299 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:37:36.295015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:36.306075 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70189620-8add-4251-825c-13ff6759363f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 404 len: 111 microversion: 2.1 time: 0.202087 Jul 18 02:37:36.306075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2223/4515] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:37:36.325297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c8d0a05-dfef-476f-a6d0-a8ddba3ce68b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: .version_select at 0x7faaf791e5e0>, body: {"keypair": {"name": "tempest-key-1828702343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMauiSyXIneTmlcWiUNsmnZbnepJByiWCSTQmrpQ5Bjd8R51V5N32bnDK0Zt5Dap+b0Prhpxu1B4SlAAPFGy3D7wcKOPMsgh4m3xaHi6auB6H1/gMKIs6QPH3v8MXqcrPQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:36.420112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9c8d0a05-dfef-476f-a6d0-a8ddba3ce68b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:36.507026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9c8d0a05-dfef-476f-a6d0-a8ddba3ce68b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:36.684990 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c8d0a05-dfef-476f-a6d0-a8ddba3ce68b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.373483 Jul 18 02:37:36.699541 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2224/4516] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:37:36 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:36.702042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.722257 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2cf4c5ef-dcc0-4f67-b50e-f6fe9606d33f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.619730 Jul 18 02:37:36.725026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2293/4517] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:36.733151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6362493d-3d1c-4f07-bdf7-d378d78b7d0d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '.version_select at 0x7fab0561a040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.750660 n-d-849796-1 devstack@n-api.service[119439]: WARNING oslo_db.sqlalchemy.utils [None req-6362493d-3d1c-4f07-bdf7-d378d78b7d0d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 18 02:37:36.761893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.768322 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6362493d-3d1c-4f07-bdf7-d378d78b7d0d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.038287 Jul 18 02:37:36.774250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.776557 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2294/4518] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:36.845402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.858420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.859983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.863774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.301462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.349725 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c269f4a7-018c-4134-9dcb-44ca62e2e5d2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 0.645968 Jul 18 02:37:37.351438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2225/4519] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:37.495893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1469376094", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-key-1828702343", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:37.670537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:37.743214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:37.744038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:37.758325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.758792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.761653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.763176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.151065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.171174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7ca85c1-51d8-4542-8674-c4a6f60b4745 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.427360 Jul 18 02:37:38.174039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2226/4520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:37 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:38.195649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1618458060", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72e9a08a-ca51-499a-9658-0d4e3b258016"}], "security_groups": [{"name": "tempest-securitygroup--2124749909"}], "key_name": "tempest-keypair-1071272261", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:38.738528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] validate_networks() for [('72e9a08a-ca51-499a-9658-0d4e3b258016', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:40.146076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:40.147140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:40.147870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:40.148493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:40.149172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:40.170288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.171655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.174843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.176644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.224383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:40.240886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:40.275782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:40.290760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:40.495911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:40.497275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:40.497275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:40.497607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:40.498198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:40.522679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.523959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.525338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.526060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.555599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35cd569b-963d-47dc-adec-a6c693e7298b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.063469 Jul 18 02:37:40.565424 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2295/4521] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:37:40.569935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:40.578456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:40.599602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:40.602522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:40.603152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.604626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.651501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.652025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.656697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.661996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.715712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0950d7a-ac0b-4474-86db-9fbcfc203855 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.535200 Jul 18 02:37:40.719427 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2227/4522] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:37:40.733413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.736334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.759151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.759848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.761733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.765297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.337630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.359436 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af02f320-c9b5-4a86-8776-ba59f3730d2d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.638136 Jul 18 02:37:41.363008 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2228/4523] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.385450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5939736-3bff-478a-9db4-39493a28e40b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.393151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5939736-3bff-478a-9db4-39493a28e40b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.630606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5939736-3bff-478a-9db4-39493a28e40b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.651655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=25 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:41.656303 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5939736-3bff-478a-9db4-39493a28e40b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1229 microversion: 2.1 time: 0.291340 Jul 18 02:37:41.658051 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2229/4524] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1229 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.799819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.838253 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd2dadcc-540e-406b-8748-2e2dd3071ca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 1.270822 Jul 18 02:37:41.849715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2296/4525] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.870825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a965462b-c193-4882-ad0b-3feaf2022991 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.871526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a965462b-c193-4882-ad0b-3feaf2022991 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.247195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a965462b-c193-4882-ad0b-3feaf2022991 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.272891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a965462b-c193-4882-ad0b-3feaf2022991 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1239 microversion: 2.1 time: 0.418478 Jul 18 02:37:42.274348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2297/4526] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1239 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:42.392891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.394088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.425171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.433423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.434841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.436429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.439213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a314c8da-d8d9-4bdf-97a6-1326ef19577e req-a8762ae3-cdd4-4b70-acf8-f019f3e82e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf", "name": "network-vif-plugged", "status": "completed", "tag": "55a1d0da-382f-4eef-8014-236f721c981f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:42.510399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a314c8da-d8d9-4bdf-97a6-1326ef19577e req-a8762ae3-cdd4-4b70-acf8-f019f3e82e11 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.522107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a314c8da-d8d9-4bdf-97a6-1326ef19577e req-a8762ae3-cdd4-4b70-acf8-f019f3e82e11 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.593639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a314c8da-d8d9-4bdf-97a6-1326ef19577e req-a8762ae3-cdd4-4b70-acf8-f019f3e82e11 service nova] Creating event network-vif-plugged:55a1d0da-382f-4eef-8014-236f721c981f for instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf on n-h2-849796-1 Jul 18 02:37:42.621928 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a314c8da-d8d9-4bdf-97a6-1326ef19577e req-a8762ae3-cdd4-4b70-acf8-f019f3e82e11 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.954885 Jul 18 02:37:42.622620 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2230/4527] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:42.695094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.698369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.729241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.740102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.745660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.751999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.162344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.181844 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6a7f5de-72f3-404b-a0f4-d9ae4f528cc3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1225 microversion: 2.1 time: 0.489295 Jul 18 02:37:43.182611 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2231/4528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1225 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:43.206505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.210849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.229634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:43.254756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.283263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e8b6ecb-f3e6-4465-8d4b-74b0bdac0e1f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.891481 Jul 18 02:37:43.295486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.300588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2298/4529] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:43.306978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.308527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.314224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.317953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.333317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.345586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.346871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.351133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.356826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.576993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.590738 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7262e748-5607-4b22-a033-aafcb606ab0a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1235 microversion: 2.1 time: 0.287878 Jul 18 02:37:43.598125 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2299/4530] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1235 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:43.804263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.814206 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b520be9-ee52-4860-ab30-4f550bd51bdf tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1317 microversion: 2.1 time: 0.626664 Jul 18 02:37:43.819765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2232/4531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:44.217239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.217916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.231860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.232848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.240569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.244489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.302022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.303063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.321249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.327044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.332865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.341859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.502516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.515924 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc189b62-6778-4946-8b55-9188a5fe2aff tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1299 microversion: 2.1 time: 0.302601 Jul 18 02:37:44.517251 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2300/4532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1299 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:44.617565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.619824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.639693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.642867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.645933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.648235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.946514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.964528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7f418b1-1ddc-4e9d-a42f-233897c3a594 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1297 microversion: 2.1 time: 0.353769 Jul 18 02:37:44.972645 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2301/4533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1297 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:44.982828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.990713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.028740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.029635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.030782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.031653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.538201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.566565 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0a96ff0-2b9f-4b52-bebe-c9d1a16ebb2b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.268792 Jul 18 02:37:45.577708 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2233/4534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:45.592955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.592955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.619248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.620544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.624967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.627101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.906856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.933394 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5056374c-f904-460d-af09-57b851dcafb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1287 microversion: 2.1 time: 0.355196 Jul 18 02:37:45.934362 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2234/4535] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1287 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:45.943788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.965432 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72944410-b595-47ea-92ff-6e5499a27739 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1508 microversion: 2.1 time: 0.990358 Jul 18 02:37:45.966519 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2302/4536] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1508 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:45.988275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.005457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.007587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.008967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.050007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.051414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.055504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.056007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.057590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.058403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.061359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.062180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.223571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.260158 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4418faf8-a135-4eea-acc1-e244f0413a8e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1297 microversion: 2.1 time: 0.266201 Jul 18 02:37:46.264115 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2303/4537] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1297 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:46.611936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.615132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.655804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.664291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.666338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.681136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.759864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.797227 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d82381bd-26cd-4e5a-9ec9-e812b1d8939c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1508 microversion: 2.1 time: 0.816425 Jul 18 02:37:46.799323 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2235/4538] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1508 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:46.815828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:46.840702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:46.846565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.857482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.858749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.860560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.861573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.078754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c4168a2-fb7d-43de-afa9-7cef4f2b024b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "PUT /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1080 microversion: 2.1 time: 0.247101 Jul 18 02:37:47.106630 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2236/4539] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:37:46 2022] PUT /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1080 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.121334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.122817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.138331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.139113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.143376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.144212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.221676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:47.724633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.749295 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37633c76-3355-4dee-860d-17544ad66496 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1287 microversion: 2.1 time: 0.641018 Jul 18 02:37:47.751361 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2237/4540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1287 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.775264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.785173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.790423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.800222 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ca427e6-0823-49c3-a59a-11f15583ec75 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.195884 Jul 18 02:37:47.808155 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2304/4541] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:46 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:47.826755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.828163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.829715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.832627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.834246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.835054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.856213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.857576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.859319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.861090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.357724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.368645 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-869754ff-9fa7-49ff-ac91-399fa83f3a49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.558630 Jul 18 02:37:48.369321 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2305/4542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:48.785943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.788339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.839039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.852417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.859956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.867587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.359412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.378066 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f6af61fd-5189-4fbf-9fb8-d3edccf3f8a3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1506 microversion: 2.1 time: 1.625529 Jul 18 02:37:49.384521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2238/4543] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1506 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:49.399375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:49.401776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:49.418745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.419487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.421622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.422298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.913185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.937989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d37b7fff-6ad2-4062-a11b-596ae4b5054a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 1.156028 Jul 18 02:37:49.944535 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2306/4544] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:49.962863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:49.963944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:49.984259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.986517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.988103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.991782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.194457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:50.557395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:50.656059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.687251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a374437-3630-4e4a-9cae-3d75c57af831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.299234 Jul 18 02:37:50.701919 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2239/4545] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:49 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:50.709611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.717344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:50.749629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.753476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.759038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.760565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.931981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.962927 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db4a2c6a-f029-4140-a46f-6db5933dd658 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 1.013741 Jul 18 02:37:50.966875 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2307/4546] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:49 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:50.991764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.992424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:51.021751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.022226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.023100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.023568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.663409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:51.832877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.841266 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e84dd23-ea32-4e92-b2a8-54c7d2eb77a1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.864370 Jul 18 02:37:51.845706 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2308/4547] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:50 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:51.853726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:51.867100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:51.894275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.900974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.902924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.907446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.268016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:53.067011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.123619 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9478e034-c0c7-4d4a-8a49-272d1d19b3b6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 1.273043 Jul 18 02:37:53.137518 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2309/4548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:51 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:53.163781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.167613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.193880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.195535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.198659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.205201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.643127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.690624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d2bdf99-7f03-47fd-b34e-e160fd02149f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1506 microversion: 2.1 time: 2.983765 Jul 18 02:37:53.694148 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2240/4549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:50 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1506 bytes in 2991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:53.714828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.724341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.750507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.752392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.755052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.757999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.984533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.051389 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-862edd38-b10e-4e04-96e6-345511426c79 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.886865 Jul 18 02:37:54.073949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2310/4550] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:54.110192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:54.118770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.137166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.138411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.141161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.142403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.405186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:54.405982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:54.407391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:54.414993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:54.421246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:54.625477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.646897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.648903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.650822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.652751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.736542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02071f15-c4e8-40b2-999b-0106dadb8907 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "POST /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf/action" status: 202 len: 1112 microversion: 2.1 time: 0.659602 Jul 18 02:37:54.738077 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2311/4551] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:54 2022] POST /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf/action => generated 1112 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 02:37:54.763466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.766103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.817047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.826643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.834732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.836263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.227287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.256793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42088533-1fe1-438e-94c8-8068de9a16e5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 1.558958 Jul 18 02:37:55.269023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2241/4552] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:55.348167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-136df080-ef9e-4863-a163-f35324cc828b req-3d27a07f-2590-450d-aed2-43bd3842779c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb49aab-e123-4819-aaf1-aed089b4e079", "tag": "b1c80bce-e0c2-4077-a3e6-1b51014a3c3b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:55.402523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-136df080-ef9e-4863-a163-f35324cc828b req-3d27a07f-2590-450d-aed2-43bd3842779c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.414798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-136df080-ef9e-4863-a163-f35324cc828b req-3d27a07f-2590-450d-aed2-43bd3842779c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.441001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.483289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c462cb9-15d8-4344-a0b8-9b5fd0534649 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.731107 Jul 18 02:37:55.490571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-136df080-ef9e-4863-a163-f35324cc828b req-3d27a07f-2590-450d-aed2-43bd3842779c service nova] Creating event network-changed:b1c80bce-e0c2-4077-a3e6-1b51014a3c3b for instance cfb49aab-e123-4819-aaf1-aed089b4e079 on n-h1-849796-1 Jul 18 02:37:55.491673 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2312/4553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:55.506806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.507746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.515010 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-136df080-ef9e-4863-a163-f35324cc828b req-3d27a07f-2590-450d-aed2-43bd3842779c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224629 Jul 18 02:37:55.523401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.526079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.527341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2242/4554] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:55.533985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.534758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.557821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.559375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.599917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.600725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.602283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.603036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.131318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.176140 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c16afe5c-90ac-4563-ad6e-4bdc49b806a2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.681951 Jul 18 02:37:56.177647 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2313/4555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:56.294292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:56.295700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:56.330853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.340883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.342832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.343877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.507874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.533912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3389092d-0e08-445b-9f84-16b5b2b0d7c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 1.003885 Jul 18 02:37:56.549677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2243/4556] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:56.561551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:56.562941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:56.575026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.576130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.577825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.579433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.100052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.133316 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dcbc6e17-9418-419b-bf05-e8941a2596b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.845184 Jul 18 02:37:57.134912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2314/4557] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:56 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:57.216580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.218540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.266275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.277061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.283516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.284365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.405394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.434848 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c03d2a4f-d357-4dfe-9289-46612754787c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1527 microversion: 2.1 time: 0.882867 Jul 18 02:37:57.436411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2244/4558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:56 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1527 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:57.566755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.571789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.587991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.589302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.591397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.592564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.812132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.823616 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f1d468c0-a76e-4c42-80ec-ca7708b83a11 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.616856 Jul 18 02:37:57.824289 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2315/4559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:57.830498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c8ab2135-136d-440d-bff0-aabbf346b521 req-c9547e18-8df5-4322-acae-06416661caa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:57.840842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c8ab2135-136d-440d-bff0-aabbf346b521 req-c9547e18-8df5-4322-acae-06416661caa0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.841814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c8ab2135-136d-440d-bff0-aabbf346b521 req-c9547e18-8df5-4322-acae-06416661caa0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.857747 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c8ab2135-136d-440d-bff0-aabbf346b521 req-c9547e18-8df5-4322-acae-06416661caa0 service nova] Creating event network-changed:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:37:57.864493 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c8ab2135-136d-440d-bff0-aabbf346b521 req-c9547e18-8df5-4322-acae-06416661caa0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038905 Jul 18 02:37:57.865182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2316/4560] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:58.099727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.109258 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8d0c993-912a-481a-b434-541239de1de8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.550033 Jul 18 02:37:58.110920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2245/4561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:58.162389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.163507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.173742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.174602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.175607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.176452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.467225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.481289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.487771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.492636 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd3b1587-03b9-4d21-ac57-b3005f2d485e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.335896 Jul 18 02:37:58.510591 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2317/4562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:58.519279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.521125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.522796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.524225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.854281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.856166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.867268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.868053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.869140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.869971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.068060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.083772 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ed922f2-9466-4b39-8d98-cd429f68d326 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1509 microversion: 2.1 time: 0.621293 Jul 18 02:37:59.085706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2246/4563] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1509 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:59.132005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.133192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.147322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.148012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.149866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.150518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.567088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.586307 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4966eba1-6497-48c4-83d1-d2880b601dbb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.738592 Jul 18 02:37:59.587081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2318/4564] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:59.594777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.600841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.617909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.619082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.621209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.623102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.738688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:00.227838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.262172 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cb6bfc5-b41b-41ff-b9ba-a1baf5ad9e97 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 1.135787 Jul 18 02:38:00.278696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2247/4565] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:00.297119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.300112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.316957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.317397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.330124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.330843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.842853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.857491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66997fbb-f171-4051-8ef8-71d751247ca4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1509 microversion: 2.1 time: 0.567645 Jul 18 02:38:00.858400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2248/4566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1509 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:00.873951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.876129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.904707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.905638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.911058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.911870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.057135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:01.075438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8ebd68f-0b87-45b5-8da2-e113e76fceca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 1.486642 Jul 18 02:38:01.076869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2319/4567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:01.309373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:01.309999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:01.314497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:01.329135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0c2ea56-4d3b-43c1-861a-ea677cc833a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.469037 Jul 18 02:38:01.343997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2249/4568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:01.345366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:01.356474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.357174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.359425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.360040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.612849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:01.621963 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b01190dd-01d7-43ed-a734-4173dc5214f9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.329737 Jul 18 02:38:01.624361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2320/4569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:01 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:01.908479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:01.909305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:01.932045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.934489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.936869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.938620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.100563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.101695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.132802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.134036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.135501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.145269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.556731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.572553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5765309f-0509-4f5b-b5b0-2f5b30aad0d2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.480284 Jul 18 02:38:02.585551 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2321/4570] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:02.607654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b40d80d7-8cd2-41f7-be4a-f24775b65556 req-90de0c95-623a-418c-a879-9d84939ccf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "name": "network-vif-unplugged", "status": "completed", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:02.615189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.648066 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1162068c-3f2e-41f6-8bb9-3663c5efc93f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1509 microversion: 2.1 time: 0.749783 Jul 18 02:38:02.649393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2250/4571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:01 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1509 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:02.661336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b40d80d7-8cd2-41f7-be4a-f24775b65556 req-90de0c95-623a-418c-a879-9d84939ccf4b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.662080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b40d80d7-8cd2-41f7-be4a-f24775b65556 req-90de0c95-623a-418c-a879-9d84939ccf4b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.664230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.670620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.696080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.701614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.703143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.703947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.726516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b40d80d7-8cd2-41f7-be4a-f24775b65556 req-90de0c95-623a-418c-a879-9d84939ccf4b service nova] Creating event network-vif-unplugged:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:38:02.737643 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b40d80d7-8cd2-41f7-be4a-f24775b65556 req-90de0c95-623a-418c-a879-9d84939ccf4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142307 Jul 18 02:38:02.746202 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2322/4572] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:02.799216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.803814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.844880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.853501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.863636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.865690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.279716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.299081 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-151066f7-6bad-45ae-a234-72e1c1985c7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.550749 Jul 18 02:38:03.316263 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2323/4573] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:03.392187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.404678 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90ccaeb4-a1ba-47f2-ab39-1df772af0104 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.753495 Jul 18 02:38:03.408072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2251/4574] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:03.593406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.598286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.638076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.660968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.666389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.667975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.673484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.674688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.680667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.681708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.682747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.690029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.126887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.156813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ce44624-d4d2-4abd-9194-8214567145c4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.563596 Jul 18 02:38:04.159163 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2324/4575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:04.325257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.326925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.337480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.338643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.339731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.340390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.489727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.502066 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71a0b1f3-73da-40f3-bbcf-8ac890f3bbb1 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1512 microversion: 2.1 time: 0.839608 Jul 18 02:38:04.506459 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2252/4576] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1512 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:04.523354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.526430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.545679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.546340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.552799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.553759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.748773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.795812 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a3a601e-eb67-483b-8dd3-bb2165799c96 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.474728 Jul 18 02:38:04.797269 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2325/4577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:04.818885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.830331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.855191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.856066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.862221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.863100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.133783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.155753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a256c3af-e355-43e9-8f0b-56bb4b8e61df tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.648034 Jul 18 02:38:05.160963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2253/4578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:05.190023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-049ba08a-0309-4af9-8167-4ee6515aebb7 req-0dade759-2465-464c-92b5-9dc8863ce080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb49aab-e123-4819-aaf1-aed089b4e079", "name": "network-vif-plugged", "status": "completed", "tag": "b1c80bce-e0c2-4077-a3e6-1b51014a3c3b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:05.240162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-049ba08a-0309-4af9-8167-4ee6515aebb7 req-0dade759-2465-464c-92b5-9dc8863ce080 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.240990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-049ba08a-0309-4af9-8167-4ee6515aebb7 req-0dade759-2465-464c-92b5-9dc8863ce080 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.289405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-049ba08a-0309-4af9-8167-4ee6515aebb7 req-0dade759-2465-464c-92b5-9dc8863ce080 service nova] Creating event network-vif-plugged:b1c80bce-e0c2-4077-a3e6-1b51014a3c3b for instance cfb49aab-e123-4819-aaf1-aed089b4e079 on n-h1-849796-1 Jul 18 02:38:05.315655 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-049ba08a-0309-4af9-8167-4ee6515aebb7 req-0dade759-2465-464c-92b5-9dc8863ce080 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151274 Jul 18 02:38:05.331833 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2254/4579] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:05.382699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.414157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.441456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.442339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.444145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.447099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.481562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:05.579367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.639042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ecba714c-f2d6-4355-84cb-66c6c1766962 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1452 microversion: 2.1 time: 0.836473 Jul 18 02:38:05.643867 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2326/4580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1452 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:05.837671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.838791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.901750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.908571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.911080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.911080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.207333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.221291 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb88e147-57ad-4d17-a3f9-733bea33744d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 0.865073 Jul 18 02:38:06.230169 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2255/4581] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:06.236691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:06.240412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.274268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.274946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.281288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.283049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.309765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.324895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lazy-loading 'flavor' on Instance uuid b743c07d-cfcf-47a3-a5d3-99d0eee2d802 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:06.342609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'shelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state shelved_offloaded Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 14 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: {"shelve": {}} Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'shelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state shelved_offloaded Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'shelve': {}}} Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 18 02:38:06.346893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state shelved_offloaded Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state shelved_offloaded Jul 18 02:38:06.351315 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:38:06.352176 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fea12c29-ff84-4df9-a7c2-4d3f0304c934 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.532582 Jul 18 02:38:06.353148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2327/4582] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:06.353714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'shelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state shelved_offloaded {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:06.354835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4edb794c-1db6-42a3-8218-76cb253659cf tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 155 microversion: 2.1 time: 0.123364 Jul 18 02:38:06.359534 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2256/4583] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:38:06 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 155 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:38:06.365627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:06.366481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.374150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.374872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.376360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.376835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.377806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.378645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.406146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.408357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.415006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.417113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.584379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-960b3810-ebd4-49dc-9e5c-b872f22051e7 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.223113 Jul 18 02:38:06.588892 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2257/4584] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:38:06 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:38:06.598843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.599363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.621112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.621970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.623338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.624275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.825769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.846554 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4b756a6-283b-48c3-8d19-61f1e126b76f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.488317 Jul 18 02:38:06.850890 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2328/4585] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:07.264284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:07.265720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:07.276394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.278047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.279289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.282212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.723496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:07.741731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f33857e7-489b-4b73-9b9f-76d1c0308096 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1460 microversion: 2.1 time: 1.151415 Jul 18 02:38:07.762392 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2258/4586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1460 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:07.777261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:07.782593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:07.803058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.804779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.808279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.811494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.181480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.209415 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bc198a7-af60-4395-8e1e-824cbe4bc787 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.444993 Jul 18 02:38:08.221824 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2259/4587] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:07 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:08.228143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:08.229271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:08.244641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.245504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.246694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.247378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.446999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.470298 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3005f2f7-5063-4e0c-8197-d815e235cb6e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1329 microversion: 2.1 time: 1.209927 Jul 18 02:38:08.492517 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2329/4588] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:07 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1329 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:08.766344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:08.767428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:08.783853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.785196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.787355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.788565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.965290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.997403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-108cac15-da3c-453e-ba57-1eadd2f39c02 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.773398 Jul 18 02:38:09.004434 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2260/4589] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:08 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:09.250108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.261961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.267182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.274098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdb7828c-3dd3-4a1e-8918-f530af3a3511 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1460 microversion: 2.1 time: 0.516210 Jul 18 02:38:09.285188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2330/4590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:08 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1460 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:09.297526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.302598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.305308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.310813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.506085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.506830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.518359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.518781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.523292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.529913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.812779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.827618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90e7c994-14e1-4a1d-b686-005da7def0af tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.582712 Jul 18 02:38:09.828244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2261/4591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:09.921975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.936868 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-53a2cc7a-02c2-4e9a-8150-a726c0499204 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1510 microversion: 2.1 time: 0.438363 Jul 18 02:38:09.941319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2331/4592] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:09.976662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.978499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.991259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.991713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.996647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.997226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.020413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.021200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.039509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.039984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.040903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.043101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.531102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.558888 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c509aea9-8b0a-4677-ab29-4ff86f11e1f7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.541572 Jul 18 02:38:10.562129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2332/4593] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:10.578657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.581241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.600362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.601985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.606415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.608820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.051901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.070296 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1312f9ac-0de8-42a7-97e7-4eebd9d0319a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1510 microversion: 2.1 time: 1.097893 Jul 18 02:38:11.072584 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2262/4594] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1510 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:11.092246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.095820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.108728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.127744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.128615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.129112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.338882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.350997 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d601afac-9618-4f69-97f4-401789630117 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1460 microversion: 2.1 time: 0.784100 Jul 18 02:38:11.352597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2333/4595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1460 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:11.381142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.382368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.402545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.403204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.406260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.409291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.486449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:11.752812 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4667e7b-700f-4c90-b5a8-65a0eefc2941 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 204 len: 0 microversion: 2.1 time: 0.394459 Jul 18 02:38:11.753471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2334/4596] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:11 2022] DELETE /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:11.759624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f6209052-1b30-4901-bb9a-5245316d2fd7 req-3861268c-06ee-43bb-91d7-e51c070a3f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-plugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:11.778334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.788752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f6209052-1b30-4901-bb9a-5245316d2fd7 req-3861268c-06ee-43bb-91d7-e51c070a3f57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.789529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f6209052-1b30-4901-bb9a-5245316d2fd7 req-3861268c-06ee-43bb-91d7-e51c070a3f57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.793182 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-820700ed-96ec-4e5f-a5ed-2711fb899a83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 0.716760 Jul 18 02:38:11.807261 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2263/4597] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:11 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:11.808436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:11.819484 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f6209052-1b30-4901-bb9a-5245316d2fd7 req-3861268c-06ee-43bb-91d7-e51c070a3f57 service nova] Creating event network-vif-plugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:38:11.825713 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f6209052-1b30-4901-bb9a-5245316d2fd7 req-3861268c-06ee-43bb-91d7-e51c070a3f57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070591 Jul 18 02:38:11.826021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.826818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.827267 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2335/4598] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:11.842334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.843071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.849409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.851140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.854914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.857557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.858109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.858930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.861664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.873321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.445620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.465719 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c754c698-37ab-4d9c-a090-c31650e73fe2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.653911 Jul 18 02:38:12.484251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2264/4599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:11 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:12.504111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:12.507533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:12.540331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.543917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.548897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.550255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.698726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.710405 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a5d5698-5755-4b90-96cd-dbd7fcb5ac94 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1516 microversion: 2.1 time: 0.881809 Jul 18 02:38:12.714716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2336/4600] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:11 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1516 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:12.812230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:12.814542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:12.833072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.833548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.834533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.834998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.041576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.066754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e313004-1755-4a8b-a5e8-26f172546d19 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.583978 Jul 18 02:38:13.071526 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2265/4601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:12 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:13.498075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.503360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:13.528687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=71 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:13.536392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.545429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.548794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.549929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.040519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.084965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b42c9a46-f49f-4a90-aa75-c58c2a819ff3 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.593289 Jul 18 02:38:14.086038 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2266/4602] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:14.123893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:14.132694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.155238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.156063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.157632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.158438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.175728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.232152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf482282-8793-44cc-8848-49b02154ffec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1365 microversion: 2.1 time: 1.423730 Jul 18 02:38:14.270382 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2337/4603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:12 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1365 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:14.295469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:14.297923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.318486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.322020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.324043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.325539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.441107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.482863 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc2a9b4a-4c50-4c19-b1c1-40d5993f5a8d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 200 len: 1516 microversion: 2.1 time: 1.388977 Jul 18 02:38:15.486293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2267/4604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:14 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 1516 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:16.231297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.242308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.344876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.347844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.354621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.355878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.419684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:16.451175 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be4b12eb-eda2-4ec4-b5ed-c1550a57ede5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 2.178792 Jul 18 02:38:16.455605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2338/4605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:14 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:16.480463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.481706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.492859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:16.515685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.517271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.541154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.541981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.627587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8179b714-8bfc-4ce5-b8f6-1eae94be8bc5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 204 len: 0 microversion: 2.42 time: 1.137381 Jul 18 02:38:16.630887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2268/4606] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:38:15 2022] DELETE /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:38:16.646491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.647615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.656243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.657511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.658670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.659386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.702935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:17.130597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.142731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7f17e1c-ad0d-4f12-9d50-7105c4b0c8c8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1517 microversion: 2.1 time: 0.685456 Jul 18 02:38:17.143336 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2339/4607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1517 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:17.162894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3afac69c-f79d-4aed-96c9-2b2687a1d420 req-9db95382-8e4a-4c7b-899f-b87ef0efcf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb49aab-e123-4819-aaf1-aed089b4e079", "name": "network-vif-deleted", "tag": "b1c80bce-e0c2-4077-a3e6-1b51014a3c3b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:17.197937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3afac69c-f79d-4aed-96c9-2b2687a1d420 req-9db95382-8e4a-4c7b-899f-b87ef0efcf49 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.205227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3afac69c-f79d-4aed-96c9-2b2687a1d420 req-9db95382-8e4a-4c7b-899f-b87ef0efcf49 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.299729 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3afac69c-f79d-4aed-96c9-2b2687a1d420 req-9db95382-8e4a-4c7b-899f-b87ef0efcf49 service nova] Creating event network-vif-deleted:b1c80bce-e0c2-4077-a3e6-1b51014a3c3b for instance cfb49aab-e123-4819-aaf1-aed089b4e079 on n-h1-849796-1 Jul 18 02:38:17.314162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3afac69c-f79d-4aed-96c9-2b2687a1d420 req-9db95382-8e4a-4c7b-899f-b87ef0efcf49 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162909 Jul 18 02:38:17.320280 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2340/4608] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:17.336872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.338932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:17.365906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.367631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.369693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.370986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.416893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 HTTP/1.1 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cfb49aab-e123-4819-aaf1-aed089b4e079'} Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:38:17.426879 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:38:17.443312 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:38:17.445781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:17.449283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c479edd1-06fb-4529-943a-9de13b617a72 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 404 len: 111 microversion: 2.1 time: 0.126459 Jul 18 02:38:17.450644 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2341/4609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:17 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:38:17.459314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.461159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:17.481450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.491496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.492201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.493537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e0bf131-8869-472c-b215-d083e94eaf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1551 microversion: 2.1 time: 0.860890 Jul 18 02:38:17.495126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.497716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2269/4610] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1551 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:17.498299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.513510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec7e2c03-9d18-4d3f-a548-85c6580ae21a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '.version_select at 0x7faaf74f6280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.568900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec7e2c03-9d18-4d3f-a548-85c6580ae21a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-key-1828702343" status: 202 len: 0 microversion: 2.1 time: 0.067114 Jul 18 02:38:17.570269 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2270/4611] 10.222.0.67 () {58 vars in 1208 bytes} [Mon Jul 18 02:38:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1828702343 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:38:17.598916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.601688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:17.624511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.625566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.628383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.629502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.023187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.032638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07213ebe-1eb7-4ac9-9b4e-3a2e655770ae tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.461061 Jul 18 02:38:18.036815 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2271/4612] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:17 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:18.065789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.067839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.108853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.110321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.111740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.112492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.361974 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a20a8665-1806-4779-91fe-c5eece679dc0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.321380 Jul 18 02:38:18.362956 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2272/4613] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:18.371762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-317314114", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:18.527989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:38:18.658919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.686612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.696947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.705693 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5beaab30-9b12-46e5-ac2b-ef949ec14692 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2951 microversion: 2.42 time: 1.252309 Jul 18 02:38:18.709841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2342/4614] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:17 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2951 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:18.727934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.731940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.762832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.768667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.774213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.776692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.020128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.060532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-69212a57-5345-46bd-98fe-798892a07346 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1523 microversion: 2.1 time: 1.342842 Jul 18 02:38:20.061799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2343/4615] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1523 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:20.085818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.085818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.110940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.111646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.112878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.116274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.979607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:38:21.980488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:38:21.981338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:38:21.981986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:38:21.982503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:38:22.034082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.036854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.053153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.057166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.145932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:38:22.177546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:38:22.246995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:38:22.258022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:38:22.444281 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ecbc96c-21e0-42d5-8b38-18ffee90d46a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.078916 Jul 18 02:38:22.445526 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2273/4616] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:38:22.501139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.502594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.537864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.541300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.557326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.563526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.817165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.888461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df58b49d-1d76-4b61-b6bd-47dfc59c8f82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 2.824216 Jul 18 02:38:22.896028 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2344/4617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:22.936788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a398a89e-c55c-4bf5-95a4-da76647e9583 req-0028ee0a-e84e-4cca-9069-92086d7dda29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf", "name": "network-vif-unplugged", "status": "completed", "tag": "55a1d0da-382f-4eef-8014-236f721c981f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:22.990454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a398a89e-c55c-4bf5-95a4-da76647e9583 req-0028ee0a-e84e-4cca-9069-92086d7dda29 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.991246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a398a89e-c55c-4bf5-95a4-da76647e9583 req-0028ee0a-e84e-4cca-9069-92086d7dda29 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.073635 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a398a89e-c55c-4bf5-95a4-da76647e9583 req-0028ee0a-e84e-4cca-9069-92086d7dda29 service nova] Creating event network-vif-unplugged:55a1d0da-382f-4eef-8014-236f721c981f for instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf on n-h2-849796-1 Jul 18 02:38:23.095237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a398a89e-c55c-4bf5-95a4-da76647e9583 req-0028ee0a-e84e-4cca-9069-92086d7dda29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192365 Jul 18 02:38:23.098107 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2345/4618] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:23.122919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:23.132310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:23.174785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.177849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.179585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.181126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.458558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.504940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.534528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.544454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68f862e8-0b5d-4804-9f8d-0588694e8fe1 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2951 microversion: 2.42 time: 2.070170 Jul 18 02:38:24.553469 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2274/4619] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2951 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:24.582517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.587546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.629363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.630976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.634196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.640007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.270888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.321082 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a978d55f-918c-4786-8c95-f90b1864ab58 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1204 microversion: 2.1 time: 0.761006 Jul 18 02:38:25.324083 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2275/4620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1204 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.383301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.393165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.434579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.435328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.436760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.438485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.793413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:26.811163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:26.872744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5003655-24f0-442f-8090-08ce53a58b06 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1523 microversion: 2.1 time: 3.761810 Jul 18 02:38:26.875186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7620fe2a-77b6-491f-9c5c-a13fd572c5c4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.539327 Jul 18 02:38:26.883335 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2346/4621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:23 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1523 bytes in 3784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:26.886303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2276/4622] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:26.919643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-770b2260-d22a-45fc-9005-00b912b58fcc req-ee9061ef-aec4-4f26-aaeb-29473c48a0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "731990ba-af53-444f-890d-a035111c7987"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:26.931971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:26.936816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:26.981805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.990360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.997808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-770b2260-d22a-45fc-9005-00b912b58fcc req-ee9061ef-aec4-4f26-aaeb-29473c48a0ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.000724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.005158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.006640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-770b2260-d22a-45fc-9005-00b912b58fcc req-ee9061ef-aec4-4f26-aaeb-29473c48a0ee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.115808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-770b2260-d22a-45fc-9005-00b912b58fcc req-ee9061ef-aec4-4f26-aaeb-29473c48a0ee service nova] Creating event network-vif-unplugged:731990ba-af53-444f-890d-a035111c7987 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:27.143951 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-770b2260-d22a-45fc-9005-00b912b58fcc req-ee9061ef-aec4-4f26-aaeb-29473c48a0ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.253705 Jul 18 02:38:27.153150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2347/4623] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:27.188804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:27.192546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:27.231256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.234741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.236905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.241616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.670876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.694208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1839cbd-978b-4e5f-b1dc-9197bb3b865d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1266 microversion: 2.1 time: 0.535107 Jul 18 02:38:27.700069 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2348/4624] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:27 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1266 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:27.903321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:27.907416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:27.927025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.927647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.928783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.930650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.685320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.720275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.729112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.735337 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68cc4021-25f4-4c87-89c2-56e9025b177d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2930 microversion: 2.42 time: 1.844656 Jul 18 02:38:28.753257 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2277/4625] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:26 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2930 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:28.763699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.765047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.775705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.776879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.778501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.779504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.753419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.822065 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e91cb311-d933-4766-9f8b-aff12d6a6b96 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 2.922079 Jul 18 02:38:30.824907 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2349/4626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:27 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 2928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:30.846709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.854030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.872762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.874167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.879808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.882351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.548460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.587939 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72296c37-8f57-4bf7-83a1-d137ef663b65 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1523 microversion: 2.1 time: 2.832486 Jul 18 02:38:31.597320 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2278/4627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1523 bytes in 2843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:31.604117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "cc5ffa71-1d83-4a8d-816b-8ad73e0f9861"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "452fbbf4-726a-466a-a5bd-e4980bde7526"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "533cb380-6f08-4fc3-a9b1-2c50cfb06fa8"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "e9ca6de3-664a-4714-950c-3622cc7b1828"}, {"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-unplugged", "status": "completed", "tag": "f7d7e49d-7458-4074-b355-2b81c955082c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:31.697644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.705942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.769598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Creating event network-vif-unplugged:cc5ffa71-1d83-4a8d-816b-8ad73e0f9861 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:31.770500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Creating event network-vif-unplugged:452fbbf4-726a-466a-a5bd-e4980bde7526 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:31.771049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Creating event network-vif-unplugged:533cb380-6f08-4fc3-a9b1-2c50cfb06fa8 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:31.771675 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Creating event network-vif-unplugged:e9ca6de3-664a-4714-950c-3622cc7b1828 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:31.772080 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] Creating event network-vif-unplugged:f7d7e49d-7458-4074-b355-2b81c955082c for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:31.798407 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-64a7a5e2-8364-42c4-abe0-8fadb1451a54 req-cf1ef5ea-1055-446f-8ace-d2b352bc93c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.198961 Jul 18 02:38:31.802157 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2279/4628] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:31.815231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.823602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.861444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.862273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.863339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.864043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.109627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:32.210485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:32.269964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.322459 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13884a25-b1b7-4c95-abe6-4be304a6128a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 1.494972 Jul 18 02:38:32.330167 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2350/4629] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:32.360960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-893d98dd-47d3-446c-a744-a720a36e3910 req-e4027c62-e6a0-4720-9692-42477ac12b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:32.386857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:32.416513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-893d98dd-47d3-446c-a744-a720a36e3910 req-e4027c62-e6a0-4720-9692-42477ac12b7c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.417985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-893d98dd-47d3-446c-a744-a720a36e3910 req-e4027c62-e6a0-4720-9692-42477ac12b7c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.459938 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-893d98dd-47d3-446c-a744-a720a36e3910 req-e4027c62-e6a0-4720-9692-42477ac12b7c service nova] Creating event network-changed:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:38:32.468168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-893d98dd-47d3-446c-a744-a720a36e3910 req-e4027c62-e6a0-4720-9692-42477ac12b7c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135217 Jul 18 02:38:32.472564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2351/4630] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:32.487093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:32.487966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:32.510438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.510912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.516408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.517159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.004886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.039243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.049749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.051331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f595d0ba-28eb-45e7-a867-c3dc2ee3303a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2909 microversion: 2.42 time: 1.246478 Jul 18 02:38:33.056296 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2280/4631] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2909 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:33.073265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.078074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.128410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.133513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.136371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.142953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.679109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.710394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d2ec652-9913-4a22-97dc-bb3f8e82883b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.234962 Jul 18 02:38:33.713529 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2352/4632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:32 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:33.737846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.741062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.768242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.773612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.776941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.779794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.647482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.678045 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d03cda70-84cf-4962-a06c-c3708bd2e6d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.961976 Jul 18 02:38:34.682594 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2353/4633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:34.698231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4a6340c4-f963-4be3-bc83-2267f65f0306 req-07e0d461-00cf-4b3f-9205-02faa85a3004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf", "name": "network-vif-plugged", "status": "completed", "tag": "55a1d0da-382f-4eef-8014-236f721c981f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:34.732890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a6340c4-f963-4be3-bc83-2267f65f0306 req-07e0d461-00cf-4b3f-9205-02faa85a3004 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.738110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.742040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4a6340c4-f963-4be3-bc83-2267f65f0306 req-07e0d461-00cf-4b3f-9205-02faa85a3004 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.775509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4a6340c4-f963-4be3-bc83-2267f65f0306 req-07e0d461-00cf-4b3f-9205-02faa85a3004 service nova] Creating event network-vif-plugged:55a1d0da-382f-4eef-8014-236f721c981f for instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf on n-h2-849796-1 Jul 18 02:38:34.790037 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4a6340c4-f963-4be3-bc83-2267f65f0306 req-07e0d461-00cf-4b3f-9205-02faa85a3004 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105599 Jul 18 02:38:34.801341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2354/4634] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:34.805982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce474218-1930-4d4c-aeed-4e57e5e9f3ce tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1523 microversion: 2.1 time: 1.740645 Jul 18 02:38:34.807803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:34.808807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:34.814614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2281/4635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1523 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:34.825894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.826717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.828105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.829107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.882557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:34.897285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:34.919363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.920131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.925294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.926076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.764677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.776433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.792760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.809675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d9ec7c90-c0aa-4620-959e-63a31af1d208 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2909 microversion: 2.42 time: 1.003494 Jul 18 02:38:35.813041 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2355/4636] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:34 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2909 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:35.832824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:35.834166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:35.856592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.861073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.864368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.866031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.917948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:36.499994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.553532 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9d78ef4-b16d-474a-a888-7a476339c1e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.734476 Jul 18 02:38:36.555087 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2282/4637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:34 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:36.580477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.581616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.603549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.604750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.606445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.607354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.744167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.761903 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65535b56-83cf-4264-9269-5ef8246b3139 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.945955 Jul 18 02:38:36.766278 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2356/4638] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:35 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:36.836729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.837674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.858036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.873635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.875477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.876145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.127233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.171127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db333866-c6fe-4e1c-8853-d3e1823df441 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1523 microversion: 2.1 time: 1.606931 Jul 18 02:38:38.181207 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2283/4639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1523 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:38.212105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e1a00eb0-d94f-4590-af01-4c7ee20f5f89 req-d7b3e5d9-1e0d-44a8-8147-2f5d2d788d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-deleted", "tag": "cc5ffa71-1d83-4a8d-816b-8ad73e0f9861"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:38.256271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e1a00eb0-d94f-4590-af01-4c7ee20f5f89 req-d7b3e5d9-1e0d-44a8-8147-2f5d2d788d57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.257453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.258692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e1a00eb0-d94f-4590-af01-4c7ee20f5f89 req-d7b3e5d9-1e0d-44a8-8147-2f5d2d788d57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.279611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.284680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.289283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05de0942-ddcb-4932-af64-09f7e9180320 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2864 microversion: 2.42 time: 1.457826 Jul 18 02:38:38.290581 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2357/4640] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2864 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:38.305180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.305909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.318124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.318673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.319564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.325886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.396370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e1a00eb0-d94f-4590-af01-4c7ee20f5f89 req-d7b3e5d9-1e0d-44a8-8147-2f5d2d788d57 service nova] Creating event network-vif-deleted:cc5ffa71-1d83-4a8d-816b-8ad73e0f9861 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:38.452035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e1a00eb0-d94f-4590-af01-4c7ee20f5f89 req-d7b3e5d9-1e0d-44a8-8147-2f5d2d788d57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266423 Jul 18 02:38:38.453635 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2284/4641] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:38.467441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.468875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.505648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.506411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.507462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.508124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.258900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.293458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dffc5e6f-f5bb-49e3-ae01-a8aa3a7d1bb1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.837786 Jul 18 02:38:39.295128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2285/4642] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:39.883887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-70104248-b857-4bde-be1d-42cbb10571c0 req-60c9b70d-72d3-4a30-9b4a-2752e32510ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11192e17-6613-433c-a07d-87a8061c158c", "tag": "913e4250-dc40-469d-8dcb-685c17d19e2c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:39.895402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.937025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-70104248-b857-4bde-be1d-42cbb10571c0 req-60c9b70d-72d3-4a30-9b4a-2752e32510ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.939036 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55f11972-8e79-40eb-99d2-683f70b62bba tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.642970 Jul 18 02:38:39.941672 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2358/4643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:39.943561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-70104248-b857-4bde-be1d-42cbb10571c0 req-60c9b70d-72d3-4a30-9b4a-2752e32510ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.006271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.007266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.025604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.026095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.026951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.027401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.033821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-70104248-b857-4bde-be1d-42cbb10571c0 req-60c9b70d-72d3-4a30-9b4a-2752e32510ea service nova] Creating event network-changed:913e4250-dc40-469d-8dcb-685c17d19e2c for instance 11192e17-6613-433c-a07d-87a8061c158c on n-h2-849796-1 Jul 18 02:38:40.074500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-70104248-b857-4bde-be1d-42cbb10571c0 req-60c9b70d-72d3-4a30-9b4a-2752e32510ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.766031 Jul 18 02:38:40.075132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2286/4644] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:40.091545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.092271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.118865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.119643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.120690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.121353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.492972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.511503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.516344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.518331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdb0605b-1f7f-4d5b-936b-f1c185aa2548 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2706 microversion: 2.42 time: 0.435987 Jul 18 02:38:40.534913 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2287/4645] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2706 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:40.534913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.534913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.555034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.555490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.556325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.556771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.744053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.755548 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4efca53c-4dcb-45b7-8df6-04ffec631f32 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1508 microversion: 2.1 time: 0.807055 Jul 18 02:38:40.756887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2359/4646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:39 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1508 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:40.762616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-960944e4-8a00-4480-8a4a-2a1c9061eaa9 req-448dd662-0259-4248-9145-e279ca59c83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-deleted", "tag": "731990ba-af53-444f-890d-a035111c7987"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:40.774010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-960944e4-8a00-4480-8a4a-2a1c9061eaa9 req-448dd662-0259-4248-9145-e279ca59c83a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.775249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-960944e4-8a00-4480-8a4a-2a1c9061eaa9 req-448dd662-0259-4248-9145-e279ca59c83a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.796302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-960944e4-8a00-4480-8a4a-2a1c9061eaa9 req-448dd662-0259-4248-9145-e279ca59c83a service nova] Creating event network-vif-deleted:731990ba-af53-444f-890d-a035111c7987 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:40.819705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-960944e4-8a00-4480-8a4a-2a1c9061eaa9 req-448dd662-0259-4248-9145-e279ca59c83a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061092 Jul 18 02:38:40.821489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2360/4647] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:40.835330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.837728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.855374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.856341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.858242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.860730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.283816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.306585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b3555096-f38b-442c-962c-b339e4c6a32a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.778671 Jul 18 02:38:41.308547 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2288/4648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:41.324824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.326454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.346874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.347414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.350708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.351146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.817540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.864775 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bebd6b51-f503-4d2c-af51-9ab35ba679b7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 200 len: 1508 microversion: 2.1 time: 1.041279 Jul 18 02:38:41.866702 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2361/4649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 1508 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:41.876724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.879033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.894933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.896271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.898113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.899726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.216592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.227025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:42.245057 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee0a3ff4-a6f9-4009-950f-e24b3d1f0cfb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.932282 Jul 18 02:38:42.246353 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2289/4650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:42.273006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.273006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.281942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.282700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.284553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.285677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.327928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:42.503694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfa7a86d-e4eb-4aa8-8880-91ec2ed017c7 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 204 len: 0 microversion: 2.1 time: 0.255658 Jul 18 02:38:42.504894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2290/4651] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:42 2022] DELETE /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:42.516733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.519652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.526387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.527301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.527628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.528069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.570143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.587659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.589648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.591630 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7197245-0926-4a9c-ba8f-69f50150992d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2547 microversion: 2.42 time: 0.722595 Jul 18 02:38:42.599767 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2362/4652] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2547 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:42.659806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1080916699", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "2a666e43-2399-4a46-b1b3-1599a2758e72"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:42.774958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] validate_networks() for [('2a666e43-2399-4a46-b1b3-1599a2758e72', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:38:42.957158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.977256 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5314d1c0-b7a2-49f8-81d5-d6d462444562 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.469737 Jul 18 02:38:42.988114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2291/4653] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:42 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:42.993763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-42127f12-0f4d-45be-8da8-fe9e9623d34d req-da1a4501-b833-4100-9f67-ad12a513d587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-deleted", "tag": "533cb380-6f08-4fc3-a9b1-2c50cfb06fa8"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:43.005088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42127f12-0f4d-45be-8da8-fe9e9623d34d req-da1a4501-b833-4100-9f67-ad12a513d587 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.005795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42127f12-0f4d-45be-8da8-fe9e9623d34d req-da1a4501-b833-4100-9f67-ad12a513d587 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.022854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-42127f12-0f4d-45be-8da8-fe9e9623d34d req-da1a4501-b833-4100-9f67-ad12a513d587 service nova] Creating event network-vif-deleted:533cb380-6f08-4fc3-a9b1-2c50cfb06fa8 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:43.036654 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-42127f12-0f4d-45be-8da8-fe9e9623d34d req-da1a4501-b833-4100-9f67-ad12a513d587 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046504 Jul 18 02:38:43.038153 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2292/4654] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:43.274535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:43.276416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:43.289159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.290011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.291034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.291659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.963354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.979104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8968bf03-76b3-47af-a669-c39539432335 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.714796 Jul 18 02:38:43.979714 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2293/4655] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:43 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:44.017892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:44.020587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:44.027654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:44.031224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.031953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.045843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.050584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.496542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.512744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.514505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.516507 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b05b6c4-2c58-45fa-aedf-9b22302391e4 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 2388 microversion: 2.42 time: 0.521379 Jul 18 02:38:44.529336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2294/4656] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:43 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 2388 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:44.535407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:44.536355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:44.544142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.544965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.545989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.547232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.006148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.014346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a737ca1f-5692-4ebd-b4d8-086e066243a0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.483673 Jul 18 02:38:45.015493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2295/4657] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:44 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:45.023607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:45.024238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:45.058872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.072072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.073224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.073685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.934885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.975682 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1837836-8f06-47ed-8aa0-7222e4387066 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.958950 Jul 18 02:38:45.976959 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2296/4658] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:45 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:45.996916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6935859f-8059-43a4-9605-24edfc48c578 req-f6f49292-625e-4eac-a440-d02bc0b71793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-deleted", "tag": "f7d7e49d-7458-4074-b355-2b81c955082c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:46.022366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6935859f-8059-43a4-9605-24edfc48c578 req-f6f49292-625e-4eac-a440-d02bc0b71793 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.023089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6935859f-8059-43a4-9605-24edfc48c578 req-f6f49292-625e-4eac-a440-d02bc0b71793 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.075219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6935859f-8059-43a4-9605-24edfc48c578 req-f6f49292-625e-4eac-a440-d02bc0b71793 service nova] Creating event network-vif-deleted:f7d7e49d-7458-4074-b355-2b81c955082c for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:46.085457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6935859f-8059-43a4-9605-24edfc48c578 req-f6f49292-625e-4eac-a440-d02bc0b71793 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099130 Jul 18 02:38:46.086700 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2297/4659] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:46.092560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.112284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.128786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.129918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.131838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.132736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.296469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:38:46.297183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:38:46.297910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:38:46.298405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:38:46.299155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:38:46.333156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.333891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.339116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.339899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.383544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:38:46.390723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Getting quotas for user d16c783d9ed84e9ab2535e921975ce5d and project f936c47ac0934697a8eec926d5673f50. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:38:46.429408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:38:46.432122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:38:46.458142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.476883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.479012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.480773 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3253d775-eae8-416f-b5fd-e64ff90a8f0e tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.392458 Jul 18 02:38:46.494311 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2298/4660] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:46.506327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.507271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.514365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.516696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.517927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.518883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.580629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9f10efe-7605-4ef0-82cf-4afdec69c72b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.925268 Jul 18 02:38:46.586300 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2363/4661] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:38:46.629881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0b38577-9639-4ba8-bf20-91cf5937c6f8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.630831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0b38577-9639-4ba8-bf20-91cf5937c6f8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.963084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0b38577-9639-4ba8-bf20-91cf5937c6f8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.979534 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0b38577-9639-4ba8-bf20-91cf5937c6f8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1218 microversion: 2.1 time: 0.386154 Jul 18 02:38:46.990607 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2364/4662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1218 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:46.995805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.996438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.030477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.032396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.037058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.038065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.057554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.076438 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d09b19c-e5a5-4905-bf46-1f502d8f232c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.580678 Jul 18 02:38:47.077075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2299/4663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:47.508830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:47.509778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.530081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.532807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.534816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.538394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.701247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.736501 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51283abe-46cc-438f-a4a0-284f5067174c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.740278 Jul 18 02:38:47.739972 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2365/4664] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:47.883992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.913993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.927828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.930186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94b1ef2f-6364-4c54-9600-33889a3c5490 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.425674 Jul 18 02:38:47.942680 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2300/4665] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:48.002157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.002157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.056836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.059100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.063878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.068737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.105780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.111739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.152545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.157415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.163862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.169568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.736057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.768824 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67c5d95d-4d8c-4c1f-993c-22e1267c84b6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1214 microversion: 2.1 time: 0.766028 Jul 18 02:38:48.773426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2366/4666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1214 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:48.793198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.801123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-20d533bf-31fc-4f49-8199-a9ef6f293c1d req-b214d982-d9a5-4b07-baa8-1e912e4ade69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39395f-99bb-419d-a5eb-6e49b7099980", "name": "network-vif-deleted", "tag": "452fbbf4-726a-466a-a5bd-e4980bde7526"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:48.830383 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-450b2841-2c44-4950-83ce-952a31be5a16 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.738459 Jul 18 02:38:48.839999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2301/4667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:48.862462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.865832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-20d533bf-31fc-4f49-8199-a9ef6f293c1d req-b214d982-d9a5-4b07-baa8-1e912e4ade69 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.867094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-20d533bf-31fc-4f49-8199-a9ef6f293c1d req-b214d982-d9a5-4b07-baa8-1e912e4ade69 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.876169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.926119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.932155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.938030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.941869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.961431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-20d533bf-31fc-4f49-8199-a9ef6f293c1d req-b214d982-d9a5-4b07-baa8-1e912e4ade69 service nova] Creating event network-vif-deleted:452fbbf4-726a-466a-a5bd-e4980bde7526 for instance 6b39395f-99bb-419d-a5eb-6e49b7099980 on n-h1-849796-1 Jul 18 02:38:48.989827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-20d533bf-31fc-4f49-8199-a9ef6f293c1d req-b214d982-d9a5-4b07-baa8-1e912e4ade69 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210093 Jul 18 02:38:48.997897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2367/4668] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:49.024813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.038716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.082145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.083239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.085272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.090734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.555644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.606951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.623609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.630502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f59d46c1-98e4-4f24-92c7-756f3e6e0561 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.626218 Jul 18 02:38:49.636493 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2368/4669] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:49.800722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.801878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.820088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.820985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.827327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.827862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.357662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.401186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-20823593-d247-44fe-9d7c-2df1773a8117 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1276 microversion: 2.1 time: 0.605406 Jul 18 02:38:50.403705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2369/4670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1276 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:50.409846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:50.427165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:50.467454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.472362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.481649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.486749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.542654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.552034 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b505fed-9ac1-44aa-9d3a-4896f23b1c43 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.709803 Jul 18 02:38:50.565357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2302/4671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:50.651846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:50.652713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:50.671056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.681708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.682957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.688878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.936089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.958896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.963657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.969166 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-108f2e35-f518-4593-af5c-d0e23c423bf8 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.321582 Jul 18 02:38:50.970384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2303/4672] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:50 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:51.247624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8ab33373-2048-4bdc-836a-0a067ca8bdc7 req-7d6510d8-c46f-43ae-91ad-738885ecc2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf", "name": "network-vif-deleted", "tag": "55a1d0da-382f-4eef-8014-236f721c981f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:51.280031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8ab33373-2048-4bdc-836a-0a067ca8bdc7 req-7d6510d8-c46f-43ae-91ad-738885ecc2a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.286092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8ab33373-2048-4bdc-836a-0a067ca8bdc7 req-7d6510d8-c46f-43ae-91ad-738885ecc2a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.343374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8ab33373-2048-4bdc-836a-0a067ca8bdc7 req-7d6510d8-c46f-43ae-91ad-738885ecc2a0 service nova] Creating event network-vif-deleted:55a1d0da-382f-4eef-8014-236f721c981f for instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf on n-h2-849796-1 Jul 18 02:38:51.368128 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8ab33373-2048-4bdc-836a-0a067ca8bdc7 req-7d6510d8-c46f-43ae-91ad-738885ecc2a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122788 Jul 18 02:38:51.370526 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2304/4673] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:51.436200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:51.437836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:51.444846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.460746 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-208af76f-a2ed-4ecf-b5fa-4e1e260a9ecc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 1.055573 Jul 18 02:38:51.461453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.463209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.464124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.464592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.466657 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2370/4674] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:50 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:51.583487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:51.584975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:51.603534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.604012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.612838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.613385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.046926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.079554 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a02613ee-9904-4cc4-94af-36a6faef8831 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.501477 Jul 18 02:38:52.086317 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2371/4675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:51 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:52.098930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.103186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.118148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.118622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.119534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.119914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.375965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.390345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.392523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.393836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fc8d33b-6711-4d22-ad17-960a7191cef2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.306169 Jul 18 02:38:52.421150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2372/4676] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:52.485590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.487177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.507014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.507728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.508898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.509611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.587550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.598609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ecbf7d8-a3cc-4409-8745-00e2b051f42f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1276 microversion: 2.1 time: 1.178798 Jul 18 02:38:52.599244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2305/4677] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:51 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1276 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:52.765223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2e777248-8e9c-4f28-96e9-3971c89ec484 req-f451170d-c78e-4f45-8021-9bf0390f2f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "name": "network-vif-plugged", "status": "completed", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:52.805692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2e777248-8e9c-4f28-96e9-3971c89ec484 req-f451170d-c78e-4f45-8021-9bf0390f2f53 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.814189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2e777248-8e9c-4f28-96e9-3971c89ec484 req-f451170d-c78e-4f45-8021-9bf0390f2f53 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.866177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2e777248-8e9c-4f28-96e9-3971c89ec484 req-f451170d-c78e-4f45-8021-9bf0390f2f53 service nova] Creating event network-vif-plugged:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:38:52.876224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2e777248-8e9c-4f28-96e9-3971c89ec484 req-f451170d-c78e-4f45-8021-9bf0390f2f53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116134 Jul 18 02:38:52.877564 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2306/4678] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:52.996182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.025385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f2552c5-7718-4a0a-bc5f-10a30e062de0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.544347 Jul 18 02:38:53.028014 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2373/4679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:53.098657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.099793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.118589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.119063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.120811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.121280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.154903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:53.431088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.432885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.446690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.447641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.449728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.450543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.742765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.751628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.766701 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b884283f-27db-4029-92a1-f407f9e79610 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.673920 Jul 18 02:38:53.769306 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2307/4680] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:53.788178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.793767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.804584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.814388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.817043 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52b72a71-d356-464d-bfee-9a0bb966d4f7 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.391845 Jul 18 02:38:53.818138 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2374/4681] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:53.852994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.856556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.858160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.866083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.047976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.049549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.070599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.071304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.072407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.073628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.675102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.734834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c746f0c-530b-4c29-8b5f-669d0afe7cba tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 0.693466 Jul 18 02:38:54.736708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2375/4682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:54.791215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.803524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.856590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.858010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.868465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.869713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.975950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:55.451058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.468709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-228e2384-aed3-4a2d-932a-d79b882ae1f2 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 1.697165 Jul 18 02:38:55.484131 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2308/4683] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:55.489366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.495617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.510712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.511631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.514421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.518736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.958466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.994624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.999924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:56.009965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c1b342c-d9ef-4aec-8fe9-ce5fbe8e7b2d tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.524099 Jul 18 02:38:56.043552 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2309/4684] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:56.054891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6ee55d73-0dac-44f7-aa59-a217a3b9ce14 req-7ea8a1e0-ab86-4a8d-8c4a-da38813348c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11192e17-6613-433c-a07d-87a8061c158c", "name": "network-vif-plugged", "status": "completed", "tag": "913e4250-dc40-469d-8dcb-685c17d19e2c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:56.095461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ee55d73-0dac-44f7-aa59-a217a3b9ce14 req-7ea8a1e0-ab86-4a8d-8c4a-da38813348c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.096347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6ee55d73-0dac-44f7-aa59-a217a3b9ce14 req-7ea8a1e0-ab86-4a8d-8c4a-da38813348c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.120719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:56.156003 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6ee55d73-0dac-44f7-aa59-a217a3b9ce14 req-7ea8a1e0-ab86-4a8d-8c4a-da38813348c1 service nova] Creating event network-vif-plugged:913e4250-dc40-469d-8dcb-685c17d19e2c for instance 11192e17-6613-433c-a07d-87a8061c158c on n-h2-849796-1 Jul 18 02:38:56.159957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45281172-3121-444b-a67c-750bdabc4b76 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 1.359891 Jul 18 02:38:56.167209 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2376/4685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:56.175045 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6ee55d73-0dac-44f7-aa59-a217a3b9ce14 req-7ea8a1e0-ab86-4a8d-8c4a-da38813348c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128735 Jul 18 02:38:56.179374 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2310/4686] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:56.199658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:56.202481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:56.243402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.244578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.267594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.269303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.419029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:56.517266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:56.518133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:56.533239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.533703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.534670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.535301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.967498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:57.354263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.370445 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46a1e620-5e68-4ba8-93a9-e1ebdd395e13 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 0.858925 Jul 18 02:38:57.373493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2311/4687] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:56 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:57.395320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.396766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.414911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.416067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.418098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.418568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.475447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.489225 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96720b06-1999-4a79-a7f4-9e4c990867da tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 1.319896 Jul 18 02:38:57.503022 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2377/4688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:56 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:57.508790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.510495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.519406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.520826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.522596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.523475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.815409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.845460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.849952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.852736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-231d6152-9a7c-45a0-b51e-e74695b32ff2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.476605 Jul 18 02:38:57.857847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2312/4689] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:58.295261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d9fd85d9-9f48-463c-b728-8bda42c67b0d req-c78b271c-e196-4d82-939d-9c11b7fde9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030da97c-a565-42cd-8164-50fc49dca698", "tag": "c9791b90-5749-41fa-a3d6-fc53131c0f6f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:58.372837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:58.406049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b80f89be-142c-4c76-b546-04a713916f46 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1518 microversion: 2.1 time: 0.898448 Jul 18 02:38:58.411951 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2378/4690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1518 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:58.428809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.430240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.436329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9fd85d9-9f48-463c-b728-8bda42c67b0d req-c78b271c-e196-4d82-939d-9c11b7fde9cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.438828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9fd85d9-9f48-463c-b728-8bda42c67b0d req-c78b271c-e196-4d82-939d-9c11b7fde9cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.453389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.454548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.456591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.457760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.516417 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d9fd85d9-9f48-463c-b728-8bda42c67b0d req-c78b271c-e196-4d82-939d-9c11b7fde9cb service nova] Creating event network-changed:c9791b90-5749-41fa-a3d6-fc53131c0f6f for instance 030da97c-a565-42cd-8164-50fc49dca698 on n-h1-849796-1 Jul 18 02:38:58.537120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d9fd85d9-9f48-463c-b728-8bda42c67b0d req-c78b271c-e196-4d82-939d-9c11b7fde9cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249683 Jul 18 02:38:58.543370 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2313/4691] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:58.571784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.572891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.597357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.597807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.602946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.603960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.739313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.768044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad573f8c-c018-4027-a5af-b42b04f1e044 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1308 microversion: 2.1 time: 1.222447 Jul 18 02:38:59.773045 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2314/4692] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1308 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:59.803239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:59.805246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:59.826730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.828176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.829782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.830903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.946472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.964742 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a2b7c87-ff85-48d5-b6dc-23dbc960715b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 1.551088 Jul 18 02:38:59.966783 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2379/4693] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:59.978764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:59.980099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:59.994497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.996236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.998592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.999878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.469218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.497559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.508144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.510778 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e70f963-39d8-49fd-8206-1322840972e5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.735713 Jul 18 02:39:00.515756 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2315/4694] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:59 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:00.588580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.607304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d83b625b-5e58-40ff-a112-72daa0f20113 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.637591 Jul 18 02:39:00.621732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2380/4695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:59 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:00.629772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.631386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.646277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.647605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.649402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.650483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.791710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.792684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.807475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.810793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.812295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.815726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.143117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:01.197851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88329f08-1970-4c8c-b926-168fd45ec8b2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1490 microversion: 2.1 time: 0.409634 Jul 18 02:39:01.216259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2381/4696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:00 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1490 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:01.235212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.235928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.282503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.287428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.289267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.290074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.638999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:01.728465 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ff70fdb5-1652-4a7d-8c03-64231e1af0a9 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.103414 Jul 18 02:39:01.734548 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2316/4697] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:01.774602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.781046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.815624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.816733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.818059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.818884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.029116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.076733 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f5ba4c7-3b24-41cf-ab9f-414ed9a93b23 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 0.858953 Jul 18 02:39:02.085423 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2382/4698] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:02.112179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-317314114", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:02.182122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.197894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.206083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.211662 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-446a3e3a-640d-4599-95e9-063a27668910 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.473148 Jul 18 02:39:02.212508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2317/4699] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:02.229529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:02.230549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:02.241923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.242777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.243895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.245365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.360170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:39:03.493855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.514710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a090e26-5704-4122-bf7d-54b030f0a1d5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.288632 Jul 18 02:39:03.522122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2318/4700] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:02 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:03.538462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:03.547536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:03.594861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.596003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.597948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.598995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.005996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:39:04.006932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:39:04.007678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:39:04.008455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:39:04.009347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:39:04.018989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:04.031768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.032666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.038488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.039321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.081477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:04.093900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:04.123051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:39:04.130744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:39:04.289320 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0815a91-6f74-44eb-b03c-f46f7a46193e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192744 Jul 18 02:39:04.299880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2383/4701] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:39:04.307017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.315889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.345544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.346515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.348661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.349881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.640544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.698428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.702809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.711788 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe83e1f6-8746-4cb4-b1d7-7439440b170a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.417244 Jul 18 02:39:04.713969 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2384/4702] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:04.740578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f56a5b6c-de89-4202-a22e-c95131203765 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:04.764764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.794984 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f56a5b6c-de89-4202-a22e-c95131203765 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. Jul 18 02:39:04.800021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73c8a9f0-8ea5-4bda-8c9f-01c690557b8c tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 1.275758 Jul 18 02:39:04.805959 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2319/4703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:03 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f56a5b6c-de89-4202-a22e-c95131203765 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/7a9db3c4-08f9-4c0a-acbc-d29012b09668/action HTTP/1.1 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 15 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: {"os-stop": {}} Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '7a9db3c4-08f9-4c0a-acbc-d29012b09668', 'body': {'os-stop': {}}} Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:04.816313 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. Jul 18 02:39:04.826402 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:04.834605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f56a5b6c-de89-4202-a22e-c95131203765 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 7a9db3c4-08f9-4c0a-acbc-d29012b09668 has no mapping to a cell. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:04.834605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f56a5b6c-de89-4202-a22e-c95131203765 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/7a9db3c4-08f9-4c0a-acbc-d29012b09668/action" status: 404 len: 117 microversion: 2.1 time: 0.116797 Jul 18 02:39:04.861123 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2385/4704] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:04 2022] POST /compute/v2.1/servers/7a9db3c4-08f9-4c0a-acbc-d29012b09668/action => generated 117 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:04.882093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4fb46110-5b04-4b42-b27f-cc26e42ec97e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.884351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fb46110-5b04-4b42-b27f-cc26e42ec97e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.914976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.932001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.979221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.979696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.980524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.999276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.275258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4fb46110-5b04-4b42-b27f-cc26e42ec97e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.389910 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4fb46110-5b04-4b42-b27f-cc26e42ec97e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1208 microversion: 2.1 time: 0.579514 Jul 18 02:39:05.391340 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2320/4705] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1208 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:05.654359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.692859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73abbdaa-ebf3-49bf-b266-ff4019e34dfc tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.822207 Jul 18 02:39:05.701357 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2386/4706] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:05.743052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:05.751434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:05.761729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:05.762331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:05.781015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.783253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.786620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.790086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.853285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.887579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.891984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.897836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.234188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.253177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.284172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.286041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb860907-f4f8-4f72-a866-1b69458564c5 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.542981 Jul 18 02:39:06.290286 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2387/4707] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:05 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:06.299711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.308972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.328103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.333230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.337390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.338252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.110368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.171466 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5be43f5e-923a-4adc-8365-9b6e943b98fb tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 1.878386 Jul 18 02:39:08.175414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2388/4708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:08.207876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:08.209195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.245414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.246873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.253132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.255605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.273457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.287742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e335e91-bd71-4316-9863-18e5639d18d8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 2.555259 Jul 18 02:39:08.288781 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2321/4709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:05 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:08.303378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:08.315214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.334171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.334364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.335121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.340171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.472711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.495588 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f80eecd-a206-495f-b26d-ef234860f606 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1266 microversion: 2.1 time: 0.317416 Jul 18 02:39:08.496255 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2389/4710] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:08 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:08.514038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:08.514038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: f4ebd333-c24e-428f-a5d8-0dc7b6c042dd] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.528774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/f4ebd333-c24e-428f-a5d8-0dc7b6c042dd/action HTTP/1.1 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 15 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: {"suspend": {}} Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f4ebd333-c24e-428f-a5d8-0dc7b6c042dd', 'body': {'suspend': {}}} Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:08.531927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance f4ebd333-c24e-428f-a5d8-0dc7b6c042dd could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e3fcaf2-bc43-4654-8c44-d1b029381907 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/f4ebd333-c24e-428f-a5d8-0dc7b6c042dd/action" status: 404 len: 111 microversion: 2.1 time: 0.036458 Jul 18 02:39:08.547839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2390/4711] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:08 2022] POST /compute/v2.1/servers/f4ebd333-c24e-428f-a5d8-0dc7b6c042dd/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:08.565763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:08.567142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.606214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.607499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.609967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.612875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.614766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.627453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.637056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.641525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a37aa944-1de7-44c2-a9f1-7ddfbd07aaff tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.351269 Jul 18 02:39:08.644834 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2322/4712] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:08 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:09.031330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:09.041855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-439874ab-55e2-466e-a442-f2d2c5ea644e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.496841 Jul 18 02:39:09.046183 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2391/4713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:08 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:09.079420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:09.080154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:09.105311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.105893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.106906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.107528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.192297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:09.193088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:09.203350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.213276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.214397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.221642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.149222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.167741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe03114f-29a7-4557-829c-b866a662aca5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 0.979309 Jul 18 02:39:10.168763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2392/4714] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:09 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:10.183725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ee43e168-6567-428d-adda-0995158df013 req-243c2e3d-8b23-4ae8-854f-5325f582b5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030da97c-a565-42cd-8164-50fc49dca698", "name": "network-vif-plugged", "status": "completed", "tag": "c9791b90-5749-41fa-a3d6-fc53131c0f6f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:10.212333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee43e168-6567-428d-adda-0995158df013 req-243c2e3d-8b23-4ae8-854f-5325f582b5f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:10.213742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee43e168-6567-428d-adda-0995158df013 req-243c2e3d-8b23-4ae8-854f-5325f582b5f6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.275664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:10.286806 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ee43e168-6567-428d-adda-0995158df013 req-243c2e3d-8b23-4ae8-854f-5325f582b5f6 service nova] Creating event network-vif-plugged:c9791b90-5749-41fa-a3d6-fc53131c0f6f for instance 030da97c-a565-42cd-8164-50fc49dca698 on n-h1-849796-1 Jul 18 02:39:10.325433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0384089e-3cb2-4aab-a6ce-5877ed6afcfd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.250248 Jul 18 02:39:10.326447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ee43e168-6567-428d-adda-0995158df013 req-243c2e3d-8b23-4ae8-854f-5325f582b5f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155477 Jul 18 02:39:10.330147 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2323/4715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:09 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:10.345689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2393/4716] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:10.349993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:10.351133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:10.367071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:10.385528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:10.386434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:10.386909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.388471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:10.389842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.419950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:10.421915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:10.449806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:10.454392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.616022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:11.625442 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d733fb05-e7d7-4889-8ec1-f3d4295bd698 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 1.293529 Jul 18 02:39:11.635794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2324/4717] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:10 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:11.641172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:11.641999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.650934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:11.664028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.664949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.666224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.670144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.703249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:11.713804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:11.721074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d6c9909-c7b6-4c05-b51f-60e0c0b46f62 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 1.370535 Jul 18 02:39:11.725517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lazy-loading 'flavor' on Instance uuid b743c07d-cfcf-47a3-a5d3-99d0eee2d802 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:11.734855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2394/4718] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:10 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:11.760712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:11.766181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.803674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.812103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.817760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.820203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.851885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:11.896793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c73ac57-22e5-4960-be7f-74a006e6b432 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.259225 Jul 18 02:39:11.897498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2325/4719] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:11 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:39:11.909233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:11.910022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.933342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.933665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.934661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.935260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.043247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.088555 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59c626d3-e102-4801-90af-14348cc27d86 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1513 microversion: 2.1 time: 1.183744 Jul 18 02:39:13.107795 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2326/4720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:11 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1513 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:13.118104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:13.120216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:13.133038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.157525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.158855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.160661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.161899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.163589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9eeeae30-63e2-4fba-8ab8-7a41294e5d7a tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1318 microversion: 2.1 time: 1.410680 Jul 18 02:39:13.168747 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2395/4721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:11 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1318 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:13.184854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:13.187066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:13.215691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.216969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.230720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.232087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.241819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:13.797491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.820807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.824238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.825980 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b13f482c-0bc2-4426-a837-e83212584877 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.655201 Jul 18 02:39:13.843794 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2396/4722] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:13 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:13.875287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.891521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e505c2ff-b5f1-4597-bf6c-899a6e5af0e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 0.781305 Jul 18 02:39:13.898357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2327/4723] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:13 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:14.117863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.118906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.121679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:14.129088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:14.165682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.167942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.174390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.181319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.210620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.214036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.223896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=70 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:14.244616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.247475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.250228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.250945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.867340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.895677 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ad74832-f780-4ad3-84e1-8bc019eb1cd5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1508 microversion: 2.1 time: 0.700907 Jul 18 02:39:14.905456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2328/4724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:14.914828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.921026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.948032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.953535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.955398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.970163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.109638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:15.137266 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84481ccb-0176-483b-b2c3-be44ac004094 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1496 microversion: 2.1 time: 1.024806 Jul 18 02:39:15.141139 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2397/4725] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1496 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:15.178021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:15.189167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:15.245382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.249405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.279644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:15.291426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.292401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.314499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:15.317230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:15.320664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5bb59bd-167c-42fa-84f0-93a09a0554a6 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.413259 Jul 18 02:39:15.334832 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2329/4726] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:15.341436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:15.343004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:15.348003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:15.356196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.358624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.360021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.360743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.361015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:16.375900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf9684e4-b2ad-40ba-8f64-5312154c1a3f tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1508 microversion: 2.1 time: 1.038774 Jul 18 02:39:16.382062 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2330/4727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:15 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1508 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:16.399841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:16.401153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:16.438116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.441300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.445299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.448647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.539932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:16.558644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lazy-loading 'flavor' on Instance uuid b743c07d-cfcf-47a3-a5d3-99d0eee2d802 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:16.575301 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c846a807-773c-4620-8481-63f8b4833d80 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 1.432024 Jul 18 02:39:16.577551 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2398/4728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:15 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:16.617114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:16.621655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:16.648574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.651659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.653770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.658493 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'suspend' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state suspended Jul 18 02:39:16.669731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: {"suspend": {}} Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'suspend' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state suspended Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'suspend': {}}} Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 18 02:39:16.672453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state suspended Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state suspended Jul 18 02:39:16.682118 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:16.703226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'suspend' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state suspended {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:16.708085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea868518-c16a-4a50-b094-ad4a306e20ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 148 microversion: 2.1 time: 0.321135 Jul 18 02:39:16.718822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2331/4729] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:16 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 148 bytes in 335 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:39:16.746324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:16.747656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:16.780560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.781413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.787583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.790647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.974770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:16.993330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:16.995606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:17.007961 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed37b241-8715-40d7-8fdc-c46a7c2c3c7a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.418449 Jul 18 02:39:17.009351 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c578b24-86ea-42c4-9c2f-6a360d3cc2dc tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "PUT /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1080 microversion: 2.1 time: 0.287282 Jul 18 02:39:17.009807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2399/4730] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:16 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:17.012700 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2332/4731] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:39:16 2022] PUT /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1080 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:17.024106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:17.024760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8f866ec1-8acd-4f3a-a8f3-66ca85d48b26 req-591756d6-7271-46ac-a9de-bd7b42e21d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079307ce-6f86-448b-be59-fc515aa4552f", "tag": "d1683d5e-6a96-429c-8e94-f3414d0bf1ca"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:17.027381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:17.047739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.049565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.052187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.053025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8f866ec1-8acd-4f3a-a8f3-66ca85d48b26 req-591756d6-7271-46ac-a9de-bd7b42e21d1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.053758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.054401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8f866ec1-8acd-4f3a-a8f3-66ca85d48b26 req-591756d6-7271-46ac-a9de-bd7b42e21d1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.086694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8f866ec1-8acd-4f3a-a8f3-66ca85d48b26 req-591756d6-7271-46ac-a9de-bd7b42e21d1c service nova] Creating event network-changed:d1683d5e-6a96-429c-8e94-f3414d0bf1ca for instance 079307ce-6f86-448b-be59-fc515aa4552f on n-h2-849796-1 Jul 18 02:39:17.099544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8f866ec1-8acd-4f3a-a8f3-66ca85d48b26 req-591756d6-7271-46ac-a9de-bd7b42e21d1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086559 Jul 18 02:39:17.106182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2400/4732] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:17.120488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:17.126907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:17.137619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.138081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.155423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.159547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.249776 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ae0e867c-158a-4757-bda2-c606fc28a770 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 202 len: 0 microversion: 2.1 time: 0.221833 Jul 18 02:39:17.254081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2333/4733] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:17 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:39:17.281483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:17.285056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:17.307193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.307713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.308570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.309053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.644582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:17.653981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e709d28-8715-4200-babc-76dcd529a859 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1506 microversion: 2.1 time: 0.546060 Jul 18 02:39:17.665849 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2401/4734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:17 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:17.672281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:17.673342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:17.695771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.696551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.697884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.703348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.310052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.323600 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2f7ab77-bab7-4430-a599-2a3b63da90a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1502 microversion: 2.1 time: 1.063124 Jul 18 02:39:18.323600 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2334/4735] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:17 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1502 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:18.338992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:18.339632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.366013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.366822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.368213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.373307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.571112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.586822 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f65df9fe-3b89-48b1-8c1b-3dc7655aa374 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 0.919529 Jul 18 02:39:18.588257 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2402/4736] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:17 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:18.595490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:18.597077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.607292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.608557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.609740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.610829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.855778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.880265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.883743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.886780 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c9839dc-10ca-41f8-b3cc-99ff4aa20104 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1605 microversion: 2.42 time: 0.296571 Jul 18 02:39:18.896967 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2403/4737] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:18 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1605 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:18.937252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.954086 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb7b05a2-d9c9-4f27-b5cf-8e32dee7dba1 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1506 microversion: 2.1 time: 0.626327 Jul 18 02:39:18.956054 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2335/4738] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:18 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:18.972844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:18.974782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.981918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.982822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.985512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.986268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.106187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17aa1630-caf8-4676-9ec7-7dcc5625906b tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "PUT /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1082 microversion: 2.1 time: 0.131183 Jul 18 02:39:19.108270 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2404/4739] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:39:18 2022] PUT /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1082 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:19.122831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.124859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.137277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.138050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.139166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.141716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.357617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.360606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.395118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.399715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.403539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.404185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.773581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.787665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b877d04-6df5-48e4-8193-1b9bab23186e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1502 microversion: 2.1 time: 0.448029 Jul 18 02:39:19.788589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2405/4740] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:19.803074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.808416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.822846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.831031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.833803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.834863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.997773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.017088 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f217536f-b87d-42a2-b240-b8ba81e025c6 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1508 microversion: 2.1 time: 0.898191 Jul 18 02:39:20.018625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2336/4741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1508 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:20.029155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.031311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.043478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.044870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.047549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.048663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.123882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.125369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.126532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lazy-loading 'fault' on Instance uuid 6b39395f-99bb-419d-a5eb-6e49b7099980 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:20.240417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.286923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.297762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9990f4c3c694c37bec6d04f56d27287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef9389578f4aca8233533171198ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.306336 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32be1eb5-612a-42de-b1bb-9e539c2bc980 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 200 len: 1610 microversion: 2.42 time: 0.285716 Jul 18 02:39:20.310141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2337/4742] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 1610 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:20.330531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.332016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.348481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.348973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.349874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.350449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.354882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.395444 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95941edb-5e85-4f4c-b5c3-63bb0875a1fb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 0.604486 Jul 18 02:39:20.418943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2406/4743] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:20.730989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.751137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2063243-1687-488f-bfb7-140580294d6d tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1508 microversion: 2.1 time: 0.436309 Jul 18 02:39:20.752849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2338/4744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:20.780714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.781700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.798124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.800877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.802175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.805543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.812333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.813529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.859007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.860407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.873116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.876565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.892002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:20.998194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:21.036431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-afa9f486-0358-4540-9e30-92b84350cb70 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 204 len: 0 microversion: 2.1 time: 0.267850 Jul 18 02:39:21.038261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2407/4745] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:20 2022] DELETE /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:39:21.063378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.065202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.077663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.079610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.081493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.082518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.184053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:21.332546 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Instance is already in deleting state, ignoring this request Jul 18 02:39:21.342638 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3282a21a-eefb-4e20-8c3b-527b43cd95a5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 204 len: 0 microversion: 2.1 time: 0.284576 Jul 18 02:39:21.351635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2408/4746] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:21 2022] DELETE /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:21.371326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.376057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.401781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.403855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.408137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.409152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.473010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] HTTP exception thrown: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Request method failure captured: Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 HTTP/1.1 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MYP8UKtTVn55snRdVfMO3XJPX0Ikw8l9L2w0ppkGoxQYTO7N4H3eKJaV_RrwhuoxndUsLZnDZgxRBYFysS0rYnqY7GvQrzc8tQKbhTacwMODfFy71QaYRzUO83yBUvpvLlCkTrMaK8JwqbUjvN_dq2pyairhbUvMkZ4jcF44JmbEkc Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6ef9389578f4aca8233533171198ee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a9990f4c3c694c37bec6d04f56d27287 Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '6b39395f-99bb-419d-a5eb-6e49b7099980'} Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:21.476739 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:21.483290 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:21.490336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Returning 404 to user: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:21.501516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1828161-6094-4914-b294-05335118893a tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 404 len: 111 microversion: 2.42 time: 0.139510 Jul 18 02:39:21.502505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2409/4747] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:21.513684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.515723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.524409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.525074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.526172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.529196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.580552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:21.690648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:21.725927 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f78f02f8-924e-4504-970f-fc2dd3eba85e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1502 microversion: 2.1 time: 0.922461 Jul 18 02:39:21.728328 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2339/4748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1502 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:21.740808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.747749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.772090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.775423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.777635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.789919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.216355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.266126 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60f2df55-42e3-4413-b7eb-9ca8123f63a8 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1514 microversion: 2.1 time: 0.760631 Jul 18 02:39:22.267425 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2410/4749] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1514 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:22.315891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37bf3061-5fba-4b6d-b616-01693c05a157 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '.version_select at 0x7fab05818ee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:22.409369 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37bf3061-5fba-4b6d-b616-01693c05a157 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081031527" status: 204 len: 0 microversion: 2.42 time: 0.101176 Jul 18 02:39:22.421827 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2411/4750] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Jul 18 02:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081031527 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:22.793564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:22.797262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:22.840791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.842356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.845349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.846679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.996114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:23.015893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1d180dc-9395-46d9-a622-7dac92968450 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 1.285182 Jul 18 02:39:23.019116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2340/4751] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:23.299761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:23.301420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:23.310215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.311618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.312977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.313660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.873169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:23.885675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa5db099-aaaf-4619-8c3f-f34c7a26af99 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1502 microversion: 2.1 time: 1.131233 Jul 18 02:39:23.886970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2412/4752] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:22 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1502 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.042907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:24.043547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.057441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.057925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.061734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.062536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.518306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.530500 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b26399b5-5a9f-486d-9ca0-76575af30068 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 0.491374 Jul 18 02:39:24.532012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2413/4753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:24 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.616670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.638171 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3edf333d-75b6-4873-bb74-66dcad695968 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1514 microversion: 2.1 time: 1.345963 Jul 18 02:39:24.641040 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2341/4754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:23 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1514 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.919048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:24.923466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.955901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.963559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.970772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.972295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.241854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7b0ed197-fcfa-426d-a27e-ea0de430842c req-8079dca4-d19a-491a-8d9b-ec324573ce7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079307ce-6f86-448b-be59-fc515aa4552f", "name": "network-vif-plugged", "status": "completed", "tag": "d1683d5e-6a96-429c-8e94-f3414d0bf1ca"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:25.276413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7b0ed197-fcfa-426d-a27e-ea0de430842c req-8079dca4-d19a-491a-8d9b-ec324573ce7c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.278956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7b0ed197-fcfa-426d-a27e-ea0de430842c req-8079dca4-d19a-491a-8d9b-ec324573ce7c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.320683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7b0ed197-fcfa-426d-a27e-ea0de430842c req-8079dca4-d19a-491a-8d9b-ec324573ce7c service nova] Creating event network-vif-plugged:d1683d5e-6a96-429c-8e94-f3414d0bf1ca for instance 079307ce-6f86-448b-be59-fc515aa4552f on n-h2-849796-1 Jul 18 02:39:25.340661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7b0ed197-fcfa-426d-a27e-ea0de430842c req-8079dca4-d19a-491a-8d9b-ec324573ce7c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125651 Jul 18 02:39:25.345683 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2342/4755] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:25.561314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.567642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.588624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.589887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.595168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.596231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.602426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.621844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a024679e-208a-47b3-ad9b-bd6f88d26718 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.710923 Jul 18 02:39:25.622897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2414/4756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:24 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:25.659461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.661637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.675030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.675942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.677056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.677798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.157551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.173713 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ffb9b8b8-99a2-48d5-8c3f-2cdeeb150a34 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.519270 Jul 18 02:39:26.175434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2415/4757] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.184683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.186041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.200700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.202701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.204557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.205383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.275729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.276455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.277207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lazy-loading 'fault' on Instance uuid 030da97c-a565-42cd-8164-50fc49dca698 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:26.314935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.343268 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13830506-8c95-4904-af89-ac46e6032fd1 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 0.796749 Jul 18 02:39:26.352501 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2343/4758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.371383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e447fb4f-ec7f-441d-b59b-106cfbe734f9 req-2ead4562-8f32-4202-98f4-16e43930e8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030da97c-a565-42cd-8164-50fc49dca698", "name": "network-vif-deleted", "tag": "c9791b90-5749-41fa-a3d6-fc53131c0f6f"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:26.382477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e447fb4f-ec7f-441d-b59b-106cfbe734f9 req-2ead4562-8f32-4202-98f4-16e43930e8a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.382990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e447fb4f-ec7f-441d-b59b-106cfbe734f9 req-2ead4562-8f32-4202-98f4-16e43930e8a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.398123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e447fb4f-ec7f-441d-b59b-106cfbe734f9 req-2ead4562-8f32-4202-98f4-16e43930e8a3 service nova] Creating event network-vif-deleted:c9791b90-5749-41fa-a3d6-fc53131c0f6f for instance 030da97c-a565-42cd-8164-50fc49dca698 on n-h1-849796-1 Jul 18 02:39:26.407300 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e447fb4f-ec7f-441d-b59b-106cfbe734f9 req-2ead4562-8f32-4202-98f4-16e43930e8a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051411 Jul 18 02:39:26.408738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2344/4759] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:26.415853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:26.417058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 7bb3163e-c4f7-47f7-b155-c9974718b6b2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.424860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/7bb3163e-c4f7-47f7-b155-c9974718b6b2/action HTTP/1.1 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 15 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: {"unpause": {}} Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7bb3163e-c4f7-47f7-b155-c9974718b6b2', 'body': {'unpause': {}}} Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:26.427336 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:26.431326 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:26.431326 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:26.431326 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. Jul 18 02:39:26.431326 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:26.434196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 7bb3163e-c4f7-47f7-b155-c9974718b6b2 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:26.436839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7d8f6a6-b6ac-44b8-b282-db4cc4ee4b21 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/7bb3163e-c4f7-47f7-b155-c9974718b6b2/action" status: 404 len: 111 microversion: 2.1 time: 0.025165 Jul 18 02:39:26.441676 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2345/4760] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:26 2022] POST /compute/v2.1/servers/7bb3163e-c4f7-47f7-b155-c9974718b6b2/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:26.454128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.454838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.465561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.466033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.467081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.468003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.485921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd16c783d9ed84e9ab2535e921975ce5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f936c47ac0934697a8eec926d5673f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.501799 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a64ca20b-87ba-45ad-8d70-7ad0ce454ccd tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 200 len: 1308 microversion: 2.1 time: 0.324480 Jul 18 02:39:26.502885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2416/4761] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.928207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.944770 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-404b5e31-c455-40f5-8cbd-8e821fe88cbb tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.498471 Jul 18 02:39:26.946154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2346/4762] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.976726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.977493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.995325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.996212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.997992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.001176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.383956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.385441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.413622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.414677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.426023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.426635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.430171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.463479 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8efff905-2c37-444b-b98c-6b15e236bf0f tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.476650 Jul 18 02:39:27.464570 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2417/4763] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:27.498047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:27.499484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.520222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.522245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.526281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.527253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.626724 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'unpause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 15 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: {"unpause": {}} Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: exception: Cannot 'unpause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'unpause': {}}} Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state active. Cannot unpause while the instance is in this state. Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.634521 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:27.643863 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:27.643863 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:27.643863 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:27.643863 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:27.643863 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.646715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'unpause' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:27.648732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03b336b2-94d3-4c36-877f-38c24ddd5d87 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 145 microversion: 2.1 time: 0.157983 Jul 18 02:39:27.651330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2418/4764] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:27 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 145 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:39:27.667162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.668966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 030da97c-a565-42cd-8164-50fc49dca698] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.697488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.698142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.703283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.703932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.742856 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] HTTP exception thrown: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Request method failure captured: Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 HTTP/1.1 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1McGCSxSBico24rPDX2zACO4APTNviwYWo2RJYUWcfCr5a7rQqLQUzJvG1rkAir0QnCMV5bG-5Hw2enB6LaADQzZfe3iRaAWkP9kB2mLWvPGg9SykLlmS23_aXgONu3yj2VvwZZYy83XNLF10h89k6fgdebTNRfXoP9L8vkHSmCnjOs Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f936c47ac0934697a8eec926d5673f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d16c783d9ed84e9ab2535e921975ce5d Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '030da97c-a565-42cd-8164-50fc49dca698'} Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:27.755548 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. Jul 18 02:39:27.759936 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:27.762555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Returning 404 to user: Instance 030da97c-a565-42cd-8164-50fc49dca698 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:27.764836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dd79789-e3a1-44fa-b503-976df2aa3413 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698" status: 404 len: 111 microversion: 2.1 time: 0.109771 Jul 18 02:39:27.771012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2419/4765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/030da97c-a565-42cd-8164-50fc49dca698 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:27.777098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.778261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.787178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.787827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.788850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.789488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.229037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.266769 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-844047af-f76e-4ee4-a86e-50eb7bd057e6 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.492565 Jul 18 02:39:28.271599 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2420/4766] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:28.290535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:28.294788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:28.318224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.319567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.321370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.322493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.367207 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] HTTP exception thrown: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Request method failure captured: Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf HTTP/1.1 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1McGCSxSBico24rPDX2zACO4APTNviwYWo2RJYUWcfCr5a7rQqLQUzJvG1rkAir0QnCMV5bG-5Hw2enB6LaADQzZfe3iRaAWkP9kB2mLWvPGg9SykLlmS23_aXgONu3yj2VvwZZYy83XNLF10h89k6fgdebTNRfXoP9L8vkHSmCnjOs Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f936c47ac0934697a8eec926d5673f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d16c783d9ed84e9ab2535e921975ce5d Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf'} Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:28.372299 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Returning 404 to user: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:28.380672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad94a193-fcda-4b5b-8bfd-93c7ce442255 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 404 len: 111 microversion: 2.1 time: 0.100207 Jul 18 02:39:28.383338 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2421/4767] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:28 2022] DELETE /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:28.677690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.725944 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-212f5737-9701-4270-abc9-18547108217f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1308 microversion: 2.1 time: 1.350762 Jul 18 02:39:28.727623 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2347/4768] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1308 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:28.742870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:28.745486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:28.763627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.766260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.769174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.771248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.036823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.037608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.052336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:29.054605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.055236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.057107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.057669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.282785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] HTTP exception thrown: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Request method failure captured: Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf HTTP/1.1 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1McGCSxSBico24rPDX2zACO4APTNviwYWo2RJYUWcfCr5a7rQqLQUzJvG1rkAir0QnCMV5bG-5Hw2enB6LaADQzZfe3iRaAWkP9kB2mLWvPGg9SykLlmS23_aXgONu3yj2VvwZZYy83XNLF10h89k6fgdebTNRfXoP9L8vkHSmCnjOs Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f936c47ac0934697a8eec926d5673f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d16c783d9ed84e9ab2535e921975ce5d Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf'} Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.284726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. Jul 18 02:39:29.289354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.291379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Returning 404 to user: Instance 88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:29.293398 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8ee0515-9aa7-424f-81ea-930e87e94444 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf" status: 404 len: 111 microversion: 2.1 time: 0.563247 Jul 18 02:39:29.294591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2348/4769] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:28 2022] GET /compute/v2.1/servers/88d49b04-ddf8-4c8c-a574-5ac6ed2d77bf => generated 111 bytes in 566 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:29.311922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.312673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.334346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.336236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.337668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.337668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.383865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] HTTP exception thrown: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Request method failure captured: Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 HTTP/1.1 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1McGCSxSBico24rPDX2zACO4APTNviwYWo2RJYUWcfCr5a7rQqLQUzJvG1rkAir0QnCMV5bG-5Hw2enB6LaADQzZfe3iRaAWkP9kB2mLWvPGg9SykLlmS23_aXgONu3yj2VvwZZYy83XNLF10h89k6fgdebTNRfXoP9L8vkHSmCnjOs Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f936c47ac0934697a8eec926d5673f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d16c783d9ed84e9ab2535e921975ce5d Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7b8e00fd-17bd-4772-95c6-795a37e38f44'} Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:29.388186 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.393656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Returning 404 to user: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:29.396173 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6942ce29-ef05-431e-8e38-5e89836f4c79 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 404 len: 111 microversion: 2.1 time: 0.090818 Jul 18 02:39:29.396774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2349/4770] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:29 2022] DELETE /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:29.427519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.429109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] [instance: 7b8e00fd-17bd-4772-95c6-795a37e38f44] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.446746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.449097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.451255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.452762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.483790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] HTTP exception thrown: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Request method failure captured: Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 HTTP/1.1 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1McGCSxSBico24rPDX2zACO4APTNviwYWo2RJYUWcfCr5a7rQqLQUzJvG1rkAir0QnCMV5bG-5Hw2enB6LaADQzZfe3iRaAWkP9kB2mLWvPGg9SykLlmS23_aXgONu3yj2VvwZZYy83XNLF10h89k6fgdebTNRfXoP9L8vkHSmCnjOs Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f936c47ac0934697a8eec926d5673f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f936c47ac0934697a8eec926d5673f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: f936c47ac0934697a8eec926d5673f50 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1437787672 Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d16c783d9ed84e9ab2535e921975ce5d Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiskConfigTestJSON-1437787672-project Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7b8e00fd-17bd-4772-95c6-795a37e38f44'} Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.488046 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] Returning 404 to user: Instance 7b8e00fd-17bd-4772-95c6-795a37e38f44 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1bebcd4-2c76-4901-9b29-63975a9a7fc5 tempest-ServerDiskConfigTestJSON-1437787672 tempest-ServerDiskConfigTestJSON-1437787672-project] 10.222.0.67 "GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44" status: 404 len: 111 microversion: 2.1 time: 0.095522 Jul 18 02:39:29.501232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2350/4771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/7b8e00fd-17bd-4772-95c6-795a37e38f44 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:29.601406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.631751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-284ebeb8-7024-4b83-93ce-8cbdc573a8ed tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.242822 Jul 18 02:39:29.632755 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2422/4772] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:28 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:29.667066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:29.667659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: ef7dc962-c84c-45e5-8547-d9a7200d1b1f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.675190 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/ef7dc962-c84c-45e5-8547-d9a7200d1b1f/action HTTP/1.1 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 18 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: {"unshelve": null} Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ef7dc962-c84c-45e5-8547-d9a7200d1b1f', 'body': {'unshelve': None}} Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.677147 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. Jul 18 02:39:29.681678 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:29.682908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance ef7dc962-c84c-45e5-8547-d9a7200d1b1f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:29.683966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8616e852-391d-4fca-a8f6-5669175ea73d tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/ef7dc962-c84c-45e5-8547-d9a7200d1b1f/action" status: 404 len: 111 microversion: 2.1 time: 0.021118 Jul 18 02:39:29.685105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2351/4773] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:29 2022] POST /compute/v2.1/servers/ef7dc962-c84c-45e5-8547-d9a7200d1b1f/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:39:29.701802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.704413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.720280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.721157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.722652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.723486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.812104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.815573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.838552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.839141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.846998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.849534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.363502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:30.379847 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ba6672a-2ae6-4ef1-821f-8da84ca1461f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1489 microversion: 2.1 time: 0.619794 Jul 18 02:39:30.381574 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2352/4774] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1489 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:30.431258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:30.432500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:30.494204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.495269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.498208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.499276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.613649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:30.634792 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0f8b09b3-1984-424f-b437-a4b0c68bf50b tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.941043 Jul 18 02:39:30.647974 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2423/4775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:30.675068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:30.676168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:30.694145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.695081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.697994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.700985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:31.180915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:31.219372 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b11b3cf-5df2-421b-bdaa-d3866913f497 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1490 microversion: 2.1 time: 0.808700 Jul 18 02:39:31.225112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2353/4776] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:30 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1490 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:31.292617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:31.298496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:31.321250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:31.322556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:31.324103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:31.324743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:31.962775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.014230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.019096 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd85a968-9c8e-4a18-a174-15ceeeea1e82 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 1.341146 Jul 18 02:39:32.023504 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2424/4777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:30 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:32.026948 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c771e3d9-98ae-4870-882c-1fa2b4f72671 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1489 microversion: 2.1 time: 0.758759 Jul 18 02:39:32.047105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2354/4778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:31 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1489 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:32.055146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:32.055739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.068392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.069052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.069518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.071028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.074140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.074894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.117096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.120339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.122002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.128217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.139176 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Cannot 'unshelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action HTTP/1.1 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 18 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: {"unshelve": null} Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: exception: Cannot 'unshelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'unshelve': None}} Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 in vm_state active. Cannot unshelve while the instance is in this state. Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:39:32.148988 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 409 to user: Cannot 'unshelve' instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 while it is in vm_state active {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-044eda29-0169-43ee-b41a-f7cc6e3e5b93 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action" status: 409 len: 146 microversion: 2.1 time: 0.099472 Jul 18 02:39:32.158348 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2355/4779] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:32 2022] POST /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802/action => generated 146 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:39:32.165189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.165749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.184228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.185244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.185935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.186455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.246201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:32.480551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81629624-0475-4331-9cb9-8c898ceb92ad tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 204 len: 0 microversion: 2.1 time: 0.440076 Jul 18 02:39:32.481671 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2425/4780] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:32 2022] DELETE /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:39:32.500211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.501270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.509130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.509990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.511318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.517716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.915246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.931784 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f37bf44-6576-48ac-ad32-7a55a7d10336 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.770941 Jul 18 02:39:32.933622 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2356/4781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:32 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:32.968954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:32.970776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:32.981677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.982669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.988355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:32.990654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.190325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:33.200353 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7241fff-b037-4e52-86fc-983f050eabdb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1495 microversion: 2.1 time: 0.713206 Jul 18 02:39:33.200996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2426/4782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:32 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1495 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:33.744545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:33.747084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.758953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.760467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.762203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.765590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.771265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:33.816358 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-188ba47f-f6c1-4efd-8198-ce9fd4c113ee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.853150 Jul 18 02:39:33.843574 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2357/4783] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:32 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:33.866293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1221453651_updated"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:33.869257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 01ab255c-097e-4c1d-a222-821cacb19712] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.882369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/01ab255c-097e-4c1d-a222-821cacb19712 HTTP/1.1 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 81 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1221453651_updated"}} Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '01ab255c-097e-4c1d-a222-821cacb19712', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1221453651_updated'}}} Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 02:39:33.887780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. Jul 18 02:39:33.901112 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:33.911180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 01ab255c-097e-4c1d-a222-821cacb19712 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:33.913459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9a652fb-d866-48ea-9bb8-d3895ff79a15 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "PUT /compute/v2.1/servers/01ab255c-097e-4c1d-a222-821cacb19712" status: 404 len: 111 microversion: 2.1 time: 0.060314 Jul 18 02:39:33.922260 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2358/4784] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:39:33 2022] PUT /compute/v2.1/servers/01ab255c-097e-4c1d-a222-821cacb19712 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:33.933189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:33.934840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.950709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.954934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.957071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.958288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.526664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:34.539515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:34.547665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc6eea0e-e090-4013-b866-143904eba7d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.812525 Jul 18 02:39:34.549002 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2427/4785] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:33 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:34.563353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:34.567103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:34.567808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:34.575754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee176495-2afe-44cb-988c-ecec5c8f17f0 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.651272 Jul 18 02:39:34.581600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.582855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.584412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.589339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.594932 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2359/4786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:33 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:34.604494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:34.607234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:34.627340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.628211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.633795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.634974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.624565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.634508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e17058a-174e-4d58-8e25-779e8a4c12f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.038169 Jul 18 02:39:35.635112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2360/4787] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:34 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:35.643051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:35.643986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:35.653306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.654434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.655548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.656207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.794180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.812378 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9aee05a5-5af1-456e-8f22-ec3a6b81d124 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1495 microversion: 2.1 time: 1.261331 Jul 18 02:39:35.814370 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2428/4788] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:34 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1495 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:35.824479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:35.826753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:35.843347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.845175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.847960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.850330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.222035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:36.299025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0ee45899-6f6b-414f-87a2-b32a78e6da30 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.653526 Jul 18 02:39:36.304161 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2361/4789] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:35 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:36.337982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38a0466e-70cb-4748-a2c0-6971dc0588a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38a0466e-70cb-4748-a2c0-6971dc0588a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 HTTP/1.1 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 280 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.343246 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38a0466e-70cb-4748-a2c0-6971dc0588a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:36.351611 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38a0466e-70cb-4748-a2c0-6971dc0588a8 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 400 len: 619 microversion: 2.1 time: 0.018191 Jul 18 02:39:36.361116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2362/4790] 10.222.0.67 () {60 vars in 1256 bytes} [Mon Jul 18 02:39:36 2022] PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:36.362076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:36.363235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:36.381738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.382641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.384117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.386562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.749531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:36.791292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea98fe3c-473a-4424-afae-a7cb5905f6e8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.973702 Jul 18 02:39:36.821412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2429/4791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:35 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:36.879727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1940944101"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:36.893114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:36.904849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:36.912184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:36.914074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.914707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.916036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.916618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.947181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0ba16562-9cb9-4bcc-be8b-85e1944439b5 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.592711 Jul 18 02:39:36.948669 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2363/4792] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:36 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:36.957892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:36.970659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.001336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.002743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.005428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.006719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.400671 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89bd4dee-bba0-4599-997f-0256b19dc73d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.545665 Jul 18 02:39:37.408913 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2430/4793] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:36 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:39:37.422485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:37.426499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.443946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.445799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.447718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.449286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.837284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.850720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c32abcf-9377-4192-8903-34cb7f744609 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1495 microversion: 2.1 time: 0.898125 Jul 18 02:39:37.861483 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2364/4794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:36 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1495 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:37.872476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-48c86325-1aae-44bc-90c0-f64e463f3e1c req-a4a56d0d-e9ca-4968-8eb9-130cf75e8e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079307ce-6f86-448b-be59-fc515aa4552f", "name": "network-vif-unplugged", "status": "completed", "tag": "d1683d5e-6a96-429c-8e94-f3414d0bf1ca"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:37.884021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-48c86325-1aae-44bc-90c0-f64e463f3e1c req-a4a56d0d-e9ca-4968-8eb9-130cf75e8e39 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.884496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-48c86325-1aae-44bc-90c0-f64e463f3e1c req-a4a56d0d-e9ca-4968-8eb9-130cf75e8e39 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.900274 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-48c86325-1aae-44bc-90c0-f64e463f3e1c req-a4a56d0d-e9ca-4968-8eb9-130cf75e8e39 service nova] Creating event network-vif-unplugged:d1683d5e-6a96-429c-8e94-f3414d0bf1ca for instance 079307ce-6f86-448b-be59-fc515aa4552f on n-h2-849796-1 Jul 18 02:39:37.907921 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-48c86325-1aae-44bc-90c0-f64e463f3e1c req-a4a56d0d-e9ca-4968-8eb9-130cf75e8e39 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044004 Jul 18 02:39:37.911665 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2365/4795] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:37.919519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:37.920961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.929670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.930584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.932196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.933289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.956012 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] HTTP exception thrown: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Request method failure captured: Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 HTTP/1.1 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MYP8UKtTVn55snRdVfMO3XJPX0Ikw8l9L2w0ppkGoxQYTO7N4H3eKJaV_RrwhuoxndUsLZnDZgxRBYFysS0rYnqY7GvQrzc8tQKbhTacwMODfFy71QaYRzUO83yBUvpvLlCkTrMaK8JwqbUjvN_dq2pyairhbUvMkZ4jcF44JmbEkc Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6ef9389578f4aca8233533171198ee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a9990f4c3c694c37bec6d04f56d27287 Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6b39395f-99bb-419d-a5eb-6e49b7099980'} Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:37.957866 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:37.962665 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:37.965345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Returning 404 to user: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:37.967430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f5a8d78-117f-49dc-906c-5a82f2dca2a2 tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 404 len: 111 microversion: 2.42 time: 0.053046 Jul 18 02:39:37.969003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2366/4796] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:39:37 2022] DELETE /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:37.984538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:37.986028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] [instance: 6b39395f-99bb-419d-a5eb-6e49b7099980] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.998429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.999699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.001792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.002772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.038392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] HTTP exception thrown: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Request method failure captured: Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 HTTP/1.1 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MYP8UKtTVn55snRdVfMO3XJPX0Ikw8l9L2w0ppkGoxQYTO7N4H3eKJaV_RrwhuoxndUsLZnDZgxRBYFysS0rYnqY7GvQrzc8tQKbhTacwMODfFy71QaYRzUO83yBUvpvLlCkTrMaK8JwqbUjvN_dq2pyairhbUvMkZ4jcF44JmbEkc Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.42 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6ef9389578f4aca8233533171198ee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6ef9389578f4aca8233533171198ee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b6ef9389578f4aca8233533171198ee6 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2011361271 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: a9990f4c3c694c37bec6d04f56d27287 Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2011361271-project Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6b39395f-99bb-419d-a5eb-6e49b7099980'} Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.042747 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. Jul 18 02:39:38.050167 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.054100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] Returning 404 to user: Instance 6b39395f-99bb-419d-a5eb-6e49b7099980 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:38.056183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-419b41bc-1c9f-4d32-b817-fba7a26d86ab tempest-TaggedBootDevicesTest_v242-2011361271 tempest-TaggedBootDevicesTest_v242-2011361271-project] 10.222.0.67 "GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980" status: 404 len: 111 microversion: 2.42 time: 0.079036 Jul 18 02:39:38.057587 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2367/4797] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:37 2022] GET /compute/v2.1/servers/6b39395f-99bb-419d-a5eb-6e49b7099980 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:38.295490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:38.316588 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72f0b224-823f-4f26-9811-6f3d5d78189c tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.903338 Jul 18 02:39:38.318646 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2431/4798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:37 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:38.338593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-042621e6-f334-4029-acd1-1209a8b0fd1e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-042621e6-f334-4029-acd1-1209a8b0fd1e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 HTTP/1.1 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 24 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": ""}} Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802', 'body': {'server': {'name': ''}}} Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi '' Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:38.344109 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:38.351089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-042621e6-f334-4029-acd1-1209a8b0fd1e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:38.352335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-042621e6-f334-4029-acd1-1209a8b0fd1e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 400 len: 108 microversion: 2.1 time: 0.018363 Jul 18 02:39:38.353381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2368/4799] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:39:38 2022] PUT /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:38.366446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:38.372656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:38.396169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.405232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.407014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.407921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.531872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-79944ee2-7a83-4d19-a22e-d99af0eef1e3 req-efee8d76-30c5-43a8-a3f6-8c1af0a17bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079307ce-6f86-448b-be59-fc515aa4552f", "name": "network-vif-deleted", "tag": "d1683d5e-6a96-429c-8e94-f3414d0bf1ca"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:38.567233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-79944ee2-7a83-4d19-a22e-d99af0eef1e3 req-efee8d76-30c5-43a8-a3f6-8c1af0a17bb6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.570080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-79944ee2-7a83-4d19-a22e-d99af0eef1e3 req-efee8d76-30c5-43a8-a3f6-8c1af0a17bb6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.611481 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-79944ee2-7a83-4d19-a22e-d99af0eef1e3 req-efee8d76-30c5-43a8-a3f6-8c1af0a17bb6 service nova] Creating event network-vif-deleted:d1683d5e-6a96-429c-8e94-f3414d0bf1ca for instance 079307ce-6f86-448b-be59-fc515aa4552f on n-h2-849796-1 Jul 18 02:39:38.627406 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-79944ee2-7a83-4d19-a22e-d99af0eef1e3 req-efee8d76-30c5-43a8-a3f6-8c1af0a17bb6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098165 Jul 18 02:39:38.630723 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2369/4800] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:38.879746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:38.880517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:38.904043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.908419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.912201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.912714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.993047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.007009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9460ae4-10c6-41e6-a803-c2c3526132c3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1505 microversion: 2.1 time: 0.648370 Jul 18 02:39:39.010488 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2432/4801] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:38 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:39.047394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.048368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.048785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lazy-loading 'fault' on Instance uuid 079307ce-6f86-448b-be59-fc515aa4552f {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:39.791538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.828968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac946f10-6d1d-4f4b-9f25-172df3b57fb8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 200 len: 1298 microversion: 2.1 time: 0.957072 Jul 18 02:39:39.834004 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2370/4802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:38 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 1298 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:40.865025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.866199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.914907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.924807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.926191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.926826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.000838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f HTTP/1.1 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '079307ce-6f86-448b-be59-fc515aa4552f'} Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:41.004754 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:39:41.011654 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:41.017572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:41.019375 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85d2f13b-fd2c-4d8a-8b53-e2e8f29dec1c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 404 len: 111 microversion: 2.1 time: 0.164403 Jul 18 02:39:41.034161 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2433/4803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:40 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:41.041716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:41.043681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:41.070138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.071220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.075224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.081075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.254329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:41.555878 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60de8765-b0dd-4f7d-af5b-a33b8957027d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 204 len: 0 microversion: 2.1 time: 0.526909 Jul 18 02:39:41.556910 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2371/4804] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:41 2022] DELETE /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:41.567408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:41.568058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:41.585742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.591217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.592257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.592798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.587160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:42.607881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9119b808-7538-4830-add5-dcf295b548ae tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1496 microversion: 2.1 time: 1.041953 Jul 18 02:39:42.613331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2434/4805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:41 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1496 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:43.631472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:43.637986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:43.670496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.673392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.675786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.676503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.544315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:44.577143 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73173a24-c41d-4aa8-b263-f00588355b31 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1496 microversion: 2.1 time: 0.951426 Jul 18 02:39:44.578941 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2372/4806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:43 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1496 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:45.596227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:45.597466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:45.623669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:45.624138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:45.629715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:45.630191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.432700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:46.454326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8204188c-4528-45f3-b4a0-fcb4cc0bf7b6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1496 microversion: 2.1 time: 0.862670 Jul 18 02:39:46.461174 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2435/4807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:45 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1496 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:47.025922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-89a504da-bc6f-4a2b-8060-56c197e77a62 req-7eade2f7-56dd-4489-8cf6-b8b5941388b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11192e17-6613-433c-a07d-87a8061c158c", "name": "network-vif-deleted", "tag": "913e4250-dc40-469d-8dcb-685c17d19e2c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:47.094527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.104506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-89a504da-bc6f-4a2b-8060-56c197e77a62 req-7eade2f7-56dd-4489-8cf6-b8b5941388b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.109095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-89a504da-bc6f-4a2b-8060-56c197e77a62 req-7eade2f7-56dd-4489-8cf6-b8b5941388b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.158874 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-89a504da-bc6f-4a2b-8060-56c197e77a62 req-7eade2f7-56dd-4489-8cf6-b8b5941388b8 service nova] Creating event network-vif-deleted:913e4250-dc40-469d-8dcb-685c17d19e2c for instance 11192e17-6613-433c-a07d-87a8061c158c on n-h2-849796-1 Jul 18 02:39:47.181907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-89a504da-bc6f-4a2b-8060-56c197e77a62 req-7eade2f7-56dd-4489-8cf6-b8b5941388b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160542 Jul 18 02:39:47.189492 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2373/4808] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:39:47.500910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:47.502587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:47.533018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.534256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.545867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.548706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.703194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.707797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.708624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lazy-loading 'fault' on Instance uuid 11192e17-6613-433c-a07d-87a8061c158c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:47.890201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:47.902458 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b49be16f-2127-4834-a9e8-fd87c18960fa tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 200 len: 1298 microversion: 2.1 time: 0.418719 Jul 18 02:39:47.903364 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2436/4809] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:47 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 1298 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:48.438428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-54b765a6-7644-4d55-9061-297092896c83 req-0e062ae8-0aeb-4bfa-a49d-2a0a82c27c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-plugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:48.478433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-54b765a6-7644-4d55-9061-297092896c83 req-0e062ae8-0aeb-4bfa-a49d-2a0a82c27c55 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:48.480215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-54b765a6-7644-4d55-9061-297092896c83 req-0e062ae8-0aeb-4bfa-a49d-2a0a82c27c55 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:48.531965 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-54b765a6-7644-4d55-9061-297092896c83 req-0e062ae8-0aeb-4bfa-a49d-2a0a82c27c55 service nova] Creating event network-vif-plugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:39:48.555639 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-54b765a6-7644-4d55-9061-297092896c83 req-0e062ae8-0aeb-4bfa-a49d-2a0a82c27c55 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129904 Jul 18 02:39:48.559285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2374/4810] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:39:48.922124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:48.922963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:48.943741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:48.944208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:48.945084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:48.945543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:48.988114 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c HTTP/1.1 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '11192e17-6613-433c-a07d-87a8061c158c'} Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:48.997271 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe2b1245-4b1d-41a1-ae9c-22713aff9c1b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 404 len: 111 microversion: 2.1 time: 0.082525 Jul 18 02:39:49.004020 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2437/4811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:48 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:49.411889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-222211356", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:49.701462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:39:53.673994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab330844-4eac-4640-9f59-65301f70a556 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-486712576", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:53.688549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ab330844-4eac-4640-9f59-65301f70a556 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] HTTP exception thrown: min_count must be <= max_count Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab330844-4eac-4640-9f59-65301f70a556 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Request method failure captured: Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 183 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mf4-KpAC7l5O2NM-CTI6cMrWZnh37SH42JyrLRh4ztIRwgPGCZXfIMLxZmeqLglXZ06M4DhBsNbjFOClzwP9AjsDvzgpXgMzfBiVuwbundeHmUB7Q3fiwwUX9vE4OKz-rqiQ5m_ikqdPU15nuKr3t-u3qENRmgWUvj9zuMddPPb1YA Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_12431490c83e46fa9b2b64761b485f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 19d4dbc883834636adea0d50ad403e35 Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-486712576", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: exception: min_count must be <= max_count Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-486712576', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 18 02:39:53.726623 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.732613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab330844-4eac-4640-9f59-65301f70a556 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Returning 400 to user: min_count must be <= max_count {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:53.732613 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab330844-4eac-4640-9f59-65301f70a556 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.411907 Jul 18 02:39:53.751691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2438/4812] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:53 2022] POST /compute/v2.1/servers => generated 74 bytes in 436 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 18 02:39:53.807662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.808591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.865208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.866043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.868750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.870732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.931201 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed HTTP/1.1 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '10674860-cbe9-4c9b-930d-3d2d4f3ecaed'} Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:53.957613 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.962611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:53.964675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a7215fc-00ca-4e50-9a09-7acbde10fbf2 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 404 len: 111 microversion: 2.1 time: 0.211149 Jul 18 02:39:53.965739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2439/4813] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:53 2022] DELETE /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:53.975039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8ca4ff2-e40c-4204-a998-4671de8fe43b tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-524101090", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "max_count": 0}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8ca4ff2-e40c-4204-a998-4671de8fe43b tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Request method failure captured: Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 167 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mf4-KpAC7l5O2NM-CTI6cMrWZnh37SH42JyrLRh4ztIRwgPGCZXfIMLxZmeqLglXZ06M4DhBsNbjFOClzwP9AjsDvzgpXgMzfBiVuwbundeHmUB7Q3fiwwUX9vE4OKz-rqiQ5m_ikqdPU15nuKr3t-u3qENRmgWUvj9zuMddPPb1YA Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_12431490c83e46fa9b2b64761b485f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 19d4dbc883834636adea0d50ad403e35 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-524101090", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "max_count": 0}} Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-524101090', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'max_count': 0}}} Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 0 Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:53.990317 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:53.994843 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:53.996590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8ca4ff2-e40c-4204-a998-4671de8fe43b tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:54.001541 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8ca4ff2-e40c-4204-a998-4671de8fe43b tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034391 Jul 18 02:39:54.002667 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2440/4814] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:54.016642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.028354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: 10674860-cbe9-4c9b-930d-3d2d4f3ecaed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.053348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.058649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.059779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.060910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.108583 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed HTTP/1.1 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '10674860-cbe9-4c9b-930d-3d2d4f3ecaed'} Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.110507 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. Jul 18 02:39:54.115849 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.117057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance 10674860-cbe9-4c9b-930d-3d2d4f3ecaed could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:54.118829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67ac2d5d-f675-49dd-be87-2757eadb7ed3 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed" status: 404 len: 111 microversion: 2.1 time: 0.110795 Jul 18 02:39:54.122313 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2441/4815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:54 2022] GET /compute/v2.1/servers/10674860-cbe9-4c9b-930d-3d2d4f3ecaed => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:54.152111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58f3608f-8ecf-40c9-94f1-3a0f2600cba3 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1431124445", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "max_count": 2.5}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58f3608f-8ecf-40c9-94f1-3a0f2600cba3 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Request method failure captured: Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 170 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mf4-KpAC7l5O2NM-CTI6cMrWZnh37SH42JyrLRh4ztIRwgPGCZXfIMLxZmeqLglXZ06M4DhBsNbjFOClzwP9AjsDvzgpXgMzfBiVuwbundeHmUB7Q3fiwwUX9vE4OKz-rqiQ5m_ikqdPU15nuKr3t-u3qENRmgWUvj9zuMddPPb1YA Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_12431490c83e46fa9b2b64761b485f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 19d4dbc883834636adea0d50ad403e35 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1431124445", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "max_count": 2.5}} Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1431124445', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'max_count': 2.5}}} Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:54.156475 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:54.160641 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.169180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58f3608f-8ecf-40c9-94f1-3a0f2600cba3 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:54.171060 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58f3608f-8ecf-40c9-94f1-3a0f2600cba3 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.046010 Jul 18 02:39:54.172044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2442/4816] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:54.182412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.183389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.207472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.209000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.210252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.212552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.310826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:54.481484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:39:54.482704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:39:54.483373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:39:54.484057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:39:54.484570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:39:54.519933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.521136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.522233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.522797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.614825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:54.619783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9449d57c-abf5-42af-8a42-9450447efda4 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 204 len: 0 microversion: 2.1 time: 0.445621 Jul 18 02:39:54.621603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2443/4817] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:54 2022] DELETE /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:54.637037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:54.657732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2add1f9-03df-41b4-8e74-d48b8a3130f2 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924321745", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 0}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2add1f9-03df-41b4-8e74-d48b8a3130f2 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Request method failure captured: Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 168 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mf4-KpAC7l5O2NM-CTI6cMrWZnh37SH42JyrLRh4ztIRwgPGCZXfIMLxZmeqLglXZ06M4DhBsNbjFOClzwP9AjsDvzgpXgMzfBiVuwbundeHmUB7Q3fiwwUX9vE4OKz-rqiQ5m_ikqdPU15nuKr3t-u3qENRmgWUvj9zuMddPPb1YA Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_12431490c83e46fa9b2b64761b485f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 19d4dbc883834636adea0d50ad403e35 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1924321745", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 0}} Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1924321745', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'min_count': 0}}} Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi 0 Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:54.685764 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 18 02:39:54.690652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:39:54.692320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:39:54.693486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2add1f9-03df-41b4-8e74-d48b8a3130f2 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:54.696877 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d2add1f9-03df-41b4-8e74-d48b8a3130f2 tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.072110 Jul 18 02:39:54.702541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:39:54.705738 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2444/4818] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:54.720052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:54.734026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.766728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.768014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.769886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.771392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.976441 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-161e3b9d-ec55-4935-b469-ff7f0903ca5c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.569938 Jul 18 02:39:54.985468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2375/4819] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:39:55.011133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd441164-ccb3-42fe-b2e5-3e49747c71cb tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-385866219", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 2.5}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd441164-ccb3-42fe-b2e5-3e49747c71cb tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Request method failure captured: Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 169 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mf4-KpAC7l5O2NM-CTI6cMrWZnh37SH42JyrLRh4ztIRwgPGCZXfIMLxZmeqLglXZ06M4DhBsNbjFOClzwP9AjsDvzgpXgMzfBiVuwbundeHmUB7Q3fiwwUX9vE4OKz-rqiQ5m_ikqdPU15nuKr3t-u3qENRmgWUvj9zuMddPPb1YA Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_12431490c83e46fa9b2b64761b485f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/12431490c83e46fa9b2b64761b485f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 12431490c83e46fa9b2b64761b485f96 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-15972086 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 19d4dbc883834636adea0d50ad403e35 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-15972086-project Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-385866219", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "min_count": 2.5}} Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-385866219', 'imageRef': '8c01d435-c8d4-440f-bb6f-419ec4a428ef', 'flavorRef': '452', 'min_count': 2.5}}} Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi 2.5 Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:39:55.038451 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:39:55.043572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd441164-ccb3-42fe-b2e5-3e49747c71cb tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:55.061588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd441164-ccb3-42fe-b2e5-3e49747c71cb tempest-MultipleCreateNegativeTestJSON-15972086 tempest-MultipleCreateNegativeTestJSON-15972086-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.053392 Jul 18 02:39:55.068767 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2376/4820] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:55.096674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8b549cb-6d34-439f-a43c-d19c26454977 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.097885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8b549cb-6d34-439f-a43c-d19c26454977 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.564178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c8b549cb-6d34-439f-a43c-d19c26454977 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.601078 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8b549cb-6d34-439f-a43c-d19c26454977 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1208 microversion: 2.1 time: 0.535993 Jul 18 02:39:55.602192 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2377/4821] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1208 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:56.324864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.349800 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4665471-87d9-4885-8a0c-0687053662cd tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 1.637820 Jul 18 02:39:56.350531 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2445/4822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:54 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:56.637792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ea9050f-c150-4511-aad5-b630f500f825 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:56.645739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ea9050f-c150-4511-aad5-b630f500f825 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:57.082893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ea9050f-c150-4511-aad5-b630f500f825 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:57.135726 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ea9050f-c150-4511-aad5-b630f500f825 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1208 microversion: 2.1 time: 0.506595 Jul 18 02:39:57.136808 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2378/4823] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:56 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1208 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:57.391782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:57.392910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:57.441457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.448786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.449962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.451243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.174467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:58.178548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:58.210669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.213058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.221702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.223252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.604345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.618224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c97e7f2-db45-447d-a3f6-d102cb42e817 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1268 microversion: 2.1 time: 0.453894 Jul 18 02:39:58.626105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2379/4824] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:58 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1268 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:59.083837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:59.111437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43b6fdba-6c3a-4698-8510-32f36cf96254 tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1511 microversion: 2.1 time: 1.710393 Jul 18 02:39:59.111831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2446/4825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:57 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1511 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:59.653620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:59.655645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:59.734484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.745185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.756474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.761330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.146277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:00.148401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:00.179231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:00.189167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.191242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.203637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.211871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.234465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.244743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b1ddbfc-f9b1-4860-9084-d8187e920b51 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1266 microversion: 2.1 time: 0.595885 Jul 18 02:40:00.253350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2380/4826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:59 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1266 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:00.352597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-68786041-6776-491f-8792-31ff51a1183f req-10d37655-de86-44b6-bca0-8654c98c4ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c07d-cfcf-47a3-a5d3-99d0eee2d802", "name": "network-vif-deleted", "tag": "c6140010-f639-48c6-9358-09ff899bf05a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:00.426403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-68786041-6776-491f-8792-31ff51a1183f req-10d37655-de86-44b6-bca0-8654c98c4ab9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.433818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-68786041-6776-491f-8792-31ff51a1183f req-10d37655-de86-44b6-bca0-8654c98c4ab9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.449255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.449743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.450261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lazy-loading 'fault' on Instance uuid b743c07d-cfcf-47a3-a5d3-99d0eee2d802 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:00.496167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:00.540758 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-68786041-6776-491f-8792-31ff51a1183f req-10d37655-de86-44b6-bca0-8654c98c4ab9 service nova] Creating event network-vif-deleted:c6140010-f639-48c6-9358-09ff899bf05a for instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 on n-h2-849796-1 Jul 18 02:40:00.583015 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-68786041-6776-491f-8792-31ff51a1183f req-10d37655-de86-44b6-bca0-8654c98c4ab9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228652 Jul 18 02:40:00.593155 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2381/4827] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:00.726413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368018b1936a4ec99e16412a5139b575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607decefd93648458479c655fcc651bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:00.760323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8aaab47a-d360-422e-8955-bf334ea3492e tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 200 len: 1306 microversion: 2.1 time: 0.611867 Jul 18 02:40:00.767294 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2447/4828] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:00 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 1306 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:01.272631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:01.274055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:01.304613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.307031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.309126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.323080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.472433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.490852 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e3f20d5c-640f-485d-90a0-c779d793c39d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1266 microversion: 2.1 time: 0.223634 Jul 18 02:40:01.506068 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2382/4829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:01 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:01.803051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:01.808953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] [instance: b743c07d-cfcf-47a3-a5d3-99d0eee2d802] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:01.838872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.842327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.847796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:01.847796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.912723 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] HTTP exception thrown: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Request method failure captured: Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 HTTP/1.1 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mazd8glbR13i2jY8hYRsWwMyCR7EJkzvypLQe9oJ_Cu7L8i2QpzSCjARCYb2th2iO706iHDuOLctT5K3LTSaznqz4tuPs7CVdxLlMPvQjBomZJbt4vrlRm4oJ-ELXPyzpre2Te1r12avQw4nVXrHVyOPP5tvHT4tZ1IryE84ee2440 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 607decefd93648458479c655fcc651bc Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_607decefd93648458479c655fcc651bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/607decefd93648458479c655fcc651bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/607decefd93648458479c655fcc651bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 607decefd93648458479c655fcc651bc Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1882498306 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 368018b1936a4ec99e16412a5139b575 Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1882498306-project Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b743c07d-cfcf-47a3-a5d3-99d0eee2d802'} Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:01.914672 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. Jul 18 02:40:01.920156 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:40:01.923913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] Returning 404 to user: Instance b743c07d-cfcf-47a3-a5d3-99d0eee2d802 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:01.926208 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-618f7713-9d29-4928-9854-12ff57657dee tempest-ServersNegativeTestJSON-1882498306 tempest-ServersNegativeTestJSON-1882498306-project] 10.222.0.67 "GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802" status: 404 len: 111 microversion: 2.1 time: 0.131670 Jul 18 02:40:01.929906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2448/4830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:01 2022] GET /compute/v2.1/servers/b743c07d-cfcf-47a3-a5d3-99d0eee2d802 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:02.515984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:02.516846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:02.529768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.530211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.535328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.542494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:03.265093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:03.285961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9514852-6b55-42ce-96b8-373951211013 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1266 microversion: 2.1 time: 0.775831 Jul 18 02:40:03.295418 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2383/4831] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:02 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1266 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:04.311788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:04.312435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:04.331339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:04.349722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:04.350889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:04.359159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:06.068736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:06.116644 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f05f7faf-fc9a-4b9d-9bc4-6e7108864dbf tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.808915 Jul 18 02:40:06.124973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2449/4832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:04 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:07.170623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:07.183145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:07.218133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:07.224812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:07.280026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:07.285595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:07.291467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:07.292381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:07.412961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:08.831572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:08.851711 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07146ae2-bba9-4fcb-bd20-07ac630e223f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.699158 Jul 18 02:40:08.854192 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2384/4833] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:07 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:09.884078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:09.886285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:09.906617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:09.908882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:09.912685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:09.913543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:10.953733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:10.973021 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e297b9b8-aff0-4da6-83f2-22f3178b2f55 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.089967 Jul 18 02:40:10.973786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2450/4834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:09 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:11.897880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0940b93f-a228-4523-82f7-0251b66f2d41 req-375f75f0-7fbf-4271-835a-9b601dc0f44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939ad598-f972-4158-90c8-48aa9fbad733", "tag": "ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:11.946638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0940b93f-a228-4523-82f7-0251b66f2d41 req-375f75f0-7fbf-4271-835a-9b601dc0f44a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:11.947468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0940b93f-a228-4523-82f7-0251b66f2d41 req-375f75f0-7fbf-4271-835a-9b601dc0f44a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:11.993124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:11.994456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:12.011848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.013722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.020190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.021652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.024155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0940b93f-a228-4523-82f7-0251b66f2d41 req-375f75f0-7fbf-4271-835a-9b601dc0f44a service nova] Creating event network-changed:ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9 for instance 939ad598-f972-4158-90c8-48aa9fbad733 on n-h2-849796-1 Jul 18 02:40:12.068036 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0940b93f-a228-4523-82f7-0251b66f2d41 req-375f75f0-7fbf-4271-835a-9b601dc0f44a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175129 Jul 18 02:40:12.068036 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2385/4835] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:14.880101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:14.924477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd136236-aba2-42ea-9744-c32bf3d0f687 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 2.933250 Jul 18 02:40:14.927523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2451/4836] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:11 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 2939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:15.961594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:15.962885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:16.009993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:16.010822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:16.012387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:16.032608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:17.709210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:17.717796 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fff182d2-07f3-4a55-a253-4d1b06b2fd18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.763867 Jul 18 02:40:17.729670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2386/4837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:15 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:18.736354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:18.738753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:18.765959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:18.766416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:18.767237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:18.767671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:19.880567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:19.901853 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15861df9-ff91-4ae2-95f2-3102ade87769 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.161864 Jul 18 02:40:19.910911 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2452/4838] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:18 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:20.944153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:20.945220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:20.948816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:20.973608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:20.974077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:20.977938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:20.978664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:22.491210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:22.526098 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c80ab03f-af98-4065-a69d-60f39bde9b2b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.583832 Jul 18 02:40:22.529718 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2387/4839] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:20 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:23.209159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a1b96e49-03d5-418f-b86b-642576a8a8fc req-bc0200bd-3e92-48aa-bf37-2de464e75018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ad598-f972-4158-90c8-48aa9fbad733", "name": "network-vif-plugged", "status": "completed", "tag": "ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:23.271772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a1b96e49-03d5-418f-b86b-642576a8a8fc req-bc0200bd-3e92-48aa-bf37-2de464e75018 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:23.276629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a1b96e49-03d5-418f-b86b-642576a8a8fc req-bc0200bd-3e92-48aa-bf37-2de464e75018 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:23.366137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a1b96e49-03d5-418f-b86b-642576a8a8fc req-bc0200bd-3e92-48aa-bf37-2de464e75018 service nova] Creating event network-vif-plugged:ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9 for instance 939ad598-f972-4158-90c8-48aa9fbad733 on n-h2-849796-1 Jul 18 02:40:23.394073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a1b96e49-03d5-418f-b86b-642576a8a8fc req-bc0200bd-3e92-48aa-bf37-2de464e75018 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205829 Jul 18 02:40:23.405869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2453/4840] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:23.552602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:23.553534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:23.573144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:23.577154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:23.579797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:23.580451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.183574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:24.191289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:24.248184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.249310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.251375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.269502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.582831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:24.613742 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a6d85fe-a70a-418c-a5e6-beded4f7f17f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.474715 Jul 18 02:40:24.630934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2454/4841] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:24 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:24.834606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:24.867906 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-384178c0-28ec-4080-9f90-ff072f012ac6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1308 microversion: 2.1 time: 1.319795 Jul 18 02:40:24.878591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2388/4842] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:23 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1308 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:25.642228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:25.643009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:25.654941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.659065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.660135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.663859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.903092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:25.904723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:25.923185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.923640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.924657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.925148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.972012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:25.992555 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-250e67ec-3c53-45d1-bf5a-9fa70e90c70a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.355485 Jul 18 02:40:26.006166 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2455/4843] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:25 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:26.035237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1578046338"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:26.038435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.054948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.056943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.060068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.061604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.328275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:26.342624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc077c01-bb72-4db0-a9d1-e8cae1b67754 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1490 microversion: 2.1 time: 0.440723 Jul 18 02:40:26.343603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2389/4844] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:25 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1490 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:26.383183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:26.388775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.404965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.405886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.411826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.412728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.582626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2525e42c-5d09-45ad-ba03-b2a832ab4b19 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "PUT /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1085 microversion: 2.1 time: 0.204125 Jul 18 02:40:26.585797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2390/4845] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:40:26 2022] PUT /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1085 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:26.609903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:26.610817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.626740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.627819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.629963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.632964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.948801 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-624feebf-b996-4c6b-99e0-d4e643febe32 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.928339 Jul 18 02:40:26.949756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2456/4846] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:40:26 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:40:27.250361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:27.264324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf02b01b-fea7-4844-bc55-effd6f43117f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1511 microversion: 2.1 time: 0.660613 Jul 18 02:40:27.270289 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2391/4847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:26 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:27.298073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:27.299514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:27.315101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.317932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.322272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.327960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.645096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:27.655309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-356f4e16-d7d3-42c0-888a-a16bd1956adb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1511 microversion: 2.1 time: 0.360278 Jul 18 02:40:27.657372 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2457/4848] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:27 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:27.686115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:27.686554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:27.698162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.699142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.699428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.700513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.810853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:28.114199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-84af6be1-1756-4780-8166-fbf3193add47 req-45aea5ba-abd3-465c-8622-1449224f80fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:28.120327 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6356d2ea-190a-4b42-9935-95c8549bd039 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 204 len: 0 microversion: 2.1 time: 0.438742 Jul 18 02:40:28.134656 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2392/4849] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:27 2022] DELETE /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:28.138374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-84af6be1-1756-4780-8166-fbf3193add47 req-45aea5ba-abd3-465c-8622-1449224f80fd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.140212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-84af6be1-1756-4780-8166-fbf3193add47 req-45aea5ba-abd3-465c-8622-1449224f80fd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.160043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:28.167637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:28.170075 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-84af6be1-1756-4780-8166-fbf3193add47 req-45aea5ba-abd3-465c-8622-1449224f80fd service nova] Creating event network-vif-unplugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:40:28.188283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-84af6be1-1756-4780-8166-fbf3193add47 req-45aea5ba-abd3-465c-8622-1449224f80fd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079525 Jul 18 02:40:28.191792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2458/4850] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:28.199446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.208273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.210408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.215161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.853643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:28.902145 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9328c3e6-bfc6-43c2-bf01-d49aa657c6b0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1517 microversion: 2.1 time: 0.763060 Jul 18 02:40:28.906439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2393/4851] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:28 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:29.937218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:29.938600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:29.956778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.957694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:29.961986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.962722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.765113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:31.768679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:31.781017 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67a3957a-cabc-4081-a3ea-cc60a2b44bf8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1517 microversion: 2.1 time: 1.848741 Jul 18 02:40:31.782337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2459/4852] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:29 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1517 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:32.740585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b05b9f50-1978-4094-af1c-baadbac648af tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7faaf74699d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:32.770960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-bc0f8066-d8cf-4485-a03a-45dc0f9a3d4f req-06c92778-9d85-4f37-9c0f-2f3ded791073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ad598-f972-4158-90c8-48aa9fbad733", "name": "network-vif-deleted", "tag": "ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:32.800487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:32.813724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bc0f8066-d8cf-4485-a03a-45dc0f9a3d4f req-06c92778-9d85-4f37-9c0f-2f3ded791073 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.814654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bc0f8066-d8cf-4485-a03a-45dc0f9a3d4f req-06c92778-9d85-4f37-9c0f-2f3ded791073 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.852915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b05b9f50-1978-4094-af1c-baadbac648af tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7db257d5-d632-43e9-9d08-4b6554ebd848" status: 200 len: 350 microversion: 2.1 time: 0.116271 Jul 18 02:40:32.860325 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2394/4853] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:40:32 2022] GET /compute/v2.1/os-volumes/7db257d5-d632-43e9-9d08-4b6554ebd848 => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:32.870426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:32.871243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:32.874636 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-bc0f8066-d8cf-4485-a03a-45dc0f9a3d4f req-06c92778-9d85-4f37-9c0f-2f3ded791073 service nova] Creating event network-vif-deleted:ab8bb255-9bd9-439d-8a02-cd17c7bd1ae9 for instance 939ad598-f972-4158-90c8-48aa9fbad733 on n-h2-849796-1 Jul 18 02:40:32.898513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.905494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.906769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.908770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.937867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-bc0f8066-d8cf-4485-a03a-45dc0f9a3d4f req-06c92778-9d85-4f37-9c0f-2f3ded791073 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174178 Jul 18 02:40:32.939536 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2460/4854] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:34.020958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:34.039211 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a008090-41c9-41de-96a6-c6f4de509b71 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 200 len: 1314 microversion: 2.1 time: 1.177064 Jul 18 02:40:34.052183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2395/4855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:32 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:35.078895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:35.084302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:35.114181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.114658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:35.115519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.115982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:35.162620 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 HTTP/1.1 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '939ad598-f972-4158-90c8-48aa9fbad733'} Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:40:35.164312 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af3dbc95-d580-4c46-9f84-0e84b3271e6f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 404 len: 111 microversion: 2.1 time: 0.100754 Jul 18 02:40:35.177778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2396/4856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:35 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:35.484531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: .version_select at 0x7fab0469ad30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1641056959", "policies": ["affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:35.485370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1544678855", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "205eb17d-f1f5-4330-9e2a-fc1d56a61ed4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:35.539626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:35.550987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:35.586283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] validate_networks() for [('205eb17d-f1f5-4330-9e2a-fc1d56a61ed4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:40:35.722213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:35.744845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:35.774429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1cda1425-822d-456e-b978-c583f57a5f12 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.767958 Jul 18 02:40:35.781936 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2461/4857] 10.222.0.67 () {60 vars in 1173 bytes} [Mon Jul 18 02:40:35 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:35.789231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: .version_select at 0x7fab04bef160>, body: {"server_group": {"name": "tempest-server-group-554073150", "policies": ["affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:35.812297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:35.819294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:35.937704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:35.946217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:35.969194 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-808dbe7a-5f2a-42f7-902b-804327bf5538 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.185512 Jul 18 02:40:35.977336 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2462/4858] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:40:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:35.988975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b972caf-7578-46f9-8d95-9644dc9c61e6 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0462fa60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.083430 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b972caf-7578-46f9-8d95-9644dc9c61e6 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/3986e97b-e0c2-4467-88ac-fe42055a1ef5" status: 200 len: 351 microversion: 2.1 time: 0.104546 Jul 18 02:40:36.084038 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2463/4859] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:40:35 2022] GET /compute/v2.1/os-volumes/3986e97b-e0c2-4467-88ac-fe42055a1ef5 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:36.094904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: .version_select at 0x7fab04684f70>, body: {"server_group": {"name": "tempest-server-group-554073150", "policies": ["affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:36.141908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:36.157030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:36.288765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:36.317656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:36.362116 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c611ebcb-6a2f-47d8-a57f-655bfaaf0a87 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.276211 Jul 18 02:40:36.370231 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2464/4860] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:40:36 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:36.385768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e19ff5c-20f0-42f6-928e-b0b573c08baf tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.462917 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e19ff5c-20f0-42f6-928e-b0b573c08baf tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/82ead906-fee6-402d-900f-fceebdb89013" status: 204 len: 0 microversion: 2.1 time: 0.091468 Jul 18 02:40:36.468003 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2465/4861] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:40:36 2022] DELETE /compute/v2.1/os-server-groups/82ead906-fee6-402d-900f-fceebdb89013 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:36.474905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67625421-6958-40f7-9862-6e35022a267c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.523026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67625421-6958-40f7-9862-6e35022a267c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.049481 Jul 18 02:40:36.530411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2466/4862] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:40:36 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:36.548641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7860ea9-afcd-48e7-8d1f-923784de8331 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.620308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:36.648042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7860ea9-afcd-48e7-8d1f-923784de8331 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/21140558-7351-49ac-94ec-12f16f738431" status: 204 len: 0 microversion: 2.1 time: 0.115837 Jul 18 02:40:36.651296 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2467/4863] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:40:36 2022] DELETE /compute/v2.1/os-server-groups/21140558-7351-49ac-94ec-12f16f738431 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:36.660100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b570e7a5-bd73-4178-bd00-2f28cb03059c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.702170 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b570e7a5-bd73-4178-bd00-2f28cb03059c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.046373 Jul 18 02:40:36.714502 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2468/4864] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:40:36 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:36.736210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: .version_select at 0x7fab046849d0>, body: {"server_group": {"name": "tempest-server-group-702939403", "policies": ["affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:36.795888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:36.818346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:37.037590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:37.058318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:37.090299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0bf34253-5577-4d28-92ea-33367202cfcc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.364437 Jul 18 02:40:37.091228 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2469/4865] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:40:36 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:37.110778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-372af453-58e4-4463-9837-4b4f279df4d0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.179634 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-372af453-58e4-4463-9837-4b4f279df4d0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/496be539-2ae0-44ff-bd53-6a3af614769c" status: 204 len: 0 microversion: 2.1 time: 0.082030 Jul 18 02:40:37.181142 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2470/4866] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:40:37 2022] DELETE /compute/v2.1/os-server-groups/496be539-2ae0-44ff-bd53-6a3af614769c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:40:37.190050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12b86b84-716d-4592-a992-c9336eaea4b5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.216020 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12b86b84-716d-4592-a992-c9336eaea4b5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029952 Jul 18 02:40:37.217075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2471/4867] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:40:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:37.228443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: .version_select at 0x7fab04684940>, body: {"server_group": {"name": "tempest-server-group-643591762", "policies": ["anti-affinity"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:37.272668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:37.288210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:37.410660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:37.431411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_groups'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:37.465273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-676205b4-1fff-467d-a6c5-2e3fb37cb29e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.240884 Jul 18 02:40:37.465908 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2472/4868] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:40:37 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:37.475895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-91619dc5-f651-4a97-8f27-8baee3d8ffbf tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.546024 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-91619dc5-f651-4a97-8f27-8baee3d8ffbf tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0" status: 204 len: 0 microversion: 2.1 time: 0.074024 Jul 18 02:40:37.547020 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2473/4869] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:40:37 2022] DELETE /compute/v2.1/os-server-groups/8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:37.555432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f78685ba-3505-4a0e-bf67-295eb541321a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.587497 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f78685ba-3505-4a0e-bf67-295eb541321a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033909 Jul 18 02:40:37.588406 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2474/4870] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:40:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:37.906338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-199933243", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "2c7727e1-2fef-41d9-b28a-e7c66ec2a435"}]}, "os:scheduler_hints": {"group": "b8e234b8-acf8-4779-9bee-e36eaea01791"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:38.077407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] validate_networks() for [('2c7727e1-2fef-41d9-b28a-e7c66ec2a435', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:40:38.147619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:40:38.149724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:40:38.149724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:40:38.150096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:40:38.150439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:40:38.204575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.216239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.220962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.225279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.341428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:38.376635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:38.392293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Getting quotas for user 76cee3956ea44a18a9dd7b79db5c43c2 and project e651124c601f4304b14598bba7e2e660. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:38.447405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:40:38.454076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:40:38.627186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40c3fee5-3978-4b00-a9d2-a7fdbf458b04 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.146380 Jul 18 02:40:38.629709 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2397/4871] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:40:38.656377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5c68aee6-4358-445b-9595-d87a492fa140 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:38.657512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5c68aee6-4358-445b-9595-d87a492fa140 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:39.197181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5c68aee6-4358-445b-9595-d87a492fa140 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:39.244977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5c68aee6-4358-445b-9595-d87a492fa140 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1209 microversion: 2.1 time: 0.589360 Jul 18 02:40:39.252389 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2398/4872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:38 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1209 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:39.915820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-bbae78e4-98f8-464c-9bc9-a87883e244f2 req-c917f994-0ea5-430a-bd3c-d221aaabfbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-plugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:39.939798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bbae78e4-98f8-464c-9bc9-a87883e244f2 req-c917f994-0ea5-430a-bd3c-d221aaabfbe3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:39.940761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bbae78e4-98f8-464c-9bc9-a87883e244f2 req-c917f994-0ea5-430a-bd3c-d221aaabfbe3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:39.961340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:40:39.962167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:40:39.962359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:40:39.962672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:40:39.963282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:40:39.984012 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-bbae78e4-98f8-464c-9bc9-a87883e244f2 req-c917f994-0ea5-430a-bd3c-d221aaabfbe3 service nova] Creating event network-vif-plugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:40:40.000912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-bbae78e4-98f8-464c-9bc9-a87883e244f2 req-c917f994-0ea5-430a-bd3c-d221aaabfbe3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091597 Jul 18 02:40:40.011215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.011215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.011215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.011867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2399/4873] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:40.015041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.098298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:40.116621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:40.167644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:40:40.177329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:40:40.275759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.289894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:40.314480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:40.332110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.332990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.334532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.335330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.350583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:40.364660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:40.503259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:40.518636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Getting quotas for user 51be14451afe413fa19c41e1151c25e8 and project 161ac7b6a5304f829f42ec3bec0d5c1d. Resources: {'server_group_members'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:40.582893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76258933-a74c-4ee9-ab88-81379752214f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681746 Jul 18 02:40:40.584024 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2475/4874] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:40:40.589486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55c06eda-09fc-402b-816d-072550663ae5 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0488dca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.699899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55c06eda-09fc-402b-816d-072550663ae5 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a5ccfec4-3f8f-4c24-9bc2-87a0533c51e5" status: 200 len: 350 microversion: 2.1 time: 0.113552 Jul 18 02:40:40.699899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2476/4875] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/os-volumes/a5ccfec4-3f8f-4c24-9bc2-87a0533c51e5 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:40.708496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5dbe68d3-5ec2-4aa3-888e-9d45569a870b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.714799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:40.720912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5dbe68d3-5ec2-4aa3-888e-9d45569a870b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:40.729429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f71887e6-62c7-4f2c-b6c5-b9cd39cef55b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1213 microversion: 2.1 time: 0.462903 Jul 18 02:40:40.744478 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2400/4876] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1213 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:40.750817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98956869-afba-4c2e-a6be-bc3683df0298 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7faaf792ce50>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.922401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5dbe68d3-5ec2-4aa3-888e-9d45569a870b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:40.968437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5dbe68d3-5ec2-4aa3-888e-9d45569a870b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1212 microversion: 2.1 time: 0.267053 Jul 18 02:40:40.979487 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2477/4877] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1212 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.113845 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-98956869-afba-4c2e-a6be-bc3683df0298 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.367834 Jul 18 02:40:41.115060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2401/4878] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.147600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2a4c9db-f6b3-4d63-81e5-e0a1582e53ff tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0479d5e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.431593 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2a4c9db-f6b3-4d63-81e5-e0a1582e53ff tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.291422 Jul 18 02:40:41.432623 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2478/4879] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:41.446470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bc4b91d2-a945-40bf-bf86-ca2b5ae4bb05 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab048ab280>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.701283 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bc4b91d2-a945-40bf-bf86-ca2b5ae4bb05 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.259482 Jul 18 02:40:41.701898 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2402/4880] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.714699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-501bca69-50ce-4dfb-b4a4-36986e1f4280 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0462f790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.751316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.751944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:41.764771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.765411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.766253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.766704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.189269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-501bca69-50ce-4dfb-b4a4-36986e1f4280 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.479215 Jul 18 02:40:42.200326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:42.201416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2479/4881] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:42.207595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71eed826-a07a-430c-b823-dd544a81b36b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:42.208236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71eed826-a07a-430c-b823-dd544a81b36b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:42.219529 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b27b03d1-8f2a-4a65-949c-aeedd877feb4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1267 microversion: 2.1 time: 0.473624 Jul 18 02:40:42.244251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2403/4882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1267 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:42.254123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb5eaa28-0ca5-4d73-9661-fbfe86e9a8ff tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7faaf74695e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:42.481909 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb5eaa28-0ca5-4d73-9661-fbfe86e9a8ff tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.236412 Jul 18 02:40:42.483247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2404/4883] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:42.507526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c9f94d9-cb99-46dd-b1f1-b8a947d1110a tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0439c940>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:42.563037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71eed826-a07a-430c-b823-dd544a81b36b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:42.577428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71eed826-a07a-430c-b823-dd544a81b36b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1212 microversion: 2.1 time: 0.374382 Jul 18 02:40:42.597443 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2480/4884] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1212 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:42.749447 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c9f94d9-cb99-46dd-b1f1-b8a947d1110a tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.246174 Jul 18 02:40:42.750466 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2405/4885] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:42.773073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aaa4b283-4f65-479d-818a-dc068a621889 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7fab0468a550>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:43.146047 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aaa4b283-4f65-479d-818a-dc068a621889 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.379806 Jul 18 02:40:43.147811 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2481/4886] 10.222.0.67 () {58 vars in 1187 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:43.166101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e644c12-81a2-4bf0-a5c2-522d2e883109 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] Calling method '.version_select at 0x7faaf748e700>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:43.252830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:43.253488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:43.283017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.283882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.284858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.285461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.520964 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e644c12-81a2-4bf0-a5c2-522d2e883109 tempest-VolumesTestJSON-250578062 tempest-VolumesTestJSON-250578062-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.359683 Jul 18 02:40:43.522658 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2406/4887] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:40:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:43.546814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:43.555640 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-494fa2a0-98af-4385-8ac5-fa2c5bc0b5fc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1267 microversion: 2.1 time: 0.308932 Jul 18 02:40:43.573930 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2482/4888] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:43 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1267 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:43.596117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:43.596985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:43.606532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.622501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.627479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.630020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.909552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:43.945293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16114c3f-d898-4a98-8bee-27a8eb5cd26e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1272 microversion: 2.1 time: 0.352668 Jul 18 02:40:43.947629 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2407/4889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:43 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:44.600517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.614560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:44.646633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.648223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.650281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.651935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.888646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:44.897532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21f9b521-c67a-4bb8-8d9c-6863ed54a2fd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1267 microversion: 2.1 time: 0.305099 Jul 18 02:40:44.913254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2483/4890] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:44 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:44.967744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.968751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:44.983638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.999827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:45.000836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:45.003299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:45.927099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:45.938802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:45.994670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:46.005494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:46.010623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:46.011778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:46.155086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:46.164792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0f9acd1-93e6-4d06-9fc6-3695247c2bfb tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1270 microversion: 2.1 time: 1.202082 Jul 18 02:40:46.189361 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2408/4891] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:44 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1270 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:47.206088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:47.207111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:47.248488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:47.356638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.357093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.358509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.359292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.366682 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d9b6d04c-62d6-485c-9202-5dc2fdb021a9 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 1.448977 Jul 18 02:40:47.404718 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2484/4892] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:45 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:47.877575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:47.886523 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a24f5ba-6123-4e93-97a9-5377b9aff87c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1270 microversion: 2.1 time: 0.688942 Jul 18 02:40:47.907996 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2409/4893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:47 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1270 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:48.448356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:48.449550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:48.492840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.505152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.510149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.510857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.952049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:48.954398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:48.988577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:49.007731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.008457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:49.021116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.025087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:49.247920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:50.044867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:50.103144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:50.144902 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0212bdc1-f532-4593-839f-272a129ab808 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 1.734681 Jul 18 02:40:50.148650 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2485/4894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:48 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:50.687658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:50.704354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4eef3278-a690-41b2-b167-5ffaa15f330b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 1.762376 Jul 18 02:40:50.707378 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2410/4895] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:48 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:51.169408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:51.175687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:51.230102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.231359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.236194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.241815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.704743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:51.728181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27e18a62-24fb-4df7-babe-b4913c905a86 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 0.562218 Jul 18 02:40:51.729603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2486/4896] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:51 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:51.741607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:51.743185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:51.754414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:51.765394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.770077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.771104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.790613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.415504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:52.429710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e442027-11dd-492e-9b88-ee9d214a8cf0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 0.692933 Jul 18 02:40:52.446977 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2411/4897] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:51 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:52.760243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:52.761197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:52.775015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=58 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:52.779524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.782467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.786587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.787056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.161978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-01588793-aa40-4e1f-86fa-51c1a7a2d308 req-1b484199-55f0-4bfa-8dbd-8a807e7fc6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14652ecf-927e-45b2-bfe3-26ada28c8473", "tag": "d402a9f2-3455-4288-a293-e970ceb1be4a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:53.197260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-01588793-aa40-4e1f-86fa-51c1a7a2d308 req-1b484199-55f0-4bfa-8dbd-8a807e7fc6d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.197655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-01588793-aa40-4e1f-86fa-51c1a7a2d308 req-1b484199-55f0-4bfa-8dbd-8a807e7fc6d5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.248450 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-01588793-aa40-4e1f-86fa-51c1a7a2d308 req-1b484199-55f0-4bfa-8dbd-8a807e7fc6d5 service nova] Creating event network-changed:d402a9f2-3455-4288-a293-e970ceb1be4a for instance 14652ecf-927e-45b2-bfe3-26ada28c8473 on n-h1-849796-1 Jul 18 02:40:53.264160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-01588793-aa40-4e1f-86fa-51c1a7a2d308 req-1b484199-55f0-4bfa-8dbd-8a807e7fc6d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104877 Jul 18 02:40:53.267074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2412/4898] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 02:40:53.463657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.468704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.500850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.504383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.507769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.512512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.219524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.228477 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6d2b2ad5-92fc-4f9e-b47e-b83e5907691b tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 1.473155 Jul 18 02:40:54.236942 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2487/4899] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:52 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:54.256775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-682870c0-e9c7-4b8b-afd0-01d1795c6a1d req-8df5d2a6-32f1-4266-bfa0-e6d78a52741a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dba2e2d-2f57-4a70-89a6-244c3e11332a", "tag": "441942c3-797f-4782-b86a-8607bcf90fdb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:54.301545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-682870c0-e9c7-4b8b-afd0-01d1795c6a1d req-8df5d2a6-32f1-4266-bfa0-e6d78a52741a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.302300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-682870c0-e9c7-4b8b-afd0-01d1795c6a1d req-8df5d2a6-32f1-4266-bfa0-e6d78a52741a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.344510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-682870c0-e9c7-4b8b-afd0-01d1795c6a1d req-8df5d2a6-32f1-4266-bfa0-e6d78a52741a service nova] Creating event network-changed:441942c3-797f-4782-b86a-8607bcf90fdb for instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a on n-h2-849796-1 Jul 18 02:40:54.356393 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-682870c0-e9c7-4b8b-afd0-01d1795c6a1d req-8df5d2a6-32f1-4266-bfa0-e6d78a52741a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115668 Jul 18 02:40:54.358324 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2488/4900] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:54.879785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.895928 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc61f61d-8eed-402e-aa6c-0818edbd5507 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 1.445903 Jul 18 02:40:54.897095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2413/4901] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:53 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:55.289467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:55.298582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:55.370647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.371545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.373024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.385114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.853487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:55.884129 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dcc508f-e324-4223-9a0f-b15a14518103 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 0.614908 Jul 18 02:40:55.897523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2489/4902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:55 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:55.934818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:55.935949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:56.007381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.008497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.017044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.020257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.728735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.766455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b32b7a8-90bd-4b22-bc79-0c7e030f322e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 0.839500 Jul 18 02:40:56.777741 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2414/4903] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:55 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:56.923763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:56.926110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:56.962980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.964749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.971978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.974094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.794667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:57.795851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:57.834110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.838004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.839239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.840282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.858603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:57.892851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85ce1bfc-3117-4713-a5f6-73ad9d309642 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 0.979284 Jul 18 02:40:57.898499 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2490/4904] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:56 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:58.929554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:58.935286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:58.966901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:58.968226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.974383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:58.976826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.554919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.564576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb4ce5c5-b225-45e2-a5ea-a334f690b514 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 1.781432 Jul 18 02:40:59.573857 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2415/4905] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:57 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:59.992799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:00.012662 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00ee37e8-0735-4ad5-8fda-0512e68a9178 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 1.089990 Jul 18 02:41:00.013477 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2491/4906] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:58 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:00.587307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:00.587856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:00.609951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.610427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.611270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.611733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.043868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:01.044510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:01.062035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.062514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.063343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.063999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.102460 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:41:01.103057 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 02:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 (ip 10.222.0.67) !!! Jul 18 02:41:01.456195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:01.472042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7980604-4353-4880-a721-6e03b064b238 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 0.432171 Jul 18 02:41:01.474894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2492/4907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:01 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:02.278432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:02.297263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2b96926-e9f0-4cb9-a51c-e0197a869316 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 1.714944 Jul 18 02:41:02.298563 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2416/4908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:00 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:02.494477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:02.496684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:02.530832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.539912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:02.541438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:02.557330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.082937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:03.086029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=72 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:03.099434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61e139d6-34b5-4df5-8778-6441a5a6592d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 0.609416 Jul 18 02:41:03.102369 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2493/4909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:02 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:03.320035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.321275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:03.354230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.369300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.372590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.376138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.821214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fdc610c6-b7ae-4bc9-b2ee-87d3244a0a1c req-aa5616f5-f934-4875-a623-68f720aee6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dba2e2d-2f57-4a70-89a6-244c3e11332a", "name": "network-vif-plugged", "status": "completed", "tag": "441942c3-797f-4782-b86a-8607bcf90fdb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:03.857669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fdc610c6-b7ae-4bc9-b2ee-87d3244a0a1c req-aa5616f5-f934-4875-a623-68f720aee6c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.858672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fdc610c6-b7ae-4bc9-b2ee-87d3244a0a1c req-aa5616f5-f934-4875-a623-68f720aee6c5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.877328 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fdc610c6-b7ae-4bc9-b2ee-87d3244a0a1c req-aa5616f5-f934-4875-a623-68f720aee6c5 service nova] Creating event network-vif-plugged:441942c3-797f-4782-b86a-8607bcf90fdb for instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a on n-h2-849796-1 Jul 18 02:41:03.886657 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fdc610c6-b7ae-4bc9-b2ee-87d3244a0a1c req-aa5616f5-f934-4875-a623-68f720aee6c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072783 Jul 18 02:41:03.888727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2494/4910] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:04.126516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:04.131194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:04.167409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.172327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.177066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.179572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.832502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:04.846137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b703154-3b06-4520-942e-d31c09a8219e tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 1.534178 Jul 18 02:41:04.853938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2417/4911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:03 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:05.807811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:05.821152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6dc82f0c-26b2-4115-bf58-be3d49c91d39 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1309 microversion: 2.1 time: 1.705466 Jul 18 02:41:05.836672 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2495/4912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:04 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1309 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:05.885491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:05.887448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:05.920609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.930090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.938272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.939108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.281458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8e0e3244-ca8c-4cb8-be9e-52a413e1774e req-de54fe4d-450d-43fc-bb08-59fa3aeba621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14652ecf-927e-45b2-bfe3-26ada28c8473", "name": "network-vif-plugged", "status": "completed", "tag": "d402a9f2-3455-4288-a293-e970ceb1be4a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:06.325012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8e0e3244-ca8c-4cb8-be9e-52a413e1774e req-de54fe4d-450d-43fc-bb08-59fa3aeba621 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.328818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8e0e3244-ca8c-4cb8-be9e-52a413e1774e req-de54fe4d-450d-43fc-bb08-59fa3aeba621 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.378956 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8e0e3244-ca8c-4cb8-be9e-52a413e1774e req-de54fe4d-450d-43fc-bb08-59fa3aeba621 service nova] Creating event network-vif-plugged:d402a9f2-3455-4288-a293-e970ceb1be4a for instance 14652ecf-927e-45b2-bfe3-26ada28c8473 on n-h1-849796-1 Jul 18 02:41:06.404907 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8e0e3244-ca8c-4cb8-be9e-52a413e1774e req-de54fe4d-450d-43fc-bb08-59fa3aeba621 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133898 Jul 18 02:41:06.412640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2496/4913] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:06.852668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:06.854580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:06.886082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.889915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.896697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.901079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:07.712391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:07.750589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-416ce520-707b-4e54-8d71-c60a1d7d5251 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1491 microversion: 2.1 time: 0.909810 Jul 18 02:41:07.778194 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2497/4914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:06 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1491 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:07.797187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1592265142"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:07.803394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:07.828630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.832358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:07.840281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.841564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.006986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:08.037423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90a48588-5389-4a06-a0c8-dec5ec40d443 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 2.157991 Jul 18 02:41:08.039839 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2418/4915] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:05 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:08.170415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bc116ee-5a7e-4284-876b-b5193c5199a5 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "PUT /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1076 microversion: 2.1 time: 0.389940 Jul 18 02:41:08.192549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2498/4916] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:41:07 2022] PUT /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1076 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:08.206616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:08.211533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:08.240553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:08.247826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.251965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:08.253213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.076669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:09.078394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:09.113420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.115003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.118808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.119567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.695638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:09.700370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=88 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:09.719385 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28745f96-7da3-44ec-bbb7-da136fbffdb3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1502 microversion: 2.1 time: 1.524099 Jul 18 02:41:09.742278 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2419/4917] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:08 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1502 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:09.762389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:09.763401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:09.794453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.795524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.803009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.804090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:10.867653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:10.897755 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ef76d0e-96a1-45fb-8297-4e3ad04c7632 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1502 microversion: 2.1 time: 1.145669 Jul 18 02:41:10.931590 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2420/4918] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:09 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1502 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:10.947980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8184b1a5-f93d-4385-9b5c-28b9f84c53d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:10.974937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8184b1a5-f93d-4385-9b5c-28b9f84c53d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:10.979340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8184b1a5-f93d-4385-9b5c-28b9f84c53d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.125862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8184b1a5-f93d-4385-9b5c-28b9f84c53d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:41:11.187769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:11.201846 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19f92395-60f0-4663-9fe3-d0556ce090bd tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1312 microversion: 2.1 time: 2.147993 Jul 18 02:41:11.225494 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2499/4919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:09 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1312 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:11.289907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8184b1a5-f93d-4385-9b5c-28b9f84c53d0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "POST /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a/action" status: 202 len: 0 microversion: 2.1 time: 0.351307 Jul 18 02:41:11.294091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2421/4920] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:41:10 2022] POST /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:41:11.303669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:11.304299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:11.306440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:11.316680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.337634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.350686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.357129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.226868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:12.228453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:12.249075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.250104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.253634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.254564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.367421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:12.391464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fdfd3f9d-18fb-4641-9fd6-8ee754f3ab45 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.091595 Jul 18 02:41:12.392876 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2500/4921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:11 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:12.712716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:12.743934 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba79eee0-1f9c-46ef-a97f-22150634ff74 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1498 microversion: 2.1 time: 0.520639 Jul 18 02:41:12.751265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2422/4922] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:12 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1498 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:12.766076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fb5e2be-9e28-4c16-b4e7-b11027217fa0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:12.805864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.server_groups [None req-1fb5e2be-9e28-4c16-b4e7-b11027217fa0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Querying cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) for 1 instances {{(pid=119439) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:41:12.814510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb5e2be-9e28-4c16-b4e7-b11027217fa0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.817520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fb5e2be-9e28-4c16-b4e7-b11027217fa0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.898097 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fb5e2be-9e28-4c16-b4e7-b11027217fa0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791" status: 200 len: 222 microversion: 2.1 time: 0.136919 Jul 18 02:41:12.919924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:12.920847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:12.925331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2501/4923] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:41:12 2022] GET /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791 => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:12.966401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.967077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.969341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.994526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.125008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:13.373279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b0326b7-45ef-40c0-a422-6254169056df tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 204 len: 0 microversion: 2.1 time: 0.462168 Jul 18 02:41:13.375535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2423/4924] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:12 2022] DELETE /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:13.384429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:13.385130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:13.401144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.403573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.406747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.408662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.413284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:13.415990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:13.437599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.441980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.443205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.446187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:14.494684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:14.524453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-287502eb-e053-42b8-8e1e-fb82e251515c tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1504 microversion: 2.1 time: 1.142767 Jul 18 02:41:14.533156 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2502/4925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:13 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1504 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:14.766795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:14.810761 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-675f7009-0364-4f60-9141-e8640c09dff8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.393799 Jul 18 02:41:14.812172 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2424/4926] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:13 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:15.551577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.553285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.581097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.584490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.592321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.594043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.846830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.848172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.919711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.921568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.936308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.943107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:16.141150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:16.168073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dfc643a-58af-403d-9a22-323858fe1ddc tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1504 microversion: 2.1 time: 0.620399 Jul 18 02:41:16.173328 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2503/4927] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:15 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:17.193635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:17.199717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:17.230161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.234075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.240589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.243111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.554728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:17.608884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d033cb2-483e-42f1-8bf2-c8216f32a3f8 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1462 microversion: 2.1 time: 0.422544 Jul 18 02:41:17.610478 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2504/4928] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:17 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1462 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:18.637236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:18.641695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:18.683854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.685825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.696592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.699797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.764466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:18.808913 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e698e21-6d5b-474b-986e-5acabf7e2c9e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 2.968003 Jul 18 02:41:18.811144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2425/4929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:15 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:18.848821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:18.852811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:18.896267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.897942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.900771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.906392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.109717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:19.137686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-943a9572-412e-418f-b6e2-504695741d3a tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1462 microversion: 2.1 time: 0.507783 Jul 18 02:41:19.140350 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2505/4930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:18 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1462 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:19.152293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f399e08a-d89e-4af9-8b17-66f4bd936b01 req-75eed1c2-b814-49c6-8ef4-09ca0675323f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14652ecf-927e-45b2-bfe3-26ada28c8473", "name": "network-vif-deleted", "tag": "d402a9f2-3455-4288-a293-e970ceb1be4a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:19.172819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f399e08a-d89e-4af9-8b17-66f4bd936b01 req-75eed1c2-b814-49c6-8ef4-09ca0675323f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.173659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f399e08a-d89e-4af9-8b17-66f4bd936b01 req-75eed1c2-b814-49c6-8ef4-09ca0675323f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.191698 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f399e08a-d89e-4af9-8b17-66f4bd936b01 req-75eed1c2-b814-49c6-8ef4-09ca0675323f service nova] Creating event network-vif-deleted:d402a9f2-3455-4288-a293-e970ceb1be4a for instance 14652ecf-927e-45b2-bfe3-26ada28c8473 on n-h1-849796-1 Jul 18 02:41:19.201710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f399e08a-d89e-4af9-8b17-66f4bd936b01 req-75eed1c2-b814-49c6-8ef4-09ca0675323f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056013 Jul 18 02:41:19.204630 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2506/4931] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:19.717699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:19.749186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a980016-bdaa-4778-872c-2950e3b46c76 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.920253 Jul 18 02:41:19.757440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2426/4932] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:18 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:19.852903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:19.863414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:19.915505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.919230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.922615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.926622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.159813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:20.161295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:20.179970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.181097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.185766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.187091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.313823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.317334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.318036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lazy-loading 'fault' on Instance uuid 14652ecf-927e-45b2-bfe3-26ada28c8473 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:20.531026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51be14451afe413fa19c41e1151c25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161ac7b6a5304f829f42ec3bec0d5c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:20.542127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ed783a7-151f-4e69-8c01-ac5e50c506e5 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 200 len: 1302 microversion: 2.1 time: 0.387774 Jul 18 02:41:20.557003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2427/4933] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:20 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 1302 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:20.770120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:20.771056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:20.795080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.799418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.800886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.803872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.640055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:21.685311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85b6a289-bb20-4e6b-9a39-1ef102b39f4a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.839742 Jul 18 02:41:21.687865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2507/4934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:19 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:21.764045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:21.803116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f96887b-4ce8-4d33-9905-4272a462de4e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.037762 Jul 18 02:41:21.812154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2428/4935] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:20 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:21.845185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:21.848054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:21.884313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.885834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.893343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.895462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.032292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 HTTP/1.1 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '14652ecf-927e-45b2-bfe3-26ada28c8473'} Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:22.038481 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:22.051961 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:22.055672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:22.062608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9dd10f8b-7d8e-4aef-b888-68b0b5b76d50 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 404 len: 111 microversion: 2.1 time: 0.247862 Jul 18 02:41:22.067342 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2429/4936] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:21 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:22.116500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-851841573"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:22.144551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:22.186857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:22.196878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.197698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.211848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1762895430", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "3c68a5ae-dd5b-40f8-95e3-b8bf21d3a480"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:22.216453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.217568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.426197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] validate_networks() for [('3c68a5ae-dd5b-40f8-95e3-b8bf21d3a480', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:41:23.287804 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e568386-f3e9-42ea-b8c6-b233806dcd7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 1.218216 Jul 18 02:41:23.294712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2430/4937] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:41:22 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 18 02:41:23.300917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82c23144-2dfc-4130-8be9-876072b16c7f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:23.361533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_groups [None req-82c23144-2dfc-4130-8be9-876072b16c7f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Querying cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) for 1 instances {{(pid=119440) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:41:23.366834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82c23144-2dfc-4130-8be9-876072b16c7f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.366834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82c23144-2dfc-4130-8be9-876072b16c7f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.406710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82c23144-2dfc-4130-8be9-876072b16c7f tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115127 Jul 18 02:41:23.407614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2431/4938] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:41:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:23.412253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:23.413048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:23.430318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.430795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.432079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.432970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.783094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:24.813857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5614143-1e0e-4a44-8a8e-557e75e78777 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.405088 Jul 18 02:41:24.817359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2432/4939] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:23 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:24.838061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:24.846021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:24.884070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.885433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.887913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.889089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.988290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:25.100354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:41:25.102541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:41:25.104072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:41:25.105858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:41:25.107057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:41:25.149972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.161487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.163092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.169055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.232052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Getting quotas for project 335651e16b204f3a86536ce8af298ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:25.265837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Getting quotas for user 6a81dabb06754ccd82f8e5e989362342 and project 335651e16b204f3a86536ce8af298ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:25.311174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:41:25.314319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:41:25.392762 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f0965e0-a516-46f9-8093-266be3b1812c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.690784 Jul 18 02:41:25.397770 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2508/4940] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:41:25.404497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e461a0a6-dd97-443a-bec5-9a141216a0c0 req-a777c8b3-b6fa-4589-8377-5383bb760aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:25.475092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e461a0a6-dd97-443a-bec5-9a141216a0c0 req-a777c8b3-b6fa-4589-8377-5383bb760aef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.476499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e461a0a6-dd97-443a-bec5-9a141216a0c0 req-a777c8b3-b6fa-4589-8377-5383bb760aef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.513218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e461a0a6-dd97-443a-bec5-9a141216a0c0 req-a777c8b3-b6fa-4589-8377-5383bb760aef service nova] Creating event network-vif-unplugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:41:25.528845 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e461a0a6-dd97-443a-bec5-9a141216a0c0 req-a777c8b3-b6fa-4589-8377-5383bb760aef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126983 Jul 18 02:41:25.531762 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2509/4941] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:25.543953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab25c990-5875-4a0e-ba51-23f445b17825 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.597656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.server_groups [None req-ab25c990-5875-4a0e-ba51-23f445b17825 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Querying cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) for 1 instances {{(pid=119439) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 18 02:41:25.599149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab25c990-5875-4a0e-ba51-23f445b17825 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.599956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab25c990-5875-4a0e-ba51-23f445b17825 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.666697 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab25c990-5875-4a0e-ba51-23f445b17825 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791" status: 200 len: 184 microversion: 2.1 time: 0.129919 Jul 18 02:41:25.671717 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2510/4942] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Jul 18 02:41:25 2022] GET /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791 => generated 184 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:25.693533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8517e529-7dc1-4394-a177-8dd284d0b222 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.695743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8517e529-7dc1-4394-a177-8dd284d0b222 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:25.722320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:25.778633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3faa56a1-87da-47cf-8057-3c1d355520ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.948508 Jul 18 02:41:25.795420 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2433/4943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:24 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:25.817243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.817782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:25.845499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.845995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.847073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.847537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.897000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 HTTP/1.1 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '14652ecf-927e-45b2-bfe3-26ada28c8473'} Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:25.899983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:25.905290 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:25.907584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:25.909391 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66e231f0-16ad-4d1b-a4a6-147bb23a6ec9 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 404 len: 111 microversion: 2.1 time: 0.112177 Jul 18 02:41:25.910613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2434/4944] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:25 2022] DELETE /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:25.916344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.920599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:25.939859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.942026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.944705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.945647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.106635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8517e529-7dc1-4394-a177-8dd284d0b222 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.158707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8517e529-7dc1-4394-a177-8dd284d0b222 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1225 microversion: 2.1 time: 0.483655 Jul 18 02:41:26.161505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2511/4945] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:25 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1225 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:26.191281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.192876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] [instance: 14652ecf-927e-45b2-bfe3-26ada28c8473] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.237688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.238813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.239982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.240998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.278924 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 HTTP/1.1 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '14652ecf-927e-45b2-bfe3-26ada28c8473'} Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.281063 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. Jul 18 02:41:26.285949 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.290169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance 14652ecf-927e-45b2-bfe3-26ada28c8473 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:26.291523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f133bf2d-f415-4c3a-bc90-dc431bea8f27 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473" status: 404 len: 111 microversion: 2.1 time: 0.124862 Jul 18 02:41:26.296129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2512/4946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:26 2022] GET /compute/v2.1/servers/14652ecf-927e-45b2-bfe3-26ada28c8473 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:26.305937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-089a3a8e-57be-4e1c-a790-ece0b8215219 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.329442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-089a3a8e-57be-4e1c-a790-ece0b8215219 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-089a3a8e-57be-4e1c-a790-ece0b8215219 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-server-groups/8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 HTTP/1.1 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0'} Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.331823 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.336785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-089a3a8e-57be-4e1c-a790-ece0b8215219 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance group 8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:26.338429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-089a3a8e-57be-4e1c-a790-ece0b8215219 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0" status: 404 len: 117 microversion: 2.1 time: 0.040601 Jul 18 02:41:26.339394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2513/4947] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:41:26 2022] DELETE /compute/v2.1/os-server-groups/8dfa1bd4-dd1f-4b20-b3d6-898e24ffccb0 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:41:26.349793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50dc1b50-1f60-466e-b5c8-95dd592b3330 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.369501 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-50dc1b50-1f60-466e-b5c8-95dd592b3330 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50dc1b50-1f60-466e-b5c8-95dd592b3330 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-server-groups/496be539-2ae0-44ff-bd53-6a3af614769c HTTP/1.1 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '496be539-2ae0-44ff-bd53-6a3af614769c'} Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.372661 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. Jul 18 02:41:26.377266 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.379845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50dc1b50-1f60-466e-b5c8-95dd592b3330 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance group 496be539-2ae0-44ff-bd53-6a3af614769c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:26.381596 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50dc1b50-1f60-466e-b5c8-95dd592b3330 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/496be539-2ae0-44ff-bd53-6a3af614769c" status: 404 len: 117 microversion: 2.1 time: 0.037482 Jul 18 02:41:26.385326 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2514/4948] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:41:26 2022] DELETE /compute/v2.1/os-server-groups/496be539-2ae0-44ff-bd53-6a3af614769c => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:41:26.394900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0f8881-8cbe-47c1-aac3-8222219a8dc0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.409771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7d0f8881-8cbe-47c1-aac3-8222219a8dc0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0f8881-8cbe-47c1-aac3-8222219a8dc0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-server-groups/21140558-7351-49ac-94ec-12f16f738431 HTTP/1.1 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '21140558-7351-49ac-94ec-12f16f738431'} Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.414149 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. Jul 18 02:41:26.418517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.422363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d0f8881-8cbe-47c1-aac3-8222219a8dc0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance group 21140558-7351-49ac-94ec-12f16f738431 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:26.423795 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d0f8881-8cbe-47c1-aac3-8222219a8dc0 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/21140558-7351-49ac-94ec-12f16f738431" status: 404 len: 117 microversion: 2.1 time: 0.033784 Jul 18 02:41:26.424782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2515/4949] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:41:26 2022] DELETE /compute/v2.1/os-server-groups/21140558-7351-49ac-94ec-12f16f738431 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:26.435061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f3e449a-e7aa-4c62-ba0e-b377b36c321b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.458849 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7f3e449a-e7aa-4c62-ba0e-b377b36c321b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] HTTP exception thrown: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f3e449a-e7aa-4c62-ba0e-b377b36c321b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Request method failure captured: Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/os-server-groups/82ead906-fee6-402d-900f-fceebdb89013 HTTP/1.1 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mgi-vZAIdQghrXkSUljb5Bd686jHjFWNC0hGzavGbU4urpQb86kw2XLNDrRxHjRfczCOVGGQqocvep0WM2HN6wBpBnKEFO2Ghha_YkK6aUWXQDR-AJsoFEDnxEOJF78fiUknuH7xiHOCINLxj_iOTn6tyhYjpZuGFZwisK2EXclebY Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/161ac7b6a5304f829f42ec3bec0d5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 161ac7b6a5304f829f42ec3bec0d5c1d Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerGroupTestJSON-1312063690 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 51be14451afe413fa19c41e1151c25e8 Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerGroupTestJSON-1312063690-project Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '82ead906-fee6-402d-900f-fceebdb89013'} Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.470216 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f3e449a-e7aa-4c62-ba0e-b377b36c321b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Returning 404 to user: Instance group 82ead906-fee6-402d-900f-fceebdb89013 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f3e449a-e7aa-4c62-ba0e-b377b36c321b tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/82ead906-fee6-402d-900f-fceebdb89013" status: 404 len: 117 microversion: 2.1 time: 0.041658 Jul 18 02:41:26.482105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2516/4950] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:41:26 2022] DELETE /compute/v2.1/os-server-groups/82ead906-fee6-402d-900f-fceebdb89013 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:26.497236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5aad4b93-bd28-49cf-86d4-c891faeceea6 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.550384 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5aad4b93-bd28-49cf-86d4-c891faeceea6 tempest-ServerGroupTestJSON-1312063690 tempest-ServerGroupTestJSON-1312063690-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791" status: 204 len: 0 microversion: 2.1 time: 0.068435 Jul 18 02:41:26.551844 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2517/4951] 10.222.0.67 () {58 vars in 1265 bytes} [Mon Jul 18 02:41:26 2022] DELETE /compute/v2.1/os-server-groups/b8e234b8-acf8-4779-9bee-e36eaea01791 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:26.676398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.733517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9a0d128-0e60-4a03-a77c-fb5eba01ec9f tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 0.819367 Jul 18 02:41:26.735988 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2435/4952] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:25 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:26.801417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.802778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.819282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.822985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.825527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.826725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.191869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:27.193612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:27.206085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.206952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.208465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.209324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.263688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.295684 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45fff379-bf56-46dc-a578-a9002d07475b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.498849 Jul 18 02:41:27.296971 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2518/4953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:26 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:27.395162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.427185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-adbb8c59-b1ef-4987-b1e4-838a55bb90e2 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1221 microversion: 2.1 time: 0.239880 Jul 18 02:41:27.430282 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2436/4954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:27 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:28.324586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:28.326985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:28.335610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.336075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.336893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.344388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.489895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:28.490532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:28.499620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.500435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.501615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.502279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.972761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:29.013345 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-007cca5b-7364-41d0-880e-3c8ea8b84f02 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1687 microversion: 2.1 time: 0.694228 Jul 18 02:41:29.017849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2437/4955] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:28 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1687 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:29.047571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:29.053693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:29.067124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:29.067954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:29.069714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:29.070510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:29.313652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:29.334152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0ed82c0-1698-4c0f-95db-15799cec4af6 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.572185 Jul 18 02:41:29.335293 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2519/4956] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:27 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:29.719917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:29.737688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-129b08ac-84e9-4d05-ad09-af4816bc0e7a tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1283 microversion: 2.1 time: 0.706597 Jul 18 02:41:29.738309 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2438/4957] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:29 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1283 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:30.036670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:30.037549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:30.047670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.048146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.056201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.057011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.367539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:30.368604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:30.380536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.381390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.382724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.383480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.940010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.966637 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ffa65ad2-9b45-48d4-8512-bb593f6b60c2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 0.609351 Jul 18 02:41:30.978636 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2439/4958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:30 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:30.984881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:30.985548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:30.994649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.995835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.997139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.998030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.177437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.216907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e36fcc8-4bad-42c4-bab1-ddc9b4906cdb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1283 microversion: 2.1 time: 0.236495 Jul 18 02:41:31.222308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2440/4959] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:30 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:31.525302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.529108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:31.551966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a7ecc46-9ea8-4dae-8ef8-6f0558ca3365 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1687 microversion: 2.1 time: 1.509954 Jul 18 02:41:31.552682 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2520/4960] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:30 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1687 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:31.988998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:31.991475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.006174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.007303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.009015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.010060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.277198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:32.278146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.313251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.314373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.316095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.316898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.672837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.704468 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89a092aa-ebf3-4ff0-a937-f761336bda0a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 0.722422 Jul 18 02:41:32.722122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2441/4961] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:31 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:32.771858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:32.773080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.815181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.818712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.825288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.843736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.078668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.095612 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2c59933-b4ab-49ed-87d4-b0595ff6e0e9 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.847625 Jul 18 02:41:33.101738 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2521/4962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:32 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:33.408259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-25704d16-f85c-44ce-a2cb-c51e2efccaa3 req-63410236-b130-4b41-8078-e7abf3a3ef2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-plugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:33.429810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25704d16-f85c-44ce-a2cb-c51e2efccaa3 req-63410236-b130-4b41-8078-e7abf3a3ef2a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.430449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25704d16-f85c-44ce-a2cb-c51e2efccaa3 req-63410236-b130-4b41-8078-e7abf3a3ef2a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.488157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-25704d16-f85c-44ce-a2cb-c51e2efccaa3 req-63410236-b130-4b41-8078-e7abf3a3ef2a service nova] Creating event network-vif-plugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:41:33.509387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-25704d16-f85c-44ce-a2cb-c51e2efccaa3 req-63410236-b130-4b41-8078-e7abf3a3ef2a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105368 Jul 18 02:41:33.511749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2522/4963] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:33.749488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:33.750210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:33.766429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.769011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.772160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.773431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.795654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.846962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b663c59-6fb7-4015-87a5-ad29941769cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1687 microversion: 2.1 time: 1.121872 Jul 18 02:41:33.852551 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2442/4964] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:32 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1687 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:34.140373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:34.143301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:34.171212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.174203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.178097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.184738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.472321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:34.505184 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ac19fad-62a1-4521-ab18-5593aaad4828 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 0.760582 Jul 18 02:41:34.521605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2523/4965] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:33 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:34.789310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:34.831431 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-caadbd43-c3a3-4bcf-b42b-3d4615183c4b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.704174 Jul 18 02:41:34.837811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2443/4966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:34 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:34.892716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:34.897382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:34.921988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.922495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.924160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.928968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.193721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:35.541691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:35.545006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:35.599268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.599918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.601139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.601890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.676395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.713304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83a5fa09-b0bf-4b7f-8974-24cfe2461c8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.829608 Jul 18 02:41:35.722725 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2524/4967] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:34 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:35.868354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:35.870095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:35.886260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.887656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.889478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.890578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.957879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.973768 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6334b2c0-9439-4d41-9de8-efb8e1de32e0 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 0.437602 Jul 18 02:41:35.989705 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2444/4968] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:35 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:36.132035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:36.753255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:36.758547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:36.778736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.780094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.784847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.786714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.811717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:36.836250 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25f5786f-ce8d-44da-a034-57746993c358 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.979942 Jul 18 02:41:36.864327 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2525/4969] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:35 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:37.001178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:37.002812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:37.024253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.027371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.031457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.034403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.968054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.039004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ba50a6b-bc71-4c9f-afe6-4eeef1b9e6e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.297754 Jul 18 02:41:38.083823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.098163 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2445/4970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:36 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:38.137627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2ce9878a-73d1-451a-bac5-44470394d887 req-fe89c9c2-d298-49d9-8958-e8294e573cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40625c26-2be3-42f7-a5c2-6fee3eff646e", "tag": "340f0ad5-9e8d-4ed6-a204-b07c6f305218"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:38.150969 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03c784ea-6533-4ad5-bf31-c5775b7949f3 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1512 microversion: 2.1 time: 1.152639 Jul 18 02:41:38.172068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ce9878a-73d1-451a-bac5-44470394d887 req-fe89c9c2-d298-49d9-8958-e8294e573cc3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.173021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ce9878a-73d1-451a-bac5-44470394d887 req-fe89c9c2-d298-49d9-8958-e8294e573cc3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.177295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2526/4971] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:36 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1512 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:38.230281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:38.241148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:38.250923 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2ce9878a-73d1-451a-bac5-44470394d887 req-fe89c9c2-d298-49d9-8958-e8294e573cc3 service nova] Creating event network-changed:340f0ad5-9e8d-4ed6-a204-b07c6f305218 for instance 40625c26-2be3-42f7-a5c2-6fee3eff646e on n-h2-849796-1 Jul 18 02:41:38.276512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.290293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.296144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.309337 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2ce9878a-73d1-451a-bac5-44470394d887 req-fe89c9c2-d298-49d9-8958-e8294e573cc3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208582 Jul 18 02:41:38.310340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.319830 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2446/4972] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:39.098559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:39.105545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:39.148467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.150317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:39.153928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.158005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.439818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:41.455065 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-619b0a9c-ade6-4f51-8ae8-0b3fd5ccde9d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 2.372619 Jul 18 02:41:41.459425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2447/4973] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:39 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:41.471026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:41.480453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:41.497750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.503351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.510624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.511474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.255113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.279889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1445c073-fc87-44a4-8877-9104dfcb947b tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 4.093207 Jul 18 02:41:42.297764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2527/4974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:38 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 4119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:42.382842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.398724 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d88f9a1a-6fa0-4ca8-b42f-bc78725dfdb2 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1489 microversion: 2.1 time: 0.937756 Jul 18 02:41:42.406578 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2448/4975] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:41 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1489 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:42.427352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-637980589"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:42.429076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:42.443432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:42.446453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.449063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.450766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.451643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.480085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:42.481844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:42.497300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.502945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.507873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.508786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.751010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dadc74f4-70f2-4a35-91a6-5061fc0a4ddd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "PUT /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1061 microversion: 2.1 time: 0.331931 Jul 18 02:41:42.767800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2528/4976] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:41:42 2022] PUT /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1061 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:42.773936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:42.775040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:42.785441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.786197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.787617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.788271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.286323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.329645 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-024a5621-fa0a-4c8e-8f63-e242c6be732a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.858563 Jul 18 02:41:43.331502 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2449/4977] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:42 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:43.358575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:43.360538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:43.397299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.413365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.425920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.430197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.536714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.593859 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24f0b6e9-2af2-4696-b534-4f53c8e8708c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1488 microversion: 2.1 time: 0.824024 Jul 18 02:41:43.595831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2529/4978] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:42 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1488 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:43.626895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:43.627811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:43.666620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.667322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.669626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.670314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.940238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.956473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb7929cd-5b8d-4f85-b149-7e945403ecca tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.622697 Jul 18 02:41:43.957740 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2450/4979] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:43 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:44.349429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.350582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.365870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.366971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.371744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.373270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.397016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:44.459045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:44.477493 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58f5bd04-6623-49c7-a1a1-0d7f09a9098e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1488 microversion: 2.1 time: 0.868911 Jul 18 02:41:44.478716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2530/4980] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:43 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1488 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:44.524798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.525676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.534543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.535368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.536419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.537659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.615252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:44.985689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e41812c4-356c-482a-b43c-50ed4dd03ba4 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 204 len: 0 microversion: 2.1 time: 0.458870 Jul 18 02:41:44.996193 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2531/4981] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:44 2022] DELETE /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:41:45.031347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:45.043908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:45.087249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.088012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.090562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.091348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.509453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:45.532979 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec5a36dc-5468-4c0f-b430-4ae94b5f366b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.184721 Jul 18 02:41:45.538461 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2451/4982] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:45.555956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:45.560953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:45.594282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.598129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.605080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.607968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.452479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:46.467703 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6774dc8-a1ae-4725-adce-37890b279087 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 1.466807 Jul 18 02:41:46.483073 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2532/4983] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:46.615384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:46.626668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:46.649259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:46.675803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.679918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.683500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.684703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.685949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb3ca11c-f161-4095-adb4-d8fdc00cc995 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1494 microversion: 2.1 time: 1.142832 Jul 18 02:41:46.689305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2452/4984] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:45 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1494 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:47.491843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:47.502790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:47.538158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:47.538624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:47.539482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:47.539940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.221581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.263991 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-954482a2-f023-4f16-a42a-97ccedd96286 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.764625 Jul 18 02:41:48.266353 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2453/4985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:47 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:48.309745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:48.311170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:48.328323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.337665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.338618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.339918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.342033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.357288 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1c517b23-00a4-465e-816d-db3958654236 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.766126 Jul 18 02:41:48.368489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2533/4986] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:46 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:48.924387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.975371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21701e06-6894-482d-9e70-df62867bd071 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1494 microversion: 2.1 time: 0.681458 Jul 18 02:41:49.022195 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2454/4987] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:48 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1494 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:49.296397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.297404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.341438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.348366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.353300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.361796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.393084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.393947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.408494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.432736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.434366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.434847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.706284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.712616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.768574 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74e1e3ab-b1cd-461f-a38d-cf06680ec740 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.371501 Jul 18 02:41:50.769305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2455/4988] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:50.788818 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0ec6c48-9dc5-402a-a8f0-987c312ecfea tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 1.496369 Jul 18 02:41:50.798261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:50.799311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:50.815557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.816693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.817873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.823598 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2534/4989] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:50.825440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.708103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:51.726969 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c84be11-5967-426f-80fa-4610138d3e44 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 200 len: 1494 microversion: 2.1 time: 0.952928 Jul 18 02:41:51.745648 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2456/4990] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:50 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 1494 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:51.801176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-45d2c731-e77e-4877-a71f-7a7b3d11b14b req-866c0504-254d-4c94-aeef-4e4f270613c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dba2e2d-2f57-4a70-89a6-244c3e11332a", "name": "network-vif-deleted", "tag": "441942c3-797f-4782-b86a-8607bcf90fdb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:51.801806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:51.802300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:51.832505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.833351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.842803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.854698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.919722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-45d2c731-e77e-4877-a71f-7a7b3d11b14b req-866c0504-254d-4c94-aeef-4e4f270613c9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.921387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-45d2c731-e77e-4877-a71f-7a7b3d11b14b req-866c0504-254d-4c94-aeef-4e4f270613c9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.020508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-45d2c731-e77e-4877-a71f-7a7b3d11b14b req-866c0504-254d-4c94-aeef-4e4f270613c9 service nova] Creating event network-vif-deleted:441942c3-797f-4782-b86a-8607bcf90fdb for instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a on n-h2-849796-1 Jul 18 02:41:52.067639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-45d2c731-e77e-4877-a71f-7a7b3d11b14b req-866c0504-254d-4c94-aeef-4e4f270613c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278562 Jul 18 02:41:52.078234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2535/4991] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:52.130236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:52.137610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:52.224116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.226821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.233071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.238924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.378455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:53.270481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.297607 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bc4e71e-7072-4fc5-ba23-6db1a29da8a8 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 1.210130 Jul 18 02:41:53.313253 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2536/4992] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:52 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:53.326310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2cdb06b8-694d-4951-825a-7fa7bc6a5723 req-224ebcd3-213f-4088-a1c0-febcff766560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40625c26-2be3-42f7-a5c2-6fee3eff646e", "name": "network-vif-plugged", "status": "completed", "tag": "340f0ad5-9e8d-4ed6-a204-b07c6f305218"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:53.344661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2cdb06b8-694d-4951-825a-7fa7bc6a5723 req-224ebcd3-213f-4088-a1c0-febcff766560 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.345882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2cdb06b8-694d-4951-825a-7fa7bc6a5723 req-224ebcd3-213f-4088-a1c0-febcff766560 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.368698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.410199 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ee2aa12-57ca-405c-9156-29ed0e2371ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.615294 Jul 18 02:41:53.410955 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2cdb06b8-694d-4951-825a-7fa7bc6a5723 req-224ebcd3-213f-4088-a1c0-febcff766560 service nova] Creating event network-vif-plugged:340f0ad5-9e8d-4ed6-a204-b07c6f305218 for instance 40625c26-2be3-42f7-a5c2-6fee3eff646e on n-h2-849796-1 Jul 18 02:41:53.417323 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2457/4993] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:51 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:53.445010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2cdb06b8-694d-4951-825a-7fa7bc6a5723 req-224ebcd3-213f-4088-a1c0-febcff766560 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127904 Jul 18 02:41:53.452414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2537/4994] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:53.459545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.463995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:53.489929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=58 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:53.498467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.502204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.506434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.509950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.592219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a HTTP/1.1 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9dba2e2d-2f57-4a70-89a6-244c3e11332a'} Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.601504 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.612275 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.616159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:53.624238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d72c922b-dc75-4fbd-9507-96c597924526 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 404 len: 111 microversion: 2.1 time: 0.196819 Jul 18 02:41:53.630539 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2458/4995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:53 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:53.656392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.659571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:53.715653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.717265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.719556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.721344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.759396 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a HTTP/1.1 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9dba2e2d-2f57-4a70-89a6-244c3e11332a'} Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:53.770513 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.781646 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.786447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:53.792631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d9f7a23-bc08-4146-bf48-d2a5e16ce6ca tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 404 len: 111 microversion: 2.1 time: 0.145258 Jul 18 02:41:53.796682 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2538/4996] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:53 2022] DELETE /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:53.806500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.807802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 9dba2e2d-2f57-4a70-89a6-244c3e11332a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:53.838537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.849675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.850816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.860160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.958132 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a HTTP/1.1 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9dba2e2d-2f57-4a70-89a6-244c3e11332a'} Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.967588 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. Jul 18 02:41:53.971893 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:53.982756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 9dba2e2d-2f57-4a70-89a6-244c3e11332a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:53.984242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-832e6962-5f96-4d14-9307-b02f3a07501a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a" status: 404 len: 111 microversion: 2.1 time: 0.182511 Jul 18 02:41:53.997169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.997697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.013069 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2459/4997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:53 2022] GET /compute/v2.1/servers/9dba2e2d-2f57-4a70-89a6-244c3e11332a => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:54.045523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.046522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.054662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.055279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.123679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 HTTP/1.1 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '939ad598-f972-4158-90c8-48aa9fbad733'} Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:54.137090 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2e961d1-1980-425b-b996-cc5813bbba6d tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 404 len: 111 microversion: 2.1 time: 0.148674 Jul 18 02:41:54.144436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2539/4998] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:53 2022] DELETE /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:54.153068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.153878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 939ad598-f972-4158-90c8-48aa9fbad733] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.169854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.170327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.171174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.171639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.298146 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 HTTP/1.1 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '939ad598-f972-4158-90c8-48aa9fbad733'} Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.303635 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. Jul 18 02:41:54.309270 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.315546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 939ad598-f972-4158-90c8-48aa9fbad733 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:54.319968 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c301587f-c944-40ed-bc82-2bbea807d943 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733" status: 404 len: 111 microversion: 2.1 time: 0.171588 Jul 18 02:41:54.327645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.328309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.331637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2460/4999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/939ad598-f972-4158-90c8-48aa9fbad733 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:54.355830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.360082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.362881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.363660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.364321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.370419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.414296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.452134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.454219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.455511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.544101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f HTTP/1.1 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '079307ce-6f86-448b-be59-fc515aa4552f'} Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:54.564072 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:41:54.579227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:54.587671 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17ffa19a-4eb7-4631-97ea-9802411cb119 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 404 len: 111 microversion: 2.1 time: 0.250223 Jul 18 02:41:54.589293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2461/5000] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:54 2022] DELETE /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:54.634074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.634358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.672626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.678370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.680340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.688865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.040431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:55.050918 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f33b8ebc-9f1e-4d88-a97d-bfde055979d7 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1325 microversion: 2.1 time: 0.728973 Jul 18 02:41:55.057660 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2540/5001] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1325 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:55.069932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.070913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 079307ce-6f86-448b-be59-fc515aa4552f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.097502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.102476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.110894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.111793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.150935 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f HTTP/1.1 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '079307ce-6f86-448b-be59-fc515aa4552f'} Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.157725 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. Jul 18 02:41:55.161927 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.163256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 079307ce-6f86-448b-be59-fc515aa4552f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.168161 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fece193b-861c-4704-9997-dbe513869dab tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f" status: 404 len: 111 microversion: 2.1 time: 0.109001 Jul 18 02:41:55.174890 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2541/5002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/079307ce-6f86-448b-be59-fc515aa4552f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:55.189551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.191075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.209923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.210862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.212008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.221140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.289874 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c HTTP/1.1 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '11192e17-6613-433c-a07d-87a8061c158c'} Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.292221 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b9af98c-9d7b-46ad-b037-f5d398564010 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 404 len: 111 microversion: 2.1 time: 0.118077 Jul 18 02:41:55.305549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2542/5003] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:55 2022] DELETE /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:55.317550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.317550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 11192e17-6613-433c-a07d-87a8061c158c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.342206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.343130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.343465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.344100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.382035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c HTTP/1.1 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '11192e17-6613-433c-a07d-87a8061c158c'} Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.384836 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 11192e17-6613-433c-a07d-87a8061c158c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39cf15b2-d423-4364-aa09-b06cde5c7672 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c" status: 404 len: 111 microversion: 2.1 time: 0.094772 Jul 18 02:41:55.403864 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2543/5004] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/11192e17-6613-433c-a07d-87a8061c158c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:55.438291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.438812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.486155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.486621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.498381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.503709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.593612 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 HTTP/1.1 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cfb49aab-e123-4819-aaf1-aed089b4e079'} Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.606517 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.624606 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.630497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.636283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39192509-7252-405e-8250-4980e547b9cd tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 404 len: 111 microversion: 2.1 time: 0.212637 Jul 18 02:41:55.641312 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2544/5005] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:55 2022] DELETE /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:55.662713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.667561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: cfb49aab-e123-4819-aaf1-aed089b4e079] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.709639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.715356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.721046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.723176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.798681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 HTTP/1.1 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cfb49aab-e123-4819-aaf1-aed089b4e079'} Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.804645 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. Jul 18 02:41:55.813252 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.818818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance cfb49aab-e123-4819-aaf1-aed089b4e079 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.822227 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1d7cb80-da29-4370-8171-be320557039c tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079" status: 404 len: 111 microversion: 2.1 time: 0.172939 Jul 18 02:41:55.827457 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2545/5006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/cfb49aab-e123-4819-aaf1-aed089b4e079 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:41:55.841318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.842320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.859873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.864947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.868656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.872755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.907461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a HTTP/1.1 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a'} Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:55.921390 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:55.928100 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:55.933550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:55.937975 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-355aa3a8-8518-4572-9cae-ca7e7c4c145a tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 404 len: 111 microversion: 2.1 time: 0.104921 Jul 18 02:41:55.943090 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2546/5007] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:55 2022] DELETE /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:55.955301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.961860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.982625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.986713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.988711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.993239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.097561 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a HTTP/1.1 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a'} Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.112604 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. Jul 18 02:41:56.118292 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.119592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:56.121811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4fe13db8-bb4a-40b2-b1ca-25fcba8db983 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a" status: 404 len: 111 microversion: 2.1 time: 0.174732 Jul 18 02:41:56.129426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2547/5008] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/f2aa2511-f31a-41a4-90c0-2f5ac62a8f2a => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:56.159206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.167517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.189349 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 HTTP/1.1 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '94c4a28b-b7ed-45df-8dd1-aebd92d0a564'} Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.191616 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-85def41e-e1f3-405a-a39e-c0a8aa5a9abb tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564" status: 404 len: 111 microversion: 2.1 time: 0.058740 Jul 18 02:41:56.208241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2548/5009] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:56 2022] DELETE /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:56.234657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.235716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: 94c4a28b-b7ed-45df-8dd1-aebd92d0a564] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.250288 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 HTTP/1.1 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '94c4a28b-b7ed-45df-8dd1-aebd92d0a564'} Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:56.253174 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:56.258564 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:56.258564 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:56.258564 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. Jul 18 02:41:56.258564 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:56.261069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance 94c4a28b-b7ed-45df-8dd1-aebd92d0a564 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:56.264858 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5151faf-5045-415d-be9a-33b887c04ef8 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564" status: 404 len: 111 microversion: 2.1 time: 0.039638 Jul 18 02:41:56.266553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2549/5010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/servers/94c4a28b-b7ed-45df-8dd1-aebd92d0a564 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:56.275603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.277610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.289443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.290651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.294002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.294883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.454207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:56.485975 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f9bf8a1-66fa-47ac-9bc1-b4612c2b132d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.876069 Jul 18 02:41:56.491464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2462/5011] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:56.528730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.529796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.569395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.570237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.580213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.584604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.779390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:57.079303 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee39c24d-53b8-4914-af39-2fbd6a9afffc tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 204 len: 0 microversion: 2.1 time: 0.585745 Jul 18 02:41:57.080620 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2463/5012] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:56 2022] DELETE /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:57.095734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.096824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.116795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.122982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.125184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.125571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.421610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:57.452622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec8286f8-f83a-472e-bbba-7884c6e5e5cb tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1522 microversion: 2.1 time: 1.178820 Jul 18 02:41:57.453339 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2550/5013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1522 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:57.485092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.488903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.500000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.500801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.503215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.504238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.580048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] HTTP exception thrown: Instance is not a member of specified network Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Request method failure captured: Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e/ips/invalid HTTP/1.1 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MhR_RnROygkJRaFq_ZcWKSo97n-Vj8xSYKCDKLg09Nu-qqN_CVY5ZntKZWX_yTanQwiyWDGBVIitWjsqASAYdJMsyV5caaUsPW2JN4UYO9c6W02v1xuisBWHqjQPOD3_4md7uwyjLD0vihSwnJtZ2CEAYpt_Sehd-iQTm1au_eUTro Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_335651e16b204f3a86536ce8af298ad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 6a81dabb06754ccd82f8e5e989362342 Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance is not a member of specified network Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '40625c26-2be3-42f7-a5c2-6fee3eff646e', 'id': 'invalid'} Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 18 02:41:57.590357 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:57.595933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:57.599915 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7d2bd5e-8a20-4870-9306-019fd540e307 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.129265 Jul 18 02:41:57.610454 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2551/5014] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e/ips/invalid => generated 91 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:41:57.624079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.625849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.649177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.651421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.652636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.656449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.474096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:58.524987 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9707d620-ab8e-4376-a577-7f96343f17a8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.912958 Jul 18 02:41:58.531796 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2552/5015] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:58.553000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.554773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Failed to fetch instance by id 999 {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 18 02:41:58.555937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] HTTP exception thrown: Instance 999 could not be found. Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Request method failure captured: Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MhR_RnROygkJRaFq_ZcWKSo97n-Vj8xSYKCDKLg09Nu-qqN_CVY5ZntKZWX_yTanQwiyWDGBVIitWjsqASAYdJMsyV5caaUsPW2JN4UYO9c6W02v1xuisBWHqjQPOD3_4md7uwyjLD0vihSwnJtZ2CEAYpt_Sehd-iQTm1au_eUTro Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_335651e16b204f3a86536ce8af298ad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 6a81dabb06754ccd82f8e5e989362342 Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 999 could not be found. Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '999'} Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 18 02:41:58.563430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:41:58.570870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:58.570870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45033f4d-5adc-41b2-91d8-7cc3def93def tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.032272 Jul 18 02:41:58.570870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2553/5016] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Jul 18 02:41:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:41:58.586506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.587364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:58.641878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.642963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.644429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.645293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.757644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:59.050591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:59.104508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bfa2763-d97d-4a21-a8d7-cf64b2a79b35 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1479 microversion: 2.1 time: 2.015348 Jul 18 02:41:59.111046 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2464/5017] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1479 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:59.128702 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b78e8ee7-9e8b-407e-a96e-99eb1cf59345 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "DELETE /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 204 len: 0 microversion: 2.1 time: 0.548667 Jul 18 02:41:59.132109 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2554/5018] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:58 2022] DELETE /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:59.143157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.144188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:59.169633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.177696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.183655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.184710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.561949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.562683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:59.598393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.599138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.615322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.616206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.997984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:00.021877 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0647f9b6-65c0-4568-8d11-30629772e0c6 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1528 microversion: 2.1 time: 0.877108 Jul 18 02:42:00.029842 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2465/5019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:59 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1528 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:00.037396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:00.053928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be27a5b3-0926-42f5-9f13-d190ae007246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.494508 Jul 18 02:42:00.068315 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2555/5020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:00.135883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:00.138430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:00.175586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.183145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.189972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.190649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.049028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.055782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:01.072158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:01.093852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.105189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.110147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.112553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-178587fd-2289-49d0-b40a-03ce61840a18 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1479 microversion: 2.1 time: 0.983450 Jul 18 02:42:01.113641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.138230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2466/5021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:00 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1479 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:01.171715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.182551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:01.218442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.220836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.223838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.227340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.598916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:03.614220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd9fabda-f43b-4a32-8952-b2a05c758f09 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 2.473444 Jul 18 02:42:03.617196 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2467/5022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:03.654583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:03.655503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:03.708096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.717449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.726290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.727899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.934627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.935104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.937883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lazy-loading 'fault' on Instance uuid b021fb3d-5d60-440b-9107-4c0324118543 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:04.148604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76cee3956ea44a18a9dd7b79db5c43c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e651124c601f4304b14598bba7e2e660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:04.154257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:04.229851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8727f9b-2532-4e4f-ae2b-1d9f7e16a36e tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 200 len: 1282 microversion: 2.1 time: 0.609962 Jul 18 02:42:04.232539 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2468/5023] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:03 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 1282 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:04.278724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e83573df-de6e-498b-b3a8-8006be3ee43c req-0afd341f-3445-41e2-9b67-17f0406f0224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b021fb3d-5d60-440b-9107-4c0324118543", "name": "network-vif-deleted", "tag": "5c8cfdf3-6093-41bd-ab8d-db98d662edcd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:04.361800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e83573df-de6e-498b-b3a8-8006be3ee43c req-0afd341f-3445-41e2-9b67-17f0406f0224 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.367357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e83573df-de6e-498b-b3a8-8006be3ee43c req-0afd341f-3445-41e2-9b67-17f0406f0224 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.441491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e83573df-de6e-498b-b3a8-8006be3ee43c req-0afd341f-3445-41e2-9b67-17f0406f0224 service nova] Creating event network-vif-deleted:5c8cfdf3-6093-41bd-ab8d-db98d662edcd for instance b021fb3d-5d60-440b-9107-4c0324118543 on n-h1-849796-1 Jul 18 02:42:04.478325 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e83573df-de6e-498b-b3a8-8006be3ee43c req-0afd341f-3445-41e2-9b67-17f0406f0224 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224991 Jul 18 02:42:04.481707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2469/5024] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:04.659436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.664972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.712603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.718612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.735071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.743284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.398790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.452431 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e6fa45d9-a2dd-49a3-9136-ff7f5846d328 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.808694 Jul 18 02:42:05.475757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2470/5025] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:05.498916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.501637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] [instance: b021fb3d-5d60-440b-9107-4c0324118543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:05.568859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.577865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.584907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.591867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.696801 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] HTTP exception thrown: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Request method failure captured: Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 HTTP/1.1 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mcp_k1QdOwxTIBz_ePVpITrwf0wz8VJJ6JcjvRT92otmlUqB0PLPoUmZM6DYlLeU2cQQYf-_sHd8_kAXyGkVioZv1PGcNPIV49_IJXbjmx3dY7Kr3T84Zhk0Wcm5oXpvHwTM93LrEf0eLSekQGBI3YMctPoUcAsjc3rmZPnX_b9ehI Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e651124c601f4304b14598bba7e2e660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e651124c601f4304b14598bba7e2e660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e651124c601f4304b14598bba7e2e660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersTestJSON-1464712105 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: e651124c601f4304b14598bba7e2e660 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersTestJSON-1464712105 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersTestJSON-1464712105-project Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 76cee3956ea44a18a9dd7b79db5c43c2 Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersTestJSON-1464712105-project Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b021fb3d-5d60-440b-9107-4c0324118543'} Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:05.706278 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. Jul 18 02:42:05.715401 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:05.719640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] Returning 404 to user: Instance b021fb3d-5d60-440b-9107-4c0324118543 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:05.722286 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf4e4b06-86c4-48c9-b071-804318d6ea53 tempest-ServersTestJSON-1464712105 tempest-ServersTestJSON-1464712105-project] 10.222.0.67 "GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543" status: 404 len: 111 microversion: 2.1 time: 0.244080 Jul 18 02:42:05.728942 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2471/5026] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/servers/b021fb3d-5d60-440b-9107-4c0324118543 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:06.357278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:06.406595 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f83f5147-3fbd-4a06-83c6-29629f0038fe tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1528 microversion: 2.1 time: 5.365362 Jul 18 02:42:06.424967 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2556/5027] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1528 bytes in 5372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:06.485381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:06.486136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:06.506750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.507218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.508038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.508497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.512582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b9816280-e0db-4c5c-ad03-e2a93b2c8da2 req-bd9ca9da-adb9-47c2-a4a4-7e2515475679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40625c26-2be3-42f7-a5c2-6fee3eff646e", "name": "network-vif-unplugged", "status": "completed", "tag": "340f0ad5-9e8d-4ed6-a204-b07c6f305218"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:06.596883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b9816280-e0db-4c5c-ad03-e2a93b2c8da2 req-bd9ca9da-adb9-47c2-a4a4-7e2515475679 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.597734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b9816280-e0db-4c5c-ad03-e2a93b2c8da2 req-bd9ca9da-adb9-47c2-a4a4-7e2515475679 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.653876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b9816280-e0db-4c5c-ad03-e2a93b2c8da2 req-bd9ca9da-adb9-47c2-a4a4-7e2515475679 service nova] Creating event network-vif-unplugged:340f0ad5-9e8d-4ed6-a204-b07c6f305218 for instance 40625c26-2be3-42f7-a5c2-6fee3eff646e on n-h2-849796-1 Jul 18 02:42:06.670856 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b9816280-e0db-4c5c-ad03-e2a93b2c8da2 req-bd9ca9da-adb9-47c2-a4a4-7e2515475679 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166017 Jul 18 02:42:06.682152 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2557/5028] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:07.319910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:07.399464 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ccf2161f-2100-465f-b779-72d6936999b0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 0.913729 Jul 18 02:42:07.433378 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2472/5029] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:06 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:07.478695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:07.481986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:07.561857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.574477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.585424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.598560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.435312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:08.436987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:08.482062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.483239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.486981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.491753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:10.455496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:10.535131 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c917bd32-c24b-453d-a116-7998f1564dff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 2.104697 Jul 18 02:42:10.546164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2473/5030] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:08 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:10.665510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:10.711631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-328e7a7a-3c57-43b1-b3a1-968a6c224d1f tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1528 microversion: 2.1 time: 3.262138 Jul 18 02:42:10.715062 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2558/5031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:07 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1528 bytes in 3276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:11.274011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d9d8a242-94b8-4f3e-8ae9-d2e9aad331a2 req-ba2622a6-700e-4f4a-8bc6-03d15ba5f66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40625c26-2be3-42f7-a5c2-6fee3eff646e", "name": "network-vif-deleted", "tag": "340f0ad5-9e8d-4ed6-a204-b07c6f305218"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:11.313354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9d8a242-94b8-4f3e-8ae9-d2e9aad331a2 req-ba2622a6-700e-4f4a-8bc6-03d15ba5f66e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.317977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9d8a242-94b8-4f3e-8ae9-d2e9aad331a2 req-ba2622a6-700e-4f4a-8bc6-03d15ba5f66e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.380201 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d9d8a242-94b8-4f3e-8ae9-d2e9aad331a2 req-ba2622a6-700e-4f4a-8bc6-03d15ba5f66e service nova] Creating event network-vif-deleted:340f0ad5-9e8d-4ed6-a204-b07c6f305218 for instance 40625c26-2be3-42f7-a5c2-6fee3eff646e on n-h2-849796-1 Jul 18 02:42:11.398259 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d9d8a242-94b8-4f3e-8ae9-d2e9aad331a2 req-ba2622a6-700e-4f4a-8bc6-03d15ba5f66e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128265 Jul 18 02:42:11.405817 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2474/5032] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:11.576126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.582571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:11.647999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.653524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.660579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.662883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.745833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.746690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:11.772771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.775382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.783771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.784915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.954242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.957228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.959861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lazy-loading 'fault' on Instance uuid 40625c26-2be3-42f7-a5c2-6fee3eff646e {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:12.379806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81dabb06754ccd82f8e5e989362342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335651e16b204f3a86536ce8af298ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:12.439893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b2ed5e5-b468-40ed-a2df-b1e30d957b6c tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 200 len: 1315 microversion: 2.1 time: 0.700457 Jul 18 02:42:12.448977 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2475/5033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:11 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:13.150458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:13.164773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-590f2d72-e949-4dc5-8fe9-1f40f3ebc5c3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.597289 Jul 18 02:42:13.168228 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2559/5034] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:11 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:13.471591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:13.472705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] [instance: 40625c26-2be3-42f7-a5c2-6fee3eff646e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:13.510185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.511981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:13.513193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.519402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:13.610410 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] HTTP exception thrown: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Request method failure captured: Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e HTTP/1.1 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MhR_RnROygkJRaFq_ZcWKSo97n-Vj8xSYKCDKLg09Nu-qqN_CVY5ZntKZWX_yTanQwiyWDGBVIitWjsqASAYdJMsyV5caaUsPW2JN4UYO9c6W02v1xuisBWHqjQPOD3_4md7uwyjLD0vihSwnJtZ2CEAYpt_Sehd-iQTm1au_eUTro Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_335651e16b204f3a86536ce8af298ad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/335651e16b204f3a86536ce8af298ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 335651e16b204f3a86536ce8af298ad7 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-939247210 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 6a81dabb06754ccd82f8e5e989362342 Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-939247210-project Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '40625c26-2be3-42f7-a5c2-6fee3eff646e'} Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:13.625597 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. Jul 18 02:42:13.630792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:42:13.635232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] Returning 404 to user: Instance 40625c26-2be3-42f7-a5c2-6fee3eff646e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:13.649509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f381082-00ee-4910-ab88-5d8cb3def237 tempest-ServerAddressesNegativeTestJSON-939247210 tempest-ServerAddressesNegativeTestJSON-939247210-project] 10.222.0.67 "GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e" status: 404 len: 111 microversion: 2.1 time: 0.173812 Jul 18 02:42:13.654207 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2476/5035] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:13 2022] GET /compute/v2.1/servers/40625c26-2be3-42f7-a5c2-6fee3eff646e => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:14.189140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.189779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.196339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:14.218816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.223198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.227960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.231628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:16.559526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:16.573822 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8aba4d0d-69f3-4198-a28e-224cf269c930 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 2.388575 Jul 18 02:42:16.581561 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2560/5036] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:14 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:17.610854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:17.611677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:17.634925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.650190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.654639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.657796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:18.781147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:18.834966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-706e564a-6a60-4a59-a2ce-d1e795c65a5e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.228784 Jul 18 02:42:18.852875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2477/5037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:17 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:19.884726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:19.885831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:19.919074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.919781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:19.920746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.924204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:21.546951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:21.556762 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a4db94a-73bc-47c5-b624-a270442b6bd4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1682 microversion: 2.1 time: 1.676683 Jul 18 02:42:21.567288 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2561/5038] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:19 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1682 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:22.589953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:22.595089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:22.640194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:22.651689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:22.654786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:22.662451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.281934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:23.321582 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ce7ad9a-c665-4e01-82b4-808d0b4e2b7a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.730657 Jul 18 02:42:23.325309 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2478/5039] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:22 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:25.170213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ffd6d092-78fb-4d7b-af72-4cc325400dde req-d8138d93-a1a3-408c-a7e7-0af4943af1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:25.219107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ffd6d092-78fb-4d7b-af72-4cc325400dde req-d8138d93-a1a3-408c-a7e7-0af4943af1a1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:25.220594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ffd6d092-78fb-4d7b-af72-4cc325400dde req-d8138d93-a1a3-408c-a7e7-0af4943af1a1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:25.234944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:25.265809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ffd6d092-78fb-4d7b-af72-4cc325400dde req-d8138d93-a1a3-408c-a7e7-0af4943af1a1 service nova] Creating event network-vif-unplugged:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:42:25.278832 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ffd6d092-78fb-4d7b-af72-4cc325400dde req-d8138d93-a1a3-408c-a7e7-0af4943af1a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114551 Jul 18 02:42:25.280807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2562/5040] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 02:42:26.100701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:26.106643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:26.123090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:26.126799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:26.127323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:26.130713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:26.136678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:26.589776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:26.618567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8799391-cde5-45c5-9427-30eecd613a70 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.532121 Jul 18 02:42:26.642206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2479/5041] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:26 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:30.949346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:30.951131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:30.980817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:30.982543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:30.985553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:30.986773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:32.327469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.346805 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4eeecbd9-7a39-4092-b32a-327a3179e62c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.402971 Jul 18 02:42:32.365750 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2563/5042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:30 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:32.376844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:32.377667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:32.392076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:32.392745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:32.394614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:32.396467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.374511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:33.401253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be7d383f-def9-4460-93b6-0b83c06aabd3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.015772 Jul 18 02:42:33.402949 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2480/5043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:32 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:33.437727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:33.437727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:33.444802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.445840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.447502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.448150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.886852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:33.900342 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e0d5718-b5dd-4bff-a5dd-57f8e256d00e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.485081 Jul 18 02:42:33.904888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2564/5044] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:33 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:33.922649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:33.924234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:33.934850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.935817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.937286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.938041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.194656 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b132138-7565-4a88-804e-35097b8b358b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.276907 Jul 18 02:42:34.217380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:34.220447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:34.223238 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2481/5045] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:42:33 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:34.254574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.256321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.259851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.261563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:35.857023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:35.885173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2955b40e-80ea-4217-b71a-cb04d7b5899b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1671 microversion: 2.1 time: 1.680403 Jul 18 02:42:35.901747 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2565/5046] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:34 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1671 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:36.859271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1219187421", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "c10e5eb9-425c-4411-b18e-1a3572a7dfa0"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:36.925830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:36.927271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:37.006357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.021569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.042470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.043980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.127887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] validate_networks() for [('c10e5eb9-425c-4411-b18e-1a3572a7dfa0', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:42:37.545043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:37.554689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9416ce7f-65ac-4326-8fa6-ce7a1bca35cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1671 microversion: 2.1 time: 0.637781 Jul 18 02:42:37.555300 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2566/5047] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:36 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1671 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:38.583748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:38.584884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:38.604208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:38.604674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:38.605717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:38.606342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:39.479234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:39.519686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f2e0876-75b1-43d6-ada7-3131ed9499d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1671 microversion: 2.1 time: 0.939513 Jul 18 02:42:39.523248 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2567/5048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:38 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1671 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:40.552331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:40.559167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:40.598539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.599702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.609311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.611624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.876240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:42:40.878108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:42:40.878108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:42:40.878108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:42:40.878469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:42:40.906402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.906897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.907806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:40.915498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:40.942587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:40.987766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Getting quotas for project e6705e811a8541ada294fb26414cbf4c. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:42:40.997679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Getting quotas for user 821ce39d724d454d9d495bf565b5c288 and project e6705e811a8541ada294fb26414cbf4c. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:42:41.044823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:42:41.052322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:42:41.203720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c7131ed-b0d8-440f-80a5-e0da05b3fa10 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.908749 Jul 18 02:42:41.204402 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2482/5049] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:42:41.233065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:41.235591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:41.507568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.519855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8c654cd-b0aa-494b-b0bc-151b3d11e88a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1676 microversion: 2.1 time: 0.974873 Jul 18 02:42:41.529718 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2568/5050] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:40 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1676 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:41.584075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.610817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.621627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:41.625019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27a5d75a-f9a0-480c-8807-6f1f9abf64a3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1262 microversion: 2.26 time: 0.410061 Jul 18 02:42:41.631114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2483/5051] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:41 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1262 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:42.549468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:42.550123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:42.565096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:42.565567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:42.566667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:42.567124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:42.656131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:42.656794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:43.020541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.038760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.060307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:43.076017 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93f8d7a5-05b8-4ce9-ac4e-465d0e963230 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1262 microversion: 2.26 time: 0.420879 Jul 18 02:42:43.080124 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2484/5052] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:42 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1262 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:44.095482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.120456 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-576bec00-8c74-4c9a-a37f-0a1bf96b37ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.572619 Jul 18 02:42:44.125039 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2569/5053] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:42 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:44.125353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:44.137661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:44.157893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:44.158927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:44.179356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.182362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.183392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.188135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.190797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.191865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.193100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.205301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.331866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6682c82-ae55-4758-aee2-d50059bd6306 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 200 len: 324 microversion: 2.1 time: 0.182593 Jul 18 02:42:44.332553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2570/5054] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:42:44 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:44.375816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:44.402261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:44.495457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=22 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:44.504849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.506543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.509496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:44.513486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:44.613690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.667958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.681807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:44.683121 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66f7cf2b-b631-48ee-b381-192398bdb10b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1258 microversion: 2.26 time: 0.588572 Jul 18 02:42:44.685582 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2485/5055] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:44 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1258 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:45.184413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:45.220242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-089e3884-06da-49a6-bf5d-a91584ed6559 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.876717 Jul 18 02:42:45.265533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2571/5056] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:44 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:45.279021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:45.279747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:45.299896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.300585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:45.301492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.302014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:45.705345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:45.709021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:45.755426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.758262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:45.765699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:45.766591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:46.214802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:46.254378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:46.268722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:46.271530 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10fff05c-0464-4155-bba8-d6cd170d9a94 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1320 microversion: 2.26 time: 0.569984 Jul 18 02:42:46.277442 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2572/5057] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:45 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:42:47.148431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:47.177918 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d819d4c2-8ed1-448a-9907-0be752ee1125 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.903542 Jul 18 02:42:47.179000 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2486/5058] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:45 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:47.206506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:47.207147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:47.259832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:47.269389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:47.277940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:47.291513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:47.292188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:47.293952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:47.315855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:47.325797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:47.334390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:47.334959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:47.918671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:47.991675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.001603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.002887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44d58f84-a408-4e26-91fc-aa330b6a247f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1320 microversion: 2.26 time: 0.715049 Jul 18 02:42:48.008957 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2487/5059] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:47 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1320 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:48.121228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:48.130445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-831b7cfe-8ea8-4f0b-a4ab-5f9695ba5a81 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.930821 Jul 18 02:42:48.153069 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2573/5060] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:47 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:48.159920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:48.160855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:48.186902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:48.187409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:48.193874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:48.196221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:49.029452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:49.030589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:49.089736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:49.091099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:49.094317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:49.095338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:49.404181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.419271 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04282265-c9f6-4c84-a26b-9a71df7eff2b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.265104 Jul 18 02:42:49.419889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2488/5061] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:48 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:49.691918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.710839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.716627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:49.718350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9749b8ee-130e-40c6-80a1-1f828f82f60b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 0.694364 Jul 18 02:42:49.719205 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2574/5062] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:49 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:49.770816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1695992202", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "72e9a08a-ca51-499a-9658-0d4e3b258016"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:49.924166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] validate_networks() for [('72e9a08a-ca51-499a-9658-0d4e3b258016', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:42:50.761735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:50.763037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:50.819585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:50.834846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:50.836511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:50.844060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:50.941775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:51.945138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:51.967150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:51.980311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:51.981849 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5fb9a65-9c8a-4c68-a801-e25ee72c20a2 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.245212 Jul 18 02:42:51.988701 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2575/5063] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:50 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:52.413034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-89c7a935-91e0-4e47-880e-6efb63f7c6dd req-8e9041db-0d23-4da3-9606-f0e16e6d5b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c2d3219-a17f-404e-9a7a-5cd964a09fd6", "tag": "bb21dcb2-5215-4587-9f94-6062f9e7b4aa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:52.447902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-89c7a935-91e0-4e47-880e-6efb63f7c6dd req-8e9041db-0d23-4da3-9606-f0e16e6d5b0c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:52.448680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-89c7a935-91e0-4e47-880e-6efb63f7c6dd req-8e9041db-0d23-4da3-9606-f0e16e6d5b0c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:52.496097 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-89c7a935-91e0-4e47-880e-6efb63f7c6dd req-8e9041db-0d23-4da3-9606-f0e16e6d5b0c service nova] Creating event network-changed:bb21dcb2-5215-4587-9f94-6062f9e7b4aa for instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 on n-h2-849796-1 Jul 18 02:42:52.539141 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-89c7a935-91e0-4e47-880e-6efb63f7c6dd req-8e9041db-0d23-4da3-9606-f0e16e6d5b0c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132698 Jul 18 02:42:52.549377 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2576/5064] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:53.027507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:53.032349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:53.042026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:53.071610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:53.072340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:53.073894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:53.075452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:53.979727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.039134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.051317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:54.058339 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9cd4d50e-fb31-44a9-a3ba-c795ba394db3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.033061 Jul 18 02:42:54.062730 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2577/5065] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:53 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:54.794220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:42:54.795720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:42:54.796390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:42:54.797002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:42:54.797607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:42:54.822402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:54.823101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:54.824181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:54.824813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:54.855962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:42:54.866210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:42:54.912480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:42:54.918261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:42:55.088726 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30a131db-9706-49e7-ba8a-7cf26fba3552 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.317553 Jul 18 02:42:55.091840 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2489/5066] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:42:55.098913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:55.101456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:55.114835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c914d7db-f298-465e-88ed-ed1a6b6aa3f3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:55.114979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c914d7db-f298-465e-88ed-ed1a6b6aa3f3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:55.131402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:55.131863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:55.145081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:55.145958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:55.496820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c914d7db-f298-465e-88ed-ed1a6b6aa3f3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:55.509598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c914d7db-f298-465e-88ed-ed1a6b6aa3f3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1215 microversion: 2.1 time: 0.412904 Jul 18 02:42:55.520646 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2490/5067] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:55 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1215 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:56.292764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.308685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.314457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.320294 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f88f29a9-9bc5-4e9b-bd3f-072e8d878d9b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.238501 Jul 18 02:42:56.325158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2578/5068] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:55 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:56.545420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:56.547114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:56.553520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:56.581660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:56.582431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:56.585572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:56.587381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:56.925999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:56.966197 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-267db755-df3c-41d0-ae85-565d0a96d429 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1211 microversion: 2.1 time: 0.432561 Jul 18 02:42:56.970482 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2491/5069] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:56 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1211 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:57.356597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:57.358363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:57.389806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:57.391092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:57.392644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:57.395163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:57.997481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:57.998002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:58.015898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:58.016368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:58.035711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:58.036528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:58.319909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.336240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c622ac4-e499-4db0-be6b-b913abe7d449 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1273 microversion: 2.1 time: 0.344104 Jul 18 02:42:58.348154 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2492/5070] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:57 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:58.733914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.747649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.765943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:58.779966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aab164ec-3056-433b-a4f6-e34837673b91 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.437678 Jul 18 02:42:58.780588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2579/5071] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:57 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:59.370632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:59.373281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:59.408088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.409323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.417018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.419706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.829749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:59.844061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:59.886936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:59.915652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.922663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.924326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:59.925167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:59.939537 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-868e95e5-daf3-421a-8370-28c382ff7eca tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1273 microversion: 2.1 time: 0.583242 Jul 18 02:42:59.978863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2493/5072] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:59 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1273 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:00.027683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:00.981140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:00.981947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:00.995567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:00.996400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:00.998016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:00.998732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:01.262177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.276686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.285995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.288872 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a94465f-ce13-475b-b339-9bd88efec0ca tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.491076 Jul 18 02:43:01.289344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:01.297585 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2580/5073] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:59 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:01.311936 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f29f208a-86f4-4f76-a944-8f055692a33a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1273 microversion: 2.1 time: 0.344469 Jul 18 02:43:01.312587 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2494/5074] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:00 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:02.338685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:02.341490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:02.342234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:02.351114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:02.362206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.362705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.368386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.373495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.379683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.383307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.385674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:02.387838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:02.976242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.005234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.007509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.010138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e815c43-8cbc-4dee-99ff-f16d95e8e503 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 0.682646 Jul 18 02:43:03.021628 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2581/5075] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:02 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:03.422668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:03.455455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79fb1617-10f9-4b34-81e9-235cfd841e95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.119474 Jul 18 02:43:03.466035 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2495/5076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:02 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:03.882414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-edb9b55b-9aff-4137-b84e-428c07377afb req-37677e01-58de-4113-a4de-6e4817eea32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2d3219-a17f-404e-9a7a-5cd964a09fd6", "name": "network-vif-plugged", "status": "completed", "tag": "bb21dcb2-5215-4587-9f94-6062f9e7b4aa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:03.904474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-edb9b55b-9aff-4137-b84e-428c07377afb req-37677e01-58de-4113-a4de-6e4817eea32b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:03.907208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-edb9b55b-9aff-4137-b84e-428c07377afb req-37677e01-58de-4113-a4de-6e4817eea32b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:03.934427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-edb9b55b-9aff-4137-b84e-428c07377afb req-37677e01-58de-4113-a4de-6e4817eea32b service nova] Creating event network-vif-plugged:bb21dcb2-5215-4587-9f94-6062f9e7b4aa for instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 on n-h2-849796-1 Jul 18 02:43:03.950151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-edb9b55b-9aff-4137-b84e-428c07377afb req-37677e01-58de-4113-a4de-6e4817eea32b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.898970 Jul 18 02:43:03.950842 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2582/5077] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:04.036712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:04.040952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:04.065697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.066995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.069257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.071016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.496691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:04.499733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:04.523110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.527308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.528558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:04.531941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:04.735225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:04.784533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:04.792021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:04.796041 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33e1d51c-024e-47fb-a140-5be6ffaaf554 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 0.768243 Jul 18 02:43:04.799965 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2496/5078] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:04 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:05.566312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:05.582438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52fe7195-3fc3-4841-a184-a1a09a07ef95 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.099464 Jul 18 02:43:05.591897 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2583/5079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:04 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:05.666845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:05.675740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:05.831592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:05.832551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:05.867330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:05.870359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:05.873738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:05.878434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:06.256511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-66cf77df-528b-4fa0-90c0-b1b7fccd748c req-c79b29ba-767d-4ba1-a230-e3d65e3ad834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37698ef-7e62-46a5-b256-6bed5032079c", "tag": "27a79f4a-3839-4288-a107-3db94da8573c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:06.349579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-66cf77df-528b-4fa0-90c0-b1b7fccd748c req-c79b29ba-767d-4ba1-a230-e3d65e3ad834 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:06.353463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-66cf77df-528b-4fa0-90c0-b1b7fccd748c req-c79b29ba-767d-4ba1-a230-e3d65e3ad834 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:06.400989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-66cf77df-528b-4fa0-90c0-b1b7fccd748c req-c79b29ba-767d-4ba1-a230-e3d65e3ad834 service nova] Creating event network-changed:27a79f4a-3839-4288-a107-3db94da8573c for instance f37698ef-7e62-46a5-b256-6bed5032079c on n-h1-849796-1 Jul 18 02:43:06.419102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-66cf77df-528b-4fa0-90c0-b1b7fccd748c req-c79b29ba-767d-4ba1-a230-e3d65e3ad834 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.755271 Jul 18 02:43:06.421322 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2497/5080] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:06.602387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:06.603402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:06.621254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:06.621878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:06.626210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:06.631786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:06.980379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:06.996593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:07.002674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:07.007959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50740a40-efaf-4f65-b56b-63103967ab29 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1362 microversion: 2.26 time: 1.180100 Jul 18 02:43:07.008887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2584/5081] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:05 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1362 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:08.029671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:08.031036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:08.046198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.047007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:08.050736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.051465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:08.559157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:08.571820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0048309b-bb9a-47ec-bcec-f026be9233e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.970859 Jul 18 02:43:08.577474 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2498/5082] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:06 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:08.745306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:08.762185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:08.763902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:08.777889 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49ba2b1a-bd1d-48bb-b8f2-b22599e4c477 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1546 microversion: 2.26 time: 0.740230 Jul 18 02:43:08.780952 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2585/5083] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:08 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1546 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:08.803846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0435cee0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:08.826020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.826481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:08.828611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:08.856901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.857423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:08.858283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.858742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:08.964465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:08.965816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.015805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.017236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.102162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:09.197910 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c98e1036-5a2b-4320-929b-ca66085818ad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1080094414" status: 201 len: 0 microversion: 2.26 time: 0.395526 Jul 18 02:43:09.205943 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2499/5084] 10.222.0.67 () {62 vars in 1379 bytes} [Mon Jul 18 02:43:08 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1080094414 => generated 0 bytes in 410 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:43:09.215530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ddd08a4b-32ce-4cb8-ad61-e9a9dc298d68 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab04586670>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:09.247673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddd08a4b-32ce-4cb8-ad61-e9a9dc298d68 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.248084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddd08a4b-32ce-4cb8-ad61-e9a9dc298d68 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.310851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ddd08a4b-32ce-4cb8-ad61-e9a9dc298d68 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1080094414" status: 204 len: 0 microversion: 2.26 time: 0.099038 Jul 18 02:43:09.316295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2586/5085] 10.222.0.67 () {60 vars in 1360 bytes} [Mon Jul 18 02:43:09 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1080094414 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:09.341874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab04839c10>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:09.396806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.401950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.402766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:09.423377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.423850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.424698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.425980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.509393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.519099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.575265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:09.607093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:09.608239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:09.619769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.620551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.624532 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bea33580-558c-407f-8d4e-b9a4f286bfac tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 204 len: 0 microversion: 2.26 time: 0.301120 Jul 18 02:43:09.627835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2500/5086] 10.222.0.67 () {60 vars in 1294 bytes} [Mon Jul 18 02:43:09 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:09.629295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.632670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.646839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1dfd7537-5d1d-4e80-b5fc-857ed16392d5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0a5b00d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:09.670091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dfd7537-5d1d-4e80-b5fc-857ed16392d5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.672008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dfd7537-5d1d-4e80-b5fc-857ed16392d5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.713363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:09.730488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1dfd7537-5d1d-4e80-b5fc-857ed16392d5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 12 microversion: 2.26 time: 0.092054 Jul 18 02:43:09.733777 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2501/5087] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:43:09 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 12 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:09.794933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab04964040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:09.851074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.856492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.878051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:09.894102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.897594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:09.901831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:09.902606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.021969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.022473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.044978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.045551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.119390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:10.162110 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a69c805-3611-4c48-a36e-29ff627f1cad tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-91417048" status: 201 len: 0 microversion: 2.26 time: 0.423233 Jul 18 02:43:10.163394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2502/5088] 10.222.0.67 () {62 vars in 1373 bytes} [Mon Jul 18 02:43:09 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-91417048 => generated 0 bytes in 425 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 18 02:43:10.181499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dc86587e-4f0c-42ee-ac7a-51e0d5572556 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7faaf748e040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:10.227732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc86587e-4f0c-42ee-ac7a-51e0d5572556 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.228527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dc86587e-4f0c-42ee-ac7a-51e0d5572556 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.246694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dc86587e-4f0c-42ee-ac7a-51e0d5572556 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 34 microversion: 2.26 time: 0.076703 Jul 18 02:43:10.249150 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2503/5089] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:43:10 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 34 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:10.303381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab042b6160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:10.336898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.346081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.347228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:10.373475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.374726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.376218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.377475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.440048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.440768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.491924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:10.523803 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb221ea3-416f-4a77-a8e2-3a25b6397ad3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-91417048" status: 204 len: 0 microversion: 2.26 time: 0.267509 Jul 18 02:43:10.529186 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2504/5090] 10.222.0.67 () {60 vars in 1357 bytes} [Mon Jul 18 02:43:10 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-91417048 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:10.545206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb0ac4d4-3c1a-4b09-b2c7-e33fa23b9b7a tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7faaf7469430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:10.570327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb0ac4d4-3c1a-4b09-b2c7-e33fa23b9b7a tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.571375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb0ac4d4-3c1a-4b09-b2c7-e33fa23b9b7a tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.590553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb0ac4d4-3c1a-4b09-b2c7-e33fa23b9b7a tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 12 microversion: 2.26 time: 0.056252 Jul 18 02:43:10.591551 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2505/5091] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:43:10 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:10.603651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab042b68b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:10.630212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.630687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.631202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:10.649898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.650385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.651228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.651678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.716269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.716628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.718594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:10.728775 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef40b975-1714-43a1-a758-3b4a64843bd2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.125819 Jul 18 02:43:10.746914 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2587/5092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:09 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:10.761524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:10.812380 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6afdca68-30f8-4a90-8ef9-2d47b801144b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 204 len: 0 microversion: 2.26 time: 0.214638 Jul 18 02:43:10.813366 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2506/5093] 10.222.0.67 () {60 vars in 1294 bytes} [Mon Jul 18 02:43:10 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:10.823734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0490fca0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:10.835355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.835833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.836452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:10.860842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.861344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.862213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.862673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.959746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.963768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:10.983919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:10.984657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.058815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:11.127174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b0b52cbb-4773-42bb-987d-3cc008a96cb4 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-882908709" status: 201 len: 0 microversion: 2.26 time: 0.307609 Jul 18 02:43:11.132001 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2588/5094] 10.222.0.67 () {62 vars in 1376 bytes} [Mon Jul 18 02:43:10 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-882908709 => generated 0 bytes in 314 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 18 02:43:11.143760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab046d69d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:11.179324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.183569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.190093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:11.217114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.217583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.227471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.228210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.281193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.281671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.314547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.315133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.385249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:11.427190 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c836eaa1-0731-4e65-8c2f-17a682285194 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1182506409" status: 201 len: 0 microversion: 2.26 time: 0.287936 Jul 18 02:43:11.427408 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2507/5095] 10.222.0.67 () {62 vars in 1379 bytes} [Mon Jul 18 02:43:11 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-1182506409 => generated 0 bytes in 289 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:43:11.438508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0457ca60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:11.452902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.454439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.455176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:11.499339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.515774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.517110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.522611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.717943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.718661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.760303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:11.768896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:11.770393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:11.794881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.795714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.796092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.796551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.816631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c4f3877-1621-47bc-ab9d-e55398a8ece5 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 204 len: 0 microversion: 2.26 time: 0.382061 Jul 18 02:43:11.830024 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2589/5096] 10.222.0.67 () {60 vars in 1294 bytes} [Mon Jul 18 02:43:11 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:11.865853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd791968-2b43-49c8-b190-0f2afa6cfa06 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0459e310>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:11.894883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd791968-2b43-49c8-b190-0f2afa6cfa06 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:11.908244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd791968-2b43-49c8-b190-0f2afa6cfa06 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:11.956817 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd791968-2b43-49c8-b190-0f2afa6cfa06 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 12 microversion: 2.26 time: 0.121590 Jul 18 02:43:11.959744 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2590/5097] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:43:11 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 12 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:11.992241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab045d61f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:12.022397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.036771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.037647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:12.067441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.069468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.074965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.076093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.297746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.313210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.346019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:12.407655 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2fe162c-4ad9-42f8-8f78-bea6c36fd9b1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 204 len: 0 microversion: 2.26 time: 0.439812 Jul 18 02:43:12.408797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2591/5098] 10.222.0.67 () {60 vars in 1294 bytes} [Mon Jul 18 02:43:11 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:12.434242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab04656820>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:12.510779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.511713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.512452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:12.533505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.534042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:12.535004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:12.537711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.053328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.054270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.108230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.115012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.244810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:13.357070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70120e98-34e5-4f35-a21b-cadc639ede41 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-2104249135" status: 201 len: 0 microversion: 2.26 time: 0.938311 Jul 18 02:43:13.365663 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2592/5099] 10.222.0.67 () {62 vars in 1379 bytes} [Mon Jul 18 02:43:12 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-2104249135 => generated 0 bytes in 948 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 18 02:43:13.393792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab045d6790>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:13.430019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.430900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.431688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:13.468721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.469609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.473325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.474489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.552752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.556095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.575878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:13.592497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.593081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.635115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:13.662704 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd9783a2-aa2d-4755-bfbb-5e788f432c0d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.899141 Jul 18 02:43:13.674494 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2508/5100] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:11 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:13.750438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:13.811990 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd8b8162-7878-46e8-aeb1-919fceff6e4f tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-608912025" status: 201 len: 0 microversion: 2.26 time: 0.437893 Jul 18 02:43:13.815921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2593/5101] 10.222.0.67 () {62 vars in 1376 bytes} [Mon Jul 18 02:43:13 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags/tempest-tag-608912025 => generated 0 bytes in 443 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 18 02:43:13.833741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Action: 'update_all', calling method: .version_select at 0x7fab0645f3a0>, body: {"tags": ["tempest-tag-405804504", "tempest-tag-1091588351"]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:13.855425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.855900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.858506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:13.896429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.897509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.902477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.903240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:13.994447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:13.995088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.061806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:14.127491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55d72a03-b355-4474-930f-2fe297c9e6cc tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 61 microversion: 2.26 time: 0.299549 Jul 18 02:43:14.132343 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2509/5102] 10.222.0.67 () {62 vars in 1311 bytes} [Mon Jul 18 02:43:13 2022] PUT /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 61 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:14.143411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bffc3f10-d068-42f5-8b8a-3b178c62ac53 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab0461edc0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.155968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bffc3f10-d068-42f5-8b8a-3b178c62ac53 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.156446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bffc3f10-d068-42f5-8b8a-3b178c62ac53 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.192606 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bffc3f10-d068-42f5-8b8a-3b178c62ac53 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 200 len: 61 microversion: 2.26 time: 0.053638 Jul 18 02:43:14.197426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2594/5103] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Jul 18 02:43:14 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 61 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:14.207042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '.version_select at 0x7fab047ae430>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.226565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.227999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.228373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:14.258027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.262450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.264025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.264503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.339290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.339754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.380228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lazy-loading 'flavor' on Instance uuid 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:43:14.422326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7da934b-9d15-42d8-a16a-a063417504d1 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags" status: 204 len: 0 microversion: 2.26 time: 0.219457 Jul 18 02:43:14.423264 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2510/5104] 10.222.0.67 () {60 vars in 1294 bytes} [Mon Jul 18 02:43:14 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6/tags => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:14.447166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.448156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:14.460466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.464660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.465865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.466479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.527158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:43:14.684740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.689637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:14.718997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=60 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:14.723572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.729787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.736754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.741270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.779346 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb6bf879-1f94-4a2a-bc56-fd6bd87dc370 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 204 len: 0 microversion: 2.26 time: 0.338356 Jul 18 02:43:14.783234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2595/5105] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:43:14 2022] DELETE /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:43:14.801705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:14.802911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:14.824860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.825776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:14.827017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:14.827795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:15.443070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:15.454086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:15.455693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:15.465402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6202909b-562b-48f0-8db5-fc08fdc0205b tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1552 microversion: 2.26 time: 0.671967 Jul 18 02:43:15.480157 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2596/5106] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:14 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1552 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:16.489650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:16.490677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:16.528648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:16.538628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:16.540178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:16.553368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:16.563565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:16.612700 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65422bcf-78da-47c4-b91e-cefb1de0ff77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.933286 Jul 18 02:43:16.614016 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2511/5107] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:14 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:17.485609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:17.496966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:17.514478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821ce39d724d454d9d495bf565b5c288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6705e811a8541ada294fb26414cbf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:17.516791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76a0d0f7-7610-44c6-96ee-66f0081d6eaf tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 200 len: 1552 microversion: 2.26 time: 1.031613 Jul 18 02:43:17.555476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2597/5108] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:16 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 1552 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:43:17.638368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:17.639458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:17.683421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:17.684242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:17.685681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:17.686431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:18.410303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:18.426090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:18.454306 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-938a46e9-0ac3-424e-8832-4c1ccc28c389 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 0.821548 Jul 18 02:43:18.474545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2512/5109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:17 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:18.893183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1253192697", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "0a6ab26f-0a5f-400b-af1a-5d28958b6068"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:18.917784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1266100353", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "61da9625-b916-4d96-9d59-9127aea5e95c"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:19.058252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] validate_networks() for [('0a6ab26f-0a5f-400b-af1a-5d28958b6068', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:19.076752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] validate_networks() for [('61da9625-b916-4d96-9d59-9127aea5e95c', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:21.885944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:21.887457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:21.888191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:21.889616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:21.891580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:21.918111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:21.920034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:21.923266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:21.925631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:21.998940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Getting quotas for project 5ee4230c72534c2da244775f79815633. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:22.019156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Getting quotas for user 86740176efd34786b7c388b44d2f6130 and project 5ee4230c72534c2da244775f79815633. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:22.063620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:22.072525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:22.248355 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88d26923-656b-474b-a667-578db0caa571 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.303872 Jul 18 02:43:22.268306 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2598/5110] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:43:22.281788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:22.286905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] [instance: 5c2d3219-a17f-404e-9a7a-5cd964a09fd6] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:22.307532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.308027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.309112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.311567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.351422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:22.354148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:22.355631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:22.356898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:22.358313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:22.361247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] HTTP exception thrown: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Request method failure captured: Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 HTTP/1.1 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mibv8tG9zIjE5RWsuQfFvkTX6oaHMNUhdPEkzIhLznkVXDaoXmrqHPsXrTiBi9s-wM29ZfgQWLe10cuOBkgAVq2GKuV0bDm2qP8L4aedMsLztlnAMUBMjwyESYOFcOfb8C_JmXx1zQ2VkBMfELoqtzi1tEnvpBKgl19pHSFajwS9VY Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.26 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: e6705e811a8541ada294fb26414cbf4c Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerTagsTestJSON-747419839 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6705e811a8541ada294fb26414cbf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e6705e811a8541ada294fb26414cbf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e6705e811a8541ada294fb26414cbf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e6705e811a8541ada294fb26414cbf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerTagsTestJSON-747419839 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: e6705e811a8541ada294fb26414cbf4c Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerTagsTestJSON-747419839 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerTagsTestJSON-747419839-project Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 821ce39d724d454d9d495bf565b5c288 Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerTagsTestJSON-747419839-project Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5c2d3219-a17f-404e-9a7a-5cd964a09fd6'} Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:43:22.369416 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. Jul 18 02:43:22.374365 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:43:22.380083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] Returning 404 to user: Instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:43:22.381234 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-358188d7-ad15-488e-ab55-b443274945d3 tempest-ServerTagsTestJSON-747419839 tempest-ServerTagsTestJSON-747419839-project] 10.222.0.67 "GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6" status: 404 len: 111 microversion: 2.26 time: 0.111951 Jul 18 02:43:22.384090 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2599/5111] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:22 2022] GET /compute/v2.1/servers/5c2d3219-a17f-404e-9a7a-5cd964a09fd6 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:43:22.409725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.410845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.414831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.415865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.432352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:22.444356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:22.489146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.489897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.491158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:22.491810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:22.549595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Getting quotas for project 791edbe40b364a80940e47501f41ef9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:22.578304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Getting quotas for user 819bad6023cd4e2482a9a31e09577fee and project 791edbe40b364a80940e47501f41ef9e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:22.708158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:22.734354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:23.025874 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f343690-15f8-4ace-8c97-c3b0a800470f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.549685 Jul 18 02:43:23.026571 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2513/5112] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:43:23.045118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-987562bb-8437-4b56-bb47-3f71d22bacc9 req-9be19490-dd25-497f-985d-0f3ab1d3f71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37698ef-7e62-46a5-b256-6bed5032079c", "name": "network-vif-plugged", "status": "completed", "tag": "27a79f4a-3839-4288-a107-3db94da8573c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:23.097243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-987562bb-8437-4b56-bb47-3f71d22bacc9 req-9be19490-dd25-497f-985d-0f3ab1d3f71c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:23.097822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-987562bb-8437-4b56-bb47-3f71d22bacc9 req-9be19490-dd25-497f-985d-0f3ab1d3f71c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:23.137568 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-987562bb-8437-4b56-bb47-3f71d22bacc9 req-9be19490-dd25-497f-985d-0f3ab1d3f71c service nova] Creating event network-vif-plugged:27a79f4a-3839-4288-a107-3db94da8573c for instance f37698ef-7e62-46a5-b256-6bed5032079c on n-h1-849796-1 Jul 18 02:43:23.174208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-987562bb-8437-4b56-bb47-3f71d22bacc9 req-9be19490-dd25-497f-985d-0f3ab1d3f71c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144373 Jul 18 02:43:23.182738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2514/5113] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:23.209009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-805562f8-0248-4f91-9697-eb6e9563712f req-cad4d7ba-6a2f-40e6-847e-2fca06c9626b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2d3219-a17f-404e-9a7a-5cd964a09fd6", "name": "network-vif-deleted", "tag": "bb21dcb2-5215-4587-9f94-6062f9e7b4aa"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:23.282943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-805562f8-0248-4f91-9697-eb6e9563712f req-cad4d7ba-6a2f-40e6-847e-2fca06c9626b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:23.283126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-805562f8-0248-4f91-9697-eb6e9563712f req-cad4d7ba-6a2f-40e6-847e-2fca06c9626b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:23.362448 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-805562f8-0248-4f91-9697-eb6e9563712f req-cad4d7ba-6a2f-40e6-847e-2fca06c9626b service nova] Creating event network-vif-deleted:bb21dcb2-5215-4587-9f94-6062f9e7b4aa for instance 5c2d3219-a17f-404e-9a7a-5cd964a09fd6 on n-h2-849796-1 Jul 18 02:43:23.389917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-805562f8-0248-4f91-9697-eb6e9563712f req-cad4d7ba-6a2f-40e6-847e-2fca06c9626b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203268 Jul 18 02:43:23.403459 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2515/5114] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:23.428639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-063aef4c-c9e6-4d80-adcd-271a6d3fbe0b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:23.433064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-063aef4c-c9e6-4d80-adcd-271a6d3fbe0b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:24.498820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-063aef4c-c9e6-4d80-adcd-271a6d3fbe0b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:24.532423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-063aef4c-c9e6-4d80-adcd-271a6d3fbe0b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1216 microversion: 2.1 time: 1.126890 Jul 18 02:43:24.537489 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2516/5115] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:23 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1216 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:24.553217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a905ba1-2a3d-4976-8511-cd8d02cc947e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:24.554434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a905ba1-2a3d-4976-8511-cd8d02cc947e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:24.701720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:24.743309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0828ed4f-997d-4406-aa19-2d74f3356e6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 2.347301 Jul 18 02:43:24.746135 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2600/5116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:22 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:25.018638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a905ba1-2a3d-4976-8511-cd8d02cc947e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:25.045615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a905ba1-2a3d-4976-8511-cd8d02cc947e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1214 microversion: 2.1 time: 0.506106 Jul 18 02:43:25.051299 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2517/5117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:24 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1214 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:25.566884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:25.567834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:25.598836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.599312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:25.611018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.612058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:25.772273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:25.774597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:25.798661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.799561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:25.802994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:25.803967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:26.016956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:26.059665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3412491-99f6-4c0b-a08d-d003b221ad44 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1276 microversion: 2.1 time: 0.495486 Jul 18 02:43:26.074481 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2601/5118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:25 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1276 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:26.091544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:26.093643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:26.102080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:26.103208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:26.104419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:26.105130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:26.408246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:26.466182 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2d1d8b4-d7fd-467f-8f9c-33568c00d669 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1266 microversion: 2.1 time: 0.386420 Jul 18 02:43:26.478101 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2602/5119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:26 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:27.043251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:27.092329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:27.109603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:27.122104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35e08650-f61f-4c42-b48e-3fe72a37c35d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1315 microversion: 2.1 time: 1.329863 Jul 18 02:43:27.145759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2518/5120] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:25 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1315 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:27.175117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.183337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.185236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.186418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.499683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:27.500725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:27.508547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:27.565537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.566872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.568423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:27.580858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:27.640582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:27.680742 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-402f2ca0-82af-43ec-a8c6-fb024b1d9dcd tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1274 microversion: 2.1 time: 0.595085 Jul 18 02:43:27.708403 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2603/5121] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:27 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1274 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:28.135697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:28.156296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:28.158359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:28.166988 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-321084a8-b597-47c8-a453-07d1dc1d9498 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1272 microversion: 2.1 time: 0.675043 Jul 18 02:43:28.177250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2519/5122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:27 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1272 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:28.179995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.180730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:28.182009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.182767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:28.717355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:28.721367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:28.820154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.822607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:28.826825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:28.828074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:29.389111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:29.425428 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a1badb6-7ad5-4511-af88-183a2ddb3ad2 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1274 microversion: 2.1 time: 0.715137 Jul 18 02:43:29.427141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2520/5123] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:28 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1274 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:29.441013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:29.442939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:29.464201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:29.465790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:29.477439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:29.479074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:29.708184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:29.738980 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d943029-5bac-4e7e-b974-aee0a0411fec tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1272 microversion: 2.1 time: 0.305900 Jul 18 02:43:29.751439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2521/5124] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:29 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:29.973102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:29.989784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67812a29-8d8f-48e6-ae46-385c681a4a94 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1501 microversion: 2.1 time: 1.839726 Jul 18 02:43:29.998505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2604/5125] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:28 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1501 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:30.025619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e14f2664-d749-4f21-b9ed-f7abfda4cddb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:30.045138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e14f2664-d749-4f21-b9ed-f7abfda4cddb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.045138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e14f2664-d749-4f21-b9ed-f7abfda4cddb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.110297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e14f2664-d749-4f21-b9ed-f7abfda4cddb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:43:30.244485 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e14f2664-d749-4f21-b9ed-f7abfda4cddb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c/action" status: 202 len: 0 microversion: 2.1 time: 0.224269 Jul 18 02:43:30.245194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2522/5126] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:43:30 2022] POST /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:43:30.260671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:30.266093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:30.295306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.295885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.296716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.304228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.455154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:30.455880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:30.470748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.479537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.480695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.493353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.855221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:30.872783 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-02e763b7-a8f8-4e79-872b-8a2e1b5f11f4 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1274 microversion: 2.1 time: 0.421880 Jul 18 02:43:30.874105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2523/5127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:30 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1274 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:30.885059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:30.885978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:30.913563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.915187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:30.917342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:30.918444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:31.931834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:31.942377 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0687d8ba-aafe-428b-9824-2f8984681165 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 1.066804 Jul 18 02:43:31.943167 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2524/5128] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:30 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:31.959777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:31.960760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:31.963515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:31.978886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:31.982483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:31.983650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:31.986476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:32.044601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:32.479561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:32.918115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:32.939939 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ab57137-599d-4929-9b83-8e1e2f6dacf8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 2.688534 Jul 18 02:43:32.941895 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2605/5129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:30 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:32.968457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:32.969930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:32.998299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:33.001624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:33.004557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:33.005944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:33.947641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:33.975868 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-845f5e01-2402-4d36-8af7-e34564624028 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 2.018883 Jul 18 02:43:33.988870 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2525/5130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:31 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:33.998065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:34.001152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:34.019435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:34.020044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:34.020952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:34.024063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:34.043933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.068771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-809b399d-2990-4c84-88ba-6c69aab9b6c5 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 1.111706 Jul 18 02:43:34.075931 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2606/5131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:32 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:34.790360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:34.824531 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2112c2d2-9fbd-4d1f-a9a9-d77e9ded7bab tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.840316 Jul 18 02:43:34.830254 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2526/5132] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:33 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:34.998848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:34.999866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:35.020691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.029472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.040057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.043609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.103101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:35.108138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:35.146103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:35.157062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.162290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.166397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:35.170520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:35.981053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:35.996773 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c9ce8a2-0941-411a-96e4-7d0ef632c05d tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.899511 Jul 18 02:43:36.000748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2527/5133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:35 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:36.012142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:36.015251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:36.038038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:36.039993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:36.041887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:36.043332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:36.692443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:36.721743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f6ad3a7d-a7e8-41e6-a5ba-3f90fc51d1fe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.718798 Jul 18 02:43:36.722828 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2528/5134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:36 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:37.039004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:37.040084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:37.079881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.082604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.090821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.099346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.427735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:37.465948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d11fc01c-07a6-4c0b-8c51-887cd595a791 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 2.472147 Jul 18 02:43:37.482681 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2607/5135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:34 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:37.573397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:37.596976 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c20c995-37b9-4ef1-880e-5c6cf07d4b25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.571842 Jul 18 02:43:37.601775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2529/5136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:37 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:37.755562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:37.758576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:37.771399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.772105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:37.774112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:37.774783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:38.490999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:38.493621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:38.524447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:38.532981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:38.534721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:38.535745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:39.094003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:39.111134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70eff508-7e88-4d1a-b18a-21f026b3a66f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 1.362053 Jul 18 02:43:39.120435 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2608/5137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:37 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:39.136982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:39.137886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:39.146387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:39.146853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:39.147670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:39.148845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:39.190250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:39.346266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:39.377798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a54b0a0b-fffb-46d1-8441-cba4fa4fc70a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.889965 Jul 18 02:43:39.380200 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2530/5138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:38 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:39.878659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8765d78c-67b9-4585-a792-6b635636de3b req-f93da505-7fc3-4d11-8297-11caa9493929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac41d0c-707e-4e51-9b29-cff059d7660f", "tag": "0fbd0546-e5ef-4a5e-a24a-a869307a3d98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:39.901558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8765d78c-67b9-4585-a792-6b635636de3b req-f93da505-7fc3-4d11-8297-11caa9493929 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:39.908633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8765d78c-67b9-4585-a792-6b635636de3b req-f93da505-7fc3-4d11-8297-11caa9493929 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:39.954217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8765d78c-67b9-4585-a792-6b635636de3b req-f93da505-7fc3-4d11-8297-11caa9493929 service nova] Creating event network-changed:0fbd0546-e5ef-4a5e-a24a-a869307a3d98 for instance bac41d0c-707e-4e51-9b29-cff059d7660f on n-h2-849796-1 Jul 18 02:43:39.964602 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8765d78c-67b9-4585-a792-6b635636de3b req-f93da505-7fc3-4d11-8297-11caa9493929 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.582586 Jul 18 02:43:39.969708 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2531/5139] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:40.131781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:40.132840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:40.152501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.166443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.167597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.168246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.798422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:40.807523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62cbb8ee-57b2-401a-b9d3-802e5f41db0e tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 1.683859 Jul 18 02:43:40.817424 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2609/5140] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:39 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:40.823876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:40.826853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:40.854532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.855509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.856527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.857391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:41.102548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:41.115583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4db5cc35-b234-4127-8c85-6d28d7cd5f22 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.988558 Jul 18 02:43:41.116199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2532/5141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:40 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:41.851179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:41.855021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:41.886308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:41.889022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:41.891259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:41.892359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:41.901404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:42.095835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:42.118209 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-231bfea4-f359-41b7-869a-d6f9060de8cc tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 1.298848 Jul 18 02:43:42.119276 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2610/5142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:40 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:42.160983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:42.164042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:42.185618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.186993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.188941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.189959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.475077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:42.532779 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c13aefc7-de79-467f-a110-944380cc35e0 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.698760 Jul 18 02:43:42.542797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2533/5143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:41 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:42.634746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-167e9b6d-7f5b-4e03-add8-a0bc31613d22 req-1aad304c-6697-403d-9a7d-7eabbdb6eaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1b9a5b-b605-4a9a-a0d4-3617d3415078", "tag": "7129f49b-a987-45a0-8269-07d736007030"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:42.670166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-167e9b6d-7f5b-4e03-add8-a0bc31613d22 req-1aad304c-6697-403d-9a7d-7eabbdb6eaf9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:42.670634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-167e9b6d-7f5b-4e03-add8-a0bc31613d22 req-1aad304c-6697-403d-9a7d-7eabbdb6eaf9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:42.688555 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-167e9b6d-7f5b-4e03-add8-a0bc31613d22 req-1aad304c-6697-403d-9a7d-7eabbdb6eaf9 service nova] Creating event network-changed:7129f49b-a987-45a0-8269-07d736007030 for instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 on n-h2-849796-1 Jul 18 02:43:42.722966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-167e9b6d-7f5b-4e03-add8-a0bc31613d22 req-1aad304c-6697-403d-9a7d-7eabbdb6eaf9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096470 Jul 18 02:43:42.723613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2534/5144] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:42.867560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:42.884981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89753e3d-0db0-4eb0-bfbd-e378893489e7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.755116 Jul 18 02:43:42.888823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2611/5145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:42 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:43.135967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:43.137561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:43.158138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.159266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.162764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.167792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.484788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:43.502962 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17af9b24-5354-4b43-8579-97f2641b5c32 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.371046 Jul 18 02:43:43.508991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2612/5146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:43 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:43.567665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:43.569673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:43.580375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.581125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.582414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.583267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.749483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-944844719", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "291ce2a6-47df-4495-a82b-852a3a48ce6f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:43.845892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:43.861618 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-44123469-cebf-44b5-b030-8ee545a8ee1a tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.301070 Jul 18 02:43:43.866134 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2613/5147] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:43 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:43.898853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] validate_networks() for [('291ce2a6-47df-4495-a82b-852a3a48ce6f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:43.908566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:43.910087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:43.918330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.919038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:43.920235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:43.920865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:44.594925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:44.603868 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b03151f6-c29a-421e-a333-fe4b3916b3dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.701618 Jul 18 02:43:44.604492 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2614/5148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:43 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:44.633611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:44.634250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:44.656857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:44.665726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:44.672048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:44.677230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.002516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:47.036971 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70cbed73-4027-461e-8de3-023ca2f8b29e tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 2.413507 Jul 18 02:43:47.063107 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2615/5149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:44 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:47.099162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:47.101707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:47.138533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:47.161683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.166431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.171021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.172215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.342752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:47.343491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:47.344356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:47.345404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:47.346537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:47.404112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.405180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.406332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.407667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.438589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Getting quotas for project 225acab317f54de1b0ce9715586063ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:47.464156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Getting quotas for user 7cc6c1cec7f54913a89ebcd0d9f8cb1b and project 225acab317f54de1b0ce9715586063ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:47.518119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:47.522058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:47.616775 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e26924bf-7f3b-49fc-a65e-dfdac0da5247 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.503600 Jul 18 02:43:47.618241 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2535/5150] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:43:47.624784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:47.632771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:47.647355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.648633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.649713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.650365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.039697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.050354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0754f5a5-50c0-406a-bb51-ddbd2ab31816 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.430734 Jul 18 02:43:48.055753 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2536/5151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:47 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:48.062149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.098255 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-596ba2fe-f557-4ccf-93f1-eb6818668e74 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 1.024278 Jul 18 02:43:48.106301 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2616/5152] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:47 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:48.128817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-920c92c4-98a1-456e-b5cc-1be8dd00a4ff tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:48.135871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-920c92c4-98a1-456e-b5cc-1be8dd00a4ff tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:48.386108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-920c92c4-98a1-456e-b5cc-1be8dd00a4ff tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.440009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-920c92c4-98a1-456e-b5cc-1be8dd00a4ff tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1227 microversion: 2.1 time: 0.330052 Jul 18 02:43:48.448874 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2617/5153] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:48 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1227 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:48.508006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:48.520539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:48.590879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:48.591921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.606727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:48.607643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.965724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-451594880", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": "none"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:49.315060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:49.315513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:49.316006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:49.316690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:49.317150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:49.367250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.367728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.368651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.369146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.483427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Getting quotas for project 16bbdaa70a7e41e4955eec7a2cf41e46. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:49.522395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Getting quotas for user a977a8ef05fe4059abb544efe617deac and project 16bbdaa70a7e41e4955eec7a2cf41e46. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:49.596557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:49.609246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:49.783403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9f91fd8-e8ef-4726-88f4-df5466a224fc tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.720520 Jul 18 02:43:49.787535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2537/5154] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:43:49.828970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:49.830666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:49.896735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:49.905760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.907947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.911836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:49.920027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:49.962084 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ef29837-ffcc-453c-b53f-3194582aa4ee tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 1.505876 Jul 18 02:43:49.980978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2618/5155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:48 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:50.008996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:50.015135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:50.062159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:50.066821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:50.078998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:50.080054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.023784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.077379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-539f4673-ba55-4675-9453-9a6f48b927ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 1.275915 Jul 18 02:43:51.096970 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2538/5156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:49 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:51.125333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:51.129210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:51.181393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.183848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.196348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.201908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.418846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.446369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.461346 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7fab3582-6146-47ff-9009-27f9d33b4a34 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 1.491577 Jul 18 02:43:51.462198 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2619/5157] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:49 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:51.471840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0773faf2-94bc-4406-8b1b-66d2d0f641e6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1285 microversion: 2.1 time: 0.380794 Jul 18 02:43:51.496470 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2539/5158] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:51 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1285 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:51.501756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:51.502416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:51.508659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:51.510466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:51.522640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.527738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.529822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.534442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.539109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.540436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.544422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.552524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.759262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.812190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.862820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.871587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca0b8924-c4cb-4dce-b316-a772361fc15e tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1281 microversion: 2.54 time: 0.404676 Jul 18 02:43:51.877880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2620/5159] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:51 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1281 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:52.124145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.127710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.163477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.165094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.171127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.171947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.406247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.419661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc3672fa-6f23-442a-a42f-45e8629177c8 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.919439 Jul 18 02:43:52.432385 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2540/5160] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:51 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:52.491106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.492493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.506637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.507283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.508154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.508614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.571240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.592748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19ad6fe7-cc6b-4a7b-909c-f86de4e554c2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.476791 Jul 18 02:43:52.595047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2621/5161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:52.608317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.608971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.635950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.636396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.637521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.638384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.839292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.864201 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42e96df4-1d29-48dd-825e-6d59df8c4dbb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1285 microversion: 2.1 time: 0.261136 Jul 18 02:43:52.867078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2622/5162] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:52.903682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.927162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.928365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.938860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-feb84314-4e99-4308-9ac1-cfb181af39c2 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.435886 Jul 18 02:43:52.959067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.959692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.960987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.961394 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2541/5163] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:52.966168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.204022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.213331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.221213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.226516 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8530ed2-db43-4548-a281-eef0ebe6db40 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1281 microversion: 2.54 time: 0.331699 Jul 18 02:43:53.238979 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2623/5164] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:53.443259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:53.447829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:53.508030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.513180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.515518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.519169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.617728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:53.625957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:53.671492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.672451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.673990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.674840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.395058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:54.409707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d6ecca0-dd2f-4890-8bd8-e77a6755b13b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.800346 Jul 18 02:43:54.412315 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2624/5165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:53 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:54.433929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-89c77de0-882a-46ee-92f9-0aca25c9691f req-a7034ad5-3b45-4dd5-96d3-4cd5231b6e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac41d0c-707e-4e51-9b29-cff059d7660f", "name": "network-vif-plugged", "status": "completed", "tag": "0fbd0546-e5ef-4a5e-a24a-a869307a3d98"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:54.453906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-89c77de0-882a-46ee-92f9-0aca25c9691f req-a7034ad5-3b45-4dd5-96d3-4cd5231b6e6a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.455239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-89c77de0-882a-46ee-92f9-0aca25c9691f req-a7034ad5-3b45-4dd5-96d3-4cd5231b6e6a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.489894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-89c77de0-882a-46ee-92f9-0aca25c9691f req-a7034ad5-3b45-4dd5-96d3-4cd5231b6e6a service nova] Creating event network-vif-plugged:0fbd0546-e5ef-4a5e-a24a-a869307a3d98 for instance bac41d0c-707e-4e51-9b29-cff059d7660f on n-h2-849796-1 Jul 18 02:43:54.503248 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-89c77de0-882a-46ee-92f9-0aca25c9691f req-a7034ad5-3b45-4dd5-96d3-4cd5231b6e6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082901 Jul 18 02:43:54.505836 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2625/5166] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:54.523651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:54.525186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:54.535915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.536962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.539830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.541375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.920526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:54.943616 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5f1428a5-a39d-4589-9a99-6612a3b0c558 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 1.509635 Jul 18 02:43:54.956610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2542/5167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:53 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:54.963022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:54.963992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:54.974609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.975747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.976949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.977600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.011166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.022243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2401344e-2a94-427f-9552-54b522236253 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.512175 Jul 18 02:43:55.029959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2626/5168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:54 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:55.035288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:55.035923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:55.062527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.062985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.063800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.064251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.092151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:55.249568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.280768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.290449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.292661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a3bd02a-8ddf-4f65-8101-5bb58ff1c7f2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1347 microversion: 2.54 time: 0.261036 Jul 18 02:43:55.302816 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2627/5169] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:55 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1347 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:55.439873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:55.440541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:55.456987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.457829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.458949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.459635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.884539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.932430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a02029c6-dee6-4d8b-bc10-33bbd8a732b3 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1314 microversion: 2.1 time: 0.971309 Jul 18 02:43:55.958811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2543/5170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:54 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:55.969976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:55.972908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:55.986775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.987987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.989727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.990773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.010284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.034240 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4be9f7f2-837f-437c-829c-5abbd28cbb4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1511 microversion: 2.1 time: 0.601304 Jul 18 02:43:56.046216 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2628/5171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:55 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1511 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:56.056434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:56.070933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:56.083116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.086106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.088390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.089478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.564861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.586545 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbdd8bea-1696-4d7c-9b75-95de7126137d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.536156 Jul 18 02:43:56.590909 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2629/5172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:56 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:56.634084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:56.635333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:56.652520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.653966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.657063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.658541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.796185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.808325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.816990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.821029 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f4bf05f-2394-4810-a397-dc45ffa0fa05 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1335 microversion: 2.54 time: 0.227718 Jul 18 02:43:56.822880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2630/5173] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:56 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1335 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:56.859959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.885823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4989da3d-6f1c-4233-beaf-baa6900fdb42 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.923570 Jul 18 02:43:56.893299 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2544/5174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:55 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:56.971237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:56.974644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:56.987478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.990903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.992765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.993477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.066610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:57.073078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.088779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.096656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.098744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.101136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.527077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.560519 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e41100e-e5c1-456f-837b-91917e3ada84 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1499 microversion: 2.1 time: 0.593343 Jul 18 02:43:57.563760 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2631/5175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:56 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1499 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:57.613544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:57.615128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.630818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.634527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.637728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.639738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.692580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.711721 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2043f6f6-f49d-4dd5-a706-f5d4e2ed5ab4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1488 microversion: 2.1 time: 0.651673 Jul 18 02:43:57.739359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2545/5176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:57 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1488 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:57.749818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:57.750951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.770647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:57.798333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.798809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.799645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.800113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.935946 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-63f0a3f0-40cf-4413-81c5-acab05e8e4bb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 200 len: 158 microversion: 2.1 time: 0.193696 Jul 18 02:43:57.936740 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2546/5177] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:43:57 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 158 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:57.952599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:57.964418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.019641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.020826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.026005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.027532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.275119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.284986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0d6702d-bf80-483a-b009-18db59cedd39 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.676275 Jul 18 02:43:58.297333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2632/5178] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:57 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:58.303027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:58.303770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.313136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.313681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.314538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.315000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.407716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:58.684005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.693763 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a0becf6-3318-4772-a8e6-1577d4fe3f7b tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.395086 Jul 18 02:43:58.694440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2633/5179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:58.717840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:58.718471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.730449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.731045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.732618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.732618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.851070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.872992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.874691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.876153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e911da97-0d54-470b-b293-45e23a842d6a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1335 microversion: 2.54 time: 0.928395 Jul 18 02:43:58.876749 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2547/5180] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:43:57 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1335 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:43:58.912641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e6c68b56-c321-4d68-9517-0338b4944019 req-ddc10239-a2f9-4c27-a8fe-0c76b0cf8b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1b9a5b-b605-4a9a-a0d4-3617d3415078", "name": "network-vif-plugged", "status": "completed", "tag": "7129f49b-a987-45a0-8269-07d736007030"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:58.989424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e6c68b56-c321-4d68-9517-0338b4944019 req-ddc10239-a2f9-4c27-a8fe-0c76b0cf8b75 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.990000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e6c68b56-c321-4d68-9517-0338b4944019 req-ddc10239-a2f9-4c27-a8fe-0c76b0cf8b75 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.043523 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e6c68b56-c321-4d68-9517-0338b4944019 req-ddc10239-a2f9-4c27-a8fe-0c76b0cf8b75 service nova] Creating event network-vif-plugged:7129f49b-a987-45a0-8269-07d736007030 for instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 on n-h2-849796-1 Jul 18 02:43:59.062768 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e6c68b56-c321-4d68-9517-0338b4944019 req-ddc10239-a2f9-4c27-a8fe-0c76b0cf8b75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161288 Jul 18 02:43:59.063564 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2548/5181] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:59.092261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fec53d4d-f5e3-406d-a2bd-ab698a8ab4e0 req-20b17c35-95f6-4be4-8b84-896b9a623c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2da9b9-918b-488d-9701-190817ac8a3b", "tag": "7577249d-6b2d-4df7-926d-f6179f775ba2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:59.121143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fec53d4d-f5e3-406d-a2bd-ab698a8ab4e0 req-20b17c35-95f6-4be4-8b84-896b9a623c1f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.121603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fec53d4d-f5e3-406d-a2bd-ab698a8ab4e0 req-20b17c35-95f6-4be4-8b84-896b9a623c1f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.166832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fec53d4d-f5e3-406d-a2bd-ab698a8ab4e0 req-20b17c35-95f6-4be4-8b84-896b9a623c1f service nova] Creating event network-changed:7577249d-6b2d-4df7-926d-f6179f775ba2 for instance ac2da9b9-918b-488d-9701-190817ac8a3b on n-h1-849796-1 Jul 18 02:43:59.172657 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fec53d4d-f5e3-406d-a2bd-ab698a8ab4e0 req-20b17c35-95f6-4be4-8b84-896b9a623c1f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084741 Jul 18 02:43:59.174243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2549/5182] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:59.307525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:59.308414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:59.354182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.356426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.365168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.365980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.430899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:59.565197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:59.586129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:59.616551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d192113-aefa-4c35-86b5-0301d59ffa51 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.916521 Jul 18 02:43:59.620239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2634/5183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:59.664099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:59.665709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:59.706866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.709092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.710881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.711836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.177442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.204521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-040bdbaf-c232-4e6c-98ef-cd28e192744f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.903414 Jul 18 02:44:00.211960 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2550/5184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:59 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:00.236507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:00.240492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:00.277648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.280084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.286001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.287932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.359219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.373164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ad67b05-112c-44bc-b392-bed6a551f8c4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.721345 Jul 18 02:44:00.380406 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2635/5185] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:00.386922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:00.387553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:00.416800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.417302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.422672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.425584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.047381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.057944 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-290592d4-01dc-4575-855f-4131f671490d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1316 microversion: 2.1 time: 0.843181 Jul 18 02:44:01.058582 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2551/5186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:00 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:01.098501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.103113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.129192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.140915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.148354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.155613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.157570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.161883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.170487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.180145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70e67ef7-6fbf-4f6f-a24b-c3dcc22db2e0 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1335 microversion: 2.54 time: 0.795145 Jul 18 02:44:01.196075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2636/5187] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:00 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1335 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:01.236805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.242083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.294959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.295631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.296958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.297614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.530313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.540978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5f3bcdcc-b279-4307-bb9e-272a754d4216 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.477988 Jul 18 02:44:01.542865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2552/5188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:01.570574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.571213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.581516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.581980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.582805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.585479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.612071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:01.728958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.749699 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cc193b69-6993-4a79-9fc6-862b7081c294 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.528665 Jul 18 02:44:01.752150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2637/5189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:02.030238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.056312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5a04232-b046-4278-9f9b-06a3e05cc137 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.489879 Jul 18 02:44:02.072965 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2553/5190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:02.089897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:02.092671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:02.110087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.111867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.114808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.115342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.214287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:02.214908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:02.225689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.226151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.227007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.227488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.421918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.437489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.444340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.446212 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f41c7142-27ff-4225-b35c-1f608ad58035 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1356 microversion: 2.54 time: 0.236628 Jul 18 02:44:02.448628 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2554/5191] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:02 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:02.472331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1160470983", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "72e9a08a-ca51-499a-9658-0d4e3b258016"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:02.600853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] validate_networks() for [('72e9a08a-ca51-499a-9658-0d4e3b258016', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:44:02.833037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.849496 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e35dff6-a77d-4ef2-9cbf-3dd1418018b0 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1504 microversion: 2.1 time: 0.761766 Jul 18 02:44:02.865819 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2638/5192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:02 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1504 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:02.887992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3a6c2c9-172b-4a53-9fad-9c8aa4c748c3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Action: 'create', calling method: .version_select at 0x7fab0462b5e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-20436978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQdxu35ufK7M73NFg4HKhlmE0ZDJ05jHGrjMqb3rrcIRX9k+O2v7lJPJMmm0PAJ3DJmSQ1MAIGefVZg3P4Xijw6ijA1m9AAUgFkRzfHxtXXxKU+We9OL23d95CCBcIiSQ=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:02.935574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-b3a6c2c9-172b-4a53-9fad-9c8aa4c748c3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Getting quotas for project 16bbdaa70a7e41e4955eec7a2cf41e46. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:02.957894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-b3a6c2c9-172b-4a53-9fad-9c8aa4c748c3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Getting quotas for user a977a8ef05fe4059abb544efe617deac and project 16bbdaa70a7e41e4955eec7a2cf41e46. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:03.040429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3a6c2c9-172b-4a53-9fad-9c8aa4c748c3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.168364 Jul 18 02:44:03.043619 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2639/5193] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:44:02 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:44:03.064223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.065112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.084049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.084533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.090245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.090750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.595394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:03.611235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43b1e175-44d5-48e4-92f9-41059565d52e tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.565297 Jul 18 02:44:03.626767 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2640/5194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:03.638269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.639484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.656558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.658568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.659509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.661804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.855313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:03.865443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:03.868467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:03.869431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:03.871008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:03.901338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd1c77a5-a43e-47a4-9956-49943c1a5a73 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.284284 Jul 18 02:44:03.907061 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2641/5195] 10.222.0.67 () {58 vars in 1295 bytes} [Mon Jul 18 02:44:03 2022] DELETE /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078/os-server-password => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:03.924417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-20436978", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:03.930476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.968221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.969059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.970335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.971221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.978720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.983654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.986109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.989922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.108159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:04.128651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:04.129858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:04.130570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:04.131445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:04.132094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:04.132717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:04.170571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:44:04.183516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:44:04.217931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:04.352776 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6975f505-6a68-43f4-99c4-ff6183c6fdc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900120 Jul 18 02:44:04.357473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.364892 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2555/5196] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:44:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:44:04.385219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.387535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.389556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.391225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.488809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df436de5-b89c-4a83-843a-1abe6d40bca5 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "POST /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b/action" status: 202 len: 1137 microversion: 2.54 time: 0.577694 Jul 18 02:44:04.490032 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2642/5197] 10.222.0.67 () {62 vars in 1319 bytes} [Mon Jul 18 02:44:03 2022] POST /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b/action => generated 1137 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 18 02:44:04.527060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.530773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.545681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.546158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.546989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.547452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.607528 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b65f79c-d7e7-49db-a40b-c4f2b7af330f tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.113317 Jul 18 02:44:04.608260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2643/5198] 10.222.0.67 () {58 vars in 1292 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078/os-server-password => generated 16 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:04.622638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.623158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.635166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.635631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.636477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.637577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.672420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:44:04.859695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce324c1c-15e6-4990-a5f7-2fa27c06396c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 204 len: 0 microversion: 2.1 time: 0.243296 Jul 18 02:44:04.861259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2644/5199] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:44:04 2022] DELETE /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:04.874981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba882435-8820-449e-ad7e-ca3df7102fa7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.878426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba882435-8820-449e-ad7e-ca3df7102fa7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.963674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba882435-8820-449e-ad7e-ca3df7102fa7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.975442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba882435-8820-449e-ad7e-ca3df7102fa7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1215 microversion: 2.1 time: 0.112415 Jul 18 02:44:04.976332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2645/5200] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:04.991983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.994924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.013082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Calling method '.version_select at 0x7fab045a9d30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.014263 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:44:05.014263 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:44:05.015853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.016450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.027202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.027820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.028726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.031835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.050882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.053558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.078572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.082688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.102356 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0eab84c-ef50-440f-a751-f53c21d882b8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524 tempest-PortsAdminExtendedAttrsIpV6TestJSON-422662524-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.731181 Jul 18 02:44:05.103368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2556/5201] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:05.125294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.125965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.134841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.135858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.136989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.137696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.180128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:44:05.197630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:05.215235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:05.237052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:05.245606 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a071d86-850f-4b7a-af29-fe52608a5227 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.257983 Jul 18 02:44:05.248325 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2646/5202] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:05.282401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.283077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.301650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.302383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.304205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.320340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.419907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48bf5e08-2284-4f0f-b20c-655f02b951ef tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 204 len: 0 microversion: 2.1 time: 0.314855 Jul 18 02:44:05.420972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2557/5203] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:44:05 2022] DELETE /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:05.442991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.445006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.488757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.492535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.501083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.502270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.100040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.118667 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d897cba-c740-412e-8737-429abd114346 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.863631 Jul 18 02:44:06.120518 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2647/5204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:05 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.145399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:06.150114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:06.150435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.167703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.171143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.172292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.173606 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99ff5002-acdc-44de-aa37-e53b5077a157 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1505 microversion: 2.1 time: 0.750804 Jul 18 02:44:06.176881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.181260 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2558/5205] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:05 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.201716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:06.203251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:06.234102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.234923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.236384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.239796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.439523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.462720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a9c6711f-d238-4b6b-8e73-b6f8a6aae43e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1267 microversion: 2.1 time: 0.279653 Jul 18 02:44:06.470027 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2559/5206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:06 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.491200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:06.494328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:06.529295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.530614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.534888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.539210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.610826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.626808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-91ae62df-e8d6-4e8d-9b53-336baeafde2c tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1510 microversion: 2.1 time: 0.500101 Jul 18 02:44:06.628161 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2648/5207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:06 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.740036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.757812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.762124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.764493 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49745000-7598-4486-a41e-29613895c7eb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.291663 Jul 18 02:44:06.765485 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2560/5208] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:06 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:07.143704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.149238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.184479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.185763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.187427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.188406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.220190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.223802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.260085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.264682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.267699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.273159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.621221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:07.633906 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7e21bbe-67f5-4093-abef-04c203361120 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.498163 Jul 18 02:44:07.635945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2649/5209] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:07.657913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.659246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.671583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.672039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.672851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.673341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.829850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:07.887361 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fd954b3-ab67-4191-9066-4edac155204b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1273 microversion: 2.1 time: 0.249400 Jul 18 02:44:07.890904 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2650/5210] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:07.903393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.906207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.926199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.929525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.931545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.932994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.112476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.125858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49a3a479-e824-41b7-ab9c-a094defaa206 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1505 microversion: 2.1 time: 0.916397 Jul 18 02:44:08.133678 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2561/5211] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:08.139147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:08.140155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:08.161062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.161875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.163492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.165744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.326809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.337236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.351218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.352513 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1da730bb-d826-43d8-92f2-172f544263df tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.217504 Jul 18 02:44:08.353359 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2562/5212] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:08 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:08.661450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:08.662431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:08.672587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.672587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.672969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.673255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.143747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.223799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.237554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4db49f57-bbab-48ae-9470-e210163f4d59 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.580741 Jul 18 02:44:09.238525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2563/5213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:08 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:09.245715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.246082 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d91e1cd0-1921-4b92-99e5-efbbdc637b04 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1510 microversion: 2.1 time: 1.347912 Jul 18 02:44:09.246957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.250033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2651/5214] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1510 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:09.283794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.285435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.290436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.291946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.294091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.295312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.306323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.306812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.307929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.308563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.511462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.520153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82489033-7168-4be9-b9f3-e306c00ec8ae tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1273 microversion: 2.1 time: 0.280174 Jul 18 02:44:09.527125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2564/5215] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:09.532359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.545978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.553045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.554525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.555698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.556408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.702677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.730011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.734172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.736398 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3812cf1b-617c-43d3-a5ed-16d71225a867 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.207749 Jul 18 02:44:09.738111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2565/5216] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:09.746380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-058a59ac-5bce-4402-ae5b-088c784e3733 req-c746dbe6-cf8a-41f3-80fb-b073d8bb5812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2da9b9-918b-488d-9701-190817ac8a3b", "name": "network-vif-plugged", "status": "completed", "tag": "7577249d-6b2d-4df7-926d-f6179f775ba2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:09.760745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-058a59ac-5bce-4402-ae5b-088c784e3733 req-c746dbe6-cf8a-41f3-80fb-b073d8bb5812 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.762664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-058a59ac-5bce-4402-ae5b-088c784e3733 req-c746dbe6-cf8a-41f3-80fb-b073d8bb5812 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.780224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-058a59ac-5bce-4402-ae5b-088c784e3733 req-c746dbe6-cf8a-41f3-80fb-b073d8bb5812 service nova] Creating event network-vif-plugged:7577249d-6b2d-4df7-926d-f6179f775ba2 for instance ac2da9b9-918b-488d-9701-190817ac8a3b on n-h1-849796-1 Jul 18 02:44:09.789416 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-058a59ac-5bce-4402-ae5b-088c784e3733 req-c746dbe6-cf8a-41f3-80fb-b073d8bb5812 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048724 Jul 18 02:44:09.792312 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2566/5217] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:10.017964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:10.074960 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-499b04df-89e4-4c3b-9767-431335f72f25 tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1505 microversion: 2.1 time: 0.793516 Jul 18 02:44:10.091596 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2652/5218] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1505 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:10.260308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:10.261100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:10.274337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:10.275423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:10.281575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.282048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.283002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.283649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.286336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:10.308511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.309914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.312888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.313734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.008503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.018726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2fd456f-19b4-4629-8b22-977997c9195d tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1510 microversion: 2.1 time: 0.752486 Jul 18 02:44:11.029984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.030850 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2653/5219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:10 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1510 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:11.036393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:11.037373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:11.050724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.051543 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-599166a6-b3ae-433c-ab44-35e7e94c37f6 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.796989 Jul 18 02:44:11.051736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.055438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.056222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.068193 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2567/5220] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:10 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:11.090113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:11.091097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:11.109706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.110525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.114194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.117458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.360970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.409974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.421822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.425936 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c232bd10-0e53-46eb-94cc-d116b6476693 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.355231 Jul 18 02:44:11.429847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2568/5221] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:11 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:11.449121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:11.450250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:11.493099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.493712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.495099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.495760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.632512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.637388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.639056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lazy-loading 'fault' on Instance uuid bac41d0c-707e-4e51-9b29-cff059d7660f {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:44:11.653516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:11.829889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819bad6023cd4e2482a9a31e09577fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791edbe40b364a80940e47501f41ef9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.843865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39be0fab-1aa6-489b-8809-febf48e02a3c tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 200 len: 1304 microversion: 2.1 time: 0.411884 Jul 18 02:44:11.844953 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2569/5222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:11 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 1304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:11.855106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-bc9cef94-e719-4207-aaba-fafa1eff3c34 req-0f2f31f9-ada7-43a4-9f1a-b2220cc26833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac41d0c-707e-4e51-9b29-cff059d7660f", "name": "network-vif-deleted", "tag": "0fbd0546-e5ef-4a5e-a24a-a869307a3d98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:11.878769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bc9cef94-e719-4207-aaba-fafa1eff3c34 req-0f2f31f9-ada7-43a4-9f1a-b2220cc26833 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.882203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bc9cef94-e719-4207-aaba-fafa1eff3c34 req-0f2f31f9-ada7-43a4-9f1a-b2220cc26833 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.927083 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-bc9cef94-e719-4207-aaba-fafa1eff3c34 req-0f2f31f9-ada7-43a4-9f1a-b2220cc26833 service nova] Creating event network-vif-deleted:0fbd0546-e5ef-4a5e-a24a-a869307a3d98 for instance bac41d0c-707e-4e51-9b29-cff059d7660f on n-h2-849796-1 Jul 18 02:44:11.942036 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-bc9cef94-e719-4207-aaba-fafa1eff3c34 req-0f2f31f9-ada7-43a4-9f1a-b2220cc26833 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094327 Jul 18 02:44:11.946879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2570/5223] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:12.041774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.043485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.070413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.071269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.073255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.074031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.270577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.306166 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f71d445d-4afe-4807-b5ee-7a4bf6e82a4a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 1.272103 Jul 18 02:44:12.317110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2654/5224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:11 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:12.337252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.346228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.361546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.362745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.364836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.366110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.397197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86740176efd34786b7c388b44d2f6130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4230c72534c2da244775f79815633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.433752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f06840b-4df5-4210-9a0a-f9cd0c5ccff5 tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 200 len: 1468 microversion: 2.1 time: 0.395790 Jul 18 02:44:12.436835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2571/5225] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 1468 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:12.488677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.491134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.531010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.532515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.535132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.536491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.827459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.841697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.843219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.850293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-834a404e-ef06-4df0-8226-7df28fb162da tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.395207 Jul 18 02:44:12.856252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2572/5226] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:12.873893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.875107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] [instance: bac41d0c-707e-4e51-9b29-cff059d7660f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.890405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.891197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.892219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.892951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.938167 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] HTTP exception thrown: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Request method failure captured: Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f HTTP/1.1 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mi8ErzSZqno0kbHv_LlbxbpOVQ1WjUJpzLujiW0coj6_IB3PRsvy2nEWDa5SxL-E8DPSsB3zaQGphXaYvPMxlqeRQog9vOQkq4LXhldiYoHYStjBezW_P9oN3UR__LlDXKXudSkyKk9dveAM_rSMm6wSozmlV0sLKigWjuY1cN0lDk Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 791edbe40b364a80940e47501f41ef9e Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesActionsTest-1025697930 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/791edbe40b364a80940e47501f41ef9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_791edbe40b364a80940e47501f41ef9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/791edbe40b364a80940e47501f41ef9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/791edbe40b364a80940e47501f41ef9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesActionsTest-1025697930 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 791edbe40b364a80940e47501f41ef9e Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesActionsTest-1025697930 Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesActionsTest-1025697930-project Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 819bad6023cd4e2482a9a31e09577fee Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesActionsTest-1025697930-project Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'bac41d0c-707e-4e51-9b29-cff059d7660f'} Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:12.946229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:12.951766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] Returning 404 to user: Instance bac41d0c-707e-4e51-9b29-cff059d7660f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:12.956283 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ffcc337-d2c0-4e2b-9d39-8c3828fbe65f tempest-VolumesActionsTest-1025697930 tempest-VolumesActionsTest-1025697930-project] 10.222.0.67 "GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f" status: 404 len: 111 microversion: 2.1 time: 0.084869 Jul 18 02:44:12.958143 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2573/5227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/bac41d0c-707e-4e51-9b29-cff059d7660f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:44:13.089107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:13.124785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e73fd46-2292-4e19-9827-189e0ccc0a15 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1327 microversion: 2.1 time: 0.788184 Jul 18 02:44:13.135778 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2655/5228] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1327 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:13.340290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.340897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.354074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.354810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.362295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.363150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.461353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.461353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] [instance: 1e1b9a5b-b605-4a9a-a0d4-3617d3415078] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.470606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.471505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.472644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.474710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.521417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] HTTP exception thrown: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Request method failure captured: Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 HTTP/1.1 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MjFsKCjYvXYyF44X0BQonTLBZIWAdRTDKsmgTbR4WMBMnqDJmxuWCNOw9ECRRAfvxAnPcjukoU_oNq6-ceff7czDNp9mIPRtFuB_BHt5mWWa-G4lhONKg3Zr_BjtRKlTb2ljcENEXtcly4TeWCKTaDfXgmAU5Joog57qr_0tCE3pdc Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 5ee4230c72534c2da244775f79815633 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerPasswordTestJSON-304645742 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5ee4230c72534c2da244775f79815633"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5ee4230c72534c2da244775f79815633"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5ee4230c72534c2da244775f79815633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5ee4230c72534c2da244775f79815633"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerPasswordTestJSON-304645742 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 5ee4230c72534c2da244775f79815633 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerPasswordTestJSON-304645742 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerPasswordTestJSON-304645742-project Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 86740176efd34786b7c388b44d2f6130 Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerPasswordTestJSON-304645742-project Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1e1b9a5b-b605-4a9a-a0d4-3617d3415078'} Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:13.524028 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] Returning 404 to user: Instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50e10edc-55c4-493d-9031-04184499608a tempest-ServerPasswordTestJSON-304645742 tempest-ServerPasswordTestJSON-304645742-project] 10.222.0.67 "GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078" status: 404 len: 111 microversion: 2.1 time: 0.070629 Jul 18 02:44:13.533786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2656/5229] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/1e1b9a5b-b605-4a9a-a0d4-3617d3415078 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:44:13.893560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.899886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.924279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.925133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.926592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.933133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.027728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:14.151040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.166895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:14.194016 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-03542e1c-4a43-457e-9e4c-9fda65e678a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 0.856354 Jul 18 02:44:14.197864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2574/5230] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:14.220623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-24cf5f1a-ceda-41ca-bea8-0c69a7d35c21 req-492cb098-58b7-4f2b-a175-bb0b94736320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1b9a5b-b605-4a9a-a0d4-3617d3415078", "name": "network-vif-deleted", "tag": "7129f49b-a987-45a0-8269-07d736007030"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:14.251982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-24cf5f1a-ceda-41ca-bea8-0c69a7d35c21 req-492cb098-58b7-4f2b-a175-bb0b94736320 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.253127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-24cf5f1a-ceda-41ca-bea8-0c69a7d35c21 req-492cb098-58b7-4f2b-a175-bb0b94736320 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.275426 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-24cf5f1a-ceda-41ca-bea8-0c69a7d35c21 req-492cb098-58b7-4f2b-a175-bb0b94736320 service nova] Creating event network-vif-deleted:7129f49b-a987-45a0-8269-07d736007030 for instance 1e1b9a5b-b605-4a9a-a0d4-3617d3415078 on n-h2-849796-1 Jul 18 02:44:14.290198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-24cf5f1a-ceda-41ca-bea8-0c69a7d35c21 req-492cb098-58b7-4f2b-a175-bb0b94736320 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090558 Jul 18 02:44:14.291114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2575/5231] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:14.304462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:14.306523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:14.325685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.326604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.327493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.327959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.827469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.879077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.885449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.889546 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b451f3b-abac-4004-8055-4acd87baf630 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 1.004246 Jul 18 02:44:14.890530 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2657/5232] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:15.225995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:15.227176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:15.236630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:15.280032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.283185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.289236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.291026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.352698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:15.742433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.781393 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef2bca56-bf0a-4b29-8500-0a02ea61a67f tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1526 microversion: 2.1 time: 1.486732 Jul 18 02:44:15.796557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2576/5233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:14 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1526 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:15.806871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-be09bd11-f876-4575-81aa-e824d7b2dd03 req-fb5f8a0b-1da4-493f-8a3e-572bfc61c6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2295331d-8f6b-4db3-a0d1-3db51186177a", "tag": "d2e79995-dfed-4b3d-8499-8e5fdf43bafc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:15.819183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-be09bd11-f876-4575-81aa-e824d7b2dd03 req-fb5f8a0b-1da4-493f-8a3e-572bfc61c6c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.819573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-be09bd11-f876-4575-81aa-e824d7b2dd03 req-fb5f8a0b-1da4-493f-8a3e-572bfc61c6c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.836388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-be09bd11-f876-4575-81aa-e824d7b2dd03 req-fb5f8a0b-1da4-493f-8a3e-572bfc61c6c0 service nova] Creating event network-changed:d2e79995-dfed-4b3d-8499-8e5fdf43bafc for instance 2295331d-8f6b-4db3-a0d1-3db51186177a on n-h1-849796-1 Jul 18 02:44:15.842100 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-be09bd11-f876-4575-81aa-e824d7b2dd03 req-fb5f8a0b-1da4-493f-8a3e-572bfc61c6c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043242 Jul 18 02:44:15.843213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2577/5234] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:15.849583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:15.850630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:15.883000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.911275 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-538d6e5f-f583-4400-bc87-6a766153c7e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 0.693127 Jul 18 02:44:15.929094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.929482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2658/5235] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:15 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:15.932433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.935408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.938710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.952893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:15.955985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:15.974081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.976621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.985370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.985886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:16.155540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:16.192273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:16.203837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:16.211398 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9882c136-5c73-4eec-8eeb-1c4de4784040 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.280275 Jul 18 02:44:16.214668 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2659/5236] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:15 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:16.598515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:16.630482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54d6b5e0-5739-48f7-8e50-17d9ccdb7fcb tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1526 microversion: 2.1 time: 0.785078 Jul 18 02:44:16.632898 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2578/5237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:15 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1526 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:16.941049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:16.944084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:16.984757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.986776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:16.990100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.995192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.442369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:17.443245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:17.465728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:17.470092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.471242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:17.475961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.550601 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] HTTP exception thrown: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Request method failure captured: Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b HTTP/1.1 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mjeo4MdWjpTxArQuzIRhcqUB4MelG0NjQKt4n0FQt_MQxdAkfzfmu8RstGK1I7j-tWYKqnXSdpSh7sFkQLmUwu5tD9bFNDI1rWwRKTafkfsM7b8_sT4s_JE42XBseXqYuuwFt6FHLDjDSwUicESkszScwvHIY5KAc7WSFTghP59M8c Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: c9a1cf2eb5344be0ba3969c9f221f466 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: c9a1cf2eb5344be0ba3969c9f221f466 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1040188812-project Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: ccd44fa97a5a4e959036e1caaf3e8158 Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812-project Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ac2da9b9-918b-488d-9701-190817ac8a3b'} Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:17.564703 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:17.575108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Returning 404 to user: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:17.584413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2669237d-6022-4490-b33d-c7cdb750d801 tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 404 len: 111 microversion: 2.1 time: 0.925333 Jul 18 02:44:17.588891 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2660/5238] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:44:16 2022] DELETE /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 111 bytes in 945 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:44:17.612046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:17.616797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:17.647807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:17.655864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.658288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:17.662066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.047409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.082681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.092504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.097740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8dfe3265-edd6-4559-bc03-a8aa12e2a502 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.503945 Jul 18 02:44:18.099839 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2661/5239] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:17 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:18.119427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:18.123920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:18.148847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.150102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.152062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.153291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.275032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.292734 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8588d70-b2b4-48f1-b2b1-6fb5b8bfec6e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 1.366543 Jul 18 02:44:18.293581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2579/5240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:16 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:18.808066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.832101 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ddf75cb2-f618-44be-95bc-292e906cee2d tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1526 microversion: 2.1 time: 0.730467 Jul 18 02:44:18.850828 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2662/5241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:18 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1526 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:18.871911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Action: 'update', calling method: >, body: {"server": {"name": "ac2da9b9-918b-488d-9701-190817ac8a3b_new"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:18.873819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:18.891959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.893204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.894337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.895002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.931423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] HTTP exception thrown: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Request method failure captured: Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: request: PUT /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b HTTP/1.1 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 64 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mjeo4MdWjpTxArQuzIRhcqUB4MelG0NjQKt4n0FQt_MQxdAkfzfmu8RstGK1I7j-tWYKqnXSdpSh7sFkQLmUwu5tD9bFNDI1rWwRKTafkfsM7b8_sT4s_JE42XBseXqYuuwFt6FHLDjDSwUicESkszScwvHIY5KAc7WSFTghP59M8c Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: c9a1cf2eb5344be0ba3969c9f221f466 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c9a1cf2eb5344be0ba3969c9f221f466"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: c9a1cf2eb5344be0ba3969c9f221f466 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1040188812-project Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: ccd44fa97a5a4e959036e1caaf3e8158 Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1040188812-project Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: {"server": {"name": "ac2da9b9-918b-488d-9701-190817ac8a3b_new"}} Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ac2da9b9-918b-488d-9701-190817ac8a3b', 'body': {'server': {'name': 'ac2da9b9-918b-488d-9701-190817ac8a3b_new'}}} Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 18 02:44:18.936002 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:18.943177 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:44:18.946089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] Returning 404 to user: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:18.950920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef8c0c52-e005-4143-9e30-e88aab7f926f tempest-ServersNegativeTestMultiTenantJSON-1040188812 tempest-ServersNegativeTestMultiTenantJSON-1040188812-project] 10.222.0.67 "PUT /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 404 len: 111 microversion: 2.1 time: 0.082286 Jul 18 02:44:18.964487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:18.965353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:18.969440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2580/5242] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 02:44:18 2022] PUT /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:44:18.975746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.976591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.977734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.978784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.088073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:44:19.139097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:19.152400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:19.179537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.186251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.188007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.193298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.427220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8aa03419-2785-4000-bfd3-d5350acd6a36 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 204 len: 0 microversion: 2.1 time: 0.467123 Jul 18 02:44:19.429392 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2663/5243] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:44:18 2022] DELETE /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:44:19.444767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:19.446725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:19.464415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.465176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.469772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.470662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.597589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:19.614320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:19.619905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:19.623735 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7b70bba7-32a4-4df4-b82e-b463e8724232 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.493951 Jul 18 02:44:19.626169 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2581/5244] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:19 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:19.634223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:19.635671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:19.670235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.673978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.676426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.676898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:20.166808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:20.193019 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78f77a97-7af9-4b50-8a0b-2bf8e0e338b4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 0.756475 Jul 18 02:44:20.194711 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2664/5245] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:19 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:20.340461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:20.354444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a31bb44-2b3b-44e6-bb3d-5122e68f2a6b tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1532 microversion: 2.1 time: 0.726207 Jul 18 02:44:20.361506 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2582/5246] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:19 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1532 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:20.670332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:20.672667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:20.702782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:20.703645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:20.705347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:20.706205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.215668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:21.216370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:21.242965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.244816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.246617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.247076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.435784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:21.453217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:21.460584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:21.463141 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd5d82d0-9762-4e7e-9d91-cd16cc0ff23a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.802186 Jul 18 02:44:21.466005 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2665/5247] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:20 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:21.489667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:21.491825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:21.507452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.511476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:21.515389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:21.516134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:22.101759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:22.114030 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-938f3f8a-e18d-4d72-aef8-078e7b5cf7ad tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1532 microversion: 2.1 time: 0.646530 Jul 18 02:44:22.116713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2666/5248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:21 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1532 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:22.485929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:22.487314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:22.510419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:22.511384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:22.512449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:22.518479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.498325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:23.502613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:23.546217 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26b511b2-5d6a-423a-b951-dfa8df6cb968 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 2.337010 Jul 18 02:44:23.549973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:23.567358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:23.569904 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2583/5249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:21 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 2362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:23.572867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca1afc8a-7c3c-448d-95e9-e6bd384a2143 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 1.087574 Jul 18 02:44:23.575143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2667/5250] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:22 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:23.604135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:23.605138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:23.626760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:23.636046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.638239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:23.644392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:23.654376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:24.582082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:24.582777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:24.601636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:24.603371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:24.604722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:24.605531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:24.723589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:24.742219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-380a6723-be00-435b-95f5-010107a954e9 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1532 microversion: 2.1 time: 1.160984 Jul 18 02:44:24.754189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2584/5251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:23 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1532 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:24.759920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:24.760960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:24.769134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:24.769912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:24.771169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:24.772250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.329102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.340875 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e190049d-ee6f-41f9-b5e5-089d15ecbbbc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 0.765286 Jul 18 02:44:25.341947 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2668/5252] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:24 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:25.347200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1257979859", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:25.486696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:44:25.540739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.570200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.577938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:25.581262 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-76c93289-e9dd-4eca-96fe-21fa5fed0d4c tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.824048 Jul 18 02:44:25.598134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2585/5253] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:24 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:25.603249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5d4330c2-a89e-4ed4-be44-e0bd7df4919d req-f55fab10-d27b-468d-b0a6-abe77fb46735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2295331d-8f6b-4db3-a0d1-3db51186177a", "name": "network-vif-plugged", "status": "completed", "tag": "d2e79995-dfed-4b3d-8499-8e5fdf43bafc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:25.630560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d4330c2-a89e-4ed4-be44-e0bd7df4919d req-f55fab10-d27b-468d-b0a6-abe77fb46735 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.632752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d4330c2-a89e-4ed4-be44-e0bd7df4919d req-f55fab10-d27b-468d-b0a6-abe77fb46735 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.682527 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5d4330c2-a89e-4ed4-be44-e0bd7df4919d req-f55fab10-d27b-468d-b0a6-abe77fb46735 service nova] Creating event network-vif-plugged:d2e79995-dfed-4b3d-8499-8e5fdf43bafc for instance 2295331d-8f6b-4db3-a0d1-3db51186177a on n-h1-849796-1 Jul 18 02:44:25.708311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5d4330c2-a89e-4ed4-be44-e0bd7df4919d req-f55fab10-d27b-468d-b0a6-abe77fb46735 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116948 Jul 18 02:44:25.710381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2586/5254] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:25.765621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:25.766938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:25.800971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.801934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:25.804600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:25.805544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.009725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:26.023799 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f41439b4-06b5-432e-9c18-1fb682f2d0d0 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1490 microversion: 2.1 time: 0.266005 Jul 18 02:44:26.030039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2587/5255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:25 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1490 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:26.048468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cce358b3-25a0-4d3c-8ec6-c90b96deffab req-b19ab067-6299-48d1-ba99-eb437fc3477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2da9b9-918b-488d-9701-190817ac8a3b", "name": "network-vif-deleted", "tag": "7577249d-6b2d-4df7-926d-f6179f775ba2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:26.098693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cce358b3-25a0-4d3c-8ec6-c90b96deffab req-b19ab067-6299-48d1-ba99-eb437fc3477e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.101161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cce358b3-25a0-4d3c-8ec6-c90b96deffab req-b19ab067-6299-48d1-ba99-eb437fc3477e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.154411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cce358b3-25a0-4d3c-8ec6-c90b96deffab req-b19ab067-6299-48d1-ba99-eb437fc3477e service nova] Creating event network-vif-deleted:7577249d-6b2d-4df7-926d-f6179f775ba2 for instance ac2da9b9-918b-488d-9701-190817ac8a3b on n-h1-849796-1 Jul 18 02:44:26.166857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cce358b3-25a0-4d3c-8ec6-c90b96deffab req-b19ab067-6299-48d1-ba99-eb437fc3477e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132383 Jul 18 02:44:26.172210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2588/5256] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:26.370676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:26.374027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:26.392622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.394043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.397787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.402307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.751992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:26.752764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:26.754874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:26.761009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:26.761770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:26.797066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.797907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.800171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.801016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.839262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:26.848460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f40f68a5-dc2c-43ca-91fa-062ba18cdc13 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1315 microversion: 2.1 time: 0.490345 Jul 18 02:44:26.853088 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2589/5257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:26 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:26.858469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:26.867284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Getting quotas for project 58f18e80df5e42859f42a0f46925716d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:26.868503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:26.887195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.887985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.889099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:26.889773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:26.902746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Getting quotas for user 6eae632ebcdd4b9f9d19badf51fb362d and project 58f18e80df5e42859f42a0f46925716d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:26.939788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:44:26.949329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:44:26.988338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:26.998814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:27.006467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:27.008662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:27.009981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f1138e4-cd01-4232-babe-828655c95fbd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.155645 Jul 18 02:44:27.016349 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2590/5258] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:26 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:27.042676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:27.054277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:27.087712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.089783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.091043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.091773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.099899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-daead7f6-4a8c-4cfa-b191-650288b1f81a tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742097 Jul 18 02:44:27.109094 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2669/5259] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:44:27.125832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02b4fe51-3985-4a44-a8aa-0f1816f811cd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:27.129321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02b4fe51-3985-4a44-a8aa-0f1816f811cd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:27.200470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.200948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.202269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lazy-loading 'fault' on Instance uuid ac2da9b9-918b-488d-9701-190817ac8a3b {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:44:27.361661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-02b4fe51-3985-4a44-a8aa-0f1816f811cd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:27.394543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc6c1cec7f54913a89ebcd0d9f8cb1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225acab317f54de1b0ce9715586063ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:27.395354 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02b4fe51-3985-4a44-a8aa-0f1816f811cd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1214 microversion: 2.1 time: 0.280838 Jul 18 02:44:27.398921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2670/5260] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:27 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:27.420202 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f7cb88c-5ff8-4fd3-944e-b776cf74947a tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 200 len: 1317 microversion: 2.1 time: 0.381247 Jul 18 02:44:27.432415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2591/5261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:27 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:27.871739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:27.872451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:27.887037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.887570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:27.905918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:27.907025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.041128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:28.042569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:28.054015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.054776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.057136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.059346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.231588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:28.240548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:28.255292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:28.258908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cbc6fcc-9a24-40a2-ac51-58ac816441c7 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.221852 Jul 18 02:44:28.260153 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2592/5262] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:28 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:28.421234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:28.422574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:28.440895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.447040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.452167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.457275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.494264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:28.511138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6457035a-6aa7-4d84-bddc-0aecc2a67c23 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1501 microversion: 2.1 time: 0.644408 Jul 18 02:44:28.524006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2671/5263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:27 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1501 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:28.524006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:28.524006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] [instance: ac2da9b9-918b-488d-9701-190817ac8a3b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:28.544856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.545626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.547456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.548026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.574713 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] HTTP exception thrown: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Request method failure captured: Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b HTTP/1.1 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mi79QupBsK4nJycYpcVKvWrIYGFmPoiFlppt3g7XdxjPH2Q8QCtCs4C6Xp1DiKrFl5RZKdbKLxCBWQ4MlSgy7LFuzJvBC2DBQKDfIjV-yi2x6p5IeG0AhkiNbjkmpb4TZ4WxdDxAFY9Ov2UoYGaMju_IpWQiHv4twW66VcWSA6HIuI Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 225acab317f54de1b0ce9715586063ba Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2062459067 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/225acab317f54de1b0ce9715586063ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_225acab317f54de1b0ce9715586063ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/225acab317f54de1b0ce9715586063ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/225acab317f54de1b0ce9715586063ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2062459067 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 225acab317f54de1b0ce9715586063ba Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2062459067 Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2062459067-project Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 7cc6c1cec7f54913a89ebcd0d9f8cb1b Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2062459067-project Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ac2da9b9-918b-488d-9701-190817ac8a3b'} Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:28.576824 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] Returning 404 to user: Instance ac2da9b9-918b-488d-9701-190817ac8a3b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:28.581530 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dfc93809-aff2-45bc-9982-474e4aadad55 tempest-ServersNegativeTestMultiTenantJSON-2062459067 tempest-ServersNegativeTestMultiTenantJSON-2062459067-project] 10.222.0.67 "GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b" status: 404 len: 111 microversion: 2.1 time: 0.062827 Jul 18 02:44:28.583307 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2672/5264] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:28 2022] GET /compute/v2.1/servers/ac2da9b9-918b-488d-9701-190817ac8a3b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:44:28.595820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:28.605629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:28.618553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.624899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.626377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:28.627092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:28.676433 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a924b19-a002-48ff-a2c1-0236652eff1d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.090555 Jul 18 02:44:28.681497 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2673/5265] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:28 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:28.699727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:28.722955 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2238ea3d-b762-425f-b374-23f52ef6d6c8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1210 microversion: 2.1 time: 0.305902 Jul 18 02:44:28.732141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2593/5266] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:28 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1210 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:29.297276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:29.298425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:29.345914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.346683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.347586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.348047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.662047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:29.689973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:29.691645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:29.714261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:29.716831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.719706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:29.721802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.723463 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2fe3e83-f7b2-4273-9035-2c278b2c19bd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.432313 Jul 18 02:44:29.725666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.726913 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2674/5267] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:29 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:29.739179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.754542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:29.758358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:29.784052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.787645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.788559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:29.789081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:29.810013 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4ee75e5-70ae-4b15-891b-8fc9968c6378 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.124973 Jul 18 02:44:29.813797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2594/5268] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:29 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:30.051574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:30.082661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-648f7a5f-fe97-42b9-a8ff-6a08df83c1dd tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1272 microversion: 2.1 time: 0.334825 Jul 18 02:44:30.093845 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2675/5269] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:29 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:30.746818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:30.748163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:30.763588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.766840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.769109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.769911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.822999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:30.824151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:30.853748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.858451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.859643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:30.863446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:30.977860 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-08fd90b5-e072-45d8-b8e2-dae9b193bd7c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.159065 Jul 18 02:44:30.983554 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2676/5270] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:30 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:44:31.047768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:31.087408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:31.090863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:31.110880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:31.117528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:31.121404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c76f6b9c-ebbb-4975-9597-383f1c8f702a tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.375034 Jul 18 02:44:31.124742 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2595/5271] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:30 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:31.152915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:31.158828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:31.159806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:31.160545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:31.179682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:31.996110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:31.998205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:32.040679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:32.042118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:32.043882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:32.044913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:32.168470 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.176046 Jul 18 02:44:32.168744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.177450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4457085f-25c5-4aef-9253-f2954b878526 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1272 microversion: 2.1 time: 1.079518 Jul 18 02:44:32.183905 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2677/5273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:31 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1272 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:32.197677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2596/5273] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:31 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:32.201287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:32.205660 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-325d9cf0-8dbc-43e6-b8d1-2b340cb0e3a7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.009689 Jul 18 02:44:32.208513 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2597/5274] 10.222.0.67 () {56 vars in 885 bytes} [Mon Jul 18 02:44:32 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:44:32.230535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:32.234522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:32.259473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:32.260269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:32.261631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:32.262290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:32.496040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.510624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.512611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:32.523467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e591d26e-d6eb-4888-b026-df14db1af3e9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.320574 Jul 18 02:44:32.524452 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2678/5275] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:32 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:33.195989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:33.201487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:33.224538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:33.227231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:33.235185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.235950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.261738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.262744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.308210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.308837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.310278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.311055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.520265 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f7c82a4-cb6c-4c72-a5b6-55eb80c85da0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.331995 Jul 18 02:44:33.535336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2598/5276] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:33 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:33.558851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:33.561630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:33.590694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.594397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.597354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:33.604640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:33.789958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:33.831364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:33.838376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:33.840536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eea9ce10-1946-45c2-83de-f7e4aab722ef tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1406 microversion: 2.54 time: 0.291183 Jul 18 02:44:33.841722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2599/5277] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:33 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:34.369733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:34.398387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6cc80acb-59a6-4dd3-b1d0-3208f09330d6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 1.181450 Jul 18 02:44:34.400511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2679/5278] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:33 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:34.562071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:34.571054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:34.629258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:34.635472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:34.649962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:34.654560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:34.838414 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27d8f6fd-eecf-4565-8c37-55cab4ef4a0e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.302757 Jul 18 02:44:34.841280 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2600/5279] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:34 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:34.865507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:34.868875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:34.895216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:34.898602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:34.904625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:34.905837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.223836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:35.279416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:35.293304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:35.299988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37a884aa-a73f-4e4e-a2c1-051ab902aba3 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1412 microversion: 2.54 time: 0.441256 Jul 18 02:44:35.313000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2680/5280] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:34 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1412 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:35.425479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:35.426628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:35.462072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.466777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.472167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.474236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.815189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:35.829763 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af1d7f8b-72d3-4e20-95ec-bbd76259027f tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 0.408818 Jul 18 02:44:35.830733 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2601/5281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:35 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:35.856746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:35.866020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:35.887832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.898283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.899767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:35.900581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:35.985180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b975149b-6a9b-4b7a-9769-0d995f7f5e49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.136343 Jul 18 02:44:35.986331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2681/5282] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:35 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:36.338310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:36.340563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:36.392744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:36.395018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:36.396910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:36.399044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:36.639408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.671187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.681977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:36.691983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51a93da0-4389-473f-9f8f-efce86114ed2 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1412 microversion: 2.54 time: 0.372080 Jul 18 02:44:36.702013 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2602/5283] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:36 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1412 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:36.897967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:36.899425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:36.904157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:36.942640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:36.944523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:36.946020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:36.946746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.002685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:37.004281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:37.044510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.054352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.056192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.063797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.167758 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da4d8387-6366-47b4-bb26-909ac6c2e24e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.172476 Jul 18 02:44:37.168441 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2603/5284] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:36 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:44:37.370658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:37.739139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:37.740774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:37.759265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.760199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.761325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:37.761988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:37.992770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.014684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.016334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:38.020634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8b99c0c-69de-4fef-ada7-eed69189134b tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1412 microversion: 2.54 time: 0.286318 Jul 18 02:44:38.032905 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2604/5285] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:37 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1412 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:38.181364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:38.182426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:38.195992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:38.196467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:38.201661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:38.202260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:38.290702 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-653e7977-af47-4a53-9d77-5ef6d31f90ff tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.113755 Jul 18 02:44:38.293293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2605/5286] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:38 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:44:39.046692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:39.048053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:39.090040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.095973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.098100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.112786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.476940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:39.502518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:39.504211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:39.505549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4d4d97db-4b04-4bde-a20b-a6423d44f279 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1412 microversion: 2.54 time: 0.468853 Jul 18 02:44:39.535350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2606/5287] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:39 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1412 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:39.559470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:39.573259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:39.617203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.618154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.619842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.620668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.775878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:39.800280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a848436-9093-4bed-99e6-376040962f99 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 2.945997 Jul 18 02:44:39.806942 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2682/5288] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:36 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 2954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:39.828788 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c928102-0ddc-4731-863a-9446f059f9eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 14 microversion: 2.1 time: 0.291032 Jul 18 02:44:39.836346 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2607/5289] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:39 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 14 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:44:40.206000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9b26bb5b-c129-4047-86c9-893e0273af44 req-a0814e40-2248-4d9c-b30c-53e2e60ff32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad1087d-2b81-4540-9974-17b2e47bb271", "tag": "4ebcb51a-affe-4e00-a785-004913971e4f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:40.225030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9b26bb5b-c129-4047-86c9-893e0273af44 req-a0814e40-2248-4d9c-b30c-53e2e60ff32b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:40.231189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9b26bb5b-c129-4047-86c9-893e0273af44 req-a0814e40-2248-4d9c-b30c-53e2e60ff32b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.273625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9b26bb5b-c129-4047-86c9-893e0273af44 req-a0814e40-2248-4d9c-b30c-53e2e60ff32b service nova] Creating event network-changed:4ebcb51a-affe-4e00-a785-004913971e4f for instance cad1087d-2b81-4540-9974-17b2e47bb271 on n-h2-849796-1 Jul 18 02:44:40.290045 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9b26bb5b-c129-4047-86c9-893e0273af44 req-a0814e40-2248-4d9c-b30c-53e2e60ff32b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087745 Jul 18 02:44:40.294372 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2683/5290] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:40.542584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:40.544824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:40.597087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:40.616893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.619625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:40.620629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.839998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:40.841648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:40.852172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:40.861683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:40.867399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.868700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:40.869406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:41.258359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:41.273808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:41.291760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:41.296994 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb91a58f-f167-4cf5-b3f3-eb8b54b020fb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1397 microversion: 2.54 time: 0.769064 Jul 18 02:44:41.325995 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2608/5291] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:40 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1397 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:41.349024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:41.351568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:41.401119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.401911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:41.414070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.420302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:41.574370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71758436-f042-4a6c-a8aa-b6a036bd9006 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action" status: 200 len: 8207 microversion: 2.1 time: 0.245511 Jul 18 02:44:41.577253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2609/5292] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:41 2022] POST /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a/action => generated 8207 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:41.605943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2c5ff8c-f1bb-4293-bf10-df17acf56e15 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '.version_select at 0x7fab0454e160>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:41.699095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2c5ff8c-f1bb-4293-bf10-df17acf56e15 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-20436978" status: 204 len: 0 microversion: 2.54 time: 0.119125 Jul 18 02:44:41.700150 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2610/5293] 10.222.0.67 () {60 vars in 1312 bytes} [Mon Jul 18 02:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-20436978 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:44:41.714530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:41.728204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:41.777561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.783471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:41.785261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:41.786029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.015426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.034533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6833418d-f0a0-467c-a987-3fbc27f99282 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 1.196784 Jul 18 02:44:42.036411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2684/5294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:40 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:42.050917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:42.055155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:42.081540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:42.084591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.090308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:42.091404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.170974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:44:42.378343 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d410aba5-a630-4916-8f8a-ca22d1390487 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 204 len: 0 microversion: 2.54 time: 0.337817 Jul 18 02:44:42.379919 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2685/5295] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:44:42 2022] DELETE /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:44:42.395393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:42.406758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:42.429074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:42.432384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.437742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:42.442422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:42.891465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.922277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.927269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:42.934416 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4829f134-6017-49b1-a34c-24a3e4438a46 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1403 microversion: 2.54 time: 0.547072 Jul 18 02:44:42.937904 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2686/5296] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:42 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1403 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:43.072682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:43.077334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:43.113044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.114716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:43.119176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.121814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:43.373358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:43.388014 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f81bebfe-8254-4b66-9935-823b8c4e0ee7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 0.322436 Jul 18 02:44:43.389608 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2687/5297] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:43 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:43.880280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:43.892290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:43.897107 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d882ac2-4ab7-42ec-8db5-12093e84fb7d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 2.189352 Jul 18 02:44:43.898358 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2611/5298] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:41 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:43.931679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:43.933063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:43.944575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.945875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:43.948080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.949496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:43.971677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:43.973916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:43.986839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.988995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:43.992041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:43.993822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.197305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.209951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.215108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5e1a768-472f-4b8e-bfef-2b021c707c4b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.289253 Jul 18 02:44:44.216880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2688/5299] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:43 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:44.225425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.225425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.225425 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1619a910-76d8-4934-92b1-3f63c9239cf9 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1403 microversion: 2.54 time: 0.261718 Jul 18 02:44:44.226846 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2612/5300] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:43 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1403 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:44:44.244661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:44.246334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:44.262197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.263935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.265618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.266270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.419446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:44.420499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:44.442783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.449760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.451845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.453544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.566156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:44.584349 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bd35685-3f2f-4710-80ba-669926549e27 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.344855 Jul 18 02:44:44.586557 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2689/5301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:44 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:44.639628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:44.641472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:44.667238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.668510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:44.670406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:44.671583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.177830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:45.231910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad24a160-44bf-485d-b6ea-3d0371ad5516 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.619444 Jul 18 02:44:45.274033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2690/5302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:44 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:45.305982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:45.312640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:45.352419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.354825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.357559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.361206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.532579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:45.553878 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0db61fa-6969-451a-ae66-f82e84a28803 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 1.142726 Jul 18 02:44:45.566976 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2613/5303] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:44 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:45.577326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:45.590394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:45.608785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.609432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.622321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.622980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.647397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:45.698246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:45.715015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:45.721974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4498338-b2ed-420e-9202-f1515fda62fd tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1403 microversion: 2.54 time: 0.444489 Jul 18 02:44:45.728394 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2691/5304] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:45 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1403 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:45.789339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Locking {{(pid=119440) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 18 02:44:45.910821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2cc8bfb1-4032-4358-af24-3bf49ec928c6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.341182 Jul 18 02:44:45.915124 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2614/5305] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:45 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:44:45.931465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:45.938991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:45.957558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.959480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:45.962118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:45.963961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:46.595660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:46.596651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:46.616715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:46.617394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:46.618303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:46.618769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.054613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.065470 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d415cb4-71ec-4d7c-bf13-e156059fa4ad tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.143113 Jul 18 02:44:47.077774 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2692/5306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:45 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:47.083293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:47.084463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:47.100765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.101835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.102935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.103639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.108892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:47.185822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.188728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.196224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lazy-loading 'fault' on Instance uuid 6c7c4fd0-a089-4245-bd26-569bb907ea1b {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:44:47.282776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.293652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.295982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a977a8ef05fe4059abb544efe617deac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bbdaa70a7e41e4955eec7a2cf41e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.297535 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e3668b7d-c098-4881-b203-d203e5515df6 tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 200 len: 1408 microversion: 2.54 time: 0.218284 Jul 18 02:44:47.311440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2693/5307] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:47 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:44:47.317295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:47.337005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.343595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.416766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:47.431290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92384c41-6558-43b2-bd6b-a75855f79fd7 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 0.836907 Jul 18 02:44:47.434915 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2615/5308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:46 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:47.457711 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action HTTP/1.1 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 15 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: {"os-stop": {}} Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa', 'body': {'os-stop': {}}} Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked Jul 18 02:44:47.465459 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:47.476124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 409 to user: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa is locked {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:47.478154 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f7b8429-1418-45e9-9cea-e89a12b7fb87 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 409 len: 107 microversion: 2.1 time: 0.165067 Jul 18 02:44:47.479732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2694/5309] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:47 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 107 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:44:47.488590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:47.489193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:47.507427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.507893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.512887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.513588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.632173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Unlocking {{(pid=119440) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 02:44:47.761828 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94df2735-41b0-45a8-87f4-a46f67d36126 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.275314 Jul 18 02:44:47.771104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2616/5310] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:47 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:44:47.791038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f51cd3b-0f74-4542-9ab4-a64c6fb3e12e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:47.811870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f51cd3b-0f74-4542-9ab4-a64c6fb3e12e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.812678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f51cd3b-0f74-4542-9ab4-a64c6fb3e12e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.879558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f51cd3b-0f74-4542-9ab4-a64c6fb3e12e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Going to try to stop instance {{(pid=119439) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:44:47.960891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f51cd3b-0f74-4542-9ab4-a64c6fb3e12e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.188630 Jul 18 02:44:47.961888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2695/5311] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:44:47 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:44:47.971619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:47.972420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:47.984965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.985429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:47.986272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:47.993839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:48.321649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:48.322385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] [instance: 6c7c4fd0-a089-4245-bd26-569bb907ea1b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:48.347251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:48.348049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:48.349694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:48.351150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:48.383538 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] HTTP exception thrown: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Request method failure captured: Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b HTTP/1.1 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mjhd_y4t1hPF-VwjQDhyxOnGoxCZmzFGQ8_8-v4kC8Pg-1MuaeQkPyiJN9qhMPiUx6vzEk3NTybinIbd2raQ0YdEjHSLh-yp2Y2CJQps3CDxh3qhvyUp7WdiWcNTEyJM9XDvkQU0LW8Rfqf30xpqccmxRCCRRKdq0LXIo18oCajhaA Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.54 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 16bbdaa70a7e41e4955eec7a2cf41e46 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerShowV254Test-1629968406 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16bbdaa70a7e41e4955eec7a2cf41e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16bbdaa70a7e41e4955eec7a2cf41e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16bbdaa70a7e41e4955eec7a2cf41e46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16bbdaa70a7e41e4955eec7a2cf41e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerShowV254Test-1629968406 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 16bbdaa70a7e41e4955eec7a2cf41e46 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerShowV254Test-1629968406 Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerShowV254Test-1629968406-project Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: a977a8ef05fe4059abb544efe617deac Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerShowV254Test-1629968406-project Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '6c7c4fd0-a089-4245-bd26-569bb907ea1b'} Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:44:48.385603 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. Jul 18 02:44:48.391619 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:44:48.393176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] Returning 404 to user: Instance 6c7c4fd0-a089-4245-bd26-569bb907ea1b could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:44:48.394414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-376f04a6-d414-48c9-80e7-268ff061e4cb tempest-ServerShowV254Test-1629968406 tempest-ServerShowV254Test-1629968406-project] 10.222.0.67 "GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b" status: 404 len: 111 microversion: 2.54 time: 0.079050 Jul 18 02:44:48.395699 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2696/5312] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:44:48 2022] GET /compute/v2.1/servers/6c7c4fd0-a089-4245-bd26-569bb907ea1b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:44:48.452230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:48.453025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:48.467580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:48.471025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:48.473985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:48.481673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:48.749943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:48.765793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e5753fb-747b-45af-86e1-c844f044fc3b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.794878 Jul 18 02:44:48.781209 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2617/5313] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:47 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:49.828606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:49.858116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:49.860877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:49.864304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-180462bc-3226-4207-bd39-52ce30240732 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 1.416251 Jul 18 02:44:49.882765 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2697/5314] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:48 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:49.900537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:49.902029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:49.904184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:49.905566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:50.895418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:50.896180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:50.909357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:50.916122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:50.917468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:50.917944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:51.074161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:51.103135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6f55918f-3bd4-4676-a629-1e09b9b136b7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 1.289114 Jul 18 02:44:51.104621 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2618/5315] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:49 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:51.839987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:51.870572 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28d0c1b7-b210-497c-b149-ba947ca79319 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 0.978793 Jul 18 02:44:51.871662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2698/5316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:50 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:52.140475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:52.145219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:52.166875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:52.167547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:52.169409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:52.170314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:52.643922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-86511ab0-9f83-46d2-bb47-1a7f71b335ea req-d66af427-3369-4b8b-b540-71c90932704b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad1087d-2b81-4540-9974-17b2e47bb271", "name": "network-vif-plugged", "status": "completed", "tag": "4ebcb51a-affe-4e00-a785-004913971e4f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:52.669152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-86511ab0-9f83-46d2-bb47-1a7f71b335ea req-d66af427-3369-4b8b-b540-71c90932704b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:52.669926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-86511ab0-9f83-46d2-bb47-1a7f71b335ea req-d66af427-3369-4b8b-b540-71c90932704b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:52.704156 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-86511ab0-9f83-46d2-bb47-1a7f71b335ea req-d66af427-3369-4b8b-b540-71c90932704b service nova] Creating event network-vif-plugged:4ebcb51a-affe-4e00-a785-004913971e4f for instance cad1087d-2b81-4540-9974-17b2e47bb271 on n-h2-849796-1 Jul 18 02:44:52.721163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-86511ab0-9f83-46d2-bb47-1a7f71b335ea req-d66af427-3369-4b8b-b540-71c90932704b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079303 Jul 18 02:44:52.721163 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2699/5317] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:52.901324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:52.902951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:52.939545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:52.940416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:52.941764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:52.948410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:53.148577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:53.166446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2af64dad-5509-4553-8032-277626a3cf72 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 1.034473 Jul 18 02:44:53.167814 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2619/5318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:52 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:53.773719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:53.814435 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef4cd31e-f0b7-40ad-9b7a-7c6408c29c93 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 0.923619 Jul 18 02:44:53.832047 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2700/5319] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:52 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:54.195207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:54.196103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:54.203482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:54.217212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.221930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:54.228762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.229976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:54.846701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:54.847400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:54.871725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.872198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:54.882232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.882890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:55.621546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:55.647452 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33257dcb-bdf2-4d69-a97e-ec3456318a0c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 1.458014 Jul 18 02:44:55.657250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2620/5320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:54 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:55.844833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:55.890938 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72f80a56-8ade-4b2f-ae61-fcfaf8b4a1e8 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1314 microversion: 2.1 time: 1.048417 Jul 18 02:44:55.892437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2701/5321] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:54 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:56.668050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:56.668691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:56.682579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.683432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.685567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.686572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.915126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:56.921620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:56.969179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.972797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.981546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.983021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:57.727602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:57.746782 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e662bff4-6d1a-42c6-b1d8-3e99d365c082 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1464 microversion: 2.1 time: 0.839833 Jul 18 02:44:57.752228 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2702/5322] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:56 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1464 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:57.767613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fb55736-d81a-434e-923d-e2c119bcdd38", "device": "/dev/sdb"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:57.773359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:57.795776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.796448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:57.797593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.798070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:58.519611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-80ea8ec3-c0ab-411f-a96b-de2ec5c5bbf6 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "POST /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756981 Jul 18 02:44:58.537821 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2703/5323] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:44:57 2022] POST /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:44:58.866662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.881708 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29594df6-4bb2-4f67-9f0b-35ab04cacdbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 2.218415 Jul 18 02:44:58.883587 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2621/5324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:56 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:59.901956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:59.903495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:59.927837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.935753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:59.942182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.963256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.301084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:01.329356 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2f0fd22-dd76-4748-b3e5-0a8d104ac7f4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1656 microversion: 2.1 time: 1.432791 Jul 18 02:45:01.331215 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2704/5325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1656 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:01.348531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d09d12fd-464a-4281-bfb6-f22cfa17230e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:01.371459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d09d12fd-464a-4281-bfb6-f22cfa17230e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:01.371816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d09d12fd-464a-4281-bfb6-f22cfa17230e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.449169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d09d12fd-464a-4281-bfb6-f22cfa17230e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Going to try to start instance {{(pid=119440) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:45:01.532063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=4,nova_cell1:UPDATE=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:01.619185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d09d12fd-464a-4281-bfb6-f22cfa17230e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.253950 Jul 18 02:45:01.622946 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2622/5326] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:01 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:01.644177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:01.648994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:01.686997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:01.693177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.698374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:01.702183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:02.405692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.416834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a171c3b-0b8e-4cd9-9110-57281b9adabf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 0.788578 Jul 18 02:45:02.436840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2705/5327] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:01 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:03.452791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:03.454341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:03.475359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.476199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.482116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.488432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:05.303800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:05.335452 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-79b9222d-3251-4981-87bb-f645c8310cfa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 1.894978 Jul 18 02:45:05.338433 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2623/5328] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:03 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:06.354991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:06.355992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:06.388209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:06.388816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:06.392302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:06.393219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.807375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:07.820547 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d43d008-facc-42f4-a02e-4e10a152b18f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 1.470155 Jul 18 02:45:07.833789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2706/5329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:06 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:08.612164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e3cfefaa-b3af-42ce-b8a1-1cf7f1c6eaf7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: .version_select at 0x7fab04602b80>, body: {"keypair": {"name": "tempest-keypair-266328934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd9s86gHNQCdQ86TApnlgOw9HV2gkv3qAT8FrCSrsKcgRCjaiOU7pRmnKo4jWLa7r7njDWsrvoJBRmE67zV3yyIIxivYncW5OH4F4OkKkwJY0AqC12hghUal/mSe1geeQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:08.666625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e3cfefaa-b3af-42ce-b8a1-1cf7f1c6eaf7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for project 63c4616265964dc0b9e563b531760614. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:45:08.706521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e3cfefaa-b3af-42ce-b8a1-1cf7f1c6eaf7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for user cac2062b69124275b997a57802730b35 and project 63c4616265964dc0b9e563b531760614. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:45:08.803886 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e3cfefaa-b3af-42ce-b8a1-1cf7f1c6eaf7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.585856 Jul 18 02:45:08.813750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2624/5330] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:45:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 597 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:45:08.854552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:08.856002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:08.878190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.880222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.884308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.886464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.078984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:10.094239 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c4553a0-b4f3-4388-8bc4-478f98f585ba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.246186 Jul 18 02:45:10.107015 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2707/5331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:08 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:10.118780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:10.119611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.143854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.144333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.150692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.151311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.565166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:10.576089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43a320e4-2e15-40d3-978b-3677aa7a17f6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.463332 Jul 18 02:45:10.576759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2625/5332] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:10 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:10.614389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:10.616137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.631831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.633215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.634964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.636530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.715411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:10.771927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Unlocking {{(pid=119439) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 18 02:45:10.905544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1b8d480-f894-4618-9374-1a842ca227dc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.304938 Jul 18 02:45:10.907270 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2708/5333] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:10 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:10.933703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:10.934346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.945855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.946344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.947184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.947616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:11.390805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:11.404878 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ba98613-b53c-492e-92f9-ce5be8645251 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.482980 Jul 18 02:45:11.410101 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2626/5334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:10 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:11.438564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:11.439968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:11.443074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:11.469771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:11.470498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:11.471542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:11.472198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.771902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:12.795420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95e53d1c-0073-4406-a286-e332561ad4f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.362214 Jul 18 02:45:12.796041 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2709/5335] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:11 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:12.847602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:12.850859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:12.874953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.875724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.877389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.878430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.758945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.769178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fc24923-40eb-4f5d-a46f-cdfb4385913d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.943913 Jul 18 02:45:13.778156 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2627/5336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:12 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:13.808622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:13.811117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.826630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.827510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.828861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.830555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.141565 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.337668 Jul 18 02:45:14.166868 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2710/5337] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:13 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:14.173547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:14.180654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:14.236853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.242019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.244431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.248382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.786812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:15.791553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-965cce9c-7e7a-4463-bf17-b41558c70f69 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008650 Jul 18 02:45:15.794607 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2711/5338] 10.222.0.67 () {56 vars in 885 bytes} [Mon Jul 18 02:45:15 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:45:15.880856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:15.893212 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4344ea2c-6390-4eea-b179-b2a1963b2b3d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1674 microversion: 2.1 time: 1.728601 Jul 18 02:45:15.904981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2628/5339] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:14 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1674 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:16.926198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:16.927702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:16.948478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.951532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.954093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.956509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:17.586215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597836948", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "613350f3-693b-4f81-a134-15d40147b6a6"}], "security_groups": [{"name": "tempest-securitygroup--1433328310"}], "key_name": "tempest-keypair-266328934", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:17.852132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] validate_networks() for [('613350f3-693b-4f81-a134-15d40147b6a6', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:45:18.162814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:18.180653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7399e00-2b95-4c5e-ac23-cf2e850076e2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1654 microversion: 2.1 time: 1.260671 Jul 18 02:45:18.183624 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2712/5340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:16 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1654 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:18.212196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:18.212702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:18.224424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.225081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.228586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.229466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.428589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fa45bdc-4952-41bb-8776-fae1c1bf42a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.221303 Jul 18 02:45:18.429812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2713/5341] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:18 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:45:18.458269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:18.465386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:18.483220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.483691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.495836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.496313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.749446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:19.484431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:19.534081 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d05a089-e1a0-4098-bb92-ae96787dd428 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1661 microversion: 2.1 time: 1.092055 Jul 18 02:45:19.550915 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2714/5342] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:18 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1661 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:20.560194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:20.560995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:20.583994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.594099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:20.599701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.606519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.080208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:45:21.084579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:45:21.085901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:45:21.086941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:45:21.088192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:45:21.134212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.136014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.138055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.139385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.236732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for project 63c4616265964dc0b9e563b531760614. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:45:21.267695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for user cac2062b69124275b997a57802730b35 and project 63c4616265964dc0b9e563b531760614. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:45:21.326719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:45:21.340003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:45:21.584310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3373ba7f-2bfb-45b9-8eab-c7d4f5b7cdf6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.002780 Jul 18 02:45:21.596779 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2629/5343] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:45:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 4017 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 02:45:21.616352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:21.621854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:21.915794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:21.941401 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd59d330-9b2d-40d3-8b3d-3e8187ee3935 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.385239 Jul 18 02:45:21.945757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2715/5344] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:20 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:22.009275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:22.010450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:22.084904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.089180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.097315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.106124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.156698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.234199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.240353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.284587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab710fcb-e874-44d3-8865-590fbe5ff0b9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1281 microversion: 2.20 time: 0.647143 Jul 18 02:45:22.286314 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2630/5345] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:21 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1281 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:23.323960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.325083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.578562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:23.604415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13086d79-0b00-4e5e-94f2-f7296038d774 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.633961 Jul 18 02:45:23.616440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2716/5346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:21 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:23.643245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.648601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.668732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.678692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.684101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.687294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.795949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.851328 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de0c3635-e930-4c08-9ec9-347446a6dba8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.205857 Jul 18 02:45:24.852472 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2717/5347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:23 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:25.555346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:25.577627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55912ab3-ed96-4b9f-aaa9-e0a1a3914f40 tempest-ExtensionsTest-664094882 tempest-ExtensionsTest-664094882-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:25.580174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55912ab3-ed96-4b9f-aaa9-e0a1a3914f40 tempest-ExtensionsTest-664094882 tempest-ExtensionsTest-664094882-project] 10.222.0.67 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.722580 Jul 18 02:45:25.587865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2718/5348] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Jul 18 02:45:24 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:25.625172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:25.632259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:25.636959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:25.638817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ec7ac8b-f36e-4a58-acae-e336225ceaab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1281 microversion: 2.20 time: 2.335986 Jul 18 02:45:25.639873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:25.643585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2631/5349] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:23 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1281 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:25.665961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.668834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3cbba4e4-5804-40f7-a078-b538d6b7d551 tempest-ExtensionsTest-664094882 tempest-ExtensionsTest-664094882-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:25.673340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.677804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:25.678867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3cbba4e4-5804-40f7-a078-b538d6b7d551 tempest-ExtensionsTest-664094882 tempest-ExtensionsTest-664094882-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.025773 Jul 18 02:45:25.679619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:25.680586 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2632/5350] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Jul 18 02:45:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:45:26.322046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:26.334509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f9ded26e-db6c-4090-b805-2a3588d81337 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.745082 Jul 18 02:45:26.340287 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2719/5351] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:25 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:26.357077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:26.357786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:26.361913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:26.378901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.379831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.381181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.382225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.662444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:26.663395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:26.678679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.679420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.681606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:26.682277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:26.921740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:26.942780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:26.946459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:26.947738 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a39062a-0d52-4d7f-8931-762b7edadca1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1339 microversion: 2.20 time: 0.289906 Jul 18 02:45:26.948341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2720/5352] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:26 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1339 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:45:27.148324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:27.176867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a372d66c-d06e-4621-a186-1acffe00c64b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.816602 Jul 18 02:45:27.178205 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2633/5353] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:26 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:27.200404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:27.201525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:27.245452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:27.246437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:27.247534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:27.248387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:27.975705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:27.977473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:28.014608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:28.015092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:28.022759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:28.023444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:28.606839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:28.618257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:28.624338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:28.629456 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f6babfa5-366a-4ed1-8fd2-a4269b2ff14d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1339 microversion: 2.20 time: 0.666214 Jul 18 02:45:28.633637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2634/5354] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:27 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1339 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:29.668017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:29.669093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:29.691018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.692775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.698086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.720139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.749541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.772290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4cb32e83-458e-44f2-b9bd-4b49b50e2272 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 2.577574 Jul 18 02:45:29.789074 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2721/5355] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:27 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:30.963568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:31.004889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:31.015878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:31.027381 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c19cc318-55b0-4b2c-be76-f1e9063af4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.366762 Jul 18 02:45:31.034671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2635/5356] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:29 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:45:32.077412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:32.078990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:32.102122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.103193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.104891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:32.105688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.740726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:32.764069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=90,nova_cell1:UPDATE=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:32.841895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:32.845733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:32.866757 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f778f30-85f7-4cf5-b2af-77f7f1e2a68d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 0.794060 Jul 18 02:45:32.877492 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2722/5357] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:32 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:33.333940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-23f5e202-3bba-4565-9ca1-ec0254d93dda req-534de873-7b72-4acf-b71e-544b6b09b297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:33.371059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:33.415280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-23f5e202-3bba-4565-9ca1-ec0254d93dda req-534de873-7b72-4acf-b71e-544b6b09b297 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.415744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-23f5e202-3bba-4565-9ca1-ec0254d93dda req-534de873-7b72-4acf-b71e-544b6b09b297 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.426541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:33.449729 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-23f5e202-3bba-4565-9ca1-ec0254d93dda req-534de873-7b72-4acf-b71e-544b6b09b297 service nova] Creating event network-changed:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h1-849796-1 Jul 18 02:45:33.466149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-23f5e202-3bba-4565-9ca1-ec0254d93dda req-534de873-7b72-4acf-b71e-544b6b09b297 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152884 Jul 18 02:45:33.467421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2636/5358] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:33.921215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:33.931846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:33.959363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.962597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.972684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.975023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.450279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b0f25f13-4073-43ac-a798-819cd918063f tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] Calling method '.version_select at 0x7fab055b6160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:34.503288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.518751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.533635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.537879 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81586205-2857-4135-9165-1008125a2706 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 0.625096 Jul 18 02:45:34.539250 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2637/5359] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:34.702734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b0f25f13-4073-43ac-a798-819cd918063f tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.831526 Jul 18 02:45:34.703668 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2723/5360] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9/defaults => generated 371 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:34.718862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aaa94dd5-517c-468d-8a9a-92807e6bf2d3 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] Calling method '.version_select at 0x7faaf74089d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:34.930763 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aaa94dd5-517c-468d-8a9a-92807e6bf2d3 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9" status: 200 len: 371 microversion: 2.1 time: 0.215762 Jul 18 02:45:34.931756 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2638/5361] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:45:34 2022] GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:34.951230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5daed26c-24df-4a0f-8221-3c109ff7177a tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] Calling method '.version_select at 0x7fab04af2e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.175946 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5daed26c-24df-4a0f-8221-3c109ff7177a tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.229857 Jul 18 02:45:35.180482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2724/5362] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 02:45:34 2022] GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9/defaults => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:45:35.207135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd548fd9-d041-4ad8-805c-84d0cee50f69 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] Calling method '.version_select at 0x7fab0454e1f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.470954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd548fd9-d041-4ad8-805c-84d0cee50f69 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9" status: 200 len: 371 microversion: 2.1 time: 0.276587 Jul 18 02:45:35.474004 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2639/5363] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 02:45:35 2022] GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9 => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:35.494050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cb3bcb0-ca8b-408e-af92-aea22f5ad803 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] Calling method '.version_select at 0x7fab055b6700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.577587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.580087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:35.611354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.612190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.614212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.616043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.915001 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2cb3bcb0-ca8b-408e-af92-aea22f5ad803 tempest-QuotasTestJSON-1447091415 tempest-QuotasTestJSON-1447091415-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9?user_id=2884b76e93094666a2a99a2b82e57eb1" status: 200 len: 371 microversion: 2.1 time: 0.430724 Jul 18 02:45:35.916332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2725/5364] 10.222.0.67 () {58 vars in 1322 bytes} [Mon Jul 18 02:45:35 2022] GET /compute/v2.1/os-quota-sets/2928844c0cde43ee8ef6f85279edf9c9?user_id=2884b76e93094666a2a99a2b82e57eb1 => generated 371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:36.670311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:36.715641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:36.725912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:36.731129 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d277d538-d67c-4af6-92c0-80960299532a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.164960 Jul 18 02:45:36.756453 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2640/5365] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:35 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:37.765688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:37.766613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:37.795921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.796789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.798387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.799714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:38.870849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:38.886164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:38.892175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:38.900070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.135021 Jul 18 02:45:38.901196 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2726/5366] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:37 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:39.940010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:39.940860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:39.991706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.992236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.993257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.993976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.535066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:41.546708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:41.549354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:41.551144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.621975 Jul 18 02:45:41.552447 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2641/5367] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:39 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:42.246246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.250423 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003787 Jul 18 02:45:42.252197 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2727/5368] 10.222.0.67 () {56 vars in 885 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:45:42.264390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.268141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004227 Jul 18 02:45:42.270614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2642/5369] 10.222.0.67 () {54 vars in 1034 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 18 02:45:42.282512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.288841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab872377-b4a3-4e3d-af87-7651b3155d11 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.006920 Jul 18 02:45:42.293834 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2728/5370] 10.222.0.67 () {54 vars in 1040 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/ => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:42.302366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.306294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a14015b-a607-487d-81be-32b8e7a502a6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004850 Jul 18 02:45:42.307483 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2643/5371] 10.222.0.67 () {56 vars in 885 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 18 02:45:42.595165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.607861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:42.628702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=36 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:42.631673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.634076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.635326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.639299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:43.663854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:43.676495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:43.687516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:43.697086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79fd9edf-c0e2-40a4-8dd0-c938a46fb075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.113735 Jul 18 02:45:43.714593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2729/5372] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:44.736704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:44.737589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:44.792412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.797587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.799289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.807944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:45.133870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6342512c-4969-4593-b8e4-afeb67ffb238 req-74ae62b5-66d8-4ce8-ad18-b7abb1a480b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "name": "network-vif-plugged", "status": "completed", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:45.211866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6342512c-4969-4593-b8e4-afeb67ffb238 req-74ae62b5-66d8-4ce8-ad18-b7abb1a480b4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:45.221982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6342512c-4969-4593-b8e4-afeb67ffb238 req-74ae62b5-66d8-4ce8-ad18-b7abb1a480b4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:45.299912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6342512c-4969-4593-b8e4-afeb67ffb238 req-74ae62b5-66d8-4ce8-ad18-b7abb1a480b4 service nova] Creating event network-vif-plugged:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h1-849796-1 Jul 18 02:45:45.353652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6342512c-4969-4593-b8e4-afeb67ffb238 req-74ae62b5-66d8-4ce8-ad18-b7abb1a480b4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222307 Jul 18 02:45:45.354371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2730/5373] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:45.456063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:45.700352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:45.712303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:45.719793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:45.722558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fbcfa9d1-af54-4406-8fb9-abc87c479359 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.001191 Jul 18 02:45:45.723956 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2644/5374] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:44 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:46.765485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:46.771237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:46.787356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:46.821432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:46.825786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:46.828657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:46.840428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:47.927116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:47.962659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:47.966980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:47.971672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-486b1d6d-9ba1-454d-a4a1-21f88a4fe31e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1407 microversion: 2.20 time: 1.220721 Jul 18 02:45:47.974331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2731/5375] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:46 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1407 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:49.009550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:49.020034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:49.068076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.079232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:49.082095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.091357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:49.771217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:49.790157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:49.794933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:49.806032 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a58f877-31f1-4164-b01a-a779b4473dc4 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1598 microversion: 2.20 time: 0.804881 Jul 18 02:45:49.824792 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2645/5376] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:45:48 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1598 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:45:49.835743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:49.839576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:49.885704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.886514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:49.888053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:49.888880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:50.470435 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9bd9dd80-4c60-42b0-adeb-faf305299400 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.646878 Jul 18 02:45:50.473983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2732/5377] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:45:49 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-interface => generated 284 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:45:59.646294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2c84825f-03e1-49d5-b403-ea4ae545bb03 req-a141074c-b245-49c7-9459-0273c143a654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:59.655697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=25 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:59.687626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2c84825f-03e1-49d5-b403-ea4ae545bb03 req-a141074c-b245-49c7-9459-0273c143a654 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:59.688081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2c84825f-03e1-49d5-b403-ea4ae545bb03 req-a141074c-b245-49c7-9459-0273c143a654 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:59.721341 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2c84825f-03e1-49d5-b403-ea4ae545bb03 req-a141074c-b245-49c7-9459-0273c143a654 service nova] Creating event network-changed:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h1-849796-1 Jul 18 02:45:59.740517 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2c84825f-03e1-49d5-b403-ea4ae545bb03 req-a141074c-b245-49c7-9459-0273c143a654 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099487 Jul 18 02:45:59.746104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2646/5378] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:12.483050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=7 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:12.488584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=24 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:12.668741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:12.671048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:12.681653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:12.685715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=33 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:12.697073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.698304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.699390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.700072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.022972 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-170a8dd9-c8c9-4f65-b3c6-9d7a1a6f0376 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.359615 Jul 18 02:46:13.026293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2647/5379] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:46:12 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:13.058235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.064098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:13.095953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.101255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.109983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.114047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.375010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f91f8baa-e013-47bd-a01b-c44ec729f5e9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: .version_select at 0x7fab05767dc0>, body: {"keypair": {"name": "tempest-keypair-555700109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIyyp58ePNmTGx3rbgMR8/z5UOVOqJ3ILlpYYVR2DF8kOoDy8Ag36hrQqEFm3K2pjhL8uVqQnaUViZqSPvFE+MAZSmSuqfNahhwA/vjWZe/XvGu1yDon+sv+eq5ZheYlw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:13.412533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f91f8baa-e013-47bd-a01b-c44ec729f5e9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:13.432171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f91f8baa-e013-47bd-a01b-c44ec729f5e9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:13.509067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f91f8baa-e013-47bd-a01b-c44ec729f5e9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.034510 Jul 18 02:46:13.510825 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2733/5380] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:46:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:13.530625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-532349632", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:13.648771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] validate_networks() for None {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:14.968284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:14.969971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:14.970604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:14.971715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:14.972425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:14.998763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.000301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.008155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.009081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.076362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Getting quotas for project 58d96f763f1a4e3e892fe6893af33a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:15.122843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Getting quotas for user fa029c5ba87041ba963fd77dc96326b8 and project 58d96f763f1a4e3e892fe6893af33a27. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:15.177270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:15.179873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:15.310130 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2c4adf36-4894-4b17-a4bb-0dd84ce4e926 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796601 Jul 18 02:46:15.311096 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2734/5381] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:46:15.325882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fb2ee58-0b79-40d0-b39c-6d72e2507478 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:15.326952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fb2ee58-0b79-40d0-b39c-6d72e2507478 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.521451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.531974 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a7bedd6-f757-46ca-ac3c-bbe46e796874 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1671 microversion: 2.1 time: 2.500407 Jul 18 02:46:15.532620 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2648/5382] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:13 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1671 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:15.602499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fb2ee58-0b79-40d0-b39c-6d72e2507478 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.618559 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fb2ee58-0b79-40d0-b39c-6d72e2507478 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1214 microversion: 2.1 time: 0.297195 Jul 18 02:46:15.624447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2735/5383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:15 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:16.554189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.555782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.613700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.614315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.625339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.625836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.640848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.642441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.667957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.674272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.678265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.679902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.313501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:17.354279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d0b41194-faa5-4b8d-940a-cc2b0156e895 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1218 microversion: 2.1 time: 0.714209 Jul 18 02:46:17.358558 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2736/5384] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1218 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:17.758664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:17.805404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19e6d134-15e2-4de7-95a7-a8934f5cd247 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1671 microversion: 2.1 time: 1.249424 Jul 18 02:46:17.814281 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2649/5385] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1671 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:18.381355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:18.382493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:18.422179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.422999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:18.424569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.436354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:18.855218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:18.858778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:18.874580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.875373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:18.876461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:18.877181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:19.082674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:19.094781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-341344da-7977-4825-aa12-f06cb2401027 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1272 microversion: 2.1 time: 0.722767 Jul 18 02:46:19.113740 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2737/5386] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:18 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1272 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:19.941025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:19.957931 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a817a58d-f563-4612-9846-55e342384dc5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1676 microversion: 2.1 time: 1.124931 Jul 18 02:46:19.965525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2650/5387] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:18 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1676 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:20.127276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:20.129285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:20.160593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.161998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.175298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.177358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.044188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:21.048896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:21.098085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:21.103346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.105467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:21.106148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.178852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:21.199383 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50308fbf-32c7-47eb-b4da-32fc6bb813fb tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1272 microversion: 2.1 time: 1.082583 Jul 18 02:46:21.200058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2738/5388] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:20 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1272 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:21.673451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:21.690203 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b6a6f8a-896b-4d07-a1aa-1e49d135a194 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1676 microversion: 2.1 time: 0.691960 Jul 18 02:46:21.693938 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2651/5389] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:20 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1676 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:22.232600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:22.234006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:22.251840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.254645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.259960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.260327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.624760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:22.663423 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5eea0c79-9662-4579-a368-e05b07e16ff1 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1272 microversion: 2.1 time: 0.433354 Jul 18 02:46:22.679144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2739/5390] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:22 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1272 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:22.727279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:22.730028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:22.758943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.763082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.764537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.765405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.658428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:23.698711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:23.699811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:23.723862 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e8e2042-3f82-44fa-8f81-876d4dd1ff7b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1676 microversion: 2.1 time: 1.015723 Jul 18 02:46:23.738945 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2652/5391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:22 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1676 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:23.746954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.766144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:23.767932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:23.770204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:24.243377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:24.283416 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bb31f80-d265-48ad-8feb-f01ce580bdb5 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1272 microversion: 2.1 time: 0.594106 Jul 18 02:46:24.284040 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2740/5392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:23 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1272 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:24.764963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:24.770487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:24.804388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:24.805647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:24.809017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:24.810095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.309754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:25.310961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:25.336174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:25.338154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.338625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.339450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.339905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.618953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:25.629269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:25.647085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78af19bf-9e5c-4715-bada-c8388522a0f8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.892029 Jul 18 02:46:25.648030 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2653/5393] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:24 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:26.794171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:26.806285 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4832c40a-5d88-4e5d-aa13-52d939277762 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 1.504040 Jul 18 02:46:26.807722 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2741/5394] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:25 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:26.911098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-91367575", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcc90fc-3273-454a-b817-89f60dcb357d"}], "security_groups": [{"name": "tempest-securitygroup--1573631872"}], "key_name": "tempest-keypair-555700109", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:27.223783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] validate_networks() for [('9fcc90fc-3273-454a-b817-89f60dcb357d', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:46:27.824220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:27.825641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:27.844356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:27.845947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:27.851256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:27.854804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.509199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:28.551729 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bf849bff-f818-4ab1-891d-20fccc4dba8d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 0.722967 Jul 18 02:46:28.563388 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2742/5395] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:27 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:28.826140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:46:28.827915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:46:28.828712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:46:28.829458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:46:28.830903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:46:28.861401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.862508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.873760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.876155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.942841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:46:28.957478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:46:28.979498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:46:28.982521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:46:29.074793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-317b4cda-cb27-42f2-b80b-e8991647f374 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.173075 Jul 18 02:46:29.084887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2654/5396] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:46:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:46:29.089447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af237133-0333-44c5-b0bc-dc680330ef25 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:29.090311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af237133-0333-44c5-b0bc-dc680330ef25 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:29.572423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:29.573578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:29.595862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:29.598912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:29.600305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:29.604621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:29.972824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af237133-0333-44c5-b0bc-dc680330ef25 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:29.994439 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af237133-0333-44c5-b0bc-dc680330ef25 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1239 microversion: 2.1 time: 0.909342 Jul 18 02:46:30.026757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2743/5397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:29 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1239 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:30.293065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d2f90e7a-785c-4fc2-8729-7e59ba5c3f34 req-7fe25735-f832-4a45-8db8-3eee9072258b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5522f8-dc13-49b4-afc8-18caac4b0756", "tag": "b6b8d768-d842-4fac-b5fa-d8830cb3ef11"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:30.301055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:30.321615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d2f90e7a-785c-4fc2-8729-7e59ba5c3f34 req-7fe25735-f832-4a45-8db8-3eee9072258b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:30.322473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c1e1cfa-2945-4649-8a8e-71b1b081679d tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 0.755990 Jul 18 02:46:30.324716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d2f90e7a-785c-4fc2-8729-7e59ba5c3f34 req-7fe25735-f832-4a45-8db8-3eee9072258b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:30.344283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2655/5398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:29 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:30.357279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d2f90e7a-785c-4fc2-8729-7e59ba5c3f34 req-7fe25735-f832-4a45-8db8-3eee9072258b service nova] Creating event network-changed:b6b8d768-d842-4fac-b5fa-d8830cb3ef11 for instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 on n-h2-849796-1 Jul 18 02:46:30.388056 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d2f90e7a-785c-4fc2-8729-7e59ba5c3f34 req-7fe25735-f832-4a45-8db8-3eee9072258b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103665 Jul 18 02:46:30.388786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2744/5399] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:31.040154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:31.047507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:31.112761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.113864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.115341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.116116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.359874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:31.361168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:31.392349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.396484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.406531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.408070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.524726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:31.542664 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68ce8da3-84dc-477f-a70e-49974fc8503a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1291 microversion: 2.1 time: 0.511584 Jul 18 02:46:31.544583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2656/5400] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:31 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1291 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.422356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:32.454010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ff0903b-f168-4b21-957c-f997fd31ba94 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 1.099341 Jul 18 02:46:32.460690 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2745/5401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:31 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.583508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:32.585904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:32.601595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.604077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.605999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.607077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.981122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:33.023020 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6e0fe377-36b2-4149-9eb6-808c340ba4da tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1297 microversion: 2.1 time: 0.451788 Jul 18 02:46:33.024552 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2657/5402] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:32 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1297 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:33.524815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:33.528487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:33.571784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.572592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.575916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.577004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.064014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:34.075212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:34.095305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:34.097627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.100764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:34.102568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.350427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:34.377110 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12fdfb16-6897-4ce1-9d7b-af446cf30df7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 0.889663 Jul 18 02:46:34.385375 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2746/5403] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:33 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:34.396827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:34.420488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20092358-e340-4f5b-be42-29de3d472587 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1297 microversion: 2.1 time: 0.367456 Jul 18 02:46:34.428044 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2658/5404] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:34 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1297 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:35.423133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:35.424033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:35.450533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:35.451481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:35.457990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.460222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.464072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.465994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.480187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.481455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.483110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.484078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.332670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:36.380995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad1abe36-681d-4c78-bd8f-0756af6c84c8 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 0.965443 Jul 18 02:46:36.387833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2747/5405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:35 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:36.424503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:36.469741 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dae28b70-a967-469e-8c2c-a88022bdff9e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 1.024801 Jul 18 02:46:36.473623 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2659/5406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:35 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:37.405811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:37.407650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:37.433919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.436596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:37.440562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.444781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:37.506630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:37.512354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:37.572740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.575720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:37.586828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.587641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:38.037579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:38.064478 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bdcafe3-3df6-41d1-ae1b-bfb45d78e8d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.567780 Jul 18 02:46:38.082200 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2660/5407] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:37 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:38.550726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:38.601211 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a306a493-33b0-4f7f-bd17-29ce1ae30ef6 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 1.200557 Jul 18 02:46:38.605324 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2748/5408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:37 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:38.631645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c4f865ea-c3be-4ff8-9901-f75092a4523e req-38d6508e-5ad7-4324-bbb5-6a72fe490631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c", "tag": "2164eb76-5762-4119-a54c-3a059de0bd9b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:38.657174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c4f865ea-c3be-4ff8-9901-f75092a4523e req-38d6508e-5ad7-4324-bbb5-6a72fe490631 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:38.657662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c4f865ea-c3be-4ff8-9901-f75092a4523e req-38d6508e-5ad7-4324-bbb5-6a72fe490631 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:38.703835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c4f865ea-c3be-4ff8-9901-f75092a4523e req-38d6508e-5ad7-4324-bbb5-6a72fe490631 service nova] Creating event network-changed:2164eb76-5762-4119-a54c-3a059de0bd9b for instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c on n-h1-849796-1 Jul 18 02:46:38.733051 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c4f865ea-c3be-4ff8-9901-f75092a4523e req-38d6508e-5ad7-4324-bbb5-6a72fe490631 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107410 Jul 18 02:46:38.741065 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2661/5409] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:39.117814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.118458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.138646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.139038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.152142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.152854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.645096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.647724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.680954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:39.683439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:39.719431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.722006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.735486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.738575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.801155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:39.831920 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8953e201-f2de-4537-bed8-a7e29d2ee910 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.731720 Jul 18 02:46:39.837802 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2749/5410] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:40.601331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:40.621430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cbe91b53-9343-4d15-97a7-ad60f39b5f2e tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 0.999792 Jul 18 02:46:40.622141 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2662/5411] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:40.872368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:40.873833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:40.891414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:40.908452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.910555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.919195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.921820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:41.448513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:41.473944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-719a7bf7-e41e-49e4-91e3-54e551cbfa07 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.613570 Jul 18 02:46:41.478336 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2750/5412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:40 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:41.653858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:41.655451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:41.694689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:41.702406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:41.704653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:41.705886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.336569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-83d4b86c-e424-49b9-9208-ce30157c2fe9 req-6791e8fe-5894-48ff-ac2e-8df067607ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5522f8-dc13-49b4-afc8-18caac4b0756", "name": "network-vif-plugged", "status": "completed", "tag": "b6b8d768-d842-4fac-b5fa-d8830cb3ef11"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:42.372057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-83d4b86c-e424-49b9-9208-ce30157c2fe9 req-6791e8fe-5894-48ff-ac2e-8df067607ee8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.373679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-83d4b86c-e424-49b9-9208-ce30157c2fe9 req-6791e8fe-5894-48ff-ac2e-8df067607ee8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.396010 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-83d4b86c-e424-49b9-9208-ce30157c2fe9 req-6791e8fe-5894-48ff-ac2e-8df067607ee8 service nova] Creating event network-vif-plugged:b6b8d768-d842-4fac-b5fa-d8830cb3ef11 for instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 on n-h2-849796-1 Jul 18 02:46:42.420782 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-83d4b86c-e424-49b9-9208-ce30157c2fe9 req-6791e8fe-5894-48ff-ac2e-8df067607ee8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091511 Jul 18 02:46:42.423899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2751/5413] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:42.498191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:42.499137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:42.508638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:42.514623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.515792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.518350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.519526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.529717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=85 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:42.654760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:42.700445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:42.728303 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b83bc6f2-8078-4a81-b708-9cfea5e52106 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 1.083879 Jul 18 02:46:42.733711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2663/5414] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:41 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:43.101914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:43.115323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b02ee28b-bec5-4ce5-be92-759defb221cf tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.620506 Jul 18 02:46:43.118112 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2752/5415] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:42 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:43.786335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:43.793891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:43.840050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:43.865528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.866447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.876898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.878754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:44.155560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:44.156953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:44.185735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:44.186589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:44.187960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:44.190571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:44.818371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:44.838266 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51eca580-9720-4a4f-adf8-10986c445976 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1314 microversion: 2.1 time: 1.085407 Jul 18 02:46:44.854507 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2664/5416] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:43 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:45.385833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:45.459820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c234dcaf-e1a0-422d-8dd6-adc505b6f7f2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 1.310811 Jul 18 02:46:45.467234 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2753/5417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:44 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:45.867090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:45.875432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:45.890747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:45.891219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:45.892045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:45.892500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.494305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:46.496672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:46.542707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.543983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.545839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.546969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.988559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:47.014483 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e587f89e-cddc-48c3-99d9-f43560fad98e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.532922 Jul 18 02:46:47.016487 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2754/5418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:46 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:47.226786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:47.243807 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-119b2317-380e-4625-8ec4-4f672e6e2bfc tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1463 microversion: 2.1 time: 1.384399 Jul 18 02:46:47.255285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2665/5419] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:45 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1463 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:47.308840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:47.309932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:47.335296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.337303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.338833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.350449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.446610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:47.688192 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34fb1025-daaa-497e-8596-0ae558bc9b8a tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 204 len: 0 microversion: 2.1 time: 0.382679 Jul 18 02:46:47.691683 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2755/5420] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:47 2022] DELETE /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:46:47.707583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:47.710338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:47.724718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.726374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.731244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.732844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.040961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:48.044192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:48.055344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.055810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.056659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.057777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.350592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:48.368190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:48.421748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-100a9194-ec23-4088-a39d-6a1969ae5352 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.386282 Jul 18 02:46:48.437347 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2756/5421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:48 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:48.444309 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90105514-b63d-423b-b56b-9d3554e1b872 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1469 microversion: 2.1 time: 0.743619 Jul 18 02:46:48.445711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2666/5422] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:47 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1469 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:48.653600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-72a7e587-f3d5-4517-8ff1-6759ee37f8cb req-15f9b38a-a395-4fc5-9ddf-d79c79ed02f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c", "name": "network-vif-plugged", "status": "completed", "tag": "2164eb76-5762-4119-a54c-3a059de0bd9b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:48.675195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-72a7e587-f3d5-4517-8ff1-6759ee37f8cb req-15f9b38a-a395-4fc5-9ddf-d79c79ed02f3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.675665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-72a7e587-f3d5-4517-8ff1-6759ee37f8cb req-15f9b38a-a395-4fc5-9ddf-d79c79ed02f3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.696495 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-72a7e587-f3d5-4517-8ff1-6759ee37f8cb req-15f9b38a-a395-4fc5-9ddf-d79c79ed02f3 service nova] Creating event network-vif-plugged:2164eb76-5762-4119-a54c-3a059de0bd9b for instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c on n-h1-849796-1 Jul 18 02:46:48.732822 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-72a7e587-f3d5-4517-8ff1-6759ee37f8cb req-15f9b38a-a395-4fc5-9ddf-d79c79ed02f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069046 Jul 18 02:46:48.739389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2757/5423] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:49.459939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:49.460909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:49.469808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:49.471074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:49.493616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.494402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.498635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:49.499552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:49.503129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.503585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.504425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:49.505196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.050667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:50.065703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d728ec51-26d4-4ed5-bd14-eb61ce44e5a0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1365 microversion: 2.1 time: 0.612305 Jul 18 02:46:50.069355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2667/5424] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:49 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1365 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:51.000383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:51.026447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d26eff6-4b50-4fb5-b194-5bae88954614 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1469 microversion: 2.1 time: 1.558883 Jul 18 02:46:51.039992 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2758/5425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:49 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1469 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:51.102418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:51.105103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:51.126047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.128874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:51.130742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.131782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.047629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.048283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:52.095269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.095742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.103753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.104199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.122271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:52.152126 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d16c071b-7303-4f4c-8190-8b213b055aad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1554 microversion: 2.1 time: 1.051715 Jul 18 02:46:52.156748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2668/5426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:51 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1554 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:52.182155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.183098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:52.198805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.202445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.207430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.209120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.416457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa029c5ba87041ba963fd77dc96326b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d96f763f1a4e3e892fe6893af33a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:52.433308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f16c4f07-4ed0-444d-bded-8617514966f7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 200 len: 1427 microversion: 2.1 time: 0.391582 Jul 18 02:46:52.435503 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2759/5427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:52 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 1427 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:52.450224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9ee98b74-660a-49ab-b883-d64c2a055d3a req-bfb6ddce-a76f-4cbc-aa06-2fdc4d5143b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5522f8-dc13-49b4-afc8-18caac4b0756", "name": "network-vif-deleted", "tag": "b6b8d768-d842-4fac-b5fa-d8830cb3ef11"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:52.473598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ee98b74-660a-49ab-b883-d64c2a055d3a req-bfb6ddce-a76f-4cbc-aa06-2fdc4d5143b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.474058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9ee98b74-660a-49ab-b883-d64c2a055d3a req-bfb6ddce-a76f-4cbc-aa06-2fdc4d5143b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.514349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb268efc-c88d-4c70-bd1c-3d34e01fd873 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337677 Jul 18 02:46:52.515588 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2669/5428] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:46:52 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:52.516397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9ee98b74-660a-49ab-b883-d64c2a055d3a req-bfb6ddce-a76f-4cbc-aa06-2fdc4d5143b7 service nova] Creating event network-vif-deleted:b6b8d768-d842-4fac-b5fa-d8830cb3ef11 for instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 on n-h2-849796-1 Jul 18 02:46:52.528233 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9ee98b74-660a-49ab-b883-d64c2a055d3a req-bfb6ddce-a76f-4cbc-aa06-2fdc4d5143b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091252 Jul 18 02:46:52.536750 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2760/5429] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:53.453882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:53.454488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] [instance: 0c5522f8-dc13-49b4-afc8-18caac4b0756] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:53.472417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.472789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.473711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.474367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.520692 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] HTTP exception thrown: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Request method failure captured: Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 HTTP/1.1 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MlwmKXGE4_GB9QkLFYnkJnV8jK9D5dMjNgW_CCigDWSolGECNlfQWPulpWsD1-Y5bDw4BaC6tK1swHe0PlNDkmCh4Cn-wlJWwHMhCl38mky4ruqp11rvj5EAjVWGZPbrwbDIaveNMcXxHNK18ALGbDPgYDivaunc0b1eTeoIVKkzpY Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 58d96f763f1a4e3e892fe6893af33a27 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesNegativeTest-1614505613 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58d96f763f1a4e3e892fe6893af33a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58d96f763f1a4e3e892fe6893af33a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58d96f763f1a4e3e892fe6893af33a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58d96f763f1a4e3e892fe6893af33a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesNegativeTest-1614505613 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 58d96f763f1a4e3e892fe6893af33a27 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesNegativeTest-1614505613 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesNegativeTest-1614505613-project Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fa029c5ba87041ba963fd77dc96326b8 Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesNegativeTest-1614505613-project Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '0c5522f8-dc13-49b4-afc8-18caac4b0756'} Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:53.523702 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. Jul 18 02:46:53.539696 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:46:53.543811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] Returning 404 to user: Instance 0c5522f8-dc13-49b4-afc8-18caac4b0756 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:53.546878 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c14f0003-c340-4a83-8645-610d2ea4dff7 tempest-VolumesNegativeTest-1614505613 tempest-VolumesNegativeTest-1614505613-project] 10.222.0.67 "GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756" status: 404 len: 111 microversion: 2.1 time: 0.096698 Jul 18 02:46:53.550095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2670/5430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:53 2022] GET /compute/v2.1/servers/0c5522f8-dc13-49b4-afc8-18caac4b0756 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:46:56.613996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-adf4e5ca-8883-4648-aa6a-e48729e479cf req-6178b3d4-a2be-4beb-86ea-5eb8e9f0171d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c", "tag": "2164eb76-5762-4119-a54c-3a059de0bd9b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:56.634716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-adf4e5ca-8883-4648-aa6a-e48729e479cf req-6178b3d4-a2be-4beb-86ea-5eb8e9f0171d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.635176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-adf4e5ca-8883-4648-aa6a-e48729e479cf req-6178b3d4-a2be-4beb-86ea-5eb8e9f0171d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.671152 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-adf4e5ca-8883-4648-aa6a-e48729e479cf req-6178b3d4-a2be-4beb-86ea-5eb8e9f0171d service nova] Creating event network-changed:2164eb76-5762-4119-a54c-3a059de0bd9b for instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c on n-h1-849796-1 Jul 18 02:46:56.685697 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-adf4e5ca-8883-4648-aa6a-e48729e479cf req-6178b3d4-a2be-4beb-86ea-5eb8e9f0171d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077314 Jul 18 02:46:56.686358 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2761/5431] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:08.357871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:08.358685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:08.373777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=13 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:08.379535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:08.406685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:08.407263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:08.415502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:08.416238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:08.525703 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efeed0b8-7a88-4b99-ba0d-163d8f0ca26a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/ips" status: 200 len: 151 microversion: 2.20 time: 0.172364 Jul 18 02:47:08.531599 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2671/5432] 10.222.0.67 () {60 vars in 1288 bytes} [Mon Jul 18 02:47:08 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/ips => generated 151 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:47:12.760200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:12.761319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:12.766654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:12.768017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:12.823213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.826213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.827198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:12.827676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:12.903394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lazy-loading 'flavor' on Instance uuid 61cfc432-dd24-4653-a500-35730df8798a {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:47:13.864702 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72a50cdc-2cab-4f71-8225-cfa9e0788ee5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/action" status: 202 len: 0 microversion: 2.20 time: 1.106259 Jul 18 02:47:13.866943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2762/5433] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:47:12 2022] POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/action => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:47:13.877505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:13.878757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:13.905342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:13.906170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:13.907599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:13.909133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:14.518598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.539523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.546154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:14.555917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f98f8b89-efb6-456e-8800-e8ca0f8ef85b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 0.680425 Jul 18 02:47:14.557836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2672/5434] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:13 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:15.598746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:15.614392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:15.660307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.675688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:15.676618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:15.677122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:16.055285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.068801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.073413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:16.079413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fab795d-d86b-4b19-8e45-dd2f807e5523 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 0.487808 Jul 18 02:47:16.080399 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2763/5435] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:15 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:17.099436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:17.100046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:17.116799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.117299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:17.118130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:17.118591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:18.520821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.565628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.583558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:18.598432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d5b3661-3511-4678-943c-310ff6a78cf2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.490686 Jul 18 02:47:18.609438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2673/5436] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:17 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:19.632865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:19.634217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:19.648254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:19.648724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:19.659327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:19.659869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.710280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:20.712629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:20.739687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.740165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:20.744103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:20.744698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:21.140292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:21.176814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:21.189143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:21.191283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d17dbdb2-2d2b-46ea-9c5b-40aefb583325 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.564049 Jul 18 02:47:21.208673 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2764/5437] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:19 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:21.533601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:21.554574 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f98229a1-fb56-4274-97ae-1b0d8c27ca45 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.853903 Jul 18 02:47:21.555233 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2674/5438] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:20 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:21.606687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:21.617676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:21.645018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:21.647077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:21.651210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:21.652212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.216626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:22.222280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:22.245298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:22.245867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.247052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.247799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.248459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.286420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc81af2f-2153-4459-aaaf-67f076f74cd6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.699368 Jul 18 02:47:22.287529 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2765/5439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:21 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:22.318475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:22.320114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:22.344460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.352459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:22.354248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:22.355276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:23.198207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:23.215601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:23.218881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:23.233152 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48b6a0c8-b3a5-42d1-9479-6eab070de705 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.020479 Jul 18 02:47:23.249905 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2675/5440] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:22 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:23.690508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:23.733538 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-309a597a-5e62-4f19-b264-cff46ae48068 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.430608 Jul 18 02:47:23.734621 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2766/5441] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:22 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:23.760520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:23.764565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:23.791543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:23.799570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:23.803902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:23.804775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.274051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:24.277019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:24.286607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.287544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.288655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:24.291280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:24.978834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:24.995362 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3638284e-517e-4a01-a523-81bc3f181e8c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.244019 Jul 18 02:47:24.996912 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2676/5442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:23 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:25.297729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:25.310197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:25.322413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:25.323733 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f51c6a1b-977d-4300-a7ff-a05aecb26ae3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.073622 Jul 18 02:47:25.324463 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2767/5443] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:24 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:25.404963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1521770809", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "72e9a08a-ca51-499a-9658-0d4e3b258016"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:25.590602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] validate_networks() for [('72e9a08a-ca51-499a-9658-0d4e3b258016', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:47:26.363513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:26.364710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:26.396313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.396313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.399226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:26.399226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:26.978685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.014284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.038867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:27.041414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fcb9a16d-d652-44c2-8da2-4967a8839d9c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1744 microversion: 2.20 time: 0.688176 Jul 18 02:47:27.043048 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2768/5444] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:26 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1744 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:28.090742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:28.093310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:28.121750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:28.122835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:28.127757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:28.129053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:28.578488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:28.604690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:28.609805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:28.617033 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fca1a4a5-8bd4-4e65-8ad6-4e41f25f1c70 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1744 microversion: 2.20 time: 0.540020 Jul 18 02:47:28.618858 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2769/5445] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:28 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1744 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:29.127736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:47:29.129175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:47:29.129855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:47:29.130807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:47:29.132963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:47:29.148243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.149275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.150867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.151532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.187832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:47:29.199345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:47:29.224512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:47:29.231583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:47:29.361540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db99e595-9dc3-454f-a7e5-7e4fee27e0ec tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.966432 Jul 18 02:47:29.365493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2677/5446] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:47:29.381431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d769340-559c-4a85-9c21-316129f2f329 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:29.382599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d769340-559c-4a85-9c21-316129f2f329 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:29.592327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d769340-559c-4a85-9c21-316129f2f329 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:29.616386 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d769340-559c-4a85-9c21-316129f2f329 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1215 microversion: 2.1 time: 0.242982 Jul 18 02:47:29.634319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2770/5447] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:29 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:29.653038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:29.654155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:29.679182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.679651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:29.683426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:29.684587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:30.646442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47f44ba5-6ebc-4339-af11-1f664ae7195c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:30.647364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47f44ba5-6ebc-4339-af11-1f664ae7195c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:30.806708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47f44ba5-6ebc-4339-af11-1f664ae7195c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:30.830219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47f44ba5-6ebc-4339-af11-1f664ae7195c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1215 microversion: 2.1 time: 0.185097 Jul 18 02:47:30.830948 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2771/5448] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:30 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:31.300326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:31.319504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:31.322488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:31.338054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a8ac0dc-a240-4951-9586-9f30523e59ec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1744 microversion: 2.20 time: 1.676341 Jul 18 02:47:31.339499 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2678/5449] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:29 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1744 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:31.854141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:31.854974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:31.871597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.873129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:31.878103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:31.878983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.065445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:32.080494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dfb2105e-c599-417b-b0d1-280c8ca4e437 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1267 microversion: 2.1 time: 0.229117 Jul 18 02:47:32.084208 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2772/5450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:31 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:32.372630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:32.374592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:32.421890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:32.430158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:32.431953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:32.438181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:33.108105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:33.109108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:33.130079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:33.131698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:33.133829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:33.134377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:34.340118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:34.348096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:34.375396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:34.377440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13e97fa8-7fbc-4d89-a716-7a75bedae072 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1744 microversion: 2.20 time: 2.012385 Jul 18 02:47:34.398626 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2679/5451] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:32 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1744 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:34.398626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-08c82271-79f4-4990-9385-405235862345 req-ea1561ba-5037-4d03-b77e-3a598006c80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "name": "network-vif-plugged", "status": "completed", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:34.467271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-08c82271-79f4-4990-9385-405235862345 req-ea1561ba-5037-4d03-b77e-3a598006c80a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:34.468149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-08c82271-79f4-4990-9385-405235862345 req-ea1561ba-5037-4d03-b77e-3a598006c80a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:34.569841 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-08c82271-79f4-4990-9385-405235862345 req-ea1561ba-5037-4d03-b77e-3a598006c80a service nova] Creating event network-vif-plugged:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h1-849796-1 Jul 18 02:47:34.630135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-08c82271-79f4-4990-9385-405235862345 req-ea1561ba-5037-4d03-b77e-3a598006c80a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240377 Jul 18 02:47:34.631895 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2680/5452] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:34.960737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:35.009538 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f25f1ff9-4122-43a5-9e31-cd8b471678f5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.904778 Jul 18 02:47:35.010863 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2773/5453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:33 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:35.420345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:35.421283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:35.465044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:35.465877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:35.468427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:35.469410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.047090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:36.050032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:36.109147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.112720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.120639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:36.123129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:36.140642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:36.184033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:36.187401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:36.214243 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27390916-7354-4764-af28-aff0099fc008 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 0.794268 Jul 18 02:47:36.218662 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2681/5454] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:35 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:37.238793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:37.239862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:37.276602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:37.277443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:37.278544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:37.279161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:38.073832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:38.098145 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1f0039fe-6d21-4857-bec5-63399a24c3ea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 2.059303 Jul 18 02:47:38.117147 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2774/5455] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:36 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:39.129174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:39.162117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:39.203846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:39.215089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:39.229050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:39.238316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:39.239483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:39.243813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:39.461660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:39.484096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=61 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:39.511507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:39.515145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:39.524885 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6fb3b6f5-556e-4571-bb77-2d13b7ec3b99 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 2.289893 Jul 18 02:47:39.534210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2682/5456] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:37 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:39.540708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:39.560215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:39.562734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:39.590560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:39.591281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:39.596995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:39.602052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:39.932623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lazy-loading 'services' on Instance uuid cad1087d-2b81-4540-9974-17b2e47bb271 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:47:40.289279 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3aa0441d-1333-499e-8538-34b762aa331d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271/os-volume_attachments/3fb55736-d81a-434e-923d-e2c119bcdd38" status: 202 len: 0 microversion: 2.1 time: 0.752728 Jul 18 02:47:40.305564 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2683/5457] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:47:39 2022] DELETE /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271/os-volume_attachments/3fb55736-d81a-434e-923d-e2c119bcdd38 => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:47:40.566322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:40.567583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:40.621352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.628639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:40.629804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:40.635198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:40.811935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:41.603124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:41.618371 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-304fcd58-7e8f-44d3-bbb4-490639617fa3 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 2.500852 Jul 18 02:47:41.630013 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2775/5458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:39 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 2516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:41.957312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:42.049926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:42.068035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:42.077767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9e14e8b-ebf9-4b3c-b503-74c28d251d84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.516937 Jul 18 02:47:42.090658 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2684/5459] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:40 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:42.641147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:42.643432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:42.712170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:42.713104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:42.716982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:42.729236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.143355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:43.153885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:43.237038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.237995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.249202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.255644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.605799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:43.621327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:43.626355 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eee81424-1c9f-4281-8dbd-e19a70bbd48d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 0.992949 Jul 18 02:47:43.627789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2776/5460] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:42 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:43.638638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c6fce33d-8cc1-4a90-a2a2-7a2846514eb7 req-e63317d5-cdcd-4583-aaba-69614dd1ceea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28daf010-f2af-4494-a9d9-e8f1672bd147", "tag": "3312a9db-c6bb-430e-8bb0-e562159f6a07"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:43.687803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=35 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:43.697650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6fce33d-8cc1-4a90-a2a2-7a2846514eb7 req-e63317d5-cdcd-4583-aaba-69614dd1ceea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:43.699772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6fce33d-8cc1-4a90-a2a2-7a2846514eb7 req-e63317d5-cdcd-4583-aaba-69614dd1ceea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:43.743903 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c6fce33d-8cc1-4a90-a2a2-7a2846514eb7 req-e63317d5-cdcd-4583-aaba-69614dd1ceea service nova] Creating event network-changed:3312a9db-c6bb-430e-8bb0-e562159f6a07 for instance 28daf010-f2af-4494-a9d9-e8f1672bd147 on n-h2-849796-1 Jul 18 02:47:43.761005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c6fce33d-8cc1-4a90-a2a2-7a2846514eb7 req-e63317d5-cdcd-4583-aaba-69614dd1ceea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130600 Jul 18 02:47:43.762493 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2777/5461] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:44.649832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:44.661603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:44.680762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:44.682106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:44.687391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:44.709742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:44.873238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:44.912689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:44.940652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:44.943405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52148241-e423-4a59-b34c-6f1b79408d3d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.824157 Jul 18 02:47:44.952522 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2685/5462] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:43 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:45.986440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:46.009896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:46.034425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:46.034789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:46.046162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:46.046873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:46.559615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:46.626352 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e56f6eac-9027-4ca4-a4ee-02ccf26a2708 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.978968 Jul 18 02:47:46.637043 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2778/5463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:44 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:47.626846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:47.661891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:47.670373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:47.683794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:47.721998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:47.731523 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1d8911ba-a90d-4961-8f23-be18f9f28410 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.765499 Jul 18 02:47:47.734458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:47.744117 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2686/5464] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:45 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:47.745826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:47.751394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:47.759830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:48.767828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:48.768912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:48.819918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:48.820695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:48.838070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:48.851535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:49.016041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:49.033539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b98ddca-d635-433f-9f64-dff652eeab24 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.381418 Jul 18 02:47:49.033539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2779/5465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:47 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:49.755285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:49.801418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:49.808946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:49.820837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7086d06-a468-45a5-a957-94251f4645eb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.061830 Jul 18 02:47:49.834346 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2687/5466] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:48 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:50.064531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:50.065383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:50.078799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.079273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.086166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.086923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.816811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:50.833969 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-403d6e70-aac2-4897-8ec9-820edbc57eb7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 0.774604 Jul 18 02:47:50.835174 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2780/5467] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:50 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:47:50.856742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:50.857977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:50.909521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.913278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:50.925660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:50.926965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.658187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:51.675304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:51.677149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:51.678452 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90f3d2ac-7a93-4d7e-83b5-bbf558849239 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 0.829811 Jul 18 02:47:51.696037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2688/5468] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:50 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:47:51.869477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:51.873189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:51.918583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.929936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:51.931947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:51.938012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:52.726589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:52.727782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:52.753425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:52.754125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:52.757350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:52.758621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:52.866542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:52.876315 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5079998f-224b-41ea-b356-320bfef5c7a4 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.013664 Jul 18 02:47:52.887657 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2781/5469] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:51 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:53.898519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:53.899573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:53.922867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.934203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:53.935260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:53.935737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:54.792328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:54.823954 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f6f76e4-f227-4e89-a6f5-45746d478c31 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 0.930439 Jul 18 02:47:54.845911 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2782/5470] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:53 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:55.842946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:55.845704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:55.864483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:55.867286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:55.870022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:55.881951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.440419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:56.452539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:56.457116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:56.458420 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f615394-819d-4fbc-a9b0-552bf8e1a5fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 3.737389 Jul 18 02:47:56.459057 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2689/5471] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:52 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 3739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:56.479235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:56.489273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:56.510267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:56.511075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.512288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:56.512901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:56.640806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:47:56.993339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ff11df4e-118c-45df-bf15-0e1a712d161d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 204 len: 0 microversion: 2.1 time: 0.520140 Jul 18 02:47:57.000252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2690/5472] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:47:56 2022] DELETE /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:47:57.024623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:57.030699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:57.044095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:57.059630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.060777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:57.062775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.063890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:57.088188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15a03427-2850-442f-b009-a5a195bb9977 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.249614 Jul 18 02:47:57.089746 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2783/5473] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:55 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:57.488510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:57.505042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:57.542624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.544003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:57.550504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:57.551847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.653755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:58.659220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:58.673543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:58.679625 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e01c8860-bc79-4727-b6f3-da3820c62a6d tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1470 microversion: 2.1 time: 1.676571 Jul 18 02:47:58.685631 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2691/5474] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:57 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1470 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:47:58.699816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:47:58.712875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:58.713131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f2aef1a-0151-47ed-91ce-444b1171dabe tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.228884 Jul 18 02:47:58.713965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2784/5475] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:47:57 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:47:58.714878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:58.729695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.730627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.731742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.734243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.752511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-70fc0384-4ec2-499b-ac3a-8d9519abce15 req-92ce0cd3-3513-46a0-b14b-da10b89285ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28daf010-f2af-4494-a9d9-e8f1672bd147", "name": "network-vif-plugged", "status": "completed", "tag": "3312a9db-c6bb-430e-8bb0-e562159f6a07"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:47:58.800317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-70fc0384-4ec2-499b-ac3a-8d9519abce15 req-92ce0cd3-3513-46a0-b14b-da10b89285ef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:58.801170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-70fc0384-4ec2-499b-ac3a-8d9519abce15 req-92ce0cd3-3513-46a0-b14b-da10b89285ef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:58.875692 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-70fc0384-4ec2-499b-ac3a-8d9519abce15 req-92ce0cd3-3513-46a0-b14b-da10b89285ef service nova] Creating event network-vif-plugged:3312a9db-c6bb-430e-8bb0-e562159f6a07 for instance 28daf010-f2af-4494-a9d9-e8f1672bd147 on n-h2-849796-1 Jul 18 02:47:58.925404 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-70fc0384-4ec2-499b-ac3a-8d9519abce15 req-92ce0cd3-3513-46a0-b14b-da10b89285ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209821 Jul 18 02:47:58.929631 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2785/5476] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:47:59.721263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:59.726053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:47:59.794720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:59.796631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:47:59.798293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:47:59.801854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.337660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:00.366019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f55c159-03d1-4a7b-bdc9-35ba548f3064 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1315 microversion: 2.1 time: 1.664788 Jul 18 02:48:00.392122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2692/5477] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:58 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1315 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:00.422042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:00.445553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:00.493811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.494569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.496106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:00.513523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:00.814200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:00.872705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ff23197-ee64-4527-bab4-a7130936dc19 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1470 microversion: 2.1 time: 1.168246 Jul 18 02:48:00.885640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2786/5478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:47:59 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1470 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:00.972779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f3f797e5-d15e-40be-abf1-1d1214056e9c req-acc038e4-20ff-4515-a676-1da8aae51035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad1087d-2b81-4540-9974-17b2e47bb271", "name": "network-vif-deleted", "tag": "4ebcb51a-affe-4e00-a785-004913971e4f"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:01.075711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f3f797e5-d15e-40be-abf1-1d1214056e9c req-acc038e4-20ff-4515-a676-1da8aae51035 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.076387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f3f797e5-d15e-40be-abf1-1d1214056e9c req-acc038e4-20ff-4515-a676-1da8aae51035 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.186987 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f3f797e5-d15e-40be-abf1-1d1214056e9c req-acc038e4-20ff-4515-a676-1da8aae51035 service nova] Creating event network-vif-deleted:4ebcb51a-affe-4e00-a785-004913971e4f for instance cad1087d-2b81-4540-9974-17b2e47bb271 on n-h2-849796-1 Jul 18 02:48:01.208086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f3f797e5-d15e-40be-abf1-1d1214056e9c req-acc038e4-20ff-4515-a676-1da8aae51035 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261854 Jul 18 02:48:01.211584 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2787/5479] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:01.429188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:01.443014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:01.460857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.461362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.462193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:01.462702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:01.957776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.009978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.025790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.029790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfea094e-5c7b-414b-bc14-b71d2026f85e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.625478 Jul 18 02:48:02.037609 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2693/5480] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:00 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:02.072226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:02.074042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.090820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.092297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.094112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.096041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.223272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.224450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.225559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lazy-loading 'fault' on Instance uuid cad1087d-2b81-4540-9974-17b2e47bb271 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:48:02.367199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.399088 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-30a6b11a-aa6a-4714-a2e2-faf922537dea tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1501 microversion: 2.1 time: 0.978956 Jul 18 02:48:02.400208 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2788/5481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:01 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1501 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:02.435864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:02.436908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:02.464092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.464875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.474609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:02.475312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:02.552892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eae632ebcdd4b9f9d19badf51fb362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f18e80df5e42859f42a0f46925716d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:02.587312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-267eae38-74f1-4198-87e3-d2ada3d3eeed tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 200 len: 1304 microversion: 2.1 time: 0.540178 Jul 18 02:48:02.615966 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2694/5482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:02 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 1304 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:03.079782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.093487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.130166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.134157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.140615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.141823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.699980 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.network.security_group_api [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Removing security group 41dcc1ab-0e36-4c62-a74c-1166d3fd1ca1 from port 3312a9db-c6bb-430e-8bb0-e562159f6a07 Jul 18 02:48:03.883600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:03.914258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:03.919739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:03.921756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c986e4e-f0f8-4fa8-8e73-5415ecec1c3c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 0.854106 Jul 18 02:48:03.926863 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2695/5483] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:03 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:03.939133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:03.940223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] [instance: cad1087d-2b81-4540-9974-17b2e47bb271] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:03.969262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.971217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:03.972672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:03.975637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.008743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] HTTP exception thrown: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Request method failure captured: Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 HTTP/1.1 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MkDKplVP-ef-CbMfrzQ4TBeRZZqF2BPx5siDQLOC6c6rqotqhMkozXHjFu4qahM7AnE4c6GSMghTwRWXxfNiH-XcaODWSR0rvKFNAs6w3Lthw2GE4WfmsXntn_SCXxLsJQLVO1H6gweFi5PAKPr0JNaOstI-43qZ-UP5VaDcqT1IsA Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 58f18e80df5e42859f42a0f46925716d Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesBackupsTest-1426436564 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58f18e80df5e42859f42a0f46925716d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58f18e80df5e42859f42a0f46925716d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58f18e80df5e42859f42a0f46925716d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58f18e80df5e42859f42a0f46925716d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesBackupsTest-1426436564 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 58f18e80df5e42859f42a0f46925716d Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesBackupsTest-1426436564 Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesBackupsTest-1426436564-project Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 6eae632ebcdd4b9f9d19badf51fb362d Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesBackupsTest-1426436564-project Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cad1087d-2b81-4540-9974-17b2e47bb271'} Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:04.012578 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:48:04.019032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] Returning 404 to user: Instance cad1087d-2b81-4540-9974-17b2e47bb271 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:04.020846 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-114db85a-4e67-4d61-ac00-367fd3626129 tempest-VolumesBackupsTest-1426436564 tempest-VolumesBackupsTest-1426436564-project] 10.222.0.67 "GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271" status: 404 len: 111 microversion: 2.1 time: 0.089455 Jul 18 02:48:04.023769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2696/5484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:03 2022] GET /compute/v2.1/servers/cad1087d-2b81-4540-9974-17b2e47bb271 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:04.962662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:04.970254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:04.992228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:04.994777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:04.998827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:05.002929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:05.050983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:06.225510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f69a4674-07cc-4a4a-a453-1b98895ff5f7 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147/action" status: 202 len: 0 microversion: 2.1 time: 3.797709 Jul 18 02:48:06.229429 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2789/5485] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:48:02 2022] POST /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147/action => generated 0 bytes in 3800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:48:06.261574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:06.266779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:06.298586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.299059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.299911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.300375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.440715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.459984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.465255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.474140 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90a29577-b35d-4d8d-95ff-ad2f7f4932ce tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.523182 Jul 18 02:48:06.475790 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2697/5486] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:04 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:06.480988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c93b3c13-5df1-4915-8257-cceb07cab5bc req-207a63e1-8907-4a44-9bc3-5b4a89c0bbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28daf010-f2af-4494-a9d9-e8f1672bd147", "tag": "3312a9db-c6bb-430e-8bb0-e562159f6a07"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:06.508943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c93b3c13-5df1-4915-8257-cceb07cab5bc req-207a63e1-8907-4a44-9bc3-5b4a89c0bbc1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.509704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c93b3c13-5df1-4915-8257-cceb07cab5bc req-207a63e1-8907-4a44-9bc3-5b4a89c0bbc1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.547549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c93b3c13-5df1-4915-8257-cceb07cab5bc req-207a63e1-8907-4a44-9bc3-5b4a89c0bbc1 service nova] Creating event network-changed:3312a9db-c6bb-430e-8bb0-e562159f6a07 for instance 28daf010-f2af-4494-a9d9-e8f1672bd147 on n-h2-849796-1 Jul 18 02:48:06.569786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c93b3c13-5df1-4915-8257-cceb07cab5bc req-207a63e1-8907-4a44-9bc3-5b4a89c0bbc1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092436 Jul 18 02:48:06.571134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2698/5487] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:07.002626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:07.036663 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f53f49a5-47b4-4f2e-8112-59291756e03f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1459 microversion: 2.1 time: 0.804864 Jul 18 02:48:07.054334 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2790/5488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:06 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1459 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:07.066296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:07.067035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:07.086238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.098200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.100310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.101579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.515431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:07.518481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:07.543881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.549043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.557291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.558590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:08.018711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:08.093568 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-af4a3036-86ce-4432-9dac-7374c38a0dba tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.029672 Jul 18 02:48:08.118435 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2699/5489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:07 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:08.142810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:08.144634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:08.171596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:08.173102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:08.179212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:08.180626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.080660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.128642 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d0164f90-655e-4944-adfb-279a30b4ba83 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.000248 Jul 18 02:48:09.147280 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2700/5490] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:08 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:09.274105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.322767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.334976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.338471 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0966d018-85a7-4aaf-a4c2-bc03563c49ba tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1739 microversion: 2.20 time: 1.832407 Jul 18 02:48:09.356978 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2791/5491] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:07 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1739 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:09.372413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:09.373094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:09.382020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.382505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.383583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.384083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.574107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-465171e4-34b7-473b-a246-762641b7cb3c tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-315383642", "availability_zone": "foo_zone"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:09.577790 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:09.577790 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:09.582467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.aggregate [None req-465171e4-34b7-473b-a246-762641b7cb3c tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Generated uuid ee4afab8-a929-4fb0-8b0c-789382529d1b for aggregate {{(pid=119440) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 18 02:48:09.643085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:09.663092 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-465171e4-34b7-473b-a246-762641b7cb3c tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.513609 Jul 18 02:48:09.663712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2701/5492] 10.222.0.67 () {60 vars in 1163 bytes} [Mon Jul 18 02:48:09 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:09.676357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64bec367-a601-4e27-920a-184c4dd0bc44 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:09.681579 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:09.681579 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:09.729607 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64bec367-a601-4e27-920a-184c4dd0bc44 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.058129 Jul 18 02:48:09.731183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2702/5493] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:48:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:09.746417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:09.749451 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:09.749451 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:09.752691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.755334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.756954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.757699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.806126 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b78d1f0-ee8d-4721-963b-bf5e399d5826 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063799 Jul 18 02:48:09.820880 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2703/5494] 10.222.0.67 () {58 vars in 1175 bytes} [Mon Jul 18 02:48:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:09.837459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6392092c-ccdd-49b4-8069-7f1d555a2793 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:09.838762 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:09.838762 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:09.856843 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6392092c-ccdd-49b4-8069-7f1d555a2793 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.023941 Jul 18 02:48:09.857862 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2704/5495] 10.222.0.67 () {58 vars in 1142 bytes} [Mon Jul 18 02:48:09 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:09.876495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16ebcf2d-4321-4739-8441-a323b1badca7 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:09.878547 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:09.878547 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:09.933598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16ebcf2d-4321-4739-8441-a323b1badca7 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.934067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16ebcf2d-4321-4739-8441-a323b1badca7 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.038752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:10.069166 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c392283b-9dcd-4bc8-a86d-60d3bfa6cde6 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.686583 Jul 18 02:48:10.072259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2792/5496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:09 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:10.101583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:10.102381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:10.129368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.146319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.148441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.149937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.780130 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16ebcf2d-4321-4739-8441-a323b1badca7 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.908420 Jul 18 02:48:10.784681 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2705/5497] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:48:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:10.799645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:10.800854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:10.831142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.832877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:10.834116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:10.836774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:11.151206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:11.164843 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-671009c6-6b68-4035-af1f-6f47a5f02c52 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.067344 Jul 18 02:48:11.171448 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2793/5498] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:10 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:11.189172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68cb31c2-0abc-416b-a967-19644735aada tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:11.192780 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:11.192780 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:48:11.213254 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68cb31c2-0abc-416b-a967-19644735aada tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.038860 Jul 18 02:48:11.216341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2794/5499] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:48:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:11.232836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a2640f4-6d21-4211-b5f1-9dc43d275175 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-916251356", "availability_zone": "foo_zone"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:11.449959 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:11.449959 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 02:48:11.685137 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a2640f4-6d21-4211-b5f1-9dc43d275175 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.448704 Jul 18 02:48:11.686522 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2795/5500] 10.222.0.67 () {60 vars in 1172 bytes} [Mon Jul 18 02:48:11 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:11.706322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-915965430", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "72e9a08a-ca51-499a-9658-0d4e3b258016"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:11.861783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:11.919445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] validate_networks() for [('72e9a08a-ca51-499a-9658-0d4e3b258016', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:11.931743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:11.947626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:11.959632 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7fd6cf60-d5b8-4053-b5ac-eadcd89f9d28 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1743 microversion: 2.20 time: 1.170105 Jul 18 02:48:11.985065 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2706/5501] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:10 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1743 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:12.020308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3663a717-6b69-4531-92ed-b6858b33b2f3 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:12.046434 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:12.046434 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:12.151019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3663a717-6b69-4531-92ed-b6858b33b2f3 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.162577 Jul 18 02:48:12.152553 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2707/5502] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:48:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:12.165899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:12.166683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:12.182141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:12.182769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:12.183756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:12.184538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:12.279903 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84d65807-c848-4885-b0b4-ca0545eed02c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/ips" status: 200 len: 147 microversion: 2.1 time: 0.125871 Jul 18 02:48:12.283095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2708/5503] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:48:12 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/ips => generated 147 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:12.294582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1bd6fe2-fd8a-412d-ad89-742abc8fbcf1 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:12.295458 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:12.295458 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:12.316471 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1bd6fe2-fd8a-412d-ad89-742abc8fbcf1 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.029075 Jul 18 02:48:12.317912 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2709/5504] 10.222.0.67 () {58 vars in 1151 bytes} [Mon Jul 18 02:48:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:12.333724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d26320d0-5a6f-46ec-8d7a-e6595739c7d0 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-849796-1"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:12.335620 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:12.335620 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:12.348972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d26320d0-5a6f-46ec-8d7a-e6595739c7d0 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:12.349816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d26320d0-5a6f-46ec-8d7a-e6595739c7d0 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:12.639435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d26320d0-5a6f-46ec-8d7a-e6595739c7d0 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.311685 Jul 18 02:48:12.644773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2710/5505] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Jul 18 02:48:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:12.669677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33c8bfc5-a09d-4d89-af0b-9dae8e60a191 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:12.674244 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:48:12.674244 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 02:48:12.778592 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33c8bfc5-a09d-4d89-af0b-9dae8e60a191 tempest-TestAggregatesBasicOps-1562403367 tempest-TestAggregatesBasicOps-1562403367-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.121561 Jul 18 02:48:12.786366 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2711/5506] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Jul 18 02:48:12 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 18 02:48:13.010178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:13.014591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:13.043585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.046444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:13.050607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:13.055457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:14.641125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:14.642768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:14.643718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:14.644559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:14.645400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:14.661362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:14.727498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:14.728345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:14.729969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:14.730778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:14.790309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=90 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:14.851946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:14.862439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Getting quotas for user 44a582cb21c54c7496b30998ab940b1c and project 266d7b33bab74d78abb11eafbbdc6842. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:14.920036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:14.945886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:15.088671 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-228f15a7-ef7f-423d-8c84-b6f5e610dfc2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.400805 Jul 18 02:48:15.089566 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2796/5507] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:15.105385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af707365-c705-4a16-9d15-5147f5888752 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:15.106507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af707365-c705-4a16-9d15-5147f5888752 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:15.325691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:15.381391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:15.383373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:15.385048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ab37ba9-5302-4e93-a209-02c9d3e16bc7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1721 microversion: 2.20 time: 2.390914 Jul 18 02:48:15.386254 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2712/5508] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:12 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1721 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:48:15.414930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af707365-c705-4a16-9d15-5147f5888752 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:15.423609 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af707365-c705-4a16-9d15-5147f5888752 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1214 microversion: 2.1 time: 0.326198 Jul 18 02:48:15.431272 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2797/5509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:15 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:15.644027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "becd793c-f2e4-481e-81f2-d2a9b105687a"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:15.648917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:15.690880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:15.693305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:15.699273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:15.704380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:16.416484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:16.418923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:16.433933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:16.434840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:16.435883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:16.436549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:16.452956 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0054886a-9d9b-4064-b66a-19b40c01aeec tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813812 Jul 18 02:48:16.455671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2713/5510] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:48:15 2022] POST /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:16.515442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-199036b8-1905-4edd-b777-af1ec6bd9d07 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:16.526580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-199036b8-1905-4edd-b777-af1ec6bd9d07 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:17.020220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-199036b8-1905-4edd-b777-af1ec6bd9d07 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:17.042917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-199036b8-1905-4edd-b777-af1ec6bd9d07 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1214 microversion: 2.1 time: 0.583071 Jul 18 02:48:17.043750 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2714/5511] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:16 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1214 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:17.914709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0b513662-aa59-4b61-bf8a-098f9e224c47 req-39d28bfd-5bf8-4a18-afda-adc2e207c340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "name": "network-vif-unplugged", "status": "completed", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:17.956687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0b513662-aa59-4b61-bf8a-098f9e224c47 req-39d28bfd-5bf8-4a18-afda-adc2e207c340 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:17.957185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0b513662-aa59-4b61-bf8a-098f9e224c47 req-39d28bfd-5bf8-4a18-afda-adc2e207c340 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:18.006251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0b513662-aa59-4b61-bf8a-098f9e224c47 req-39d28bfd-5bf8-4a18-afda-adc2e207c340 service nova] Creating event network-vif-unplugged:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h1-849796-1 Jul 18 02:48:18.026467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0b513662-aa59-4b61-bf8a-098f9e224c47 req-39d28bfd-5bf8-4a18-afda-adc2e207c340 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.959590 Jul 18 02:48:18.027191 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2715/5512] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:18.075925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:18.076833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:18.105963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:18.106514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:18.107797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:18.111456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:18.319300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:18.355810 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7df9cbe4-68b8-4d4c-a7c0-8643f12a6507 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1266 microversion: 2.1 time: 0.279233 Jul 18 02:48:18.358146 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2716/5513] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:18 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:19.020022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:19.090822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:19.095960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:19.113852 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e72fb64c-41d6-4f45-989c-0b0dd1f34983 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1721 microversion: 2.20 time: 2.702456 Jul 18 02:48:19.115426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2798/5514] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:16 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1721 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:19.378613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:19.379410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:19.397133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:19.398001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:19.399152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:19.400002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:19.641232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:19.655652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e1c127a-2f53-472f-94f8-aef6b5ee2e59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1266 microversion: 2.1 time: 0.282844 Jul 18 02:48:19.656473 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2717/5515] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:19 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:20.151954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:20.154762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:20.233759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.239778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:20.249617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.258216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:20.689433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:20.691103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:20.693880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:20.710125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.711446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:20.713299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.715222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:20.892452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:20.904313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:20.915881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:20.917864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ee6a6e2-208b-44ff-8b15-08b9d7bacab2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1724 microversion: 2.20 time: 0.787194 Jul 18 02:48:20.931150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2799/5516] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:20 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1724 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:20.937815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b6dfad9-fc84-4594-bf7a-535ec66e3886"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:20.939425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:20.957578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.958378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:20.959734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:20.960088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:21.494731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:21.514088 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e1d15fe-daf2-45f2-afaf-4509ad40b8de tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1272 microversion: 2.1 time: 0.829150 Jul 18 02:48:21.520266 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2718/5517] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:20 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1272 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:21.926084 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-132b6ed0-394c-44a2-9bf0-5a06073159b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.992930 Jul 18 02:48:21.927203 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2800/5518] 10.222.0.67 () {62 vars in 1363 bytes} [Mon Jul 18 02:48:20 2022] POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 188 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:48:22.235853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:22.240338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:22.276669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:22.279900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:22.285030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:22.287517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:22.549668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:22.555264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:22.594839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:22.602330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:22.614503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:22.615659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:23.086444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84082142-045a-4d14-8530-fe5081a2fc44 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/action" status: 202 len: 0 microversion: 2.20 time: 0.859086 Jul 18 02:48:23.092773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:23.098607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2719/5519] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:48:22 2022] POST /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/action => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:48:23.127442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:23.130398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:23.143748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5e159e2-b3f8-446e-9d04-4dd8fb52df49 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1272 microversion: 2.1 time: 0.601742 Jul 18 02:48:23.157531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:23.165581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:23.166658 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2801/5520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:22 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1272 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:23.170488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:23.171384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:24.166977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:24.168899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:24.189475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:24.190833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:24.194207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:24.196144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:24.755615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:24.790443 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-118491d1-2b15-40f7-8921-829684fcc398 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1272 microversion: 2.1 time: 0.624885 Jul 18 02:48:24.791165 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2802/5521] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:24 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1272 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:24.896647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:24.927515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:24.944295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:24.947413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11f7b3df-0f86-40aa-834b-912de1168ff7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1750 microversion: 2.20 time: 1.846439 Jul 18 02:48:24.949761 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2720/5522] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:23 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1750 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:25.808070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:25.811709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:25.818624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:25.825977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:25.861954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:25.864257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:25.865421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:25.876099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:25.985816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:25.987461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:26.045355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:26.052133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:26.053518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:26.055125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:27.033654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:27.549778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:27.596651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:27.630089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:27.643935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:27.663244 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9cd7efab-eb60-4ce3-85d6-5d2e4413dc78 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1750 microversion: 2.20 time: 1.680172 Jul 18 02:48:27.665987 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2721/5523] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:25 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1750 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:48:28.082251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:28.099861 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fffbf890-5e4e-4977-932f-376cc3505ca8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 2.295753 Jul 18 02:48:28.112966 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2803/5524] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:25 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:28.691123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:28.704141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:28.747113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:28.752346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:28.758787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:28.760731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:29.136244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:29.143336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:29.212572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:29.214079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:29.220071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:29.223945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:29.758491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:29.839112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:29.853384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:29.867802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14d27e03-d3d1-484b-ad43-3921dc7f53f2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1752 microversion: 2.20 time: 1.186407 Jul 18 02:48:29.889986 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2722/5525] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:28 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1752 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:30.609913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6c2a8c44-fd7c-4ea1-acb7-05182d1a4abf req-2a19bb2e-2c5b-4530-8cbe-7b505042e6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9914ba66-82ac-43af-9d22-4128b678f0f2", "tag": "cb3776b0-7724-4ec1-8365-b192f63dd0d1"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:30.681423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c2a8c44-fd7c-4ea1-acb7-05182d1a4abf req-2a19bb2e-2c5b-4530-8cbe-7b505042e6bb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:30.682021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c2a8c44-fd7c-4ea1-acb7-05182d1a4abf req-2a19bb2e-2c5b-4530-8cbe-7b505042e6bb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:30.731792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6c2a8c44-fd7c-4ea1-acb7-05182d1a4abf req-2a19bb2e-2c5b-4530-8cbe-7b505042e6bb service nova] Creating event network-changed:cb3776b0-7724-4ec1-8365-b192f63dd0d1 for instance 9914ba66-82ac-43af-9d22-4128b678f0f2 on n-h1-849796-1 Jul 18 02:48:30.755177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6c2a8c44-fd7c-4ea1-acb7-05182d1a4abf req-2a19bb2e-2c5b-4530-8cbe-7b505042e6bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401554 Jul 18 02:48:30.759404 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2723/5526] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:30.910200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:30.911547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:30.938086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:30.941703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:30.950222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:30.951490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:31.785924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:31.797904 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88f1b985-1321-4632-a56e-40138aad42eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 2.673145 Jul 18 02:48:31.801002 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2804/5527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:29 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:32.830930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:32.845774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:32.872180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.873046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:32.874087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:32.878087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:33.228467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:33.324271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:33.336261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:33.345252 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e33a6220-c171-440e-bae6-bacac79483ab tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1752 microversion: 2.20 time: 2.440754 Jul 18 02:48:33.363929 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2724/5528] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:30 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1752 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:34.047184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:34.111855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75affccd-2728-422c-8b28-fee4ceaf8f20 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 1.295197 Jul 18 02:48:34.117985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2805/5529] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:32 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:34.385460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:34.391561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:34.449308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:34.454517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:34.457282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:34.465172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:35.148293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:35.149736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:35.176429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:35.177773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:35.197936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:35.201857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:36.096741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.100038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.114560 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90dda33e-4230-4b65-8fdd-98e0054ab6cc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.971571 Jul 18 02:48:36.119454 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2806/5530] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:35 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:36.138373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.149687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:36.154471 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d230d996-0f06-48b3-af0b-7b8d3a265ca3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1752 microversion: 2.20 time: 1.775831 Jul 18 02:48:36.155948 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2725/5531] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:34 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1752 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:37.137481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:37.139269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:37.167107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.173161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.177809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.196458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.205862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:37.221176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:37.259221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.259678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.276748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:37.280465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:37.917248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:37.970867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fa80d22-2ec0-4ccc-8edb-f471fbbea73c tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.833623 Jul 18 02:48:37.992799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2807/5532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:37 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:38.276366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f601996a-946b-4bf1-8d23-d0b8d77bfa49 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: .version_select at 0x7fab0597bb80>, body: {"keypair": {"name": "tempest-keypair-345116562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7QyesqbcNvluVChmtl3eTGijbSQXwASg3JMv6FbvWAs+nVqqr9IM8FpzXuhfcDZsjP9QhtlWztI+Bgz3i/GUxqvlYo5Xwhr3Si8K6sZNExgygmzNTwKVt0JA0U6faGLw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:38.347769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f601996a-946b-4bf1-8d23-d0b8d77bfa49 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:38.362026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f601996a-946b-4bf1-8d23-d0b8d77bfa49 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:38.410587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f601996a-946b-4bf1-8d23-d0b8d77bfa49 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151340 Jul 18 02:48:38.414157 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2808/5533] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:48:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:39.017160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:39.025627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:39.047376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:39.059929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:39.062016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:39.069144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:39.774755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:39.807549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58da813a-ae71-49a7-851a-66b751f7e667 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.800855 Jul 18 02:48:39.810117 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2809/5534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:38 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:39.914295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:39.943394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:39.950238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:39.958003 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3db7fd0e-370d-4698-8b87-cd94b156eda0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1752 microversion: 2.20 time: 2.774624 Jul 18 02:48:39.960251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2726/5535] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:37 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1752 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:40.835503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:40.836426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:40.852323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:40.853381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:40.854623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:40.855449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:41.001025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:41.002424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:41.007586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:41.040536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:41.041390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:41.047039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:41.050197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:41.403362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:41.435899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f1de90eb-5373-4dd2-b361-4a60edbbe536 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.603595 Jul 18 02:48:41.438384 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2810/5536] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:40 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:42.374105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b63c7601-2e0f-4781-9e03-a41da127ac68 req-427fdf72-a642-461c-b31e-6730ab5ed31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9914ba66-82ac-43af-9d22-4128b678f0f2", "name": "network-vif-plugged", "status": "completed", "tag": "cb3776b0-7724-4ec1-8365-b192f63dd0d1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:42.401902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b63c7601-2e0f-4781-9e03-a41da127ac68 req-427fdf72-a642-461c-b31e-6730ab5ed31e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.403129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b63c7601-2e0f-4781-9e03-a41da127ac68 req-427fdf72-a642-461c-b31e-6730ab5ed31e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.448667 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b63c7601-2e0f-4781-9e03-a41da127ac68 req-427fdf72-a642-461c-b31e-6730ab5ed31e service nova] Creating event network-vif-plugged:cb3776b0-7724-4ec1-8365-b192f63dd0d1 for instance 9914ba66-82ac-43af-9d22-4128b678f0f2 on n-h1-849796-1 Jul 18 02:48:42.464876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b63c7601-2e0f-4781-9e03-a41da127ac68 req-427fdf72-a642-461c-b31e-6730ab5ed31e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097744 Jul 18 02:48:42.467645 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2811/5537] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:48:42.516032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:42.526208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:42.568334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.579837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:42.580696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:42.583880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:43.048265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:43.061793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:43.079234 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d77304e-bd31-4bc9-8859-fc9a371e65a5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.609039 Jul 18 02:48:43.090602 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2812/5538] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:42 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:43.121561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:43.123898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:43.126257 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38cfcca3-54e9-46ae-9fe9-e70421a9c227 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1752 microversion: 2.20 time: 2.136574 Jul 18 02:48:43.129242 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2727/5539] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:40 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1752 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:48:44.106321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:44.107461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:44.140223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.141200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.142652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.143460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.167644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:44.169145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:44.180448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.184588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.190383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:44.193550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:44.194063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:44.923854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:44.981846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:44.989722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:44.993603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36832b63-a50c-468e-9ba0-bf30ded4d838 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.832473 Jul 18 02:48:44.995640 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2728/5540] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:44 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:45.003231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:45.035543 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3eecf5d2-c49a-494b-b0a7-b73bf89e6246 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1314 microversion: 2.1 time: 0.938898 Jul 18 02:48:45.037387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2813/5541] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:44 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:46.026193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:46.027102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:46.054483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:46.055874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:46.066843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.068193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.070799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.073162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:46.074296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.084721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.094368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.095695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:46.096417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:46.971121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:47.009573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f49027b-b11b-4248-83a8-6fa8ce65ac77 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1500 microversion: 2.1 time: 0.958894 Jul 18 02:48:47.010759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2814/5542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:46 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1500 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:47.035245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-666701935", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcc90fc-3273-454a-b817-89f60dcb357d"}], "security_groups": [{"name": "tempest-securitygroup--1411680607"}], "key_name": "tempest-keypair-345116562", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:47.735172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] validate_networks() for [('9fcc90fc-3273-454a-b817-89f60dcb357d', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:48:48.190000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:48.240037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:48.242128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:48.243796 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db5827e6-3b31-4d5b-9f3f-20af38d8c316 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.221757 Jul 18 02:48:48.246034 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2729/5543] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:46 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:48.253631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:48.254568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:48.265194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.266074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.267352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.268893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.379593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:48.411638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8dc63755-f280-42e1-8dc9-586df6074ff8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2/action" status: 202 len: 0 microversion: 2.1 time: 0.163836 Jul 18 02:48:48.412706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2730/5544] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:48:48 2022] POST /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:48:48.431701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:48.432693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:48.447607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.452512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:48.453961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:48.455748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:49.701046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:49.721672 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8435eb96-9a0b-4df1-b84f-d1accf8a8364 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1505 microversion: 2.1 time: 1.294151 Jul 18 02:48:49.723824 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2731/5545] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:48 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1505 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:50.242742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6c2529ad-014c-45db-886a-1bab4f903994 req-7e333f76-f8c5-4789-9142-25e999fefc6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:50.299923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c2529ad-014c-45db-886a-1bab4f903994 req-7e333f76-f8c5-4789-9142-25e999fefc6b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.301379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c2529ad-014c-45db-886a-1bab4f903994 req-7e333f76-f8c5-4789-9142-25e999fefc6b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.327781 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6c2529ad-014c-45db-886a-1bab4f903994 req-7e333f76-f8c5-4789-9142-25e999fefc6b service nova] Creating event network-changed:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h2-849796-1 Jul 18 02:48:50.340843 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6c2529ad-014c-45db-886a-1bab4f903994 req-7e333f76-f8c5-4789-9142-25e999fefc6b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.614142 Jul 18 02:48:50.341879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2732/5546] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:50.350020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:50.351028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:50.368701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:48:50.371799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:48:50.373530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:48:50.374377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:48:50.375152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:48:50.382557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.391401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.392760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.401804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.407116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.408534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.411106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.412232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.464228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:48:50.489369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:48:50.555582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:48:50.574014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:48:50.806646 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b5fa378-5220-47e9-979b-d4d63478b968 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.790923 Jul 18 02:48:50.816909 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2815/5547] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:48:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 3797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:48:50.829236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:50.831495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:50.846654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.848244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:50.850383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:50.851807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:51.007637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:51.029698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:51.037743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:51.049173 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5a914b69-7168-43a2-a89f-a71f01a58b4d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.700746 Jul 18 02:48:51.051076 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2733/5548] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:50 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:48:51.072154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ab24306-c1cb-4e58-b01e-3b2c775d0273 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:51.072786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ab24306-c1cb-4e58-b01e-3b2c775d0273 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:51.280315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ab24306-c1cb-4e58-b01e-3b2c775d0273 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:51.289659 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ab24306-c1cb-4e58-b01e-3b2c775d0273 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1240 microversion: 2.1 time: 0.237144 Jul 18 02:48:51.295848 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2734/5549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:51 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1240 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:52.099046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:52.102885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:52.127934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:52.161800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:52.163117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:52.168233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:52.172001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:52.189719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59676a83-a350-4038-bf03-5fb7131058bf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1485 microversion: 2.1 time: 1.353213 Jul 18 02:48:52.190994 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2816/5550] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:50 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1485 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:52.229077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:52.232539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:52.328104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:52.340096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:52.347338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:52.348193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:52.599234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lazy-loading 'flavor' on Instance uuid 9914ba66-82ac-43af-9d22-4128b678f0f2 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:48:53.786310 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22e3e7cd-2a19-448c-be9d-e4a2e8e336fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2/action" status: 202 len: 0 microversion: 2.1 time: 1.564606 Jul 18 02:48:53.789002 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2817/5551] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:48:52 2022] POST /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2/action => generated 0 bytes in 1568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:48:53.802539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:53.803323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:53.824655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.829273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:53.830461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:53.830936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:54.327313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:54.375045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:54.405435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:54.407389 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b09d592-734e-49f4-bbfd-f915d9f0768c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.326920 Jul 18 02:48:54.408602 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2735/5552] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:52 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:48:54.414028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:54.415124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:54.436213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:54.437802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:54.439460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:54.440180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:54.683458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:54.715129 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7cdda047-24d9-46e6-af35-8788beb03337 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1292 microversion: 2.1 time: 0.922505 Jul 18 02:48:54.720382 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2818/5553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:53 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1292 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:55.443291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:55.444034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:55.472348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:55.473011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:55.474135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:55.474607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:56.863306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:56.906610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e231061a-2de3-43af-bfbb-e18ad521bbc1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1491 microversion: 2.1 time: 2.493101 Jul 18 02:48:56.929386 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2736/5554] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:54 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1491 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:56.961891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:56.966437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:56.996644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:57.000816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:57.003250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:57.007394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:57.520486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:57.545505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:57.563314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:57.566925 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1764595d-02c9-4324-90c5-43e316addf40 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1298 microversion: 2.1 time: 0.634551 Jul 18 02:48:57.572423 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2737/5555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:56 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1298 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:57.576022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:57.589948 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fe7fc02-2660-4ad4-93ad-64964d6ecdc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.148588 Jul 18 02:48:57.597785 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2819/5556] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:55 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:48:57.954600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:57.964663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:58.004363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.018440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.019980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.021138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.595848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:58.599193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:58.638671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.640016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:58.642342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:58.645834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.598583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:59.603124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:59.621324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6e358d33-6759-48b7-87b0-ea5fc55db920 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1512 microversion: 2.1 time: 1.679406 Jul 18 02:48:59.622538 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2738/5557] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:57 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1512 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:59.629638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:59.630989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:59.657962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.662772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:59.667982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:59.670022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:00.437245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:00.515568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:00.589654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:00.643709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:00.672557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:00.675599 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a01eee5-6f5e-47fe-8246-27f45b696165 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.051131 Jul 18 02:49:00.683711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2739/5558] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:48:59 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:00.708740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:00.716039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:00.747554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:00.749258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:00.755032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:00.755926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.268436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:01.283434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9eb2aeca-74cc-41aa-96d8-7905f21954bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 2.692894 Jul 18 02:49:01.288379 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2820/5559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:58 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 2700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:01.303858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:01.643431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b677cafd-d7ad-4a15-8510-a2ad696b31b9 req-7be22045-daab-4bb9-853e-3c04dcb42568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9914ba66-82ac-43af-9d22-4128b678f0f2", "name": "network-vif-plugged", "status": "completed", "tag": "cb3776b0-7724-4ec1-8365-b192f63dd0d1"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:01.710957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b677cafd-d7ad-4a15-8510-a2ad696b31b9 req-7be22045-daab-4bb9-853e-3c04dcb42568 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.712467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b677cafd-d7ad-4a15-8510-a2ad696b31b9 req-7be22045-daab-4bb9-853e-3c04dcb42568 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.788181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b677cafd-d7ad-4a15-8510-a2ad696b31b9 req-7be22045-daab-4bb9-853e-3c04dcb42568 service nova] Creating event network-vif-plugged:cb3776b0-7724-4ec1-8365-b192f63dd0d1 for instance 9914ba66-82ac-43af-9d22-4128b678f0f2 on n-h1-849796-1 Jul 18 02:49:01.809063 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b677cafd-d7ad-4a15-8510-a2ad696b31b9 req-7be22045-daab-4bb9-853e-3c04dcb42568 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183836 Jul 18 02:49:01.815664 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2821/5560] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:49:01.860339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:01.866278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:01.938008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.942124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:01.955208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:01.963783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:02.159968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:02.215255 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dae03e5-ec57-4523-b9b1-a96e702109d0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1512 microversion: 2.1 time: 1.513622 Jul 18 02:49:02.226376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2740/5561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:00 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1512 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:02.331240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:02.343501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:02.427987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.439149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:02.447772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:02.453955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.421262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:03.433100 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c623baa-4897-414b-aebb-887750e58757 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.111392 Jul 18 02:49:03.456392 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2741/5562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:02 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:03.473861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:03.479933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:03.513928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:03.519234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.521961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:03.529166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:03.979951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:04.010838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:04.012800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:04.022173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62e67e2a-b03c-4fc5-8268-beddf5fc29fc tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.199483 Jul 18 02:49:04.025545 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2822/5563] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:01 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:04.479226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:04.482114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:04.526555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.531698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:04.536353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:04.537452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.765677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:05.834853 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c43c7a5f-8bb2-4ec1-99da-ff173924bd8f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 2.372966 Jul 18 02:49:05.840215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2742/5564] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:03 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:05.907548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:05.914004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:05.966273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.974431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:05.981331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:05.987442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:07.037581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:07.084680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:07.099102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:07.103890 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb7037d2-922c-448b-b71f-7b9c0bbbf427 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.261960 Jul 18 02:49:07.115962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2743/5565] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:05 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:07.124816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:07.136825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:07.163007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:07.166438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:07.171405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:07.172572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.005526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:08.026937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fb7c1a4-9874-4077-be18-46224934595f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 3.552141 Jul 18 02:49:08.029205 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2823/5566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:04 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 3555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:08.082394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-734a5d9b-b961-4774-a790-1a7a81a61ae6 req-8970525e-69f2-4fd1-8f96-8ae1043f9146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec163ca3-3477-45e6-b206-9dc0d96c191a", "tag": "71dfd282-07ca-4ea4-9c02-d62c6745dabb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:08.157627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-734a5d9b-b961-4774-a790-1a7a81a61ae6 req-8970525e-69f2-4fd1-8f96-8ae1043f9146 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.178665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-734a5d9b-b961-4774-a790-1a7a81a61ae6 req-8970525e-69f2-4fd1-8f96-8ae1043f9146 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.240458 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-734a5d9b-b961-4774-a790-1a7a81a61ae6 req-8970525e-69f2-4fd1-8f96-8ae1043f9146 service nova] Creating event network-changed:71dfd282-07ca-4ea4-9c02-d62c6745dabb for instance ec163ca3-3477-45e6-b206-9dc0d96c191a on n-h2-849796-1 Jul 18 02:49:08.263236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-734a5d9b-b961-4774-a790-1a7a81a61ae6 req-8970525e-69f2-4fd1-8f96-8ae1043f9146 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231175 Jul 18 02:49:08.265162 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2824/5567] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:08.284120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:08.285675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:08.305625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.306453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:08.312214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:08.315202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:09.005494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:09.044778 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fa0f22c0-60b6-470f-bb7f-177165165a6f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.926479 Jul 18 02:49:09.076198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2744/5568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:07 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:09.090499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:09.091484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:09.109100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:09.110126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:09.111140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:09.111791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.063739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:10.078307 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fdee5b3a-f372-48d7-ba54-0995b85c75d9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.000467 Jul 18 02:49:10.081004 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2745/5569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:09 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:10.112115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:10.114974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:10.120746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:10.148284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.151796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.155446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:10.162011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:10.179562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:10.203380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:10.216166 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c967033c-6eb9-4a77-9c5d-d4d3f60b8ecb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.937783 Jul 18 02:49:10.218354 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2825/5570] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:08 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:11.118590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:11.119625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:11.207027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.214569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.218515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.224541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.857686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:11.882973 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0e7aff9-530e-48b4-9b67-11b74b12595b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.778098 Jul 18 02:49:11.894966 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2746/5571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:10 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:11.916350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:11.919008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:11.927856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=42 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:11.965848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.978504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:11.983320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:11.984612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.534325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:12.575605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6edd83d2-9e16-467f-b8c4-6a3db69107cc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.466111 Jul 18 02:49:12.599113 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2826/5572] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:11 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:12.902255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:12.930551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:12.932845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:12.934816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:12.934977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:12.942319 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cc0d0a9-c73d-4b6b-b8c9-2b31933768ac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.039129 Jul 18 02:49:12.959881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2747/5573] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:11 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:12.971105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.974881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:12.981889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:12.989276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:13.615099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:13.617219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:13.699742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:13.719330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:13.726504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:13.730321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.099038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.117314 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df4b4b91-fdb0-461e-85b9-1bf8c4d95fe0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.190380 Jul 18 02:49:14.129322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2827/5574] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:12 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:14.143835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:14.150431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:14.180487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:14.193285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.197939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:14.201277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:14.293335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:14.753831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.780396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.783759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:14.790513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b6b794a-3878-42c4-9227-3bc15d953bac tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.659682 Jul 18 02:49:14.798315 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2828/5575] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:14 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:15.136485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:15.138053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:15.168561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.174541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:15.175856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:15.183754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:16.250982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:16.470433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:16.498181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a93d95b9-3a13-4f6f-ae11-cf44e10833bc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 2.894720 Jul 18 02:49:16.515614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2748/5576] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:13 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:16.523570 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db6ff6e5-9adb-4880-a16e-cde5f8d665ef tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.382222 Jul 18 02:49:16.533434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2829/5577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:15 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:16.556167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:16.558806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:16.597072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.598086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:16.598947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:16.599401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.533440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:17.535636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:17.551322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:17.553378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.555682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.558595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.559376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.959270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:17.969343 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ba8d9c2-ee72-494e-9974-c8fb65d31f05 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 0.440259 Jul 18 02:49:17.970672 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2830/5578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:17 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:17.976280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:17.977356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:17.986624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.987507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:17.988790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:17.989840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:18.117312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:18.167251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:18.171445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:18.178488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21acb7c0-2d21-49ad-86d2-5067795f824d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.660020 Jul 18 02:49:18.184235 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2749/5579] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:16 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:19.010781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:19.012387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:19.037549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.040103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.041916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.048112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.619395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:19.641413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c33114e-8825-4cb5-8480-f59e34e4fc43 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.666399 Jul 18 02:49:19.644629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2831/5580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:17 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:19.662877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:19.665426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:19.707008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.708756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.715114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:19.717970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:19.736838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:19.745481 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-83ee7ff4-7f8b-478b-a428-42e79b157515 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 0.750818 Jul 18 02:49:19.762866 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2750/5581] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:18 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:20.673915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:20.678011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:20.702216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.711087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:20.712357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:20.715945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.335503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.368736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.371337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.375391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa82c32d-80bb-4373-874f-5d32d951f769 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.723027 Jul 18 02:49:22.390187 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2832/5582] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:19 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:22.392440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:22.401079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:22.424137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.424624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.425516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:22.425976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:22.767804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:22.787821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56ece7a2-311e-402d-b546-a2dddab9309a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 2.119404 Jul 18 02:49:22.793159 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2751/5583] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:20 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:23.231682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:23.273841 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8eab9d12-0343-40e1-b23b-9f58139feadc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 0.894755 Jul 18 02:49:23.289941 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2833/5584] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:22 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:23.414905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:23.416024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:23.440619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.442136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.444415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.449937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.853152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:23.854675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:23.921648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.922624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:23.924200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:23.925079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.037019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.064885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.079985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.081323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40c3a8a6-acc7-427f-a210-4168552da30b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.674700 Jul 18 02:49:25.081942 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2752/5585] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:23 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:25.102417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:25.103056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:25.120751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.127003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.127965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:25.128443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:25.330455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:25.351120 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7aeb2c57-cf23-48b0-bf0a-506fde5afd3e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.532873 Jul 18 02:49:25.356419 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2834/5586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:23 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:26.115242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:26.116022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:26.147240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.149157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.150678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.159437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.383435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:26.452617 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d30d690d-3651-42dc-8c90-3b8a8551890d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.362575 Jul 18 02:49:26.470259 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2753/5587] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:25 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:26.483240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:26.484590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:26.569492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.584162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:26.601549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:26.602131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.015358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:28.054966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b58d2ade-44e0-4d47-88d1-ddb13ba4a13a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1507 microversion: 2.1 time: 1.582204 Jul 18 02:49:28.087221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2754/5588] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:26 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1507 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:28.114427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b0ab8328-30ea-49f2-a8c0-dca3641dfb8b req-dabf134d-64c9-451a-b36e-e143d2c4729f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec163ca3-3477-45e6-b206-9dc0d96c191a", "name": "network-vif-plugged", "status": "completed", "tag": "71dfd282-07ca-4ea4-9c02-d62c6745dabb"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:28.152608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b0ab8328-30ea-49f2-a8c0-dca3641dfb8b req-dabf134d-64c9-451a-b36e-e143d2c4729f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.156127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b0ab8328-30ea-49f2-a8c0-dca3641dfb8b req-dabf134d-64c9-451a-b36e-e143d2c4729f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.212222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b0ab8328-30ea-49f2-a8c0-dca3641dfb8b req-dabf134d-64c9-451a-b36e-e143d2c4729f service nova] Creating event network-vif-plugged:71dfd282-07ca-4ea4-9c02-d62c6745dabb for instance ec163ca3-3477-45e6-b206-9dc0d96c191a on n-h2-849796-1 Jul 18 02:49:28.259060 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b0ab8328-30ea-49f2-a8c0-dca3641dfb8b req-dabf134d-64c9-451a-b36e-e143d2c4729f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166584 Jul 18 02:49:28.270286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2755/5589] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:28.311720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:28.321756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:28.365410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.370983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.380903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:28.389861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:28.405152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:29.368019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.391070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.404055 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8cef8fb4-cbad-4034-a852-02dfbbd6210f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.125647 Jul 18 02:49:29.405956 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2756/5590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:28 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:29.416153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:29.417205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:29.431773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.435358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.435647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.437484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.438716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:29.439694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:29.443355 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ee2b46e-1bcb-4f45-9dfa-fefcd08f00b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 3.327721 Jul 18 02:49:29.445322 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2835/5591] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:26 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 3336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:29.972403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:29.989378 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9af791d8-72d6-49dd-8d4a-4246edcdc4c0 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1504 microversion: 2.1 time: 0.574897 Jul 18 02:49:29.990095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2757/5592] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:29 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:30.436179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.437022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.478353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:30.479850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:30.492406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.493327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.496967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.497873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.502032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.502902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:30.517111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:30.520768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.031925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:31.048450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:31.050081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:31.051373 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39e81215-3a1d-453e-bb5e-ddfb3d5bc28b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.577191 Jul 18 02:49:31.058441 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2758/5593] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:30 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:31.085474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:31.098516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:31.115102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.116281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.117935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:31.119584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:31.790753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:31.804755 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-173b325c-90aa-4813-acf9-e0f812c2c7ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 1.373976 Jul 18 02:49:31.808103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2836/5594] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:30 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:32.090348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:32.091290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:32.105003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.105331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.106225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.106574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.556666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.574192 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dbf3b15c-6be3-42ec-89d6-bab721b9087a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1504 microversion: 2.1 time: 1.513641 Jul 18 02:49:32.599158 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2759/5595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:31 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1504 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:32.610950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a5c13910-2d2a-47a6-a8dc-eb5f4b32748c req-bec0e666-3e55-4ee5-8738-a315816e72ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9914ba66-82ac-43af-9d22-4128b678f0f2", "name": "network-vif-unplugged", "status": "completed", "tag": "cb3776b0-7724-4ec1-8365-b192f63dd0d1"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:32.622179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a5c13910-2d2a-47a6-a8dc-eb5f4b32748c req-bec0e666-3e55-4ee5-8738-a315816e72ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.622650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a5c13910-2d2a-47a6-a8dc-eb5f4b32748c req-bec0e666-3e55-4ee5-8738-a315816e72ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.646454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a5c13910-2d2a-47a6-a8dc-eb5f4b32748c req-bec0e666-3e55-4ee5-8738-a315816e72ff service nova] Creating event network-vif-unplugged:cb3776b0-7724-4ec1-8365-b192f63dd0d1 for instance 9914ba66-82ac-43af-9d22-4128b678f0f2 on n-h1-849796-1 Jul 18 02:49:32.659535 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a5c13910-2d2a-47a6-a8dc-eb5f4b32748c req-bec0e666-3e55-4ee5-8738-a315816e72ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058876 Jul 18 02:49:32.660627 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2760/5596] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:32.836368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:32.840915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.853440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:32.871722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.879283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:32.886052 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4bfa8cf9-f63c-4f45-b5de-63d8224287b6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.799484 Jul 18 02:49:32.890070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2837/5597] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:32 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:49:32.892203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.892974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:32.894204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:32.895069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.603930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:33.605204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:33.642794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.647588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.649734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.650890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.802837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:33.816431 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2600c925-88a2-41a3-93ad-7f3f21307cee tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1366 microversion: 2.1 time: 0.984353 Jul 18 02:49:33.822274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2761/5598] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:32 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1366 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:33.915219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:33.915723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:33.927232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.927687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:33.929905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:33.932107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.272873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.283659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f550b7fd-65e5-4f7f-9901-7f81f27dc166 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 200 len: 1447 microversion: 2.1 time: 0.695248 Jul 18 02:49:34.297526 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2838/5599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:33 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 1447 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:34.303148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:34.304095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:34.311730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.312563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.313715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.314386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.844431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.852338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.882963 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5ec3261-3bb1-4d16-9cfa-4d2c08de6a06 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.583964 Jul 18 02:49:34.888046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.891058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2839/5600] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:34 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:34.896158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:34.906671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:34.907485 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad62f8e0-5256-4191-b782-29450028fa75 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.996222 Jul 18 02:49:34.908034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:34.908511 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2762/5601] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:33 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:49:34.925250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.929817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:34.930102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.930981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:34.931712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.932360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.959181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.959929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:34.961512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:34.962241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.307268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:35.320715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78b31afa-3845-49b3-bbb8-59778840736f tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.404528 Jul 18 02:49:35.321374 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2763/5602] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:34 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:35.339348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:35.340346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:35.356039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.360472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.374196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.374837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.656776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:35.678856 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a84b7e34-fe3b-432a-8b16-99963673a511 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1555 microversion: 2.1 time: 0.786530 Jul 18 02:49:35.692035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2840/5603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:34 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1555 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:35.713497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:35.714417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:35.738921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.739939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:35.741209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:35.753765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.405128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:36.454088 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-abd7ebac-7ab8-4945-81a4-906f44ce1862 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.112958 Jul 18 02:49:36.456377 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2764/5604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:35 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:36.479790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:36.482006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:36.508379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.509219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.517372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:36.518519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:36.977925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1af9ff34-73a6-43b4-9b24-37f62d1e78d0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.282737 Jul 18 02:49:36.979850 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2841/5605] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:49:35 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/os-interface => generated 284 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:36.999406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:37.011770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:37.043227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.044494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.059559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.068753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.361790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:37.410827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:37.428643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:37.436160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fdfbb56b-2cf5-4cf0-bdc4-1348aab3366f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.973141 Jul 18 02:49:37.442627 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2765/5606] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:36 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:37.645297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:37.657076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-592e77f5-3b0c-4303-b5c8-39883a548837 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.675342 Jul 18 02:49:37.660733 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2842/5607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:36 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:37.702232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-436e55b2-7639-4af6-954d-5df93061c918 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:37.725528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-436e55b2-7639-4af6-954d-5df93061c918 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:37.734530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-436e55b2-7639-4af6-954d-5df93061c918 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:37.860627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-436e55b2-7639-4af6-954d-5df93061c918 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:49:38.154216 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-436e55b2-7639-4af6-954d-5df93061c918 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.447476 Jul 18 02:49:38.162717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2766/5608] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:37 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:49:38.174123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:38.174979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:38.188688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.189349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.193473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.194063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.487294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:38.491858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:38.528184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.534021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:38.536119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:38.539810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:39.334384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.395750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b94d4653-e615-4812-bb8f-ac25a4e3e195 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 1.223487 Jul 18 02:49:39.397365 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2843/5609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:38 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:39.637352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.712105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.721758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:39.723379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b07e47a4-2acf-47e0-92df-20f4d7d394af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.252020 Jul 18 02:49:39.727146 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2767/5610] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:38 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:49:40.418982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:40.420775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:40.455006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.467659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.469569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.470594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.745938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:40.746538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:40.755992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.762122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.764347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:40.764901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:40.946180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:40.957573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5c4b9b8-684d-474a-b1e7-4802c42e0ced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.546363 Jul 18 02:49:40.971187 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2844/5611] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:40 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:41.946585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:41.963442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:41.967343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:41.975873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3dd6812e-0ae8-4875-98ab-89b7de3db478 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.233488 Jul 18 02:49:41.985208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:41.990030 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2768/5612] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:40 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:41.990439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:42.018038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:42.022320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:42.024235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:42.028707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:42.059267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:42.680644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:42.709888 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-590e807d-10f2-4a14-9157-ddab64f5b9d8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.734118 Jul 18 02:49:42.733891 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2845/5613] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:41 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:43.014183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:43.015563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:43.030122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=44 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:43.057948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.061942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.063519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.064307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.715214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:43.759215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:43.769231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:43.770217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:43.776336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:43.785712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-978bfbe3-731b-472a-bac3-8bc5a3513a0a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.778752 Jul 18 02:49:43.789808 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2769/5614] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:43 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:43.796337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.801223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:43.804624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:43.814292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.574150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e5864f5e-4f83-46bc-a995-27c3e083c9aa req-2aa08541-ee7d-4dfc-9b55-0f2113ed18f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec163ca3-3477-45e6-b206-9dc0d96c191a", "tag": "71dfd282-07ca-4ea4-9c02-d62c6745dabb"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:44.649874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e5864f5e-4f83-46bc-a995-27c3e083c9aa req-2aa08541-ee7d-4dfc-9b55-0f2113ed18f5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:44.652957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e5864f5e-4f83-46bc-a995-27c3e083c9aa req-2aa08541-ee7d-4dfc-9b55-0f2113ed18f5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.684629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:44.697954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e5864f5e-4f83-46bc-a995-27c3e083c9aa req-2aa08541-ee7d-4dfc-9b55-0f2113ed18f5 service nova] Creating event network-changed:71dfd282-07ca-4ea4-9c02-d62c6745dabb for instance ec163ca3-3477-45e6-b206-9dc0d96c191a on n-h2-849796-1 Jul 18 02:49:44.709817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e5864f5e-4f83-46bc-a995-27c3e083c9aa req-2aa08541-ee7d-4dfc-9b55-0f2113ed18f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182268 Jul 18 02:49:44.711128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2770/5615] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:44.719138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a85991e1-e3ec-4371-8a90-ad4b709cd92a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.968529 Jul 18 02:49:44.769759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2846/5616] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:43 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:44.808346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:44.810811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:44.829492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:44.837722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:44.838891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:44.843050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.730898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-572251c9-4063-45f4-912b-51a57a356f36 req-15241b91-89e9-4655-93d5-59cbd3ec2867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "name": "network-vif-plugged", "status": "completed", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:45.773127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:45.786332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-572251c9-4063-45f4-912b-51a57a356f36 req-15241b91-89e9-4655-93d5-59cbd3ec2867 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.790339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-572251c9-4063-45f4-912b-51a57a356f36 req-15241b91-89e9-4655-93d5-59cbd3ec2867 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.791379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:45.793494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:45.795280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37a8cc35-1ad4-4f44-a44e-f199e5755ebb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 0.991067 Jul 18 02:49:45.801225 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2771/5617] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:44 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:45.813549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:45.829226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:45.837964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.838742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.839970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:45.844996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:45.865566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-572251c9-4063-45f4-912b-51a57a356f36 req-15241b91-89e9-4655-93d5-59cbd3ec2867 service nova] Creating event network-vif-plugged:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h2-849796-1 Jul 18 02:49:45.900381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-572251c9-4063-45f4-912b-51a57a356f36 req-15241b91-89e9-4655-93d5-59cbd3ec2867 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182924 Jul 18 02:49:45.902081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2847/5618] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:46.458275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:46.476112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17310b06-2f83-46f7-b998-1bda4d0268c9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.673445 Jul 18 02:49:46.492229 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2772/5619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:45 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:46.835625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:46.836449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:46.863267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.864266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:46.866275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:46.870564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.497024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:47.498107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:47.527743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.528213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.535988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:47.539251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:47.604412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:48.067340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:48.094432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be7d8384-63d2-4b85-9bb1-617bbed0f9e1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1679 microversion: 2.1 time: 0.602611 Jul 18 02:49:48.100181 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2773/5620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:47 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1679 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:48.128032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-098d4d1a-8146-4f39-9df0-fab926e3959c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: .version_select at 0x7fab045a0dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-468621492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5lJcj/JATu8OqnNSg22+QkdIIpslSt7dzlCGP9dscGFvFRXMzwutRm+ekZb74Qc6S9buZjJlR7g8Nn30baSbh19h4IeUF42jEZYMK8AQZ1INL1pGgDZ9yLlhG+XaKSqg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:48.178558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-098d4d1a-8146-4f39-9df0-fab926e3959c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:49:48.196121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-098d4d1a-8146-4f39-9df0-fab926e3959c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:49:48.245828 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-098d4d1a-8146-4f39-9df0-fab926e3959c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.143839 Jul 18 02:49:48.246730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2774/5621] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:49:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:49:48.565087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:48.589679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:48.597391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:48.598695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3affff5b-2c24-48f9-9f8f-ade65c087e7f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.769910 Jul 18 02:49:48.604507 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2848/5622] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:46 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:49.141073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:49.148427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:49.191454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.192620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.195424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.208637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.657418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:49.686591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:49.720495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:49.725313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.727326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:49.730095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:49.731187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.776052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:50.780059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:50.790917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-374f2fe9-4edc-4874-bf4a-12fc97a45bbe tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1656 microversion: 2.1 time: 1.670551 Jul 18 02:49:50.797181 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2775/5623] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:49 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1656 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:50.815372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a11541a-8db2-40c4-8907-e337660caced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:50.818074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:50.821735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:50.832122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a11541a-8db2-40c4-8907-e337660caced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:50.834214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a11541a-8db2-40c4-8907-e337660caced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:50.844104 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5507132-3406-4968-b2bb-4190b3b58675 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 1.211868 Jul 18 02:49:50.865199 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2849/5624] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:49 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:50.895888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a11541a-8db2-40c4-8907-e337660caced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Going to try to start instance {{(pid=119440) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:49:51.135917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a11541a-8db2-40c4-8907-e337660caced tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.325286 Jul 18 02:49:51.146062 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2776/5625] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:49:50 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:49:51.149503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:51.150924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:51.164322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:51.165585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:51.168189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:51.168895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:51.899055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:51.909569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:51.940582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:51.942015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:51.944034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:51.945000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:52.028105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:52.045600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0e66ae5-0ecc-4e29-8464-073c4ca67366 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 0.902238 Jul 18 02:49:52.068166 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2850/5626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:51 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:53.072908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:53.074020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:53.087347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:53.089460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:53.094064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:53.094964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:53.623226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.664790 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b2166e3-31da-42e2-8c63-63a4ebb512e9 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 0.584572 Jul 18 02:49:53.666409 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2851/5627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:53 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:53.855312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.972486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.983564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:53.986295 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-00807007-3b27-4697-ab67-5b76c7076365 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1808 microversion: 2.20 time: 2.098387 Jul 18 02:49:53.991267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2777/5628] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:51 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1808 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:54.688509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:54.693188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:54.719548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.720331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:54.729262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:54.729262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.031671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:55.034308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:55.070273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.071378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.073135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:55.074349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:55.522039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:55.538219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:55.540247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:55.541696 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ddb8171-b316-4f45-9c34-d7f168d3d4d3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1795 microversion: 2.20 time: 0.536045 Jul 18 02:49:55.552482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:55.562243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2778/5629] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:49:55 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1795 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:49:55.581094 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-afa2aeec-c204-494b-af87-b58fad3521d2 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1665 microversion: 2.1 time: 0.896576 Jul 18 02:49:55.583827 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2852/5630] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:54 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1665 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:56.602273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:56.603633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:56.624266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:56.631051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:56.632217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:56.633305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:57.390481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:57.399128 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f23509f8-9760-4659-8629-1f61d2aa6e19 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.801180 Jul 18 02:49:57.405393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2779/5631] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:56 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:49:57.435753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:57.439343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:57.454906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:57.457532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:57.459624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:57.460775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:57.867659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:57.891624 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-550f806e-b683-4ef0-a14a-561383acd53d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.465638 Jul 18 02:49:57.893446 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2853/5632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:57 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:57.928424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:57.930682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:57.944000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:57.945281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:57.947022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:57.948153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:58.220723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:59.468033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:59.486414 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fceb15ab-b8d9-4629-9213-02d8c80d2781 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 1.563349 Jul 18 02:49:59.487724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2780/5633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:57 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:59.516199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:59.516785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:59.533361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.533820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.534634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.535082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.603717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1633112588", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "96437e20-e971-49cd-a28e-bdef57befd29"}], "key_name": "tempest-TestNetworkBasicOps-468621492", "security_groups": [{"name": "tempest-secgroup-smoke-1158854045"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:49:59.871760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] validate_networks() for [('96437e20-e971-49cd-a28e-bdef57befd29', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:49:59.912016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:49:59.928030 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b61f21e1-85c6-46fd-93c9-b3d24ecc504e tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.417412 Jul 18 02:49:59.943217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2854/5634] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:49:59.950952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:49:59.951960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:49:59.961713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.962550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:49:59.963863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:49:59.964518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.563012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:00.581634 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6747411-cbf0-44ae-8a3f-ba356caa4ed8 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.636864 Jul 18 02:50:00.582882 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2855/5635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:49:59 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:00.617297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:00.621870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:00.647603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.648598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.651775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.655634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.712334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lazy-loading 'flavor' on Instance uuid ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:00.903243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1efe6524-a5f3-463a-9858-2e9e048da58b tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.297184 Jul 18 02:50:00.908707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2856/5636] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:50:00 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Jul 18 02:50:00.923593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:00.924430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:00.955882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.956356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:00.957298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:00.957770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:01.496251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:01.509236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d82c468-0bc7-481a-be47-09c00c094f8a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1677 microversion: 2.1 time: 0.597300 Jul 18 02:50:01.510792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2857/5637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:00 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1677 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:01.540284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:50:01.542791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:50:01.548497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:50:01.555594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:50:01.556529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:50:01.601356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:01.603943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:01.606185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:01.610664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:01.662014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:50:01.681490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:50:01.713634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:50:01.716632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:50:01.863726 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dfe5e4d2-4b24-46ff-9bca-9f8731bedd0d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.260320 Jul 18 02:50:01.865090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2781/5638] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:49:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:50:01.885206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46e10b13-fca1-4283-be2a-6a921c97c625 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:01.886263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46e10b13-fca1-4283-be2a-6a921c97c625 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:02.140825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-46e10b13-fca1-4283-be2a-6a921c97c625 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:02.160809 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46e10b13-fca1-4283-be2a-6a921c97c625 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1248 microversion: 2.1 time: 0.285102 Jul 18 02:50:02.177913 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2858/5639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:01 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1248 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:02.546623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:02.551373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:02.593343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:02.594274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:02.595792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:02.596559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.210189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:03.212592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:03.230452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.232869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.235005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.236279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.249243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:03.282681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55f8451e-202f-4b8a-919b-baa6771df5aa tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1660 microversion: 2.1 time: 0.745503 Jul 18 02:50:03.294996 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2782/5640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:02 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1660 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:03.332570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:03.333751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:03.362928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.364163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.365794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.366621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.635787 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d150f3f7-d1c5-4036-9d7d-e4a053b14060 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.327057 Jul 18 02:50:03.638611 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2783/5641] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:50:03 2022] POST /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:50:03.654830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:03.664014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:03.667998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:03.678178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.680428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.682427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:03.683647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:03.701839 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de3b0cfc-6f86-4b93-8bdd-026bf3276ac3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1244 microversion: 2.1 time: 0.492634 Jul 18 02:50:03.706447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2859/5642] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:03 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1244 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:04.573370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:04.586865 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b9ba4ebb-20ef-4cf3-9755-8c2985ff0384 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1666 microversion: 2.1 time: 0.940896 Jul 18 02:50:04.588242 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2784/5643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:03 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1666 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:04.737244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:04.738728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:04.755231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:04.756088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:04.757184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:04.758694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:04.976177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:04.985090 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb48076a-024f-4f48-9c86-b403f1c03274 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1306 microversion: 2.1 time: 0.251962 Jul 18 02:50:04.986471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2860/5644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:04 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:05.614175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:05.615567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:05.633900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:05.638514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:05.639425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:05.639875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:06.021708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:06.023799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:06.040285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:06.040766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:06.041662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:06.049626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:06.270787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:06.281364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:06.286973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0676b9da-42a1-44e2-b505-da533839a4c3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1306 microversion: 2.1 time: 0.274852 Jul 18 02:50:06.289619 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2861/5645] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:06 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:06.398521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:06.411108 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69084c46-2de5-4174-91e9-9c0097df2a35 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1666 microversion: 2.1 time: 0.802256 Jul 18 02:50:06.413506 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2785/5646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:05 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1666 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:07.308854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:07.311306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:07.332096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:07.332552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:07.333402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:07.333866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:07.432845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:07.433485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:07.444871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:07.445358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:07.446363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:07.453053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:07.535355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:07.556600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7fc31945-62d7-4755-8af9-71b0432d7cde tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1306 microversion: 2.1 time: 0.252831 Jul 18 02:50:07.561244 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2862/5647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:07 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1306 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:08.143064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:08.176254 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5029b005-8828-4a8d-8971-9202b5605a6d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1666 microversion: 2.1 time: 0.746828 Jul 18 02:50:08.179454 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2786/5648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:07 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1666 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:08.577308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:08.578703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:08.604084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:08.604547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:08.605409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:08.605863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:09.215620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:09.220781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:09.245331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:09.246655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:09.249990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:09.254148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:09.310176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:09.321060 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd684ac3-a555-423d-be48-8f1506c01b49 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.748797 Jul 18 02:50:09.322395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2863/5649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:08 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:09.770300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:09.783977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-953cc488-fb77-43da-8188-28cf65802bdc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.581402 Jul 18 02:50:09.803255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:09.804628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:09.813335 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2787/5650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:09 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:09.830359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:09.831420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:09.832496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:09.833233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:10.341364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:10.343276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:10.367871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:10.368444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:10.369829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:10.370322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:10.635478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:10.647981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-04e25922-df24-415f-8f63-0c619e94a039 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1669 microversion: 2.1 time: 0.846517 Jul 18 02:50:10.649628 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2864/5651] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:09 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1669 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:10.677891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:10.678462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:10.688285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:10.697603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:10.705785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:10.706967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:10.768974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:10.783213 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Working on deleting snapshot 777cb630-ea60-4d9f-8569-0722e5208675 from shelved instance... Jul 18 02:50:11.020270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:11.049650 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f7cb538-3b4f-4273-b048-c8a8a07de132 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.714544 Jul 18 02:50:11.052199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2788/5652] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:10 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:11.532013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-eee8fab6-1f58-4e0b-968c-128ef40badcc req-9e0dc38b-aee5-4225-984c-886af27c80cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c392a5a1-57df-4381-b598-d962e00acf92", "tag": "08b400c1-27ff-4df2-8c34-872a30c8f83a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:11.580454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-eee8fab6-1f58-4e0b-968c-128ef40badcc req-9e0dc38b-aee5-4225-984c-886af27c80cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:11.581394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-eee8fab6-1f58-4e0b-968c-128ef40badcc req-9e0dc38b-aee5-4225-984c-886af27c80cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:11.615804 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-eee8fab6-1f58-4e0b-968c-128ef40badcc req-9e0dc38b-aee5-4225-984c-886af27c80cb service nova] Creating event network-changed:08b400c1-27ff-4df2-8c34-872a30c8f83a for instance c392a5a1-57df-4381-b598-d962e00acf92 on n-h1-849796-1 Jul 18 02:50:11.633005 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-eee8fab6-1f58-4e0b-968c-128ef40badcc req-9e0dc38b-aee5-4225-984c-886af27c80cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107438 Jul 18 02:50:11.635524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2789/5653] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:50:11.971764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Doing local delete in cell e1b22adc-a2ca-4858-ac65-f680047bed9f(cell1) {{(pid=119439) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 18 02:50:11.972617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:11.977048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:11.977581 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 18 02:50:11.992880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] deallocate_for_instance() {{(pid=119439) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 18 02:50:12.086439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:12.091197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:12.111468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:12.114232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:12.121237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.121790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.122742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:12.123653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:12.159708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:12.172426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:13.147242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:13.163016 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b197478e-8b07-4e52-8e01-0a03635fb397 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 1.084077 Jul 18 02:50:13.169503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2790/5654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:12 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:13.310757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Updating instance_info_cache with network_info: [] {{(pid=119439) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 18 02:50:13.317497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cca864f5-ccec-43af-b7c4-54b4192fd733 req-57ac7df1-727a-4ac1-83ac-66731ca2c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9914ba66-82ac-43af-9d22-4128b678f0f2", "name": "network-vif-deleted", "tag": "cb3776b0-7724-4ec1-8365-b192f63dd0d1"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:13.322605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:13.337357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cca864f5-ccec-43af-b7c4-54b4192fd733 req-57ac7df1-727a-4ac1-83ac-66731ca2c9ec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:13.340315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cca864f5-ccec-43af-b7c4-54b4192fd733 req-57ac7df1-727a-4ac1-83ac-66731ca2c9ec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:13.378480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_external_events [req-cca864f5-ccec-43af-b7c4-54b4192fd733 req-57ac7df1-727a-4ac1-83ac-66731ca2c9ec service nova] Unable to find a host for instance 9914ba66-82ac-43af-9d22-4128b678f0f2. Dropping event network-vif-deleted {{(pid=119440) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:50:13.384365 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cca864f5-ccec-43af-b7c4-54b4192fd733 req-57ac7df1-727a-4ac1-83ac-66731ca2c9ec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069993 Jul 18 02:50:13.402974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2791/5655] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 02:50:13.771826 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b12892e1-eb40-4c16-b5eb-28641ce82bcc tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 204 len: 0 microversion: 2.1 time: 3.099203 Jul 18 02:50:13.773184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2865/5656] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:10 2022] DELETE /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 0 bytes in 3101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:50:13.796300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:13.806371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 9914ba66-82ac-43af-9d22-4128b678f0f2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:13.823900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:13.825143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:13.826801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:13.827829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:13.859204 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 HTTP/1.1 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9914ba66-82ac-43af-9d22-4128b678f0f2'} Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:13.863054 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. Jul 18 02:50:13.870984 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:13.874230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 404 to user: Instance 9914ba66-82ac-43af-9d22-4128b678f0f2 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:13.876127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-955857dd-9097-49a8-a787-1fbf63b9084a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2" status: 404 len: 111 microversion: 2.1 time: 0.095388 Jul 18 02:50:13.882847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2792/5657] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:13 2022] GET /compute/v2.1/servers/9914ba66-82ac-43af-9d22-4128b678f0f2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:50:13.891231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:13.891713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:13.905184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:13.910143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:13.914001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:13.914652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:13.962718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:14.195049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:14.196103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:14.223560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.229859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:14.234718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.235872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:14.286489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86a3ab65-ff1c-41f2-8117-83be13f792ee tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 204 len: 0 microversion: 2.1 time: 0.402143 Jul 18 02:50:14.287549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2866/5658] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:13 2022] DELETE /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:50:14.298798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:14.299722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:14.313689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.314323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:14.315699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:14.321454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:14.461365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:14.475411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e842c539-1c63-431d-9d0c-31df406e0289 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1465 microversion: 2.1 time: 0.181558 Jul 18 02:50:14.476443 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2867/5659] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:14 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:15.422842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:15.431800 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a82404de-7183-4b08-a3d6-63683674fccc tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 1.249132 Jul 18 02:50:15.442328 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2793/5660] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:14 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:15.499846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:15.501556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:15.510073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:15.511054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:15.513451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:15.514074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:15.790967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:15.802039 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e40ccbac-3ea4-4e34-8fea-74297fc43f9a tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1465 microversion: 2.1 time: 0.306209 Jul 18 02:50:15.804417 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2868/5661] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:15 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1465 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:16.454614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:16.455838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:16.476082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.478336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:16.488409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.489186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:16.832517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:16.833460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:16.847919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.852437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:16.855586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:16.857054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:17.073452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:17.083523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a057e704-cee1-4bf8-8dec-923a2ad98465 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1465 microversion: 2.1 time: 0.255034 Jul 18 02:50:17.084497 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2869/5662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:16 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1465 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:17.239784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a3804689-8d5d-4475-a948-16fb98daf5d0 req-2d926420-9add-4cd2-8d5c-ef6d81d7d249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28daf010-f2af-4494-a9d9-e8f1672bd147", "name": "network-vif-deleted", "tag": "3312a9db-c6bb-430e-8bb0-e562159f6a07"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:17.259170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3804689-8d5d-4475-a948-16fb98daf5d0 req-2d926420-9add-4cd2-8d5c-ef6d81d7d249 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:17.260214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3804689-8d5d-4475-a948-16fb98daf5d0 req-2d926420-9add-4cd2-8d5c-ef6d81d7d249 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:17.267858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:17.284632 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e6980b6-f139-4076-85f1-19715d09a2f3 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.835285 Jul 18 02:50:17.285856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2794/5663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:16 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:17.301242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a3804689-8d5d-4475-a948-16fb98daf5d0 req-2d926420-9add-4cd2-8d5c-ef6d81d7d249 service nova] Creating event network-vif-deleted:3312a9db-c6bb-430e-8bb0-e562159f6a07 for instance 28daf010-f2af-4494-a9d9-e8f1672bd147 on n-h2-849796-1 Jul 18 02:50:17.316831 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a3804689-8d5d-4475-a948-16fb98daf5d0 req-2d926420-9add-4cd2-8d5c-ef6d81d7d249 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085595 Jul 18 02:50:17.326611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2870/5664] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:18.125480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:18.127020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:18.140316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.141144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.142536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.151526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.315848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.316999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.318797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lazy-loading 'fault' on Instance uuid 28daf010-f2af-4494-a9d9-e8f1672bd147 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:18.328617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:18.330193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:18.368384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.368384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.368384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:18.370075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:18.494205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:18.601030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:18.613276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0905b2a5-1a10-41b7-a8a7-80d5d5809581 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 200 len: 1305 microversion: 2.1 time: 0.508170 Jul 18 02:50:18.631378 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2795/5665] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:18 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 1305 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:18.838798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:18.850736 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d1185f1-ba93-4e70-aa15-5dcb343134ed tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.545449 Jul 18 02:50:18.851734 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2871/5666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:18 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:19.638294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:19.639090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 28daf010-f2af-4494-a9d9-e8f1672bd147] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:19.654207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.654667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.655669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.660973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.682727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 HTTP/1.1 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '28daf010-f2af-4494-a9d9-e8f1672bd147'} Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:19.691891 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. Jul 18 02:50:19.696736 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:19.713014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 404 to user: Instance 28daf010-f2af-4494-a9d9-e8f1672bd147 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:19.714924 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-953133ec-5f2c-4f4d-85bc-86302f3ac358 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147" status: 404 len: 111 microversion: 2.1 time: 0.080931 Jul 18 02:50:19.722462 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2796/5667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:19 2022] GET /compute/v2.1/servers/28daf010-f2af-4494-a9d9-e8f1672bd147 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:19.727898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:19.728442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:19.746798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:19.759543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.760220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.761133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.761601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.853747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:19.885473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:19.889464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:19.931221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.932422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:19.934803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:19.935916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:20.170147 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32935760-7300-4447-acc5-135dec2908cd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 204 len: 0 microversion: 2.1 time: 0.446274 Jul 18 02:50:20.176158 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2872/5668] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:19 2022] DELETE /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:50:20.195488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:20.198840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:20.223514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:20.231922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:20.246563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:20.248698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:20.519989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:20.534450 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-146de91d-9e0c-4fa9-ab1c-45f2d6ab2683 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.656713 Jul 18 02:50:20.535091 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2797/5669] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:19 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:21.359860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:21.408296 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73d5593c-920e-4579-b4d1-cdfcb671a067 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1507 microversion: 2.1 time: 1.228684 Jul 18 02:50:21.449366 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2873/5670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:20 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1507 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:21.569387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:21.570374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:21.610232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:21.614476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:21.617283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:21.618429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.276635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:22.334248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-838b1722-13c1-4f4f-90f6-d109adfc6dd1 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.766881 Jul 18 02:50:22.363668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2798/5671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:21 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:22.479148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:22.480033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:22.503427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:22.504385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.507203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:22.508877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.669335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:22.682808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7b3b08a-dadd-4d5c-88b1-a5fb349fd080 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1465 microversion: 2.1 time: 0.208223 Jul 18 02:50:22.686099 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2874/5672] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:22 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1465 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:22.810965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-bfe0222d-c5d4-4971-bd81-06d710a97cb9 req-5be4325e-4132-4363-8348-28b00ca3c3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2295331d-8f6b-4db3-a0d1-3db51186177a", "name": "network-vif-deleted", "tag": "d2e79995-dfed-4b3d-8499-8e5fdf43bafc"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:22.833037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bfe0222d-c5d4-4971-bd81-06d710a97cb9 req-5be4325e-4132-4363-8348-28b00ca3c3da service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:22.843215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bfe0222d-c5d4-4971-bd81-06d710a97cb9 req-5be4325e-4132-4363-8348-28b00ca3c3da service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:22.909453 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-bfe0222d-c5d4-4971-bd81-06d710a97cb9 req-5be4325e-4132-4363-8348-28b00ca3c3da service nova] Creating event network-vif-deleted:d2e79995-dfed-4b3d-8499-8e5fdf43bafc for instance 2295331d-8f6b-4db3-a0d1-3db51186177a on n-h1-849796-1 Jul 18 02:50:22.921473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-bfe0222d-c5d4-4971-bd81-06d710a97cb9 req-5be4325e-4132-4363-8348-28b00ca3c3da service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123339 Jul 18 02:50:22.924722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2799/5673] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:23.386425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:23.389295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:23.450422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.453922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:23.470689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.477347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:23.723258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:23.727032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:23.761945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.766880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:23.770062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:23.771498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:24.002464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:24.003581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:24.004408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lazy-loading 'fault' on Instance uuid 2295331d-8f6b-4db3-a0d1-3db51186177a {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:24.111728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:24.123264 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ab580b4-59d4-4ba7-abd8-d0daa3b97873 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 200 len: 1305 microversion: 2.1 time: 0.412303 Jul 18 02:50:24.124636 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2800/5674] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:23 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 1305 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:24.227641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d710ef19-aa2d-43eb-97cd-2e1e5ea38c2a req-3f61cf6c-26c9-45d1-af48-5037a0634133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c392a5a1-57df-4381-b598-d962e00acf92", "name": "network-vif-plugged", "status": "completed", "tag": "08b400c1-27ff-4df2-8c34-872a30c8f83a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:24.241947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d710ef19-aa2d-43eb-97cd-2e1e5ea38c2a req-3f61cf6c-26c9-45d1-af48-5037a0634133 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:24.242681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d710ef19-aa2d-43eb-97cd-2e1e5ea38c2a req-3f61cf6c-26c9-45d1-af48-5037a0634133 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:24.287530 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d710ef19-aa2d-43eb-97cd-2e1e5ea38c2a req-3f61cf6c-26c9-45d1-af48-5037a0634133 service nova] Creating event network-vif-plugged:08b400c1-27ff-4df2-8c34-872a30c8f83a for instance c392a5a1-57df-4381-b598-d962e00acf92 on n-h1-849796-1 Jul 18 02:50:24.311298 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d710ef19-aa2d-43eb-97cd-2e1e5ea38c2a req-3f61cf6c-26c9-45d1-af48-5037a0634133 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085514 Jul 18 02:50:24.323721 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2801/5675] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:24.343981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:24.355231 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1af5d1f-4578-45b2-8394-fe594a2ceeb2 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.976831 Jul 18 02:50:24.356983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2875/5676] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:23 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:25.165179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:25.166486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: 2295331d-8f6b-4db3-a0d1-3db51186177a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:25.176142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.176969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.178362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.178976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.197753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a HTTP/1.1 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2295331d-8f6b-4db3-a0d1-3db51186177a'} Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:25.199808 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:25.208535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 404 to user: Instance 2295331d-8f6b-4db3-a0d1-3db51186177a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:25.212953 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3b7650d-cb53-4539-b9b1-ea7d71e9e405 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a" status: 404 len: 111 microversion: 2.1 time: 0.063163 Jul 18 02:50:25.213670 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2802/5677] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:25 2022] GET /compute/v2.1/servers/2295331d-8f6b-4db3-a0d1-3db51186177a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:25.221259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:25.221838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:25.230614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.232713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.233129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.233588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.282975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:25.381817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:25.382956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:25.394349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.398279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.399939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.411243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.485392 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-92904ae7-79b4-4ad0-82b5-16035881b841 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 204 len: 0 microversion: 2.1 time: 0.267337 Jul 18 02:50:25.488471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2876/5678] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:25 2022] DELETE /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:25.503939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:25.505663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:25.522773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.525367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.527185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:25.528295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:25.713461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:25.736563 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a14ccf1-5482-4cb2-a2e7-2ba832ac528e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1374 microversion: 2.1 time: 0.360999 Jul 18 02:50:25.738058 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2803/5679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:25 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1374 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:26.067461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:26.083870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6270278d-c6d6-4f14-95b3-04198ad8b7cf tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1494 microversion: 2.1 time: 0.589013 Jul 18 02:50:26.096220 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2877/5680] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:25 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1494 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:26.772202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:26.774527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:26.792140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:26.793494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:26.796496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:26.797895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:27.107625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:27.110162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:27.126088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:27.127252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:27.128966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:27.130385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:27.391885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:27.418635 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-57016050-fbce-4688-b66e-1cb40f623710 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1494 microversion: 2.1 time: 0.318104 Jul 18 02:50:27.419707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2878/5681] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:27 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1494 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:27.991505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:28.019643 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a57df83a-873e-408f-88ac-e64e90a53440 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1545 microversion: 2.1 time: 1.257074 Jul 18 02:50:28.039010 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2804/5682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:26 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1545 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:28.048914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:28.050718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:28.062686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:28.063630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.064511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:28.065429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.444362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:28.453572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:28.466594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:28.467063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.467869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:28.470051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.758289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:28.784740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b12df51-7462-47fc-ba36-9bf2b9cc46a1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 200 len: 1452 microversion: 2.1 time: 0.344928 Jul 18 02:50:28.789722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2805/5683] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:28 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 1452 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:28.799743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0d3ada0a-da7b-4a77-97a3-187a703a2256 req-db64c90e-557b-4c29-980f-74b23d9b2949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37698ef-7e62-46a5-b256-6bed5032079c", "name": "network-vif-deleted", "tag": "27a79f4a-3839-4288-a107-3db94da8573c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:28.836581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0d3ada0a-da7b-4a77-97a3-187a703a2256 req-db64c90e-557b-4c29-980f-74b23d9b2949 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:28.847000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0d3ada0a-da7b-4a77-97a3-187a703a2256 req-db64c90e-557b-4c29-980f-74b23d9b2949 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:28.909612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0d3ada0a-da7b-4a77-97a3-187a703a2256 req-db64c90e-557b-4c29-980f-74b23d9b2949 service nova] Creating event network-vif-deleted:27a79f4a-3839-4288-a107-3db94da8573c for instance f37698ef-7e62-46a5-b256-6bed5032079c on n-h1-849796-1 Jul 18 02:50:28.946811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0d3ada0a-da7b-4a77-97a3-187a703a2256 req-db64c90e-557b-4c29-980f-74b23d9b2949 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154829 Jul 18 02:50:28.954528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2806/5684] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:28.977381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:29.017214 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee5952fb-e39c-48b0-8095-f79e222c9537 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1545 microversion: 2.1 time: 0.971203 Jul 18 02:50:29.022436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2879/5685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:28 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1545 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:29.809658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:29.810859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: f37698ef-7e62-46a5-b256-6bed5032079c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:29.829547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.830009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.830824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.831273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.873025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c HTTP/1.1 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'f37698ef-7e62-46a5-b256-6bed5032079c'} Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:29.876726 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:29.880577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 404 to user: Instance f37698ef-7e62-46a5-b256-6bed5032079c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:29.882269 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f70c3187-a68c-4b73-95e9-a5b99b9b1059 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c" status: 404 len: 111 microversion: 2.1 time: 0.076701 Jul 18 02:50:29.887956 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2807/5686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:29 2022] GET /compute/v2.1/servers/f37698ef-7e62-46a5-b256-6bed5032079c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:29.899554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:29.900147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:29.931601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.933236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:29.936588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:29.941833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:30.019842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:30.177520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dfe9be7b-8fc4-435f-aecc-bfd58f78918d tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 204 len: 0 microversion: 2.1 time: 0.283535 Jul 18 02:50:30.190161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:30.192645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:30.195835 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2880/5687] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:29 2022] DELETE /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:30.205335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:30.206185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:30.207242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:30.207871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:30.432511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:30.449060 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3fa1b2f-fdf8-44ad-9014-c744059d7083 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1675 microversion: 2.1 time: 0.264806 Jul 18 02:50:30.451653 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2808/5688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:30 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1675 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:31.479368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:31.479368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:31.524169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:31.524169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:31.529748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:31.530605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:31.953185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:31.966135 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31bbf118-6031-4997-aa93-9c73891e4908 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1675 microversion: 2.1 time: 0.500099 Jul 18 02:50:31.967900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2881/5689] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:31 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1675 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:32.989218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:32.991431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:33.010805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:33.012846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:33.017120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:33.018818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:34.275410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:34.302050 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b840d2de-87d9-4680-97e3-750fc7619af5 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1675 microversion: 2.1 time: 1.319364 Jul 18 02:50:34.312461 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2809/5690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:32 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1675 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:35.325212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:35.327635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:35.344471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.345892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.347759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.348957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.660609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:35.687263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:35.693667 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-868756f7-32c9-44d8-b7bf-7db134b047b1 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1607 microversion: 2.1 time: 0.375905 Jul 18 02:50:35.695170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2882/5691] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:35 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1607 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:35.827039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8bb1aab8-9c6c-41ad-b7ef-2cbd819aebfb req-196d39fb-5435-4bfd-9a3f-7c561431d794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c392a5a1-57df-4381-b598-d962e00acf92", "tag": "08b400c1-27ff-4df2-8c34-872a30c8f83a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:35.870400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8bb1aab8-9c6c-41ad-b7ef-2cbd819aebfb req-196d39fb-5435-4bfd-9a3f-7c561431d794 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:35.871880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8bb1aab8-9c6c-41ad-b7ef-2cbd819aebfb req-196d39fb-5435-4bfd-9a3f-7c561431d794 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:35.931627 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8bb1aab8-9c6c-41ad-b7ef-2cbd819aebfb req-196d39fb-5435-4bfd-9a3f-7c561431d794 service nova] Creating event network-changed:08b400c1-27ff-4df2-8c34-872a30c8f83a for instance c392a5a1-57df-4381-b598-d962e00acf92 on n-h1-849796-1 Jul 18 02:50:35.958287 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8bb1aab8-9c6c-41ad-b7ef-2cbd819aebfb req-196d39fb-5435-4bfd-9a3f-7c561431d794 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138158 Jul 18 02:50:35.959281 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2810/5692] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:36.732246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:36.742713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:36.764591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:36.765830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:36.767688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:36.768788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:37.541951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:37.571502 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2f516ba-7317-4b71-b56f-3a1bd165a2eb tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1607 microversion: 2.1 time: 0.849772 Jul 18 02:50:37.573725 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2883/5693] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:36 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1607 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:38.305539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-91f69de2-2cea-4e54-be66-3fe125f269b3 req-eede666d-d222-4b48-8459-7ee25cc8ee37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa", "name": "network-vif-deleted", "tag": "93f8baa4-5521-4aff-a8cb-135842c4ccb9"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:38.332847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-91f69de2-2cea-4e54-be66-3fe125f269b3 req-eede666d-d222-4b48-8459-7ee25cc8ee37 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.339397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-91f69de2-2cea-4e54-be66-3fe125f269b3 req-eede666d-d222-4b48-8459-7ee25cc8ee37 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.389642 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-91f69de2-2cea-4e54-be66-3fe125f269b3 req-eede666d-d222-4b48-8459-7ee25cc8ee37 service nova] Creating event network-vif-deleted:93f8baa4-5521-4aff-a8cb-135842c4ccb9 for instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa on n-h1-849796-1 Jul 18 02:50:38.415840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-91f69de2-2cea-4e54-be66-3fe125f269b3 req-eede666d-d222-4b48-8459-7ee25cc8ee37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121624 Jul 18 02:50:38.417368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2811/5694] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:38.594995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:38.599013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:38.628814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.630731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.632595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.634334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.810990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:38.819755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:38.820155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lazy-loading 'fault' on Instance uuid ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:50:39.069277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a582cb21c54c7496b30998ab940b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d7b33bab74d78abb11eafbbdc6842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:39.099842 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cbb39bc7-8d51-401c-b6e8-4b3c97913270 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 200 len: 1329 microversion: 2.1 time: 0.512792 Jul 18 02:50:39.100468 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2884/5695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:38 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 1329 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:40.127238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:40.128702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] [instance: ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:40.148412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:40.149304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:40.155868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:40.155868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:40.192183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] HTTP exception thrown: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Request method failure captured: Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa HTTP/1.1 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MdlsFYlIYLJnfP7AJlN1iAI5-0_5oRRdNDbLyxM4FPYpS59pOOoF1-5PTxGqPjB3vi2boagZcxVlx4ULnGRKF5fEBySkZLz6m6bGU3vJ8ZwSk5KAmXOCGDZoB-bZt9ZOeiO93Pg94hUgAzfZzh-qh3SKQQEB7NXYUsInMVVui05tJc Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/266d7b33bab74d78abb11eafbbdc6842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 266d7b33bab74d78abb11eafbbdc6842 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1753243733 Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 44a582cb21c54c7496b30998ab940b1c Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1753243733-project Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa'} Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:40.201688 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Returning 404 to user: Instance ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96436f5b-6ee6-42f4-9511-f4ed8ff95a59 tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa" status: 404 len: 111 microversion: 2.1 time: 0.080539 Jul 18 02:50:40.220792 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2812/5696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:40 2022] GET /compute/v2.1/servers/ee65dae2-a1fc-4e1b-b847-ef9910bbb3fa => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:50:40.227047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ea3b5f06-4368-4263-921a-31cf7f7219fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] Calling method '.version_select at 0x7fab04f6a1f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:40.288823 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ea3b5f06-4368-4263-921a-31cf7f7219fd tempest-ServerActionsTestJSON-1753243733 tempest-ServerActionsTestJSON-1753243733-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071272261" status: 202 len: 0 microversion: 2.1 time: 0.066608 Jul 18 02:50:40.289698 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2885/5697] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071272261 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:50:56.322232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:56.326724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:56.342689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=47 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:56.345853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:56.349586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.350365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.352497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.353250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.429553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4fc2dbb7-4672-4c3b-89eb-d95125982089 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/ips" status: 200 len: 148 microversion: 2.1 time: 0.114768 Jul 18 02:50:56.439562 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2813/5698] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:50:56 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/ips => generated 148 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:50:56.445819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "becd793c-f2e4-481e-81f2-d2a9b105687a"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:50:56.447045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:56.455702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=15 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:56.456764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:56.494414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.495014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.496838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.497441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.658898 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/os-volume_attachments HTTP/1.1 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 74 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: {"volumeAttachment": {"volumeId": "becd793c-f2e4-481e-81f2-d2a9b105687a"}} Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: exception: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': 'ec163ca3-3477-45e6-b206-9dc0d96c191a', 'body': {'volumeAttachment': {'volumeId': 'becd793c-f2e4-481e-81f2-d2a9b105687a'}}} Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:50:56.671354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:50:56.676007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 400 to user: Invalid volume: volume becd793c-f2e4-481e-81f2-d2a9b105687a is already attached to instances: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:50:56.678606 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ea91853-a962-47e2-83ed-a92274068dab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.234089 Jul 18 02:50:56.679479 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2886/5699] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:50:56 2022] POST /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a/os-volume_attachments => generated 174 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:50:56.694383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:56.696164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:56.707814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.708424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.710291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:56.710885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:56.763362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:50:56.976065 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f45ef407-72bd-45ec-83f4-4e0b97db197b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 204 len: 0 microversion: 2.1 time: 0.288542 Jul 18 02:50:56.989024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2814/5700] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:50:56 2022] DELETE /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:50:56.994070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:56.994697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:57.004732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:57.008478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:57.009652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:57.018954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:57.439799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:57.448418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d61950bf-ac7b-4f68-a4aa-b55b01ee2b62 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1679 microversion: 2.1 time: 0.458326 Jul 18 02:50:57.449283 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2887/5701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:56 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1679 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:50:58.468583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:58.469472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:58.488527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.489020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.498239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:58.498700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:58.839175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:50:58.852400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b01df994-ca35-44f1-8d2f-ac1a482783fb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1679 microversion: 2.1 time: 0.388697 Jul 18 02:50:58.854773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2815/5702] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:58 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:50:59.878685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:50:59.880011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:50:59.901229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.902468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:50:59.903872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:50:59.904541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:01.339049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:01.359216 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a330b4e-a3ed-4f35-9804-a90c71622c10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1679 microversion: 2.1 time: 1.487847 Jul 18 02:51:01.383547 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2888/5703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:50:59 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1679 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:01.776258 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:51:01.776626 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 02:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:51:02.379611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:02.380275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:02.407043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:02.407522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:02.408421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:02.408886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.062697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:03.077232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43a2b5a9-8723-4046-a973-ee2f1279d81a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1611 microversion: 2.1 time: 0.702815 Jul 18 02:51:03.079784 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2816/5704] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:02 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1611 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:03.337482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c72d282b-4a3f-4c6b-a4d4-d1451e91c331 req-ccee88a0-d3f0-4875-b692-9b604a315ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec163ca3-3477-45e6-b206-9dc0d96c191a", "name": "network-vif-deleted", "tag": "71dfd282-07ca-4ea4-9c02-d62c6745dabb"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:03.368779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c72d282b-4a3f-4c6b-a4d4-d1451e91c331 req-ccee88a0-d3f0-4875-b692-9b604a315ff2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.369457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c72d282b-4a3f-4c6b-a4d4-d1451e91c331 req-ccee88a0-d3f0-4875-b692-9b604a315ff2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.393017 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c72d282b-4a3f-4c6b-a4d4-d1451e91c331 req-ccee88a0-d3f0-4875-b692-9b604a315ff2 service nova] Creating event network-vif-deleted:71dfd282-07ca-4ea4-9c02-d62c6745dabb for instance ec163ca3-3477-45e6-b206-9dc0d96c191a on n-h2-849796-1 Jul 18 02:51:03.402558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c72d282b-4a3f-4c6b-a4d4-d1451e91c331 req-ccee88a0-d3f0-4875-b692-9b604a315ff2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100621 Jul 18 02:51:03.403871 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2817/5705] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:03.419940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:03.420692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:03.437086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.440763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.443913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.446893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.541464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-918767a9-04e8-489a-a61b-001417c126fa tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments/8b6dfad9-fc84-4594-bf7a-535ec66e3886" status: 200 len: 194 microversion: 2.20 time: 0.673905 Jul 18 02:51:03.546648 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2889/5706] 10.222.0.67 () {60 vars in 1453 bytes} [Mon Jul 18 02:51:02 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments/8b6dfad9-fc84-4594-bf7a-535ec66e3886 => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:03.732573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:03.733241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:03.758176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.760589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.762888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:03.763590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:03.958619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lazy-loading 'services' on Instance uuid 61cfc432-dd24-4653-a500-35730df8798a {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:51:04.099139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:04.099395 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:04.110803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.112315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.114662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.115893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.163762 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5fb7de4-1ace-4e60-b844-9512a24b9285 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments/8b6dfad9-fc84-4594-bf7a-535ec66e3886" status: 202 len: 0 microversion: 2.20 time: 0.445031 Jul 18 02:51:04.171024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2818/5707] 10.222.0.67 () {60 vars in 1456 bytes} [Mon Jul 18 02:51:03 2022] DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments/8b6dfad9-fc84-4594-bf7a-535ec66e3886 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:51:04.200867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:04.207735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:04.233227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.234161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.237376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.238271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.296050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:04.300128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:04.300755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'fault' on Instance uuid ec163ca3-3477-45e6-b206-9dc0d96c191a {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:51:04.383402 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6238f9c4-2bbd-4714-80a4-285df23524bb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207441 Jul 18 02:51:04.390647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2819/5708] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:04 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:04.572095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:04.607290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5edae78c-6549-4d5d-9c12-c96f80da1616 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 200 len: 1330 microversion: 2.1 time: 0.513806 Jul 18 02:51:04.621017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2890/5709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:04 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 1330 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:05.404777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:05.407995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:05.452488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.453892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.459675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.460602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.629605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:05.630743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:05.699954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0369188f-9510-4141-9b8e-4d27148b45f9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.303319 Jul 18 02:51:05.701478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.702831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.704469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:05.705557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:05.712696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2820/5710] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:05 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:05.756719 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a HTTP/1.1 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ec163ca3-3477-45e6-b206-9dc0d96c191a'} Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:05.759686 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-30323cb5-012a-41ae-9458-f7157a71c6af tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 404 len: 111 microversion: 2.1 time: 0.141778 Jul 18 02:51:05.765415 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2891/5711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:05 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:51:05.779107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d1d89f0-941d-4e85-94ed-6df20a0fe04c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '.version_select at 0x7faaf730adc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:05.856647 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d1d89f0-941d-4e85-94ed-6df20a0fe04c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345116562" status: 202 len: 0 microversion: 2.1 time: 0.082310 Jul 18 02:51:05.861277 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2821/5712] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345116562 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:06.061844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:06.063733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:06.131192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.132146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.133645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.134428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.305350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3a310d1-1bd0-4b5f-8203-34679e3308cf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92/action" status: 200 len: 24569 microversion: 2.1 time: 0.256103 Jul 18 02:51:06.306424 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2892/5713] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:51:06 2022] POST /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92/action => generated 24569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:06.795491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:06.798238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:06.833229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.834053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.846025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:06.846640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:06.918416 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d8ab8d7-d8cd-44dc-9b6e-1363dc93bc1d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.177267 Jul 18 02:51:06.919424 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2822/5714] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:06 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:07.942300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:07.951949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:08.004866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:08.013463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:08.015350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:08.019550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:08.206215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d34bad83-0c18-467e-b082-f3df55fdc5db tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.268240 Jul 18 02:51:08.207548 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2893/5715] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:07 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:09.225615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.227299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.252032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.252863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.254378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.255158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.395727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-425fada5-ee3a-42ab-bf4e-50ba2d9c7d9d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.178491 Jul 18 02:51:09.405351 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2823/5716] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:09 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:09.519709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:09.524493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:09.555125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.564995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.568448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:09.569549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:09.932678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'services' on Instance uuid 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:51:10.266892 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17a3c85c-d139-48cf-bd42-6e40e388200d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments/becd793c-f2e4-481e-81f2-d2a9b105687a" status: 202 len: 0 microversion: 2.1 time: 0.753008 Jul 18 02:51:10.273058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2894/5717] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:51:09 2022] DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments/becd793c-f2e4-481e-81f2-d2a9b105687a => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:10.296952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:10.298600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:10.362920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.363889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.375217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.380047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.428002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:10.430530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:10.450350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.454470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.455679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:10.457341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:10.543225 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-950f4489-986f-4f0c-bc70-173d03b497af tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127144 Jul 18 02:51:10.545350 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2895/5718] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:10 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:10.587827 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dea36595-be5f-4cab-8247-ce21d77718eb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.303164 Jul 18 02:51:10.596789 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2824/5719] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:10 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:11.565750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:11.570480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:11.622493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:11.627485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:11.636001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.638203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.650941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.657624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.673658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.674789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.675936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:11.678569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:11.746699 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09df86fb-0291-4018-8677-525964892d0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190695 Jul 18 02:51:11.753521 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2896/5720] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:11 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:11.784442 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce0f1fe8-03df-4367-a2f2-68a3df81300c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183606 Jul 18 02:51:11.785145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2825/5721] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:11 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:12.768306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:12.769591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:12.779179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.779775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.780688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.783153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.798771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:12.799903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:12.829711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.830270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.833828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:12.834278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:12.973264 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24e0f75d-e4cf-41a8-b661-56884d9a7f2e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204086 Jul 18 02:51:12.980911 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2897/5722] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:12 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:12.988717 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3371b6d-da90-41a7-bc6b-25a617fff860 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196691 Jul 18 02:51:12.989380 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2826/5723] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:12 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:14.033615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:14.044506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:14.087804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:14.090771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:14.093325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:14.095168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:14.226078 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-57f9baee-9fe7-4790-a566-2afab23a805e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.240000 Jul 18 02:51:14.235738 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2898/5724] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:13 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:14.923608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:14.926763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:14.939852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:14.941170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:14.942985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:14.944334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.035257 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ab2f09a-ccdd-463a-bd4f-8443b75fbff8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.038295 Jul 18 02:51:15.037105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2827/5725] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:13 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:15.301463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:15.304243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:15.335283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.339564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.342451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:15.344056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:15.482966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-917220a5-e833-40f5-a03d-383fd125f578 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.239612 Jul 18 02:51:15.491314 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2899/5726] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:15 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:51:16.056632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.059968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:16.101442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.102219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.109768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.110594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.254585 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43ba521c-bea6-49b0-b09a-8bd8b2e6a7c3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208905 Jul 18 02:51:16.258951 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2828/5727] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:16 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:16.505791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.507680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:16.529139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.529966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.532664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.533465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.709861 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4dd387b1-4516-4130-8922-97ac539aaff8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.198671 Jul 18 02:51:16.718898 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2900/5728] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:51:16 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a/os-volume_attachments => generated 25 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:16.864289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:16.873058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:16.899215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.916434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:16.933591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:16.934599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.074835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:17.107481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:51:17.273034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.277189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.302037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.304222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.308865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.322735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.473650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46bbc9d8-2f88-4e46-b1ea-e1f32c2f4e7f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209517 Jul 18 02:51:17.483196 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2901/5729] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:17 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:17.485840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50f24cbe-e67e-49d7-825d-26c47ae2ef42 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 204 len: 0 microversion: 2.20 time: 0.626151 Jul 18 02:51:17.487112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2829/5730] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:51:16 2022] DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 02:51:17.496255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:17.500128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:17.523296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.526601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.527748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:17.529369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:17.618718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:18.498324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:18.504474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:18.561401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:18.564865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.571213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.576730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:18.578646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:18.578939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:18.587198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:18.590493 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1be2374b-c20e-4224-9a42-10451b97a34c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.097031 Jul 18 02:51:18.592308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2902/5731] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:17 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:51:18.756119 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6aa79ce1-61eb-4318-9c14-c30f764fc49d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.264172 Jul 18 02:51:18.768849 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2830/5732] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:18 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:19.626136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:19.629864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:19.646425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.648016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.650092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.651504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.782232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:19.787620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:19.821452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.826548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.828488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:19.831550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:19.988638 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09ead7d1-925f-43ed-9b67-9657c9c7e760 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206578 Jul 18 02:51:19.997450 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2831/5733] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:19 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:21.008028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:21.013467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:21.055535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.059598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.061200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:21.062004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:21.085929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:21.130195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:21.133606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:21.141295 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0a73924-e866-43d6-81a7-f3c384ed357f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 1.523052 Jul 18 02:51:21.157685 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2903/5734] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:19 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:21.234841 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf49ea23-3e7d-4411-ab52-026fb95ab266 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234529 Jul 18 02:51:21.237978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2832/5735] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:20 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:22.179040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:22.180167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:22.235688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:22.236705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:22.238329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:22.246154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:22.257426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:22.259108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:22.301678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:22.302627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:22.304085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:22.304882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:22.514397 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6722b4c6-5c7a-4137-acfb-02b0f7216ae0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.254482 Jul 18 02:51:22.520917 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2833/5736] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:22 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:23.536914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:23.551003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:23.606902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:23.623082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:23.627339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:23.628175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:23.768508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5384888f-6b02-4ee4-bc1c-9412a05030ab tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239006 Jul 18 02:51:23.773735 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2834/5737] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:23 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:24.544994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:24.573969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:24.584430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:24.601706 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae23e0fc-e83e-4cec-a5c9-1e82bf102bfb tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1723 microversion: 2.20 time: 2.421592 Jul 18 02:51:24.603963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2904/5738] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:22 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1723 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:24.800683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:24.807111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:24.864618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.866478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:24.871401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:24.873576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:25.068020 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69b6cb40-9eff-4a6d-a4ae-013f061fe2fe tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.289337 Jul 18 02:51:25.075972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2835/5739] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:24 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:25.623080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:25.624421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:25.634759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:25.636239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:25.637790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:25.638446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:26.045281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:26.078616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:26.084348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:26.085662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:26.086612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:26.088232 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7655fa44-c6b2-4b9f-9a1f-a4b2c5fc1918 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1655 microversion: 2.20 time: 0.470375 Jul 18 02:51:26.094508 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2905/5740] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:25 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1655 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:26.096455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:26.096946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:26.098506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:26.099002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:26.207212 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53c62f6d-46bc-4e32-b1b1-62c4f7cee0a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128448 Jul 18 02:51:26.220052 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2836/5741] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:26 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:26.927925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5d130c87-eb45-476c-ab77-36eeb59b9da0 req-89e1d62b-ca74-4213-890b-28134d030115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cfc432-dd24-4653-a500-35730df8798a", "name": "network-vif-deleted", "tag": "eb739af6-0efb-49d1-aff7-b043aa20858e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:26.956542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=43 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:26.967496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5d130c87-eb45-476c-ab77-36eeb59b9da0 req-89e1d62b-ca74-4213-890b-28134d030115 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:26.974427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5d130c87-eb45-476c-ab77-36eeb59b9da0 req-89e1d62b-ca74-4213-890b-28134d030115 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.007844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5d130c87-eb45-476c-ab77-36eeb59b9da0 req-89e1d62b-ca74-4213-890b-28134d030115 service nova] Creating event network-vif-deleted:eb739af6-0efb-49d1-aff7-b043aa20858e for instance 61cfc432-dd24-4653-a500-35730df8798a on n-h2-849796-1 Jul 18 02:51:27.024342 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5d130c87-eb45-476c-ab77-36eeb59b9da0 req-89e1d62b-ca74-4213-890b-28134d030115 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102028 Jul 18 02:51:27.029807 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2906/5742] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:27.129876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:27.131779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:27.144400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:27.170102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.171065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.176504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.179022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.226906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:27.228204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:27.264975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.265823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.267613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.273796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.374750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4423659-b222-4d63-986d-0429a4043d80 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153129 Jul 18 02:51:27.376582 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2907/5743] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:27 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:27.388659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:27.389782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:27.391356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lazy-loading 'fault' on Instance uuid 61cfc432-dd24-4653-a500-35730df8798a {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:51:27.789858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:27.841344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:27.844949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:27.861022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f03f6588-90c9-4cbc-bb71-d58497b7f468 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 200 len: 1371 microversion: 2.20 time: 0.738501 Jul 18 02:51:27.874174 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2837/5744] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:27 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 1371 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:51:28.394894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:28.409847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:28.457144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:28.458605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:28.463321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:28.467114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:28.583610 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e967b06-5c58-4e78-b069-ce32be75f941 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190188 Jul 18 02:51:28.584298 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2908/5745] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:28 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:28.908656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:28.909442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:28.923203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:28.934225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:28.936376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:28.936842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:28.995465 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a HTTP/1.1 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '61cfc432-dd24-4653-a500-35730df8798a'} Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:51:28.998120 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:51:29.003356 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:51:29.005709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:29.006953 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c871979c-74ed-44c2-bfd5-718dacc8d4d6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 404 len: 111 microversion: 2.20 time: 0.102707 Jul 18 02:51:29.009732 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2838/5746] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:28 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:51:29.030331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40539ad3-a772-44dd-822e-a40793a2bc39 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '.version_select at 0x7fab0491b9d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:29.118185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40539ad3-a772-44dd-822e-a40793a2bc39 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266328934" status: 204 len: 0 microversion: 2.20 time: 0.096569 Jul 18 02:51:29.121348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2909/5747] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Jul 18 02:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266328934 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:51:29.602120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:29.614212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:29.671494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:29.684317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:29.687845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:29.688669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:29.816833 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ec3470b-ae44-4423-be42-1bf5a9fbd8d3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221317 Jul 18 02:51:29.828390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2839/5748] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:29 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:30.837476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:30.841170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:30.880877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:30.882017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:30.883896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:30.887058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:30.974592 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a109cdf1-611d-4f11-845a-14f004e93fa2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141943 Jul 18 02:51:30.978962 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2910/5749] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:30 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:31.999917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:32.001709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:32.036220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.037436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.039313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.040461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.205609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58015cfa-f1c8-48ae-a91d-78b7616c657e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.209077 Jul 18 02:51:32.217472 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2840/5750] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:51:31 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c/os-volume_attachments => generated 25 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:51:32.430608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:32.431859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:32.451940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.452421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.453307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.453777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.522345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:51:32.720591 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2e678a3-9201-4b1c-995a-adf695198417 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 204 len: 0 microversion: 2.1 time: 0.294728 Jul 18 02:51:32.721987 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2911/5751] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:51:32 2022] DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:51:32.738879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:32.739901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:32.756694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.757501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.758803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:32.760408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:32.882240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e3a158f-f04a-4ae7-b275-c253aef84353 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: .version_select at 0x7fab0597bf70>, body: {"keypair": {"name": "tempest-keypair-564575198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtUzcl0V/0DZ6syNY+ZgJMwD3ni4TUhWwD45bRC65k0bRQe+7mfNzrI6wTr3/Pt24jCs/3p8Mf77RemK7czyumJF3l93hEulm1XQc5rr+8hqzD/u7/XJBIN0p1HIYk0Mg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:32.956788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4e3a158f-f04a-4ae7-b275-c253aef84353 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for project 63c4616265964dc0b9e563b531760614. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:32.992386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4e3a158f-f04a-4ae7-b275-c253aef84353 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for user cac2062b69124275b997a57802730b35 and project 63c4616265964dc0b9e563b531760614. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:33.071167 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e3a158f-f04a-4ae7-b275-c253aef84353 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.194531 Jul 18 02:51:33.075863 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2912/5752] 10.222.0.67 () {62 vars in 1199 bytes} [Mon Jul 18 02:51:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:51:33.188317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:33.199993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c823d14-5c99-4cbc-b979-43792201bc83 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1677 microversion: 2.1 time: 0.472564 Jul 18 02:51:33.205937 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2841/5753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:32 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1677 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:34.233889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:34.236503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:34.253076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:34.254307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:34.256091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:34.257693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:35.105672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:35.121982 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0b9a1cc4-e644-4b54-a551-c71a275be980 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1677 microversion: 2.1 time: 0.897299 Jul 18 02:51:35.129078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2913/5754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:34 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1677 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:36.157659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:36.158943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:36.175897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:36.177032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:36.178514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:36.183440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:37.305326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:37.315284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-966509311", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "613350f3-693b-4f81-a134-15d40147b6a6"}], "security_groups": [{"name": "tempest-securitygroup--406957792"}], "key_name": "tempest-keypair-564575198", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:37.330120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30b47c4e-6689-4c7f-8d86-3556fc1c612e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1677 microversion: 2.1 time: 1.176852 Jul 18 02:51:37.334795 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2842/5755] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:36 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1677 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:51:37.563248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] validate_networks() for [('613350f3-693b-4f81-a134-15d40147b6a6', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:51:38.367571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:38.380214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:38.426969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.427795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:38.437544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.438506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:38.741208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:38.794183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2567cffa-c05b-4be0-b790-67e05b41dcc2 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1609 microversion: 2.1 time: 0.431999 Jul 18 02:51:38.799239 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2843/5756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:38 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1609 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:38.925794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:51:38.927478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:51:38.929228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:51:38.930687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:51:38.931739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:51:38.977236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.978609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:38.980211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:38.995967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.127950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for project 63c4616265964dc0b9e563b531760614. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:39.150122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Getting quotas for user cac2062b69124275b997a57802730b35 and project 63c4616265964dc0b9e563b531760614. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:39.234469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:51:39.244502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e662570d-1eb9-47ee-bad3-a8f6e00d215a req-3ced871d-978f-4e36-95b7-217f1538d2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c", "name": "network-vif-deleted", "tag": "2164eb76-5762-4119-a54c-3a059de0bd9b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:39.256465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:51:39.270624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e662570d-1eb9-47ee-bad3-a8f6e00d215a req-3ced871d-978f-4e36-95b7-217f1538d2e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:39.274326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e662570d-1eb9-47ee-bad3-a8f6e00d215a req-3ced871d-978f-4e36-95b7-217f1538d2e8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.328633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e662570d-1eb9-47ee-bad3-a8f6e00d215a req-3ced871d-978f-4e36-95b7-217f1538d2e8 service nova] Creating event network-vif-deleted:2164eb76-5762-4119-a54c-3a059de0bd9b for instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c on n-h1-849796-1 Jul 18 02:51:39.348165 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e662570d-1eb9-47ee-bad3-a8f6e00d215a req-3ced871d-978f-4e36-95b7-217f1538d2e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108353 Jul 18 02:51:39.369525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2844/5757] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:39.649703 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b429b3b-5b4d-480f-8e32-b42203486c43 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.329942 Jul 18 02:51:39.653907 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2914/5758] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Jul 18 02:51:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:51:39.688895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:39.694881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:39.828697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:39.829381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:39.844916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:39.845269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.846236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:39.846499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.985262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:39.990924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:39.991839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'fault' on Instance uuid 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:51:40.086434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:40.118913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:40.123657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:40.128418 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e511259-8bff-4ff2-afb6-8d22c300ebf9 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1280 microversion: 2.20 time: 0.463452 Jul 18 02:51:40.130891 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2845/5759] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:39 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1280 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:40.213027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:40.230236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b00c04ba-612e-4ff8-afc9-7b8100f18973 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 200 len: 1329 microversion: 2.1 time: 0.403540 Jul 18 02:51:40.233407 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2915/5760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:39 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 1329 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:51:41.184657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:41.191275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:41.289941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:41.295234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:41.302443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.306119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.313412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.318009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.362920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.364215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.365880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:41.375933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:41.478793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:51:41.485789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c HTTP/1.1 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c'} Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:51:41.491974 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:51:41.503126 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:51:41.508141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:51:41.533276 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c545b58-2f87-44aa-a837-2593f74104ce tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 404 len: 111 microversion: 2.1 time: 0.279239 Jul 18 02:51:41.539256 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2916/5761] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:51:41 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 111 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:51:41.572689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f3c4de3-a2d8-4560-80d2-c913fa20211b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '.version_select at 0x7fab0491b940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:41.660014 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f3c4de3-a2d8-4560-80d2-c913fa20211b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555700109" status: 202 len: 0 microversion: 2.1 time: 0.110195 Jul 18 02:51:41.661434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2917/5762] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 02:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555700109 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:51:41.868847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:41.882271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:41.887031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:41.889227 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-900fa202-dc85-43d4-a778-e911181dd139 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1284 microversion: 2.20 time: 0.725399 Jul 18 02:51:41.903590 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2846/5763] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:41 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1284 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:42.929900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:42.933033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:42.973813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:42.975352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:42.983065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:42.984391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:43.587937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:43.614286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:43.630788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:43.633151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11834947-a949-4248-8f3e-0a93c150ed32 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1338 microversion: 2.20 time: 0.726039 Jul 18 02:51:43.647932 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2918/5764] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:42 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1338 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:44.691343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:44.692655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:44.734284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:44.735067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:44.736548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:44.747369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:45.075829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:45.102747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:45.106187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:45.122288 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-267b9248-169e-4346-af91-fb26254b4a18 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1338 microversion: 2.20 time: 0.452068 Jul 18 02:51:45.128247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2847/5765] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:44 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1338 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:46.165416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:46.177718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:46.196072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6836f86-be75-483f-b38d-5a877d606d97 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: .version_select at 0x7faaf737ab80>, body: {"keypair": {"name": "tempest-keypair-1168313851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI4BzSXn7iS5+TvlzuTydoil2kCbalsQhxBkDSSGnFG/kIWR0g7WUv7xnClxVYDNMiwObNgLPuG7duGTh1/YT8gkBDWoe6iYMju9rkbF4SFJ1ocBjZTpu5g+ERbsMRpgg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:46.218491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:46.225092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:46.237360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:46.243530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:46.310106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b6836f86-be75-483f-b38d-5a877d606d97 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:46.344672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b6836f86-be75-483f-b38d-5a877d606d97 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:46.543141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6836f86-be75-483f-b38d-5a877d606d97 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.356839 Jul 18 02:51:46.544256 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2848/5766] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:51:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:46.938536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:47.015188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:47.032579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:47.042203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90ef7f9f-160d-4d8e-9df6-c8f36f1351c1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1338 microversion: 2.20 time: 0.887097 Jul 18 02:51:47.052420 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2919/5767] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:46 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1338 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:48.085897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:48.087239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:48.101187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:48.102171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:48.103361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:48.104731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:48.583345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:48.606516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:48.608446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:48.609618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f8f91e8-28f7-4575-ba4d-a3bc51226ac1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.528107 Jul 18 02:51:48.610203 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2849/5768] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:48 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:49.655125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:49.661368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:49.740520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:49.747324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:49.777904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:49.779899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:49.787045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:49.788371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:49.823950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:51.792998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:51.833700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:51.846915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:51.850838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e6f5c7e-b572-4019-92af-92a48e865387 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 2.209756 Jul 18 02:51:51.860887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2920/5769] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:49 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:51:52.894290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:52.901093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:52.935504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.937192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:52.939900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:52.941648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:53.649575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:53.669168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:53.671964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:53.677240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7fe4711-8e1c-4b7c-8a9e-6ec1f992ffd5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.793491 Jul 18 02:51:53.692116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2850/5770] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:52 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:51:54.726126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:54.726815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:54.739040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.739496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:54.745981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:54.752441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:55.967502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-550e7235-2a87-4c03-b122-8a66bef4749b req-dce440fd-67d8-481f-a79d-1609d2d7c1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:55.988519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-550e7235-2a87-4c03-b122-8a66bef4749b req-dce440fd-67d8-481f-a79d-1609d2d7c1ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:55.989227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-550e7235-2a87-4c03-b122-8a66bef4749b req-dce440fd-67d8-481f-a79d-1609d2d7c1ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:56.026613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-550e7235-2a87-4c03-b122-8a66bef4749b req-dce440fd-67d8-481f-a79d-1609d2d7c1ad service nova] Creating event network-changed:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:51:56.039619 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-550e7235-2a87-4c03-b122-8a66bef4749b req-dce440fd-67d8-481f-a79d-1609d2d7c1ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076253 Jul 18 02:51:56.042918 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2851/5771] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:51:56.254062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:56.286476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:56.298356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:56.300348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26f60062-3e3a-4de1-9b61-a8a65ea89a94 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 1.577924 Jul 18 02:51:56.305414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2921/5772] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:54 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:51:57.036201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efe58e49-b71d-430d-b782-ee78b9aafa89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: .version_select at 0x7faaf7317550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-468615196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLxyy3PNyY2zvv58BrsGPBJUFdeLQfUAul0GvuFSONm1/0FFjEFsQPdqLxUhVbnSZGhx/eMnYf7Kdsfx9d/QzqY2KNhbGPkrsav4wlCej/3VWT8rzbAHWIB8FgZasb3lw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:51:57.049012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:57.119591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-efe58e49-b71d-430d-b782-ee78b9aafa89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:51:57.158527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-efe58e49-b71d-430d-b782-ee78b9aafa89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:51:57.221048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efe58e49-b71d-430d-b782-ee78b9aafa89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.189646 Jul 18 02:51:57.221682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2852/5773] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:51:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:51:57.323514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:51:57.331797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:51:57.378318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:51:57.381958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.382803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:57.387062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:51:57.387894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:51:59.158358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:59.194019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:59.201610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:51:59.207167 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fda412f-1ff3-4d06-b74b-2b35abead9c2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 1.889709 Jul 18 02:51:59.227856 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2922/5774] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:51:57 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:52:00.240854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:00.247784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:00.291941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:00.329542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:00.330319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:00.333332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:00.338340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:01.557231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:01.595841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:01.602831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:01.610837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9abf4c32-b5a6-46be-9514-2d5308a1fdb7 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 1.384434 Jul 18 02:52:01.611952 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2853/5775] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:00 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:52:01.790415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-658264797", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcc90fc-3273-454a-b817-89f60dcb357d"}], "security_groups": [{"name": "tempest-securitygroup--478550171"}], "key_name": "tempest-keypair-1168313851", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:02.676887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:02.677965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:02.698312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:02.698800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:02.702926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:02.707287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:03.451619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:03.491128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:03.499330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:03.506095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8db063c8-0cf1-45e7-9cbe-8bf77b52e668 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.833958 Jul 18 02:52:03.526508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2854/5776] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:02 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:52:03.774392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] validate_networks() for [('9fcc90fc-3273-454a-b817-89f60dcb357d', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:52:04.545978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:04.547901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:04.574406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:04.575479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:04.578594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:04.579105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:04.983711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:04.992994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:04.995665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:05.012150 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ff229a3-69ee-4322-9b5b-ac2f545e5303 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.480516 Jul 18 02:52:05.018263 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2855/5777] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:04 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:52:06.078603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:06.095865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:06.161604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.162147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:06.163250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:06.163702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.111213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:07.161651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:07.182519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:07.184810 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-58befeef-cdd6-4ce2-b43c-dea17b1432f5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 1.125996 Jul 18 02:52:07.197087 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2856/5778] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:06 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:52:07.816963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:52:07.818258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:52:07.819668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:52:07.820855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:52:07.822707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:52:07.914556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.922896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:07.934183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:07.937013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:08.080337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:52:08.103862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:52:08.153616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1292659825", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "f86e3983-e088-4996-b543-dc96630386d3"}], "key_name": "tempest-TestNetworkBasicOps-468615196", "security_groups": [{"name": "tempest-secgroup-smoke-1071878238"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:08.173762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:52:08.201186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:08.209586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:52:08.515170 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac216874-9603-4a8b-ac77-2b937a1bd9f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.732042 Jul 18 02:52:08.516724 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2923/5779] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:52:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 6738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:52:08.537005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:08.537521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:08.557749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.558193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:08.564815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:08.566675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.040212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.069447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.082867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.085354 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2eb9fd2e-4ec5-4182-b3bc-63b0e6d91ee8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.566772 Jul 18 02:52:09.092036 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2924/5780] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:08 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:52:09.114213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-75c50ed4-1c18-476e-bc88-56c7fe2872d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:09.115572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-75c50ed4-1c18-476e-bc88-56c7fe2872d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:09.245023 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] validate_networks() for [('f86e3983-e088-4996-b543-dc96630386d3', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:52:09.310015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-75c50ed4-1c18-476e-bc88-56c7fe2872d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:09.340311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-75c50ed4-1c18-476e-bc88-56c7fe2872d1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1241 microversion: 2.1 time: 0.246176 Jul 18 02:52:09.341757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2925/5781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:09 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1241 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:09.369238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4d30d44f-f55d-47f3-8c5c-e9aaae73d87a req-58730a56-00ce-4fcd-9368-bf58903a919b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "name": "network-vif-plugged", "status": "completed", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:09.410716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4d30d44f-f55d-47f3-8c5c-e9aaae73d87a req-58730a56-00ce-4fcd-9368-bf58903a919b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:09.418137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4d30d44f-f55d-47f3-8c5c-e9aaae73d87a req-58730a56-00ce-4fcd-9368-bf58903a919b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:09.465361 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4d30d44f-f55d-47f3-8c5c-e9aaae73d87a req-58730a56-00ce-4fcd-9368-bf58903a919b service nova] Creating event network-vif-plugged:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:52:09.482391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4d30d44f-f55d-47f3-8c5c-e9aaae73d87a req-58730a56-00ce-4fcd-9368-bf58903a919b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120028 Jul 18 02:52:09.483571 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2926/5782] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:10.134163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:10.145962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:10.163422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.163901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.171619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.172271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.537951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:10.558444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:10.562394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:10.565127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fb38da4-82b4-4553-94f1-e454933b4158 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1405 microversion: 2.20 time: 0.441417 Jul 18 02:52:10.566943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2927/5783] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:10 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:52:10.598471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:10.601399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:10.631111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.637523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.639527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:10.640324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:10.866210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:10.952567 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4171ff4a-797f-4b59-a5bc-1b71764a5432 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1293 microversion: 2.1 time: 0.383238 Jul 18 02:52:10.955754 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2928/5784] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:10 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:11.284479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:52:11.285822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:52:11.286588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:52:11.287118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:52:11.287703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:52:11.308550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.312079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.315362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.315981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.391349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:52:11.420454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:52:11.499914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:52:11.519655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:52:11.593917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:11.606043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:11.708466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.724858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.734594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:11.739439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:11.918084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e7b0c3eb-6ae5-4467-84d3-158f1c32fa7e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.764610 Jul 18 02:52:11.951459 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2857/5785] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:52:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 3802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:52:11.958962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3a215c0e-04a8-4897-9837-93cb493afdae tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:11.959774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3a215c0e-04a8-4897-9837-93cb493afdae tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:12.319808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3a215c0e-04a8-4897-9837-93cb493afdae tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:12.410200 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3a215c0e-04a8-4897-9837-93cb493afdae tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1248 microversion: 2.1 time: 0.456161 Jul 18 02:52:12.411759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2858/5786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:11 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1248 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:12.440278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:12.449208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:12.482383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.483798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.531731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.534026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.626446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=51 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:12.697683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:12.734749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:12.738694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:12.744487 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5526625-0a6e-404b-9de6-383193380e6f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1597 microversion: 2.20 time: 1.161454 Jul 18 02:52:12.748319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2929/5787] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:52:11 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1597 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:52:12.778977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:12.779855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:12.796263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.803272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.804574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:12.809622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:12.983036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:13.004290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-201e18e4-7ba8-4b7a-b3ab-214828349cc8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1299 microversion: 2.1 time: 0.589206 Jul 18 02:52:13.007478 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2859/5788] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:12 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1299 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:13.140754 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58ce4b31-f31b-4f05-bd87-c57dd29c00cf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.366590 Jul 18 02:52:13.142335 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2930/5789] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Jul 18 02:52:12 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-interface => generated 285 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:52:13.431798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:13.434142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:13.451779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:13.454227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:13.456273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:13.459703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.035521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:14.036427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:14.068830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.077730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.078863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:14.085016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:14.590709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:14.607227 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27895e84-8c65-4f65-b7dc-170b36a01954 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1244 microversion: 2.1 time: 1.180460 Jul 18 02:52:14.620109 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2860/5790] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:13 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1244 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:14.843454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:14.867853 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b9f7a99-4452-479f-8009-e7c785547e13 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1299 microversion: 2.1 time: 0.837774 Jul 18 02:52:14.880434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2931/5791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:14 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1299 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:15.646138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:15.648808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:15.707358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.713915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.722242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.723888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.902544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:15.903681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:15.921632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.925379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:15.928767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:15.929640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:16.198751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:16.218858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7dba581b-11d9-46e5-9ef2-4268ca94cace tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1306 microversion: 2.1 time: 0.582106 Jul 18 02:52:16.220121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2861/5792] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:15 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1306 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:17.250069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:17.251764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:17.265453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:17.268790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:17.270433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:17.271381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:17.568598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:17.605160 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95c44c88-102d-4aa0-a947-6dfbefa9a7cd tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 1.709534 Jul 18 02:52:17.606639 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2932/5793] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:15 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:17.953418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:17.976727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e038a3d-14f5-4827-937e-b01393999170 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1306 microversion: 2.1 time: 0.731803 Jul 18 02:52:17.981925 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2862/5794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:17 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1306 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:18.190073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4be4aa93-26b0-4cfa-b58e-028e952e18fd req-7127fce9-d752-404c-b8b3-858e4df7538e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:18.218853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:18.221933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4be4aa93-26b0-4cfa-b58e-028e952e18fd req-7127fce9-d752-404c-b8b3-858e4df7538e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:18.223505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4be4aa93-26b0-4cfa-b58e-028e952e18fd req-7127fce9-d752-404c-b8b3-858e4df7538e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:18.247898 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4be4aa93-26b0-4cfa-b58e-028e952e18fd req-7127fce9-d752-404c-b8b3-858e4df7538e service nova] Creating event network-changed:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:52:18.292226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4be4aa93-26b0-4cfa-b58e-028e952e18fd req-7127fce9-d752-404c-b8b3-858e4df7538e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108485 Jul 18 02:52:18.293246 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2933/5795] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:18.625359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:18.626000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:18.641966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:18.649181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:18.651536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:18.661742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:18.996803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:18.998191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:19.015471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.016111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:19.016991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:19.021530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:19.142784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:19.162977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41de9b60-151b-4de6-93c3-7bd4e3264c4e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.541417 Jul 18 02:52:19.163199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2863/5796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:18 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:19.317737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:19.371135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:19.383344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f5ba266-6a70-4bed-be26-ea6a4b0cfaef tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1306 microversion: 2.1 time: 0.391059 Jul 18 02:52:19.383960 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2934/5797] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:18 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1306 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:20.186145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:20.188240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:20.235738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:20.238308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:20.240534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:20.245562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:20.410697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:20.415034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:20.444372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:20.450739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:20.457222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:20.457222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:20.468604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=70 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:21.354996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:21.605382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:21.610781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:21.639646 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-23432de6-703f-4a72-b4cb-ef83199f21b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 1.461023 Jul 18 02:52:21.655258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2864/5798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:20 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:21.674097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-afde4d62-00e5-4fa8-80ee-19f60856784b req-e51f9027-d7a4-4d4b-a2f9-05b87794b7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa4eaae-a19e-4e98-ab90-8a0559bca110", "tag": "6ea86ba1-09e2-4318-bef1-b7d4d87e8c18"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:21.684850 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-188be6e1-95c7-4cd3-adba-cf07bf210195 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 1.262580 Jul 18 02:52:21.700967 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2935/5799] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:20 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:21.739803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-afde4d62-00e5-4fa8-80ee-19f60856784b req-e51f9027-d7a4-4d4b-a2f9-05b87794b7f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:21.741211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-afde4d62-00e5-4fa8-80ee-19f60856784b req-e51f9027-d7a4-4d4b-a2f9-05b87794b7f9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:21.808071 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-afde4d62-00e5-4fa8-80ee-19f60856784b req-e51f9027-d7a4-4d4b-a2f9-05b87794b7f9 service nova] Creating event network-changed:6ea86ba1-09e2-4318-bef1-b7d4d87e8c18 for instance baa4eaae-a19e-4e98-ab90-8a0559bca110 on n-h1-849796-1 Jul 18 02:52:21.825466 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-afde4d62-00e5-4fa8-80ee-19f60856784b req-e51f9027-d7a4-4d4b-a2f9-05b87794b7f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167812 Jul 18 02:52:21.826149 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2865/5800] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:22.687669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:22.697211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:22.729648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:22.730486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:22.751279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:22.753302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.753875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:22.754675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.755267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:22.761991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.781855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:22.793791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:22.795088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:23.496338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:23.514941 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7458c19e-b1ad-431a-b8bd-7e1a937bf2ca tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.842615 Jul 18 02:52:23.516312 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2936/5801] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:22 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:23.943057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:23.970451 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ffa08976-7c07-4ec2-9b5a-f53bd00fde07 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 1.242739 Jul 18 02:52:23.989053 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2866/5802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:22 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:24.556046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:24.559672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:24.583864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.584968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:24.592047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:24.593178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.018369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:25.021125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:25.035578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:25.048964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.050168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:25.050835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.278162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:25.294923 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09451d45-a9a3-45f1-a7e1-386b43d19d38 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.754691 Jul 18 02:52:25.299651 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2937/5803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:24 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:25.323670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-27b9b6d4-04fb-406a-9b06-659de0a54d3f req-daec391e-a6e7-4b59-a69c-d1ea3b99d3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18da3ab-6921-42ce-ac57-6f18fa1b2f9c", "tag": "a2bca254-3be4-40a4-9139-2692d8d51c56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:25.358131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-27b9b6d4-04fb-406a-9b06-659de0a54d3f req-daec391e-a6e7-4b59-a69c-d1ea3b99d3c4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:25.358654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-27b9b6d4-04fb-406a-9b06-659de0a54d3f req-daec391e-a6e7-4b59-a69c-d1ea3b99d3c4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:25.421274 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-27b9b6d4-04fb-406a-9b06-659de0a54d3f req-daec391e-a6e7-4b59-a69c-d1ea3b99d3c4 service nova] Creating event network-changed:a2bca254-3be4-40a4-9139-2692d8d51c56 for instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c on n-h2-849796-1 Jul 18 02:52:25.440710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-27b9b6d4-04fb-406a-9b06-659de0a54d3f req-daec391e-a6e7-4b59-a69c-d1ea3b99d3c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137392 Jul 18 02:52:25.444395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2938/5804] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:25.864883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:25.881503 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-942a9f45-5942-41e7-bf02-d41123e24ccf tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 0.890262 Jul 18 02:52:25.897234 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2867/5805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:24 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:26.322398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:26.325706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:26.342563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.343578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.345185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.345978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.742006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:26.760517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6dba4f0-dfef-4b39-9d71-3f08e44b00a9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.446233 Jul 18 02:52:26.776276 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2939/5806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:26 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:26.900989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:26.901695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:26.928365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.928824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:26.929850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:26.930295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:27.781032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:27.782329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:27.792561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:27.794949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:27.796550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:27.801844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:27.802682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:28.174795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:28.186836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-031a1f44-ca2f-4ac7-9643-f62357fef079 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.411991 Jul 18 02:52:28.188079 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2940/5807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:27 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:28.990336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:29.027250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4bec5781-a118-48c0-9c4d-122e6f470f14 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 2.131211 Jul 18 02:52:29.034378 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2868/5808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:26 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:29.212595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:29.217670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:29.254195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.255178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:29.259434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:29.264886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:30.058638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:30.059400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:30.089927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:30.090545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:30.091432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:30.091993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.110823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:31.126182 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f68be39a-93e8-4bf1-8bd0-d08085272e58 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 1.069501 Jul 18 02:52:31.141944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2869/5809] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:30 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:31.223779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:31.257174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e040f63-5b5d-4a34-a028-c66749cc046e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 2.048713 Jul 18 02:52:31.258114 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2941/5810] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:29 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:31.319726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fcdb8e05-a154-420b-a516-8014bc1666db req-02b62907-861c-4442-adaf-385b746508a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa4eaae-a19e-4e98-ab90-8a0559bca110", "name": "network-vif-plugged", "status": "completed", "tag": "6ea86ba1-09e2-4318-bef1-b7d4d87e8c18"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:31.338936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:52:31.343138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fcdb8e05-a154-420b-a516-8014bc1666db req-02b62907-861c-4442-adaf-385b746508a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:31.346228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fcdb8e05-a154-420b-a516-8014bc1666db req-02b62907-861c-4442-adaf-385b746508a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:31.375400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fcdb8e05-a154-420b-a516-8014bc1666db req-02b62907-861c-4442-adaf-385b746508a6 service nova] Creating event network-vif-plugged:6ea86ba1-09e2-4318-bef1-b7d4d87e8c18 for instance baa4eaae-a19e-4e98-ab90-8a0559bca110 on n-h1-849796-1 Jul 18 02:52:31.396220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fcdb8e05-a154-420b-a516-8014bc1666db req-02b62907-861c-4442-adaf-385b746508a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080150 Jul 18 02:52:31.398775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2870/5811] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:32.157525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:32.177218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:32.250908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.252658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.254281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.256404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.288501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:32.291181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:32.365426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.388745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.388745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:32.388745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:32.825862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:32.852294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f574e63e-6f93-40e5-ab78-b7e6c3d85cdc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.576876 Jul 18 02:52:32.854026 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2871/5812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:32 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:33.740600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:33.769031 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fbb5fc6e-7db4-4139-8fa4-29e4dc87917b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 1.625222 Jul 18 02:52:33.770823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2942/5813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:32 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:33.870114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:33.871399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:33.879462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:33.896568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:33.897518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:33.898651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:34.688323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:34.729742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f39eb6d-6e85-4a99-b6fd-2162e03d97d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1366 microversion: 2.1 time: 0.860516 Jul 18 02:52:34.731475 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2872/5814] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:33 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1366 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:34.789375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:34.791371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:34.816109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:34.820183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:34.821630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:34.826806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.522405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:35.536465 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2830480e-f6a0-4883-ad3f-a1361a13d30d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 0.751662 Jul 18 02:52:35.542537 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2943/5815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:34 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:35.762927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:35.763537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:35.782623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:35.784143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.784143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:35.784356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.844893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e6e99aac-d1b1-4998-b149-efb94a898e1b req-24218ef0-c5cc-4537-b690-a3e0c76985fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18da3ab-6921-42ce-ac57-6f18fa1b2f9c", "name": "network-vif-plugged", "status": "completed", "tag": "a2bca254-3be4-40a4-9139-2692d8d51c56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:35.880490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6e99aac-d1b1-4998-b149-efb94a898e1b req-24218ef0-c5cc-4537-b690-a3e0c76985fa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:35.880981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e6e99aac-d1b1-4998-b149-efb94a898e1b req-24218ef0-c5cc-4537-b690-a3e0c76985fa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:35.942108 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e6e99aac-d1b1-4998-b149-efb94a898e1b req-24218ef0-c5cc-4537-b690-a3e0c76985fa service nova] Creating event network-vif-plugged:a2bca254-3be4-40a4-9139-2692d8d51c56 for instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c on n-h2-849796-1 Jul 18 02:52:35.949200 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e6e99aac-d1b1-4998-b149-efb94a898e1b req-24218ef0-c5cc-4537-b690-a3e0c76985fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109767 Jul 18 02:52:35.965380 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2944/5816] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:52:36.216431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:36.233710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-001c6837-fbbc-4a95-b217-2c7f8eed0bbb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1556 microversion: 2.1 time: 0.476194 Jul 18 02:52:36.238108 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2873/5817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:35 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1556 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:36.266227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:36.267764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:36.293559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.294031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.294878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.296511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.564612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:36.583056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:36.602002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.604332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.614892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:36.617147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:36.619632 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de342ad3-b549-4f1b-a589-27c8eb9cd16e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.369454 Jul 18 02:52:36.626758 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2945/5818] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:52:36 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-interface => generated 285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:52:37.210906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:37.248539 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ba845a3-6be5-4bce-9bcd-31813a37f38c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 0.688828 Jul 18 02:52:37.249256 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2874/5819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:36 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:38.309473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:38.313271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:38.336518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:38.341313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:38.343085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:38.350106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:38.938818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:38.970820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d2b3e761-ab32-41a4-8c2f-33192dfc2d3d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1374 microversion: 2.1 time: 0.707043 Jul 18 02:52:38.974058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2946/5820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:38 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1374 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:40.002724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:40.004200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:40.014478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.015854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.018067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.018905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.612775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:40.630962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19b63cbc-953c-4dce-a337-06287efde015 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1546 microversion: 2.1 time: 0.633937 Jul 18 02:52:40.651326 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2875/5821] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:39 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1546 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:52:40.654454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:52:40.655293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:52:40.672010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.672806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:40.673940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:40.674574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.477124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:52:41.487224 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c5c7b7b8-5e1f-49b4-9cf0-210045da4bd6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1546 microversion: 2.1 time: 0.837721 Jul 18 02:52:41.496691 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2947/5822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:52:40 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1546 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:52:41.813681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d41d75d2-68ec-46cd-8c67-7c6b1aac1cd9 req-6af627fc-7623-461a-86c9-efdd7233539e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa4eaae-a19e-4e98-ab90-8a0559bca110", "tag": "6ea86ba1-09e2-4318-bef1-b7d4d87e8c18"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:52:41.841501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d41d75d2-68ec-46cd-8c67-7c6b1aac1cd9 req-6af627fc-7623-461a-86c9-efdd7233539e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:52:41.844338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d41d75d2-68ec-46cd-8c67-7c6b1aac1cd9 req-6af627fc-7623-461a-86c9-efdd7233539e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:52:41.887786 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d41d75d2-68ec-46cd-8c67-7c6b1aac1cd9 req-6af627fc-7623-461a-86c9-efdd7233539e service nova] Creating event network-changed:6ea86ba1-09e2-4318-bef1-b7d4d87e8c18 for instance baa4eaae-a19e-4e98-ab90-8a0559bca110 on n-h1-849796-1 Jul 18 02:52:41.913791 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d41d75d2-68ec-46cd-8c67-7c6b1aac1cd9 req-6af627fc-7623-461a-86c9-efdd7233539e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102341 Jul 18 02:52:41.918706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2876/5823] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:28.770463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:28.771607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:28.790500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=15 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:28.794380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=67 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:28.798137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:28.799185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:28.801058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:28.820088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:28.926810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:53:29.291387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8dd5952e-41b3-4aa1-8eca-aad60a9ef4d7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 204 len: 0 microversion: 2.1 time: 0.524350 Jul 18 02:53:29.294568 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2948/5824] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:53:28 2022] DELETE /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:53:29.305894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:29.307613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:29.366316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=13 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:29.374105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:29.388474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.389353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:29.390818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:29.391626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:30.154530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:30.209046 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd0f126e-a9c4-4192-819c-cefc5016817f tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1552 microversion: 2.1 time: 0.909256 Jul 18 02:53:30.210391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2877/5825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:29 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1552 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:31.252287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:31.257665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:31.286789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:31.286789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:31.287132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:31.287498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:32.266039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:32.304017 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f47c33e3-3b6f-44a6-ba4a-7d834072b10c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1552 microversion: 2.1 time: 1.060456 Jul 18 02:53:32.328814 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2949/5826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:31 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1552 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:33.355430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:33.357152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:33.428460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:33.429551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:33.434829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:33.435777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:34.415847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-478ff6a0-d660-40ab-a0d1-70e7f09c606f req-9927b8b1-72e7-43fc-b3dc-54f92e8c092a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18da3ab-6921-42ce-ac57-6f18fa1b2f9c", "name": "network-vif-deleted", "tag": "a2bca254-3be4-40a4-9139-2692d8d51c56"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:34.469034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-478ff6a0-d660-40ab-a0d1-70e7f09c606f req-9927b8b1-72e7-43fc-b3dc-54f92e8c092a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:34.474670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-478ff6a0-d660-40ab-a0d1-70e7f09c606f req-9927b8b1-72e7-43fc-b3dc-54f92e8c092a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:34.477871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:34.507633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4ae500f-9039-4ed6-9e2f-aabb228f7ee8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1552 microversion: 2.1 time: 1.172780 Jul 18 02:53:34.515511 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-478ff6a0-d660-40ab-a0d1-70e7f09c606f req-9927b8b1-72e7-43fc-b3dc-54f92e8c092a service nova] Creating event network-vif-deleted:a2bca254-3be4-40a4-9139-2692d8d51c56 for instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c on n-h2-849796-1 Jul 18 02:53:34.522978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2878/5827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:33 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1552 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:34.528752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-478ff6a0-d660-40ab-a0d1-70e7f09c606f req-9927b8b1-72e7-43fc-b3dc-54f92e8c092a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120852 Jul 18 02:53:34.533358 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2950/5828] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:35.560802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:35.566854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:35.614716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:35.615520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:35.616876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:35.617639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:35.765604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:35.766774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:35.767799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lazy-loading 'fault' on Instance uuid e18da3ab-6921-42ce-ac57-6f18fa1b2f9c {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:53:36.401161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:36.438183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b63e8bb1-aef8-400e-97df-80281935145c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 200 len: 1338 microversion: 2.1 time: 0.878476 Jul 18 02:53:36.443299 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2879/5829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:35 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 1338 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:37.481601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:37.482878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: e18da3ab-6921-42ce-ac57-6f18fa1b2f9c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:37.507587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.522174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:37.524592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:37.526014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:37.575783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] HTTP exception thrown: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Request method failure captured: Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c HTTP/1.1 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Morg627wt9nQdots5IeFS5nl2awmE4xQPhdjSkofRYfiSMfgw49cOcSfKmXA1a2zGWZPsqnPpkFOsutYK8Jnt32DOcYcsBdLWb21VG1CJOZT65Cv2mbX4T-J8D17v1aHl9RDSIkeFxGhgH-3AH8tRoshpSi1GXMJ4Ho_2HrI-7w1Ko Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad4255390afb444c838b12632e86ca55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad4255390afb444c838b12632e86ca55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 9917a7316471409699a914b358301e1c Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e18da3ab-6921-42ce-ac57-6f18fa1b2f9c'} Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:37.577584 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Returning 404 to user: Instance e18da3ab-6921-42ce-ac57-6f18fa1b2f9c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:37.586652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8333ca57-923d-48a2-8f34-df08c3520151 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c" status: 404 len: 111 microversion: 2.1 time: 0.108378 Jul 18 02:53:37.592964 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2951/5830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:37 2022] GET /compute/v2.1/servers/e18da3ab-6921-42ce-ac57-6f18fa1b2f9c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:38.341949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc523398-910b-4a45-88b6-f81b4c43b640 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '.version_select at 0x7faaf7364670>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:38.394151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc523398-910b-4a45-88b6-f81b4c43b640 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468615196" status: 202 len: 0 microversion: 2.1 time: 0.067537 Jul 18 02:53:38.399549 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2880/5831] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Jul 18 02:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468615196 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:53:45.223676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:45.225007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:45.271979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.276523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.277806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.281459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.342422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:53:45.595721 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19b6f2d3-b7fa-451d-b2b0-7a96b4e41e75 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 204 len: 0 microversion: 2.1 time: 0.376050 Jul 18 02:53:45.598639 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2952/5832] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:53:45 2022] DELETE /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:53:45.609387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:45.617007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:45.628915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.629832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.630947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:45.631663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:45.987624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e47e7c1c-4fe0-4071-9104-c59d9432c280 req-4567a51c-49d3-4ce2-81ab-a57a344db55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c392a5a1-57df-4381-b598-d962e00acf92", "tag": "08b400c1-27ff-4df2-8c34-872a30c8f83a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:46.029517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e47e7c1c-4fe0-4071-9104-c59d9432c280 req-4567a51c-49d3-4ce2-81ab-a57a344db55f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.036077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e47e7c1c-4fe0-4071-9104-c59d9432c280 req-4567a51c-49d3-4ce2-81ab-a57a344db55f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.084034 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e47e7c1c-4fe0-4071-9104-c59d9432c280 req-4567a51c-49d3-4ce2-81ab-a57a344db55f service nova] Creating event network-changed:08b400c1-27ff-4df2-8c34-872a30c8f83a for instance c392a5a1-57df-4381-b598-d962e00acf92 on n-h1-849796-1 Jul 18 02:53:46.120055 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e47e7c1c-4fe0-4071-9104-c59d9432c280 req-4567a51c-49d3-4ce2-81ab-a57a344db55f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.888983 Jul 18 02:53:46.134784 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2881/5833] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:46.147886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:46.148764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:46.201259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.201988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.203248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:46.203944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:46.300588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:46.337668 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e3df92ac-8fea-4ba7-b8cb-38ac8014731c tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1669 microversion: 2.1 time: 0.734482 Jul 18 02:53:46.338714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2953/5834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:45 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1669 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:46.339745 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6615a1f1-f395-4b26-a5a9-c88146e4fa8c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/ips" status: 200 len: 151 microversion: 2.20 time: 0.183110 Jul 18 02:53:46.340832 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2882/5835] 10.222.0.67 () {60 vars in 1288 bytes} [Mon Jul 18 02:53:46 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/ips => generated 151 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:53:47.373454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:47.375267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:47.425411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:47.426701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:47.428519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:47.430348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:48.573264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:48.601848 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59b1b007-2d19-4433-924f-3ca4824f22c7 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1669 microversion: 2.1 time: 1.236786 Jul 18 02:53:48.606188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2954/5836] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:47 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1669 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:49.624097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:49.625424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:49.642300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:49.643218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:49.644893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:49.648565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.038854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:51.093169 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32b9e767-282c-4f77-acd8-75baf3753758 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1601 microversion: 2.1 time: 1.473500 Jul 18 02:53:51.094265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2883/5837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:49 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1601 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:53:51.195772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:51.201559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:51.248256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.249053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.255451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.256587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.439664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lazy-loading 'flavor' on Instance uuid 9fca31ed-7869-4cf6-a36c-749846a36241 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:53:51.690996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b4498499-b6a0-4b28-b75b-6fec688f4bae req-8e5d8fd6-795c-4d41-a741-5305e2b79f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c392a5a1-57df-4381-b598-d962e00acf92", "name": "network-vif-deleted", "tag": "08b400c1-27ff-4df2-8c34-872a30c8f83a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:53:51.717898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b4498499-b6a0-4b28-b75b-6fec688f4bae req-8e5d8fd6-795c-4d41-a741-5305e2b79f3b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:51.718659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b4498499-b6a0-4b28-b75b-6fec688f4bae req-8e5d8fd6-795c-4d41-a741-5305e2b79f3b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:51.786676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b4498499-b6a0-4b28-b75b-6fec688f4bae req-8e5d8fd6-795c-4d41-a741-5305e2b79f3b service nova] Creating event network-vif-deleted:08b400c1-27ff-4df2-8c34-872a30c8f83a for instance c392a5a1-57df-4381-b598-d962e00acf92 on n-h1-849796-1 Jul 18 02:53:51.833556 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b4498499-b6a0-4b28-b75b-6fec688f4bae req-8e5d8fd6-795c-4d41-a741-5305e2b79f3b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143371 Jul 18 02:53:51.843463 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2884/5838] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:52.137626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:52.146057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.175749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.181439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.183518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.185973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.387624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.388208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.388680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lazy-loading 'fault' on Instance uuid c392a5a1-57df-4381-b598-d962e00acf92 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:53:52.523417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60c467ed-c5d6-4e09-8c35-2ce689e5d966 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/action" status: 202 len: 0 microversion: 2.20 time: 1.334603 Jul 18 02:53:52.525653 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2955/5839] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:53:51 2022] POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/action => generated 0 bytes in 1339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:53:52.586425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:52.591402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:52.626334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.626805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.629192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:52.639112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:52.911140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:52.924857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6cc3b8c8-82b2-4c59-b2c7-1c4f637069f5 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 200 len: 1338 microversion: 2.1 time: 0.793855 Jul 18 02:53:52.926138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2885/5840] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:52 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 1338 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:53:53.240901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:53.269696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:53.283983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:53.313504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de4475e4-867a-4d81-8484-1023e414e62a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 0.736707 Jul 18 02:53:53.315449 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2956/5841] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:53:52 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:53:53.944452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:53.946590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: c392a5a1-57df-4381-b598-d962e00acf92] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:53.963746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.965271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:53.968365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:53.970423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.013521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] HTTP exception thrown: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Request method failure captured: Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 HTTP/1.1 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Morg627wt9nQdots5IeFS5nl2awmE4xQPhdjSkofRYfiSMfgw49cOcSfKmXA1a2zGWZPsqnPpkFOsutYK8Jnt32DOcYcsBdLWb21VG1CJOZT65Cv2mbX4T-J8D17v1aHl9RDSIkeFxGhgH-3AH8tRoshpSi1GXMJ4Ho_2HrI-7w1Ko Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad4255390afb444c838b12632e86ca55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad4255390afb444c838b12632e86ca55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 9917a7316471409699a914b358301e1c Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'c392a5a1-57df-4381-b598-d962e00acf92'} Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:53:54.019733 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:53:54.031225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Returning 404 to user: Instance c392a5a1-57df-4381-b598-d962e00acf92 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:53:54.033460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17e20058-0d3d-4096-a168-45f747c8f220 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92" status: 404 len: 111 microversion: 2.1 time: 0.091416 Jul 18 02:53:54.033973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2886/5842] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:53:53 2022] GET /compute/v2.1/servers/c392a5a1-57df-4381-b598-d962e00acf92 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:53:54.364844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.366503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.389215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.390958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.392062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.392605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.634549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-167e107d-5156-4ede-8d41-bb335b7c2fca tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '.version_select at 0x7faaf7359550>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.679029 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-167e107d-5156-4ede-8d41-bb335b7c2fca tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468621492" status: 202 len: 0 microversion: 2.1 time: 0.050394 Jul 18 02:53:54.689382 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2887/5843] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Jul 18 02:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468621492 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:53:54.725865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:54.726664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:54.735571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.736467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.737534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:54.738169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:54.808009 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59cf1370-9fd4-4062-9ea5-1ac5e190e4d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/ips" status: 200 len: 149 microversion: 2.1 time: 0.101004 Jul 18 02:53:54.811906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2888/5844] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:53:54 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/ips => generated 149 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:53:55.434758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:55.492373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:55.517169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:55.530280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc1f8c3a-6d31-4b11-8de5-78add6a71820 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 1.169526 Jul 18 02:53:55.545815 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2957/5845] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:53:54 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:53:56.566365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:56.574577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:56.610727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:56.611523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:56.628327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:56.629171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:57.409205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:57.425585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:57.429198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:57.442434 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-741d39f8-5574-4401-a277-739ec1cf252a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 0.883828 Jul 18 02:53:57.444138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2889/5846] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:53:56 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:53:58.499740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:53:58.504572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:53:58.558782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.559617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:58.561228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:53:58.573961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:53:59.613645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:59.629224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:53:59.636465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:59.636465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:53:59.639262 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8091c6db-77a6-42c6-b888-6a4f654c4a07 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 1.167881 Jul 18 02:53:59.657865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2958/5847] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:53:58 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:00.665423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:00.666465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:00.667683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ef23f51-c821-42c7-80b7-59a075235a5a"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:00.676803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:00.677001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:00.678329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.679414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.681971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.682822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.692062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:00.792868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.797142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.817801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:00.824516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:00.954114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=55 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:01.676471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:01.737281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:01.753170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:01.759941 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f7e2a26-a4ed-4401-91cd-2a6bd4af317b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 1.094460 Jul 18 02:54:01.762481 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2959/5848] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:00 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:54:01.795386 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2215c04-44e9-4796-8430-5b5ec318148d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134411 Jul 18 02:54:01.801230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2890/5849] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:54:00 2022] POST /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:02.799768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:02.800588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:02.818843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:02.819316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:02.820327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:02.820751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:04.022366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:04.075046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:04.090095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:04.111482 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abe601b1-6f58-4da6-af6d-e754ef0d6acf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 1.321812 Jul 18 02:54:04.113562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2960/5850] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:02 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:05.155638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:05.164181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:05.197632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.210220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:05.215182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:05.224829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:06.911571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:06.969897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:06.974002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:07.003187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c8aae37-94f0-4b8f-8cf5-af748429679e tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1742 microversion: 2.20 time: 1.838661 Jul 18 02:54:07.004310 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2891/5851] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:05 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1742 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:08.042445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:08.043315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:08.080910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:08.101510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:08.106296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:08.107537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:08.610120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:08.661602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:08.666277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:08.676191 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c5ee2575-9235-4b12-a403-d611e2de6d82 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1742 microversion: 2.20 time: 0.641155 Jul 18 02:54:08.694311 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2961/5852] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:08 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1742 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:09.723787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:09.730940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:09.784148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:09.787541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:09.794510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:09.801429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:10.921631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:10.953226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:10.964758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:10.972601 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10bde9b7-49d4-4968-b183-f57573450707 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1742 microversion: 2.20 time: 1.258694 Jul 18 02:54:10.980305 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2892/5853] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:09 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1742 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:11.373549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-78d0e871-78c4-4f8e-8096-1128db7ebaed req-d2a56477-6240-443f-a5e0-85996cae2204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "name": "network-vif-plugged", "status": "completed", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:11.396591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-78d0e871-78c4-4f8e-8096-1128db7ebaed req-d2a56477-6240-443f-a5e0-85996cae2204 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:11.399771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-78d0e871-78c4-4f8e-8096-1128db7ebaed req-d2a56477-6240-443f-a5e0-85996cae2204 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:11.426450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-78d0e871-78c4-4f8e-8096-1128db7ebaed req-d2a56477-6240-443f-a5e0-85996cae2204 service nova] Creating event network-vif-plugged:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:54:11.439912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-78d0e871-78c4-4f8e-8096-1128db7ebaed req-d2a56477-6240-443f-a5e0-85996cae2204 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.644247 Jul 18 02:54:11.442846 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2962/5854] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:12.027865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:12.039412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:12.077284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:12.081188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:12.086102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:12.087928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:13.721609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:13.744289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:13.749796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:13.751326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7012131-700e-4212-ab26-a81892a3fe72 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.744737 Jul 18 02:54:13.756895 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2893/5855] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:12 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:14.777710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:14.779158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:14.801611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:14.802099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:14.802965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:14.803532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:17.482451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:17.513004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:17.514886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:17.529928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b18ca7e-4fd1-4b12-b195-612833ce3e00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 2.743526 Jul 18 02:54:17.530648 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2963/5856] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:14 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:54:18.577778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:18.579106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:18.617389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:18.622288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:18.626149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:18.629207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:19.825040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:19.839406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:19.851863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:19.854102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f85bce0c-b095-4b4a-b340-10a02c3ba78c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.284590 Jul 18 02:54:19.854662 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2894/5857] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:18 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:20.886462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:20.887315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:20.921229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.925027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:20.935838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:20.941755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:21.670366 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:54:21.670968 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 02:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 (ip 10.222.0.67) !!! Jul 18 02:54:23.294443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:23.345108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:23.372576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:23.385710 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fd18aca-20db-4816-8347-0cff5dbb6ee6 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 2.502754 Jul 18 02:54:23.405477 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2964/5858] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:20 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:54:24.426656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:24.427479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:24.484152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:24.488503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:24.507557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:24.509837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:26.536847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:26.613154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:26.636404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:26.650440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-afc1358b-b267-4b8e-87d1-6687e3b29cec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 2.223840 Jul 18 02:54:26.666798 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2895/5859] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:24 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:27.706131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:27.707488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:27.719364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:27.731517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:27.733287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:27.735132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:28.242217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ef23f51-c821-42c7-80b7-59a075235a5a"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:28.244876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:28.288024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:28.291599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:28.294643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:28.295988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:28.826274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:28.849648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:28.851581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:28.859735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3be686d-773f-4c4c-b8a8-f78e8aecc50c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.158519 Jul 18 02:54:28.860376 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2965/5860] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:27 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:28.942806 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments HTTP/1.1 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 74 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: {"volumeAttachment": {"volumeId": "8ef23f51-c821-42c7-80b7-59a075235a5a"}} Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'baa4eaae-a19e-4e98-ab90-8a0559bca110', 'body': {'volumeAttachment': {'volumeId': '8ef23f51-c821-42c7-80b7-59a075235a5a'}}} Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:54:28.945196 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 Jul 18 02:54:28.951116 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:54:28.954377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 400 to user: Invalid volume: volume 8ef23f51-c821-42c7-80b7-59a075235a5a is already attached to instances: baa4eaae-a19e-4e98-ab90-8a0559bca110 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:54:28.960651 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b458db96-266c-462d-9778-6f329470f749 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.728576 Jul 18 02:54:28.967665 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2896/5861] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:54:28 2022] POST /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 174 bytes in 738 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:54:29.265163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:29.266027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:29.344471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.345837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:29.356530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.359051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:29.764450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'services' on Instance uuid baa4eaae-a19e-4e98-ab90-8a0559bca110 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:54:29.897903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:29.898586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:29.927918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.930990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:29.939360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:29.943160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:30.052461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-33cd13ff-2da5-4806-84f8-3c6066c7ca8b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments/8ef23f51-c821-42c7-80b7-59a075235a5a" status: 202 len: 0 microversion: 2.1 time: 0.812758 Jul 18 02:54:30.057427 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2966/5862] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:54:29 2022] DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments/8ef23f51-c821-42c7-80b7-59a075235a5a => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:54:30.076099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:30.085144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:30.115122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:30.117208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:30.121405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:30.122129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:30.323545 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e2b8916-ed35-4db8-accd-123d65aac462 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.264627 Jul 18 02:54:30.333333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2967/5863] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:30 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:31.173560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:31.205839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:31.286849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:31.300407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:31.309648 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-61bd79ce-3448-404c-8875-2e5e0a43fd5f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.412264 Jul 18 02:54:31.310768 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2897/5864] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:29 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:54:31.345277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:31.351972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:31.401417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=18 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:31.401417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:31.409939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:31.430978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:31.430978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:31.459526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:31.678620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-664ec14f-2862-4bd8-adf0-dd9f069d3da4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.343001 Jul 18 02:54:31.683930 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2968/5865] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:31 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:32.359125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:32.377081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:32.382106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=16 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:32.416080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:32.421868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:32.434900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:32.436166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:32.698264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:32.699692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:32.728484 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:32.730737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:32.740177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:32.742204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:32.874384 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5496a95f-e616-4295-864e-1376006f9227 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183325 Jul 18 02:54:32.878553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2969/5866] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:32 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:33.173123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:33.183872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:33.207337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:33.215855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a54220c0-4175-489f-8477-5092c34b1df2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.865801 Jul 18 02:54:33.219159 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2898/5867] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:32 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:33.891357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:33.898112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:33.936137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:33.948507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:33.962724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:33.965399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:34.151178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3261cb18-3c80-4bb0-b23a-b3960ea24a75 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.267631 Jul 18 02:54:34.164820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2970/5868] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:33 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:34.246940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:34.249266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:34.271708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:34.282431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:34.284145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:34.285295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:35.175012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:35.176674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:35.232310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:35.233402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:35.235905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:35.241038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:35.358329 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83fc5a12-60a0-4276-9f48-31a9910c5e98 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190019 Jul 18 02:54:35.360871 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2971/5869] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:35 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:36.019217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:36.035868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:36.041952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:36.051803 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1bed48a6-fe2b-4ca6-8ce4-bcf6368fd554 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.812932 Jul 18 02:54:36.058974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2899/5870] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:34 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:36.375655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:36.378110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:36.409708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:36.411626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:36.416796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:36.419618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:36.559057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-42647167-b8c2-4909-a959-b6f29a85f972 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189487 Jul 18 02:54:36.569881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2972/5871] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:36 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:37.078252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:37.079021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:37.103690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.108378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:37.109674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.113436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:37.610269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:37.617116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:37.653158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.654736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:37.661837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:37.663193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:37.879124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e3535a40-01d2-4d2f-900a-a2051540ad6d tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.305590 Jul 18 02:54:37.904709 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2973/5872] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:37 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:38.103586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:38.124757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:38.138183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:38.152458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3eacd448-ebde-4c98-97ae-7ea8fdda6e84 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.079114 Jul 18 02:54:38.158801 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2900/5873] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:37 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:38.912214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:38.916370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:38.935997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:38.940419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:38.943447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:38.944301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:39.059773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fb6c689-43c9-4c7b-89ad-52ffd6b1efe8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152005 Jul 18 02:54:39.064801 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2974/5874] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:38 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:39.184032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:39.186490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:39.208368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:39.212261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:39.217002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:39.217828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:40.074505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:40.075664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:40.094377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:40.095005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:40.095954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:40.097776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:40.228118 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7d6b2e4-db0b-49b6-a45e-f4b5445019ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160168 Jul 18 02:54:40.251934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2975/5875] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:40 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:41.181136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:41.203906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:41.211164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:41.222013 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec641fdf-3a5d-47c7-94a4-7edfc8753321 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 2.042746 Jul 18 02:54:41.239025 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2901/5876] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:39 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:41.267494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:41.276835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:41.335026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.351138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:41.355767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:41.381276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:41.501605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb8b5c73-823e-477b-8407-3f180a9d0d03 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244868 Jul 18 02:54:41.507965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2976/5877] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:41 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:42.249907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:42.250552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:42.267428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:42.267893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:42.277140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:42.277815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:42.525592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:42.527302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:42.583385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:42.584586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:42.587141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:42.593583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:42.812004 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-440cd8b0-ac66-4486-95ca-9ff22f4bf90c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.299046 Jul 18 02:54:42.840711 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2977/5878] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:42 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:42.978210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:43.007049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:43.023469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:43.030048 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b66d8b88-0da7-433f-bae4-10d950714ba8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.784073 Jul 18 02:54:43.030675 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2902/5879] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:42 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:43.856200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:43.857378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:43.876694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:43.880648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:43.885426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:43.888031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:44.016617 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-279fa7c9-8f75-45e4-a24a-bf9efd8c93d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165351 Jul 18 02:54:44.022028 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2978/5880] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:43 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:44.050153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:44.051991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:44.073532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:44.077661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:44.079554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:44.084374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.002327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:45.026410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:45.038914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:45.041715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:45.049975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:45.059076 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-863b5840-1eb8-4b0c-a89b-273743f6bf2d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.012867 Jul 18 02:54:45.072962 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2903/5881] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:44 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:45.093602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.095864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.107328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:45.109204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:45.277797 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-62e39699-8268-4064-b22e-355bcd6b95ad tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216572 Jul 18 02:54:45.284188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2979/5882] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:45 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:46.088645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:46.090186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:46.120743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.122085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.123178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.124388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.304529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:46.314677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:46.363018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.368598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.374935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:46.376411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:46.588187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9330dcca-c8a7-4571-a2bc-65e3f8dcf7b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.293638 Jul 18 02:54:46.600099 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2980/5883] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:46 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:47.616954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:47.618478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:47.667232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.667706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.668553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:47.684413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:47.833869 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70c2a8a9-f9bd-46a2-81df-a233ba56867b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222352 Jul 18 02:54:47.840247 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2981/5884] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:47 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:48.852069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:48.853692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:48.881576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:48.888305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:48.891250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:48.895018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:49.090357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01855a8e-c1ea-485b-88ec-ddf66522f3d7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243624 Jul 18 02:54:49.094179 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2982/5885] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:48 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:49.465953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:49.484406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:49.493888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:49.502914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29b00c70-28f9-4273-bc19-30fb2281102a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 3.418902 Jul 18 02:54:49.510964 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2904/5886] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:46 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 3428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:49.642044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86d12ba5-59e8-4737-83eb-f352ccec1811 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: .version_select at 0x7fab0468a040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1434172396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDq2uBM/TMwDi+57omYD6g5xUia+ajeNvitp9hrbQPlvdp1jCDMxirtGGW6hlphgMqmtVHcFmU2/89GDqG9pAytxyz2eF68bkCcivE/4Imhd9e6mHWjBuh+to+/ngQGnA=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:49.680007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-86d12ba5-59e8-4737-83eb-f352ccec1811 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:54:49.722263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-86d12ba5-59e8-4737-83eb-f352ccec1811 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:54:49.839489 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86d12ba5-59e8-4737-83eb-f352ccec1811 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.202324 Jul 18 02:54:49.848740 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2983/5887] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:54:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:50.109405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:50.110810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:50.186560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:50.192500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:50.202994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:50.204469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:50.455392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e7faae2c-9d7c-4255-99ed-1881e4c4f5e0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.351306 Jul 18 02:54:50.467274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2905/5888] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:50 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:50.529725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:50.530796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:50.588370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:50.588848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:50.610923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:50.617640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:51.489656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:51.494215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:51.557966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:51.558441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:51.559268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:51.559729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:51.688563 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06c3d262-fd55-45a9-81aa-5b12970c787a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221575 Jul 18 02:54:51.693498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2906/5889] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:51 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:52.705455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:52.706563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:52.727107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:52.728113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:52.740729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:52.749466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:52.757507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:52.802643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:52.806520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:52.826683 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3167fde6-39ad-4d66-b7c2-1395f48f6670 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 2.303365 Jul 18 02:54:52.834689 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2984/5890] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:50 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:52.927922 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a2fa637-a448-4b79-b0be-6608c15577b8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226981 Jul 18 02:54:52.937355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2907/5891] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:52 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:53.864654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:53.866415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:53.901979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.903824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:53.908250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.911984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:53.942372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:53.943366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:53.966712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.973635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:53.978545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:53.985890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:54.159345 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a58efe4-1c0d-49e4-b38d-efd0e2073ecc tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221066 Jul 18 02:54:54.160108 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2908/5892] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:53 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:54:54.558388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:54.572353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:54.595203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:54.597048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:54.598343 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61b34cb4-3a68-49bc-809f-b0c9ab5836e0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.738919 Jul 18 02:54:54.598935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2985/5893] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:53 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:55.180824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:55.182675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:55.203514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.203514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.203514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.203514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.365084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1fedc2a-11f9-47b0-bea8-44775c4af9bb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190087 Jul 18 02:54:55.386017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2909/5894] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:55 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:55.633001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:55.634487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:55.655679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.656152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.657054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:55.657558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:55.891319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1286740837", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "aec5d427-fbc8-48ed-8d41-cc11819402b8"}], "key_name": "tempest-TestNetworkBasicOps-1434172396", "security_groups": [{"name": "tempest-secgroup-smoke-578596547"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:54:56.075360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:56.103958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:56.105750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:56.107180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-86dc71e9-1503-45b9-bc87-3f282b00e59d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.479606 Jul 18 02:54:56.108178 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2986/5895] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:55 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:54:56.380748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:56.382145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:56.406147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:56.409688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:56.420643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:56.421615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:56.510870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aafd0625-8669-475d-bb62-679e8ed65e10 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134128 Jul 18 02:54:56.512833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2987/5896] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:56 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:56.584832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] validate_networks() for [('aec5d427-fbc8-48ed-8d41-cc11819402b8', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:54:57.139579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:57.152769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:57.192161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.197733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.201914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.204351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.755265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:57.772053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:57.777148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:57.785716 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be37c793-e6d1-4bde-883d-829638f90431 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.661341 Jul 18 02:54:57.787044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2988/5897] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:57 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:57.805324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:57.811847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:57.851417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.852175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.854749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:57.855521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:57.980753 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c594fe09-8ee3-4fe1-92be-71670dc3f3e3 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187818 Jul 18 02:54:57.987759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2989/5898] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:57 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:54:58.834007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:58.852883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:58.890532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.891379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:58.893843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.895041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:58.929064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:54:58.930000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:54:58.932497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:54:58.934107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:54:58.934766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:54:58.959104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.963672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:58.965052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:58.969915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:59.050198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:54:59.067642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Getting quotas for user 9917a7316471409699a914b358301e1c and project ad4255390afb444c838b12632e86ca55. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:54:59.110881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:54:59.120746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:54:59.314949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf1c6290-49e0-4ad4-a2e0-dbf4048d1182 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.428665 Jul 18 02:54:59.325503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2910/5899] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:54:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:54:59.346868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:59.353609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:59.395006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:59.410882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:59.428240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:59.430476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:59.608619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:59.616512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f20ba8e2-479d-4b27-ba2d-d7156c0e0422 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.293467 Jul 18 02:54:59.623996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:59.625670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:54:59.626906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2911/5900] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:54:59 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110/os-volume_attachments => generated 25 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:54:59.627115 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4db2f2e3-d779-44c3-86cb-130803bbb4c0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 0.820278 Jul 18 02:54:59.644862 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2990/5901] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:54:58 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:54:59.684062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dffb8d0d-bba4-4f9f-8949-f2ef2eaadc19 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:59.684732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dffb8d0d-bba4-4f9f-8949-f2ef2eaadc19 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:59.835851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:59.894359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:54:59.895639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:54:59.909184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:59.911019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:54:59.913076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:54:59.914141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.027120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:55:00.108264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dffb8d0d-bba4-4f9f-8949-f2ef2eaadc19 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:00.123582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dffb8d0d-bba4-4f9f-8949-f2ef2eaadc19 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1249 microversion: 2.1 time: 0.466830 Jul 18 02:55:00.137756 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2991/5902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:54:59 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1249 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:00.669785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:00.691345 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f6791506-f931-461b-b7da-9af1e87373de tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 204 len: 0 microversion: 2.1 time: 0.805714 Jul 18 02:55:00.693169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:00.712671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2912/5903] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:54:59 2022] DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:55:00.786748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.788774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.793917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.795385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.820031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:00.831716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:00.903221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.924848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:00.935540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:00.936339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:01.297801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:02.183156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.230038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-67e006a7-3669-46e7-b514-8c3d29a522f7 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1680 microversion: 2.1 time: 1.493280 Jul 18 02:55:02.248031 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2913/5904] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:00 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1680 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:02.320510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:02.326763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:02.354779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.355597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.357077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:02.357899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:02.391506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.408256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.427047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.439446 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ccec5a3e-8d4a-4735-ae93-96c3d2a6d075 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 1.783931 Jul 18 02:55:02.448963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2992/5905] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:00 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:02.606737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:02.621756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fadff1a0-98c1-4e99-b3e5-f58d0f23fa39 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1253 microversion: 2.1 time: 0.366681 Jul 18 02:55:02.636882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2914/5906] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:02 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1253 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:03.283676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:03.296175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:03.301540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:03.341465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.343104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:03.354421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.357058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:03.470182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:03.473580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:03.497175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:03.557609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.558422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:03.559815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:03.560586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.302402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:04.335628 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec32e25a-30f9-4aff-8b17-fab1e8e90529 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1680 microversion: 2.1 time: 1.063336 Jul 18 02:55:04.341261 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2993/5907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:03 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1680 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:04.364000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:04.367303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:04.401590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:04.405221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.408489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:04.410592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:04.695183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:04.714354 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a3632ec9-7b21-4ebd-b5e4-a9f24d932fc6 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1319 microversion: 2.1 time: 0.370906 Jul 18 02:55:04.715792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2994/5908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:04 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:05.366190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:05.367058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:05.393286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.395357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:05.399480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:05.402272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:06.194087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:06.229127 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22197b4c-416d-4f54-864e-3c7259d8d830 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1680 microversion: 2.1 time: 0.867973 Jul 18 02:55:06.234928 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2995/5909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:05 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1680 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:06.293775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:06.295230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:06.316667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:06.317747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:06.319351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:06.320493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:06.651130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:06.681863 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab3aa49e-cb77-46d8-b1d8-f8a864c3ce84 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1307 microversion: 2.1 time: 0.388741 Jul 18 02:55:06.684130 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2996/5910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:06 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1307 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:07.007010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:07.022708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:07.029616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:07.032831 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a6b633f-a48b-4084-8c49-5f8b577dc047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1737 microversion: 2.20 time: 3.575516 Jul 18 02:55:07.034974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2915/5911] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:03 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1737 bytes in 3579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:07.271488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:07.279291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:07.315364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.316478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.324387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.325798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.703665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:07.704715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:07.727096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.729901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.739035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:07.740433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:07.842917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:07.874572 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ca9515b-8e62-418e-9042-723969b54188 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1613 microversion: 2.1 time: 0.604743 Jul 18 02:55:07.908856 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2997/5912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:07 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1613 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:08.058516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:08.065534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:08.089592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.096290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:08.098845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.099983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:08.429124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:08.439287 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-219e8404-3c78-47c6-be39-f67f5471e448 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1307 microversion: 2.1 time: 0.740663 Jul 18 02:55:08.443011 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2916/5913] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:07 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1307 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:08.489698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e0970029-5e11-41b3-8971-0e5e33c2fb73 req-47468a35-251f-4529-bf4b-9b1b0c8c2024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "name": "network-vif-unplugged", "status": "completed", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:08.532296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0970029-5e11-41b3-8971-0e5e33c2fb73 req-47468a35-251f-4529-bf4b-9b1b0c8c2024 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.538950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e0970029-5e11-41b3-8971-0e5e33c2fb73 req-47468a35-251f-4529-bf4b-9b1b0c8c2024 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:08.589483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e0970029-5e11-41b3-8971-0e5e33c2fb73 req-47468a35-251f-4529-bf4b-9b1b0c8c2024 service nova] Creating event network-vif-unplugged:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:55:08.619287 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e0970029-5e11-41b3-8971-0e5e33c2fb73 req-47468a35-251f-4529-bf4b-9b1b0c8c2024 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168508 Jul 18 02:55:08.624019 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2917/5914] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:08.844033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-80f94bef-d402-4e15-95e7-6a3ebd0937d5 req-c928f505-16c8-41db-afa6-2a2c93d52ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa4eaae-a19e-4e98-ab90-8a0559bca110", "name": "network-vif-deleted", "tag": "6ea86ba1-09e2-4318-bef1-b7d4d87e8c18"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:08.892684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:08.915456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-80f94bef-d402-4e15-95e7-6a3ebd0937d5 req-c928f505-16c8-41db-afa6-2a2c93d52ece service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:08.920581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-80f94bef-d402-4e15-95e7-6a3ebd0937d5 req-c928f505-16c8-41db-afa6-2a2c93d52ece service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:08.935294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:08.943625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:08.951171 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c769246-8af6-4dad-a8c2-1f9f74f1bbc3 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1719 microversion: 2.20 time: 0.895410 Jul 18 02:55:08.953993 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2998/5915] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:08 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1719 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:08.979412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:08.980438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:09.012796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.016494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.019965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:09.020669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.025295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.040681 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-80f94bef-d402-4e15-95e7-6a3ebd0937d5 req-c928f505-16c8-41db-afa6-2a2c93d52ece service nova] Creating event network-vif-deleted:6ea86ba1-09e2-4318-bef1-b7d4d87e8c18 for instance baa4eaae-a19e-4e98-ab90-8a0559bca110 on n-h1-849796-1 Jul 18 02:55:09.098546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-80f94bef-d402-4e15-95e7-6a3ebd0937d5 req-c928f505-16c8-41db-afa6-2a2c93d52ece service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300075 Jul 18 02:55:09.102633 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2918/5916] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:09.406615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:09.423218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ebdbac1e-585b-4a6c-88b6-48ab50ce90c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 200 len: 1326 microversion: 2.1 time: 0.454721 Jul 18 02:55:09.426264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 2999/5917] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:08 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 1326 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:09.476414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:09.476414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:09.487783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:09.544456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.546457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.554077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:09.556585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:09.799400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:09.852914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b361811b-4319-4304-aef9-781e8b11db89 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1307 microversion: 2.1 time: 0.374714 Jul 18 02:55:09.854074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2919/5918] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:09 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:09.995517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:09.999659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:10.032849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.042423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.044475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.046677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.139080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:10.458809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:10.476632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:10.506011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.522622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.525348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.527743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.609708 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 HTTP/1.1 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'baa4eaae-a19e-4e98-ab90-8a0559bca110'} Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:55:10.636222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:55:10.646453 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:55:10.649499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:55:10.652031 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-121545ee-1eb8-4c49-94fe-d539887fc77f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 404 len: 111 microversion: 2.1 time: 0.200410 Jul 18 02:55:10.659039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2920/5919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:10 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:55:10.672501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6941ed71-912c-457f-9aa7-03bef47a9179 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '.version_select at 0x7faaf731b5e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:10.756187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6941ed71-912c-457f-9aa7-03bef47a9179 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168313851" status: 202 len: 0 microversion: 2.1 time: 0.087979 Jul 18 02:55:10.765724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2921/5920] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168313851 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:55:10.884218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:10.885341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:10.904627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.905535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:10.906692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:10.907452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:11.082683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:11.092251 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9b5fa65-97ac-4c2c-ad78-0a30a528516d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1307 microversion: 2.1 time: 0.212336 Jul 18 02:55:11.098617 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2922/5921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:10 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:11.238807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:11.293048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:11.302796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:11.311128 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-54927657-4257-4941-9567-cfb20e72a018 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1722 microversion: 2.20 time: 1.321839 Jul 18 02:55:11.314404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3000/5922] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:09 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1722 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:11.346488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6cc3fd2-9a6e-46f5-8662-a169e1aa8681"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:11.347785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:11.367538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.372078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:11.373909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:11.382979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:12.141177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:12.147376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:12.159489 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66577a31-490c-486f-8a9a-4f00ac1b59a1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.817779 Jul 18 02:55:12.160240 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2923/5923] 10.222.0.67 () {62 vars in 1363 bytes} [Mon Jul 18 02:55:11 2022] POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments => generated 188 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:55:12.198657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:12.199151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:12.204660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:12.205349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:12.507017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:12.510649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:12.565321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:12.571293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:12.573696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:12.577426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.420601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:13.434137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f903b47e-c17f-4ac1-b430-631c6ce90255 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments/d6cc3fd2-9a6e-46f5-8662-a169e1aa8681" status: 202 len: 0 microversion: 2.20 time: 0.935803 Jul 18 02:55:13.440296 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c67e9b92-0695-4d2c-a2d5-25f07c57c34d tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 1.321960 Jul 18 02:55:13.443277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3001/5924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:12 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:13.453253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2924/5925] 10.222.0.67 () {60 vars in 1456 bytes} [Mon Jul 18 02:55:12 2022] DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments/d6cc3fd2-9a6e-46f5-8662-a169e1aa8681 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:55:13.602976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:13.603847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:13.630108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.634798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.635911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.641788 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.830134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f606ba3-936b-4174-b2b1-b4b9ead3389c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/action" status: 202 len: 0 microversion: 2.20 time: 0.231880 Jul 18 02:55:13.833057 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2925/5926] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Jul 18 02:55:13 2022] POST /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:55:13.846248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:13.847779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:13.862316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.885295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:13.893375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:13.896797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:14.464894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:14.466458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:14.499139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:14.503326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:14.508525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:14.510698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.063789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:15.072426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:15.089939 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1ec1a89-c9cd-4f07-a10b-846916610f57 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 0.623650 Jul 18 02:55:15.090332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2926/5927] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:14 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:15.108588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3df4195-f8dc-46c2-8e5a-46ce951b3252 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: .version_select at 0x7faaf7334f70>, body: {"keypair": {"name": "tempest-keypair-1441567698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdVx+/2MR+H2xYLvMG2OoY8u/RWNRJ/ccldWAGShfPcRgLeWDm3f2qIw8VF/nn5q/K5ARfOjR4tJ+Xg02WQS/23O9FJ6kMTj3UXPvHtiENshzfoGIYCqOfS/bzoW8fUXw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:15.157086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-a3df4195-f8dc-46c2-8e5a-46ce951b3252 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:15.168118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-a3df4195-f8dc-46c2-8e5a-46ce951b3252 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:15.217231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3df4195-f8dc-46c2-8e5a-46ce951b3252 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124464 Jul 18 02:55:15.218333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2927/5928] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:55:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:15.312583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:15.385885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:15.390719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:15.394296 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af459808-bc75-4198-a44d-b13efa709b87 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1670 microversion: 2.20 time: 1.554478 Jul 18 02:55:15.401013 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3002/5929] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:13 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1670 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:15.781047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-43c4fdeb-6654-44ec-bffa-6c3e5dee1b10 req-45149ee8-9afe-4431-b447-b60a6919189e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b83581-584e-49db-8021-4f40da0062c8", "tag": "9773fc5b-516a-4d67-a092-2fe8d69985c2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:15.814610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-43c4fdeb-6654-44ec-bffa-6c3e5dee1b10 req-45149ee8-9afe-4431-b447-b60a6919189e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:15.821472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-43c4fdeb-6654-44ec-bffa-6c3e5dee1b10 req-45149ee8-9afe-4431-b447-b60a6919189e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:15.879844 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-43c4fdeb-6654-44ec-bffa-6c3e5dee1b10 req-45149ee8-9afe-4431-b447-b60a6919189e service nova] Creating event network-changed:9773fc5b-516a-4d67-a092-2fe8d69985c2 for instance a3b83581-584e-49db-8021-4f40da0062c8 on n-h1-849796-1 Jul 18 02:55:15.923149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-43c4fdeb-6654-44ec-bffa-6c3e5dee1b10 req-45149ee8-9afe-4431-b447-b60a6919189e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144131 Jul 18 02:55:15.924468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2928/5930] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:16.107930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:16.108572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:16.134323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.137292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.150547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.151034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.213447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:16.422183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:16.423415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:16.449284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.453744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:16.456597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:16.456597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:17.298104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:17.323884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:17.339226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:17.359252 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37130577-f2a1-41ae-8c54-d49fbdaccea0 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1670 microversion: 2.20 time: 0.941556 Jul 18 02:55:17.367022 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2929/5931] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:16 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1670 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:17.644134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:17.663025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4583870-fbb2-4bf8-be6e-35f08aefac3a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 1.556864 Jul 18 02:55:17.666957 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3003/5932] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:16 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:18.404280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:18.405876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:18.422580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.423399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.436093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.437440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.688297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:18.689251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:18.705908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.706646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:18.709095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:18.709750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:19.038834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:19.055062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:19.063327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:19.065041 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa575d36-055e-4445-a143-2548e808b933 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.669036 Jul 18 02:55:19.085375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2930/5933] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:18 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:19.903289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-621486688", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcc90fc-3273-454a-b817-89f60dcb357d"}], "security_groups": [{"name": "tempest-securitygroup--345543747"}], "key_name": "tempest-keypair-1441567698", "user_data": "}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:20.219688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:20.253925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c91e4d57-9e4e-4978-a61e-cf5a4a46918e tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 1.570085 Jul 18 02:55:20.276670 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3004/5934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:18 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:20.296360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:20.300701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:20.330740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:20.331656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:20.333751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:20.346444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:20.564652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] validate_networks() for [('9fcc90fc-3273-454a-b817-89f60dcb357d', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:55:21.273305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:21.273305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:21.273305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:21.273305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f3dcc51-58e1-4d32-8b66-6a137034da36 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.951372 Jul 18 02:55:21.273305 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3005/5935] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:20 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:21.283876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:21.284499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:21.300172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.300632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:21.301492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:21.301939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.197957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:55:22.199284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:55:22.200393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:55:22.201637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:55:22.202809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:55:22.241592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.251116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.253485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.257318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.326707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:55:22.357714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Getting quotas for user eafda3150bc849d28c0a5b95cef45a65 and project eb0087a8f0594e5386cec56e55efb4f5. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:55:22.408571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:55:22.421035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:55:22.633290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-823037a1-5865-4d31-83a8-341a2e318a79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.736088 Jul 18 02:55:22.647935 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2931/5936] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:55:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:55:22.647935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:22.647935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:22.658128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.658765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.659738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:22.660324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:22.969704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:23.022902 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72ed270d-7607-4b89-b364-88e5e7fc7eac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 1.739973 Jul 18 02:55:23.048136 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3006/5937] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:21 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:23.091403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0f5356c-3ebb-4b48-8725-06615c067734 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:23.096360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0f5356c-3ebb-4b48-8725-06615c067734 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:23.308884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:23.345500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:23.348671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:23.376437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9011bdd-21fe-4b9b-ac1a-08cb62921a7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.733435 Jul 18 02:55:23.382155 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2932/5938] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:22 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:23.768428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0f5356c-3ebb-4b48-8725-06615c067734 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:23.778788 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0f5356c-3ebb-4b48-8725-06615c067734 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1241 microversion: 2.1 time: 0.728081 Jul 18 02:55:23.781685 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3007/5939] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:23 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1241 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:24.060147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:24.065812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:24.101574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.103103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.104473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.111174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.435847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:24.436668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:24.454358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.455722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.463441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:24.464033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:24.866840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:24.951343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5179f9a0-80b1-429d-ac33-4f4611d4cdfa tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 0.880502 Jul 18 02:55:24.953584 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2933/5940] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:24 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:24.969677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:24.970371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:25.001530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.002015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:25.005409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:25.006673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:25.320246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:25.391169 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d62a88c-2911-4220-b0c7-b9cd51d66e8e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1237 microversion: 2.1 time: 0.421002 Jul 18 02:55:25.392252 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2934/5941] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:24 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1237 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:25.976548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:25.985554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:26.007904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:26.010072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:26.012063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:26.025372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:26.730029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:26.753056 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ceb80ab7-5c1c-4acd-98b3-66ca067cb1da tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 0.785436 Jul 18 02:55:26.757784 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2935/5942] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:25 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:26.778904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:26.779603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:26.803963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:26.804427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:26.805820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:26.806281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.107086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:27.143871 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50246c91-5ec5-4c99-affa-a0dea76b0358 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1301 microversion: 2.1 time: 0.378682 Jul 18 02:55:27.151464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2936/5943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:26 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1301 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:27.221292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-be0c3511-5fd7-4f05-87b7-e27df593ca43 req-28588352-d3d2-4580-8c22-5aa4529de6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b83581-584e-49db-8021-4f40da0062c8", "name": "network-vif-plugged", "status": "completed", "tag": "9773fc5b-516a-4d67-a092-2fe8d69985c2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:27.309528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-be0c3511-5fd7-4f05-87b7-e27df593ca43 req-28588352-d3d2-4580-8c22-5aa4529de6f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.313792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-be0c3511-5fd7-4f05-87b7-e27df593ca43 req-28588352-d3d2-4580-8c22-5aa4529de6f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.380884 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-be0c3511-5fd7-4f05-87b7-e27df593ca43 req-28588352-d3d2-4580-8c22-5aa4529de6f8 service nova] Creating event network-vif-plugged:9773fc5b-516a-4d67-a092-2fe8d69985c2 for instance a3b83581-584e-49db-8021-4f40da0062c8 on n-h1-849796-1 Jul 18 02:55:27.419509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-be0c3511-5fd7-4f05-87b7-e27df593ca43 req-28588352-d3d2-4580-8c22-5aa4529de6f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220057 Jul 18 02:55:27.420317 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2937/5944] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:27.795121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:27.801194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:27.842736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.847749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:27.853887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:27.866897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.528167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:28.537293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf706add-9869-4926-acc4-3de91688579a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1374 microversion: 2.1 time: 0.750954 Jul 18 02:55:28.541063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2938/5945] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:27 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1374 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:28.552666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:28.557416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:28.607386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.608312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.615706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:28.616546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:28.751689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:28.850355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:28.856557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:28.879870 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d29ecd6b-3f44-48d4-adae-8ab9c4ababec tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 4.440671 Jul 18 02:55:28.882385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3008/5946] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:24 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 4451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:28.926777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:29.000280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-680d0b90-4b51-43d3-86b1-83b380402b04 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 0.456809 Jul 18 02:55:29.013081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2939/5947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:28 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:29.589166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:29.590158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:29.608716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.611477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:29.614414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.617576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:29.918513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:29.919363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:29.938395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.939490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:29.940943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:29.941781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.307704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:30.322825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:30.334316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:30.337946 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a97fcfed-963f-4379-aa5e-5e75490fc64b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.425462 Jul 18 02:55:30.339090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2940/5948] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:29 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:30.365488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:30.369861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:30.397584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.398190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.405079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:30.406699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:30.643158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:30.676243 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13ac47d5-e20f-4066-ac93-54c011201d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 0.329892 Jul 18 02:55:30.705887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2941/5949] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:30 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:30.883431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:30.942415 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a9804e2-b6d2-4ee7-83d0-d3d11c180013 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1547 microversion: 2.1 time: 1.373551 Jul 18 02:55:30.948003 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3009/5950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:29 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1547 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:30.981490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:30.994942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:31.020295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.021676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.023850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.025716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.366745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:31.375037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:31.404305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.405259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.406661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.407369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.499830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:31.534506 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fc8cdb5-d3af-4f50-8227-4303d49f4deb tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1547 microversion: 2.1 time: 0.560519 Jul 18 02:55:31.536227 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2942/5951] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:30 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1547 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:31.745574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:31.749322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:31.792995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.794626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:31.800366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:31.802741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:32.280763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:32.388358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:33.625951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:33.679217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:33.688281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:33.691464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e46cc981-ae30-4d31-9182-48e311078be1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 2.334479 Jul 18 02:55:33.698254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3010/5952] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:31 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:34.164296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:34.217928 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19fc2ef5-acb1-49cf-80a5-af51f62aed79 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 2.510877 Jul 18 02:55:34.238987 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2943/5953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:31 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:34.738436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:34.744596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:34.754628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:34.774542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:34.828131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:34.829397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:34.831333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:34.832315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.264294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:35.266039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:35.283305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:35.285388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.293268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.294152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:35.294620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:35.536370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:35.576444 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49bfc6d4-7d63-434d-af7f-863459a7ad89 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 0.313820 Jul 18 02:55:35.579939 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2944/5954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:35 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:36.604404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:36.608215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:36.675637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:36.678862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:36.685382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:36.692126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:37.032321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:37.050074 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9796eb16-aaae-4a20-bda8-3334592c63a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 0.450824 Jul 18 02:55:37.051931 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2945/5955] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:36 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:37.315233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:37.355487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:37.357495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:37.382718 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c277e852-ba68-4a8e-a0ce-60d21fce1ec2 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 2.654341 Jul 18 02:55:37.383125 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3011/5956] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:34 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:38.074408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:38.075118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:38.104083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.105093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.107921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.108598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.195651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:38.404148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:38.404778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:38.417612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.447745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.450390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.452418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:38.475611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:38.510963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50badf63-e5ff-4027-8858-a257ff16c27a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1299 microversion: 2.1 time: 0.443024 Jul 18 02:55:38.527599 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2946/5957] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:38 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1299 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:38.956097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8216f930-11a2-40e4-87d2-96b905ec7fa0 req-bd4e3684-3701-40d0-9603-6c3d1d92ceae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b83581-584e-49db-8021-4f40da0062c8", "tag": "9773fc5b-516a-4d67-a092-2fe8d69985c2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:38.974680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8216f930-11a2-40e4-87d2-96b905ec7fa0 req-bd4e3684-3701-40d0-9603-6c3d1d92ceae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:38.977236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8216f930-11a2-40e4-87d2-96b905ec7fa0 req-bd4e3684-3701-40d0-9603-6c3d1d92ceae service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.009626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8216f930-11a2-40e4-87d2-96b905ec7fa0 req-bd4e3684-3701-40d0-9603-6c3d1d92ceae service nova] Creating event network-changed:9773fc5b-516a-4d67-a092-2fe8d69985c2 for instance a3b83581-584e-49db-8021-4f40da0062c8 on n-h1-849796-1 Jul 18 02:55:39.027394 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8216f930-11a2-40e4-87d2-96b905ec7fa0 req-bd4e3684-3701-40d0-9603-6c3d1d92ceae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075810 Jul 18 02:55:39.050569 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2947/5958] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:39.535382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:39.536114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:39.576738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.582716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.590262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:39.595470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:39.808555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:39.817969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:39.819932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:39.855470 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e752c5d5-99eb-4981-8553-7f8bac533229 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 1.422130 Jul 18 02:55:39.861368 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3012/5959] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:38 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:40.893418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:40.905476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:40.962567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:40.963158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:40.970588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:40.971227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:42.839538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:42.881553 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-988dde51-5f32-4a56-a20e-c6994880052b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 3.350705 Jul 18 02:55:42.899174 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2948/5960] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:39 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 3370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:43.822193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:43.831276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:43.833509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:43.835112 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9773ff89-0ecc-4a3e-b841-c0e201b1672a tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 2.961570 Jul 18 02:55:43.836337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3013/5961] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:40 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:43.910234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:43.910943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:43.947642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.948184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:43.956384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:43.957049 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:44.857027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:44.857847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:44.870143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:44.870618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:44.871448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:44.878728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:45.838169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:45.862569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec31b69b-d0d7-4187-9762-fe38c11da494 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 1.956747 Jul 18 02:55:45.864412 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2949/5962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:43 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:46.298085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:46.309638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2edf336a-881f-4fdb-a402-55015132b9b2 req-8740576d-bbd7-4bb2-9d9d-266d47200c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eca85ac-b07e-41fc-9992-5ad29b199d90", "tag": "c5c26e95-4fe1-4797-b778-deae82fd9435"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:46.332566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=62 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:55:46.337592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:46.345265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:46.355142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2edf336a-881f-4fdb-a402-55015132b9b2 req-8740576d-bbd7-4bb2-9d9d-266d47200c95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:46.355931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2edf336a-881f-4fdb-a402-55015132b9b2 req-8740576d-bbd7-4bb2-9d9d-266d47200c95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:46.357310 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fe90c00-761d-4e35-a8c4-d2daba59b22c tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 1.505421 Jul 18 02:55:46.361500 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3014/5963] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:44 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:46.417624 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2edf336a-881f-4fdb-a402-55015132b9b2 req-8740576d-bbd7-4bb2-9d9d-266d47200c95 service nova] Creating event network-changed:c5c26e95-4fe1-4797-b778-deae82fd9435 for instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 on n-h2-849796-1 Jul 18 02:55:46.431897 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2edf336a-881f-4fdb-a402-55015132b9b2 req-8740576d-bbd7-4bb2-9d9d-266d47200c95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.548868 Jul 18 02:55:46.432916 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2950/5964] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:46.895056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:46.896289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:46.935671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:46.937667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:46.940703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:46.942174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.388358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:47.391295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:47.416567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.417555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.418866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:47.419540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:47.912440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:47.924728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:47.925329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:47.926180 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-053f6de8-8be5-4394-9fe6-8de36b1a92b8 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.545369 Jul 18 02:55:47.940216 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2951/5965] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:47 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:48.688948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:48.702041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d093e7f6-8829-4821-b8b9-2868e81aa552 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 1.812828 Jul 18 02:55:48.715002 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3015/5966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:46 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:48.961157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:48.963818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:49.020802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.021679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.023209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.023941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.757906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:49.767162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:49.811487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.812463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.814645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:49.825422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:49.894892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.940898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.964443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:49.964443 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-daa8db9e-4eeb-4f9e-945b-19310e14c345 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 1.016114 Jul 18 02:55:49.965954 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2952/5967] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:48 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:55:50.535099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:50.553798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6269db33-ce65-4aaa-8180-7ec54d6df7ef tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.835063 Jul 18 02:55:50.557131 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3016/5968] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:49 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:51.041750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:51.044593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:51.093169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.095568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.097715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.103718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.595028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:51.603061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:51.621321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.623307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.627005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:51.628259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:51.773426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:51.799045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:51.808196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:51.809763 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-444aab5f-1f84-42bc-97ce-f27872b76178 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.829225 Jul 18 02:55:51.814447 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2953/5969] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:50 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:52.151570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:52.441513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dedb0872-1487-4410-b54f-9f1d0e66f36a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.629654 Jul 18 02:55:52.441513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3017/5970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:51 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:52.851559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:52.854473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:52.910135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.913634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:52.920867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:52.923484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.240166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:53.240166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:53.246151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:53.260763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:53.263327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.263327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.263717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:53.263899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:53.264057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:53.278559 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d33bd838-83e7-4980-9603-9567ccd21081 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.437351 Jul 18 02:55:53.288249 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2954/5971] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:52 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:53.861425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:53.874188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51480e3d-eb57-4233-ad81-ef3419fccc76 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.641427 Jul 18 02:55:53.877714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3018/5972] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:53 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:54.320112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:54.320733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:54.348041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.349229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:54.354119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.357909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:54.913989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:54.915491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:54.931432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.934755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:54.948089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:54.948089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:55.016974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:55.030966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:55.034998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:55.039116 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a201ef48-f6ae-44e8-9f9a-9b7e023f1c8f tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.723078 Jul 18 02:55:55.043775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2955/5973] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:54 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:55.610410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:55.655546 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1c273ef-19c9-4301-9265-23b9ea2c256e tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.740262 Jul 18 02:55:55.667989 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3019/5974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:54 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:56.079574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:56.080250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:56.097689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.101950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.106169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.110189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.651522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:56.664580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:56.688053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:56.688660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:56.706250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:56.707549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d0d4156d-b41c-4df0-8add-135ac0fcef37 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.633177 Jul 18 02:55:56.722930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.723612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:56.724168 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2956/5975] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:56 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:56.724975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:56.725440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:57.412325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:57.427578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a83e4ef-bd96-4a8e-9708-fef8b2fb7ba5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.743658 Jul 18 02:55:57.441045 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3020/5976] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:56 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:55:57.740661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:57.758885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:57.811559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:57.823455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:57.830064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:57.831410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.452387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:58.466592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:58.505549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:58.508082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.513968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:58.515005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.772029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:58.782945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:58.792664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:58.794281 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-457712c9-a666-417c-ac48-a822499dad5b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 1.064085 Jul 18 02:55:58.800882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2957/5977] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:57 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:55:58.806911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-da8f57ee-1279-4b81-8744-b0ceb558094a req-1bd28161-1d62-45d5-beee-77b02155db95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eca85ac-b07e-41fc-9992-5ad29b199d90", "name": "network-vif-plugged", "status": "completed", "tag": "c5c26e95-4fe1-4797-b778-deae82fd9435"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:55:58.844276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da8f57ee-1279-4b81-8744-b0ceb558094a req-1bd28161-1d62-45d5-beee-77b02155db95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:58.845051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-da8f57ee-1279-4b81-8744-b0ceb558094a req-1bd28161-1d62-45d5-beee-77b02155db95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:58.864583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-da8f57ee-1279-4b81-8744-b0ceb558094a req-1bd28161-1d62-45d5-beee-77b02155db95 service nova] Creating event network-vif-plugged:c5c26e95-4fe1-4797-b778-deae82fd9435 for instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 on n-h2-849796-1 Jul 18 02:55:58.879475 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-da8f57ee-1279-4b81-8744-b0ceb558094a req-1bd28161-1d62-45d5-beee-77b02155db95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076977 Jul 18 02:55:58.881810 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2958/5978] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:55:59.383227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:55:59.396033 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-482ee6f2-38e1-44a1-81e5-7258609382c0 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 0.953553 Jul 18 02:55:59.401593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3021/5979] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:55:58 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:55:59.820637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:55:59.821533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:55:59.847392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:59.847806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:55:59.856331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:55:59.859074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:00.309323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:00.322097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:00.323719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:00.334810 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-edfd6441-b6b5-4381-990b-e391af8a4643 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.509794 Jul 18 02:56:00.339760 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2959/5980] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:55:59 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:56:00.416826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:00.417742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:00.429559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:00.442253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:00.443426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:00.444147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:01.356514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:01.358248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:01.389451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:01.392898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:01.395453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:01.396687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:01.993396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:02.057895 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2f699724-37a5-4258-98bb-124686682075 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1366 microversion: 2.1 time: 1.646875 Jul 18 02:56:02.067894 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3022/5981] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:00 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1366 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:02.073775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a6a23d81-2c67-4676-9b34-b7ea9e21c24c req-76358d16-13fc-4016-8148-701a4878f568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "name": "network-vif-plugged", "status": "completed", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:02.103441 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:02.106519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a6a23d81-2c67-4676-9b34-b7ea9e21c24c req-76358d16-13fc-4016-8148-701a4878f568 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:02.107780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a6a23d81-2c67-4676-9b34-b7ea9e21c24c req-76358d16-13fc-4016-8148-701a4878f568 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:02.134424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:02.142200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:02.143756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74a9db98-f005-4c4f-8028-38334bdebeb1 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.792032 Jul 18 02:56:02.155719 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2960/5982] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:56:01 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:56:02.159732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a6a23d81-2c67-4676-9b34-b7ea9e21c24c req-76358d16-13fc-4016-8148-701a4878f568 service nova] Creating event network-vif-plugged:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:56:02.178925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a6a23d81-2c67-4676-9b34-b7ea9e21c24c req-76358d16-13fc-4016-8148-701a4878f568 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105864 Jul 18 02:56:02.180170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3023/5983] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:03.080744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:03.081508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:03.114610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.115094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.130482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.130960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.841164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:03.841867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:03.844785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:03.857984 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d5128a69-dce8-421d-8011-a6d12be9ced8 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1555 microversion: 2.1 time: 0.783004 Jul 18 02:56:03.860792 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2961/5984] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:03 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1555 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:56:03.864630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.865729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.871258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.871813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.911414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:03.911787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:03.973658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.974735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:03.975882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:03.976529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:04.299988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:04.303357 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7283edf4-c665-4a5f-993c-15c73fbd6500 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.414949 Jul 18 02:56:04.311616 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2962/5985] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:56:03 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:04.313043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:04.316818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:04.318098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f73351f9-2a1d-4848-a56a-78e4528f6e96 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 1.158945 Jul 18 02:56:04.318684 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3024/5986] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:56:03 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:56:05.339986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:05.340434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:05.359515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:05.360215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:05.361055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:05.361528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:06.184047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:06.221599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:06.225208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:06.228715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c0afbbb-427f-4b12-ba12-d5d4b4b03497 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1728 microversion: 2.20 time: 0.894552 Jul 18 02:56:06.230688 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2963/5987] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:56:05 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1728 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:56:07.275057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:07.275967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:07.280236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:07.313963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:07.317273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:07.329726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:07.330526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:08.605346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:08.624568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:08.627945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:08.629380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9f5e771-d8a1-4125-a000-3afe1fe74faf tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1715 microversion: 2.20 time: 1.363365 Jul 18 02:56:08.630589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3025/5988] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:56:07 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1715 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:56:10.717956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-22bca418-74af-4b5b-9263-5f4eec50b895 req-ea9401f0-afa0-4582-9db4-787408a7b398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eca85ac-b07e-41fc-9992-5ad29b199d90", "tag": "c5c26e95-4fe1-4797-b778-deae82fd9435"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:10.731420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=40 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:10.779454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-22bca418-74af-4b5b-9263-5f4eec50b895 req-ea9401f0-afa0-4582-9db4-787408a7b398 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:10.783613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-22bca418-74af-4b5b-9263-5f4eec50b895 req-ea9401f0-afa0-4582-9db4-787408a7b398 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:10.787771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=91 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:10.825276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-22bca418-74af-4b5b-9263-5f4eec50b895 req-ea9401f0-afa0-4582-9db4-787408a7b398 service nova] Creating event network-changed:c5c26e95-4fe1-4797-b778-deae82fd9435 for instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 on n-h2-849796-1 Jul 18 02:56:10.845103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-22bca418-74af-4b5b-9263-5f4eec50b895 req-ea9401f0-afa0-4582-9db4-787408a7b398 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127999 Jul 18 02:56:10.856397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2964/5989] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:11.966754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:11.971152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:12.011791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.014556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:12.018068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:12.022774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:12.204845 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-14512d24-0a5f-4c33-81da-7cfa82fb5ef9 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8/action" status: 200 len: 24570 microversion: 2.1 time: 0.248177 Jul 18 02:56:12.213640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3026/5990] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:11 2022] POST /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8/action => generated 24570 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:56:52.455484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.457614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:52.463956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:52.465992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:52.474216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.474990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:52.476048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:52.477981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:52.555525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2818d420-9ce2-4d3c-a338-c6d1d6819d29 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "POST /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8/action" status: 200 len: 32638 microversion: 2.1 time: 0.102502 Jul 18 02:56:52.564206 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2965/5991] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 02:56:52 2022] POST /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8/action => generated 32638 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:56:56.850810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:56.885314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:56.888649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8959c14f-bed4-4187-871e-13825ba01740 req-1fccaf01-b8db-4c29-92c3-37fca32ca560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b83581-584e-49db-8021-4f40da0062c8", "tag": "9773fc5b-516a-4d67-a092-2fe8d69985c2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:56:56.928623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:56.935669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=67 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:56:56.938049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:56.938618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:56.939515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:56.940026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:56.957038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8959c14f-bed4-4187-871e-13825ba01740 req-1fccaf01-b8db-4c29-92c3-37fca32ca560 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:56.957836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8959c14f-bed4-4187-871e-13825ba01740 req-1fccaf01-b8db-4c29-92c3-37fca32ca560 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:57.022112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:56:57.045277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8959c14f-bed4-4187-871e-13825ba01740 req-1fccaf01-b8db-4c29-92c3-37fca32ca560 service nova] Creating event network-changed:9773fc5b-516a-4d67-a092-2fe8d69985c2 for instance a3b83581-584e-49db-8021-4f40da0062c8 on n-h1-849796-1 Jul 18 02:56:57.078052 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8959c14f-bed4-4187-871e-13825ba01740 req-1fccaf01-b8db-4c29-92c3-37fca32ca560 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194373 Jul 18 02:56:57.089073 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2966/5992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:56:57.333894 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f7b5fe8-677f-4a61-9cfe-6194a6a0039b tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 204 len: 0 microversion: 2.1 time: 0.497289 Jul 18 02:56:57.342215 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3027/5993] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:56:56 2022] DELETE /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:56:57.364593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:57.366455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:57.405606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:57.411265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:57.416249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:57.417472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:58.499196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:56:58.543088 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5f578391-1eda-484b-a370-5e6b4470e5b4 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1671 microversion: 2.1 time: 1.189666 Jul 18 02:56:58.544704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2967/5994] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:57 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1671 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:56:59.564972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:56:59.565861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:56:59.617169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:59.617169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:56:59.620370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:56:59.627562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:01.995331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:02.057060 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8deb494-78cd-4459-84f5-58808f528cab tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1671 microversion: 2.1 time: 2.496511 Jul 18 02:57:02.058141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3028/5995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:56:59 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1671 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:57:02.386096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-224e6509-e46a-45c8-b031-c3b77f650e93 req-9235b2f8-ef9f-4a4b-ab00-792da3d288fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b83581-584e-49db-8021-4f40da0062c8", "name": "network-vif-deleted", "tag": "9773fc5b-516a-4d67-a092-2fe8d69985c2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:02.408324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-224e6509-e46a-45c8-b031-c3b77f650e93 req-9235b2f8-ef9f-4a4b-ab00-792da3d288fb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:02.409735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-224e6509-e46a-45c8-b031-c3b77f650e93 req-9235b2f8-ef9f-4a4b-ab00-792da3d288fb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:02.460448 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-224e6509-e46a-45c8-b031-c3b77f650e93 req-9235b2f8-ef9f-4a4b-ab00-792da3d288fb service nova] Creating event network-vif-deleted:9773fc5b-516a-4d67-a092-2fe8d69985c2 for instance a3b83581-584e-49db-8021-4f40da0062c8 on n-h1-849796-1 Jul 18 02:57:02.480685 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-224e6509-e46a-45c8-b031-c3b77f650e93 req-9235b2f8-ef9f-4a4b-ab00-792da3d288fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101837 Jul 18 02:57:02.484560 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2968/5996] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:57:03.077711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:03.079100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:03.112310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:03.112784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:03.119877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:03.129631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:03.315418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:03.316110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:03.316863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lazy-loading 'fault' on Instance uuid a3b83581-584e-49db-8021-4f40da0062c8 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:57:03.694196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9917a7316471409699a914b358301e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad4255390afb444c838b12632e86ca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:03.745606 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fef9a8ac-1a99-40ba-8c55-bababafd58ac tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 200 len: 1339 microversion: 2.1 time: 0.669544 Jul 18 02:57:03.749900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3029/5997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:03 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 1339 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:04.792174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:04.796191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] [instance: a3b83581-584e-49db-8021-4f40da0062c8] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:04.841443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:04.842971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:04.850903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:04.855797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:04.924655 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] HTTP exception thrown: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Request method failure captured: Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 HTTP/1.1 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Morg627wt9nQdots5IeFS5nl2awmE4xQPhdjSkofRYfiSMfgw49cOcSfKmXA1a2zGWZPsqnPpkFOsutYK8Jnt32DOcYcsBdLWb21VG1CJOZT65Cv2mbX4T-J8D17v1aHl9RDSIkeFxGhgH-3AH8tRoshpSi1GXMJ4Ho_2HrI-7w1Ko Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ad4255390afb444c838b12632e86ca55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ad4255390afb444c838b12632e86ca55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ad4255390afb444c838b12632e86ca55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestNetworkBasicOps-88549427 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: ad4255390afb444c838b12632e86ca55 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestNetworkBasicOps-88549427 Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 9917a7316471409699a914b358301e1c Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestNetworkBasicOps-88549427-project Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a3b83581-584e-49db-8021-4f40da0062c8'} Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:04.926674 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. Jul 18 02:57:04.932775 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:04.935176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Returning 404 to user: Instance a3b83581-584e-49db-8021-4f40da0062c8 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:04.944334 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6fa1b83-bb7d-4e2d-bb69-a5a87392ba4a tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8" status: 404 len: 111 microversion: 2.1 time: 0.167021 Jul 18 02:57:04.948813 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2969/5998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:57:04 2022] GET /compute/v2.1/servers/a3b83581-584e-49db-8021-4f40da0062c8 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:57:05.571866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c142624-d026-43c6-b1fa-35bac04ea2e8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] Calling method '.version_select at 0x7fab044bbc10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:05.671120 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c142624-d026-43c6-b1fa-35bac04ea2e8 tempest-TestNetworkBasicOps-88549427 tempest-TestNetworkBasicOps-88549427-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1434172396" status: 202 len: 0 microversion: 2.1 time: 0.122412 Jul 18 02:57:05.676044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3030/5999] 10.222.0.67 () {58 vars in 1256 bytes} [Mon Jul 18 02:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1434172396 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:57:20.129670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:20.130646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:20.166311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:20.170741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=16 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:20.178973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:20.179569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:20.200004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:20.200004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:20.460119 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa32342d-0e9d-40a8-ab17-853c9902f192 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.332231 Jul 18 02:57:20.461436 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2970/6000] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Jul 18 02:57:20 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241/os-volume_attachments => generated 25 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:57:20.707452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:20.708771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:20.720672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:20.728014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:20.760246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:20.762779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:20.765117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:20.767882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:20.902345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:57:21.247752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c77dbde-2273-4221-afb4-3d1ce4b0cc0b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 204 len: 0 microversion: 2.20 time: 0.542665 Jul 18 02:57:21.249012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3031/6001] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:57:20 2022] DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:57:21.263581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:21.272895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:21.324195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.325175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:21.329364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:21.339078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:22.006808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:22.065157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:22.077199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:22.081449 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e67d3ae9-7bf2-440f-af14-f4462f96a6a5 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 0.825240 Jul 18 02:57:22.090882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2971/6002] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:21 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:57:23.110373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:23.111284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:23.152849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:23.153339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:23.154153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:23.154599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:24.250361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:24.285654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:24.290159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:24.294764 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e30714c-f689-4b6a-b49e-e0041476837b tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 1.189363 Jul 18 02:57:24.312975 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3032/6003] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:23 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:57:25.329053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:25.330459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:25.342668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:25.344146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:25.347277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:25.350528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:26.226405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:26.277706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:26.283660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:26.293036 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3b5b8fa-ff04-4946-a647-efc825ba7467 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1721 microversion: 2.20 time: 0.968040 Jul 18 02:57:26.297129 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2972/6004] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:25 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1721 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:57:27.312392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:27.313473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:27.327127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.327602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:27.328407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:27.344664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:28.442877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:28.475412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:28.510450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:28.518332 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c8a9998-3316-4ddc-9a8c-a8409147be33 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1654 microversion: 2.20 time: 1.208910 Jul 18 02:57:28.533043 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3033/6005] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:27 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1654 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:57:29.553366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:29.557221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:29.598516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a045a253-c8f8-44da-9ff7-0be0ab0d7841 req-35da7963-6bf7-4d8b-aa68-c62317417208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca31ed-7869-4cf6-a36c-749846a36241", "name": "network-vif-deleted", "tag": "79d63ab0-57bc-4168-ba8b-5f769e88a2fa"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:29.619920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.621177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.626916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.628536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.630133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a045a253-c8f8-44da-9ff7-0be0ab0d7841 req-35da7963-6bf7-4d8b-aa68-c62317417208 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:29.637429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a045a253-c8f8-44da-9ff7-0be0ab0d7841 req-35da7963-6bf7-4d8b-aa68-c62317417208 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:29.683370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a045a253-c8f8-44da-9ff7-0be0ab0d7841 req-35da7963-6bf7-4d8b-aa68-c62317417208 service nova] Creating event network-vif-deleted:79d63ab0-57bc-4168-ba8b-5f769e88a2fa for instance 9fca31ed-7869-4cf6-a36c-749846a36241 on n-h2-849796-1 Jul 18 02:57:29.700332 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a045a253-c8f8-44da-9ff7-0be0ab0d7841 req-35da7963-6bf7-4d8b-aa68-c62317417208 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105737 Jul 18 02:57:29.707309 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3034/6006] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:31.641651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:31.686518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:31.690390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cac2062b69124275b997a57802730b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c4616265964dc0b9e563b531760614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:57:31.753651 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2174d50-9d7d-48fe-ae7e-181706be2047 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 200 len: 1654 microversion: 2.20 time: 2.206189 Jul 18 02:57:31.764882 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2973/6007] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:29 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 1654 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:57:32.801949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:32.821220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:32.876117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:32.878961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:32.878961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:32.878961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:32.963969 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 HTTP/1.1 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9fca31ed-7869-4cf6-a36c-749846a36241'} Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:32.967247 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a932526-a54b-4ff9-b32e-60b41d7e60ea tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 404 len: 111 microversion: 2.20 time: 0.176416 Jul 18 02:57:32.975227 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3035/6008] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:32 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:57:33.011524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a2acbfe-8797-428a-a867-f7731240a623 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '.version_select at 0x7fab0482b040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:33.096437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a2acbfe-8797-428a-a867-f7731240a623 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564575198" status: 204 len: 0 microversion: 2.20 time: 0.109207 Jul 18 02:57:33.097930 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2974/6009] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Jul 18 02:57:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564575198 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:57:35.151041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:35.152457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:35.167673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:35.168508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:35.170426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:35.171133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:35.228716 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e51c06bf-d0ca-45de-9e05-c639644cfb91 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/ips" status: 200 len: 149 microversion: 2.1 time: 0.730945 Jul 18 02:57:35.229371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3036/6010] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 02:57:34 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/ips => generated 149 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:39.421253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6351cc98-2c8e-4b72-a909-9769bef69ae8"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:57:39.428408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:39.453930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.458332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:39.464721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:39.465782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:40.832658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b24f533-e8bb-4426-b4af-7dfd6b55446a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "POST /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.419708 Jul 18 02:57:40.842172 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2975/6011] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:57:39 2022] POST /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:57:41.811163 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:57:41.816802 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 02:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:57:46.471493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:46.474779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:46.527511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:46.551091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:57:46.566963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:46.568288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:46.569874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:46.581892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:46.646498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 HTTP/1.1 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9fca31ed-7869-4cf6-a36c-749846a36241'} Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:46.648142 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:46.658338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-deca640b-4e00-4a6e-9a9d-7f866736fb00 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 404 len: 111 microversion: 2.20 time: 0.201114 Jul 18 02:57:46.663549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:57:46.665522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 9fca31ed-7869-4cf6-a36c-749846a36241] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:57:46.670707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3037/6012] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:57:46 2022] DELETE /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:57:46.682329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:46.682790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:46.683605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:57:46.684053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:57:46.743748 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 HTTP/1.1 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9fca31ed-7869-4cf6-a36c-749846a36241'} Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.770255 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. Jul 18 02:57:46.780975 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:57:46.787362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 9fca31ed-7869-4cf6-a36c-749846a36241 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:57:46.791586 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-760938fb-666e-4286-9674-e2f5d071a390 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241" status: 404 len: 111 microversion: 2.20 time: 0.130237 Jul 18 02:57:46.793384 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2976/6013] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:57:46 2022] GET /compute/v2.1/servers/9fca31ed-7869-4cf6-a36c-749846a36241 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:58:04.022832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:04.045857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:04.049737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:04.102633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.105455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.111591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.128807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.227465 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a HTTP/1.1 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '61cfc432-dd24-4653-a500-35730df8798a'} Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:04.232263 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.240722 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.246603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:04.248970 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f09549df-9250-4494-91f6-2da18b68dc7d tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 404 len: 111 microversion: 2.20 time: 0.228387 Jul 18 02:58:04.264685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:04.268670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] [instance: 61cfc432-dd24-4653-a500-35730df8798a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:04.294238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3038/6014] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Jul 18 02:58:04 2022] DELETE /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:58:04.296225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:04.298816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:04.347642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.357327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.361387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:04.370256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:04.499174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] HTTP exception thrown: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Request method failure captured: Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a HTTP/1.1 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MkzKMom7tUkpF3mkgeRWLZ-OdZXrVU1cLRdz4O_HMJ-OgbPBJGq3rCONHBi1wtry76RRMWBpFa6N3BS7hUV0fYAoBUXeg3R2ttqOwe5UD3dZBUHQBurIRztjTM6toACVEZ3qZeNtlsaxQ4KkdPk4GOWjh53w44CS8sP9iuQw8nylMo Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63c4616265964dc0b9e563b531760614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63c4616265964dc0b9e563b531760614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63c4616265964dc0b9e563b531760614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 63c4616265964dc0b9e563b531760614 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1141771017 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cac2062b69124275b997a57802730b35 Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1141771017-project Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '61cfc432-dd24-4653-a500-35730df8798a'} Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.503029 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:04.513007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] Returning 404 to user: Instance 61cfc432-dd24-4653-a500-35730df8798a could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:04.514907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81d53034-0c17-4b7c-a6b4-41955d4fa684 tempest-AttachVolumeShelveTestJSON-1141771017 tempest-AttachVolumeShelveTestJSON-1141771017-project] 10.222.0.67 "GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a" status: 404 len: 111 microversion: 2.20 time: 0.258691 Jul 18 02:58:04.531355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2977/6015] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Jul 18 02:58:04 2022] GET /compute/v2.1/servers/61cfc432-dd24-4653-a500-35730df8798a => generated 111 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:58:11.384747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:11.388333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:11.417214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:11.422645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:11.426365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:11.439959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:11.766475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'services' on Instance uuid 1eca85ac-b07e-41fc-9992-5ad29b199d90 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:58:11.973330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8f87798-8e04-4cc5-88c2-4e3cd2780622 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments/6351cc98-2c8e-4b72-a909-9769bef69ae8" status: 202 len: 0 microversion: 2.1 time: 0.599635 Jul 18 02:58:11.974896 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3039/6016] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 02:58:11 2022] DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments/6351cc98-2c8e-4b72-a909-9769bef69ae8 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:58:11.989105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:11.990977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:12.031192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.033391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.037799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:12.041004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:12.128754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d58aa376-45dd-4e2c-95b0-e7e9c4d01487 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148308 Jul 18 02:58:12.129535 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2978/6017] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:11 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:13.147113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:13.149263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:13.166974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:13.169099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:13.170279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:13.171946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:13.234994 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-50f72027-64e5-44f0-8339-badd6917562c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094425 Jul 18 02:58:13.236417 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3040/6018] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:13 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:58:14.264253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:14.265481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:14.283094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.283557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.284530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:14.285009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:14.360104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d086d407-2b24-48cb-bd27-bb1a79401db9 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111887 Jul 18 02:58:14.361604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2979/6019] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:14 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:15.383264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:15.388181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:15.418840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:15.423565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:15.425388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:15.434365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:16.458000 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34cc2e49-4658-4dd7-9540-0f1036e91312 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.085677 Jul 18 02:58:16.459654 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3041/6020] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:15 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:17.508362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:17.511486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:17.547080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.549642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.553048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:17.556499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:17.690863 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26b416ab-23f0-43b9-a052-caf3af24ca31 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221534 Jul 18 02:58:17.691500 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2980/6021] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:17 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:18.715468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:18.720279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:18.751200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:18.754859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:18.759092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:18.759810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:18.835893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-416a6b9d-5c9b-461b-bba8-555a104beb41 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135348 Jul 18 02:58:18.840262 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3042/6022] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:18 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:19.855353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:19.857259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:19.895309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.896077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:19.897631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:19.910945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:20.024242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11043b69-24de-444c-bdaf-ed22583339d5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178070 Jul 18 02:58:20.031396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2981/6023] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:19 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:21.044479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:21.048852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:21.078638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.079726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.098052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:21.099044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:21.198444 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12ce5f20-79fa-4a55-bcf1-259d80476eeb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161856 Jul 18 02:58:21.199817 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3043/6024] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:21 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:58:22.218704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:22.223189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:22.240870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:22.241397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:22.242783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:22.243249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:22.313713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28c43517-e790-4a7d-9003-61c9c054f313 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099365 Jul 18 02:58:22.314961 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2982/6025] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:22 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:23.327651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:23.328892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:23.338214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.338852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.339853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.340464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.383364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a26794a0-434c-4fdd-b90f-ed719a7a5a8f tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059380 Jul 18 02:58:23.385061 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3044/6026] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 02:58:23 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:58:23.603379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:23.612061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:23.643954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.646483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.647888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.649405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.722288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:58:23.906183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88e2d428-29f1-40e7-bb5b-4cb57aecd627 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 204 len: 0 microversion: 2.1 time: 0.334500 Jul 18 02:58:23.908179 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2983/6027] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:58:23 2022] DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:58:23.926028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:23.927998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:23.948824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.950778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:23.952595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:23.953700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:25.004878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:25.036154 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84826535-ad1d-47df-9703-e68ff9507a1c tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1680 microversion: 2.1 time: 1.120460 Jul 18 02:58:25.060480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3045/6028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:23 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1680 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:26.114890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:26.123580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:26.146674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:26.149135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:26.152563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:26.154450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:26.782477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:26.848802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-03ece39a-510d-4caf-84f1-549399ed081a tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1680 microversion: 2.1 time: 0.758191 Jul 18 02:58:26.861260 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2984/6029] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:26 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1680 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:27.880721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:27.882060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:27.891907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:27.892622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:27.893755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:27.894867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:28.481668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:28.498982 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34ff80c7-e66c-4fb3-b649-c36304a360c1 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1680 microversion: 2.1 time: 0.620502 Jul 18 02:58:28.504384 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3046/6030] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:27 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1680 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:29.306386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-93433e79-d37e-47b4-8dad-1196ef34eb7b req-5af81c18-1e8e-43ab-8055-b543623de060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eca85ac-b07e-41fc-9992-5ad29b199d90", "name": "network-vif-deleted", "tag": "c5c26e95-4fe1-4797-b778-deae82fd9435"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:29.374254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93433e79-d37e-47b4-8dad-1196ef34eb7b req-5af81c18-1e8e-43ab-8055-b543623de060 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:29.378837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-93433e79-d37e-47b4-8dad-1196ef34eb7b req-5af81c18-1e8e-43ab-8055-b543623de060 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:29.442275 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-93433e79-d37e-47b4-8dad-1196ef34eb7b req-5af81c18-1e8e-43ab-8055-b543623de060 service nova] Creating event network-vif-deleted:c5c26e95-4fe1-4797-b778-deae82fd9435 for instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 on n-h2-849796-1 Jul 18 02:58:29.464823 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-93433e79-d37e-47b4-8dad-1196ef34eb7b req-5af81c18-1e8e-43ab-8055-b543623de060 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166785 Jul 18 02:58:29.470192 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2985/6031] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:29.537427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:29.542946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:29.577622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:29.579206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:29.582893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:29.584384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:29.727396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:29.730392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:29.731314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lazy-loading 'fault' on Instance uuid 1eca85ac-b07e-41fc-9992-5ad29b199d90 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:58:29.858773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafda3150bc849d28c0a5b95cef45a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0087a8f0594e5386cec56e55efb4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:29.877201 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-195002f3-2250-4fb5-a240-8ae59ddef839 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 200 len: 1331 microversion: 2.1 time: 0.347182 Jul 18 02:58:29.878255 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3047/6032] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:29 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 1331 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:30.899510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:30.900895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:30.923870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.924345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:30.925233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:30.925693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:30.958469 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 HTTP/1.1 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1eca85ac-b07e-41fc-9992-5ad29b199d90'} Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:30.960229 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:30.964060 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:30.971117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:30.972491 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b8f298d-7e22-47b6-a0b3-246cc98601f4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 404 len: 111 microversion: 2.1 time: 0.078820 Jul 18 02:58:30.975808 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2986/6033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:30 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:58:30.987562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1c325770-9a76-46fd-905b-e2be9d859550 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '.version_select at 0x7fab0491b4c0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:31.054980 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1c325770-9a76-46fd-905b-e2be9d859550 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441567698" status: 202 len: 0 microversion: 2.1 time: 0.072649 Jul 18 02:58:31.057374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3048/6034] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 02:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441567698 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:58:43.468654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:43.474918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:44.388405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ca5b1d3-a12d-4c69-ad18-c025dc9014b3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: .version_select at 0x7fab04a8e310>, body: {"keypair": {"name": "tempest-keypair-391185178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsf/ggYyaiBTf2QA7xBSRqsoRDtAFrj48qhGyUZkDUJl3wku4eeQthmKfKK9M+EFqvg5D0ZAfLVCtLaEK5YNMgoRRRMiI7EBw8ofbiR9zjH/MRddvb9PiHCx/P0Vhfsvg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:44.430567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3ca5b1d3-a12d-4c69-ad18-c025dc9014b3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:44.451028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-3ca5b1d3-a12d-4c69-ad18-c025dc9014b3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for user 57025f6e4a2842c6bbfd58050e2e7371 and project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:44.528544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ca5b1d3-a12d-4c69-ad18-c025dc9014b3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.079307 Jul 18 02:58:44.529640 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2987/6035] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 02:58:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:58:45.235899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:45.239741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:45.312646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:45.321607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:45.331440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.334252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.337872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.343630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.398555 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 HTTP/1.1 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1eca85ac-b07e-41fc-9992-5ad29b199d90'} Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:45.406112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74ed89cc-2ba1-41b7-8c34-53d03326aacb tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 404 len: 111 microversion: 2.1 time: 0.192317 Jul 18 02:58:45.416631 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3049/6036] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:58:45 2022] DELETE /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:58:45.443269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:45.448763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 1eca85ac-b07e-41fc-9992-5ad29b199d90] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:45.490632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.507035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.509744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:45.510807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:45.611022 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 HTTP/1.1 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '1eca85ac-b07e-41fc-9992-5ad29b199d90'} Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:58:45.630192 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 1eca85ac-b07e-41fc-9992-5ad29b199d90 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8eb8fd0-f90c-4f8f-8e11-66edaf7495b6 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90" status: 404 len: 111 microversion: 2.1 time: 0.211885 Jul 18 02:58:45.638979 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2988/6037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:45 2022] GET /compute/v2.1/servers/1eca85ac-b07e-41fc-9992-5ad29b199d90 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:58:50.457879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1585485871", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9047773-5150-46e6-a690-6453ed3b301f"}], "security_groups": [{"name": "tempest-securitygroup--1682843822"}], "key_name": "tempest-keypair-391185178", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:51.081807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] validate_networks() for [('a9047773-5150-46e6-a690-6453ed3b301f', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:53.014006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:53.015006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:53.015816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:53.016011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:53.017071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:53.044162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:53.044762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:53.047660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:53.050487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:53.119764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:53.141507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for user 57025f6e4a2842c6bbfd58050e2e7371 and project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:53.188031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:53.194077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:53.324186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01d6d502-ce1a-4ea4-ac19-59cdd9852d7d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.883099 Jul 18 02:58:53.325082 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3050/6038] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:58:53.341087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81005069-346e-4a18-b890-56be92450fc3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:53.342399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81005069-346e-4a18-b890-56be92450fc3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:53.456569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81005069-346e-4a18-b890-56be92450fc3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:53.471618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81005069-346e-4a18-b890-56be92450fc3 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1237 microversion: 2.1 time: 0.136264 Jul 18 02:58:53.472576 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2989/6039] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:53 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1237 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:53.930632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1761057968", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "5e09b9ce-285d-4cb5-89e5-501ef6d4aa21"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:58:54.103057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] validate_networks() for [('5e09b9ce-285d-4cb5-89e5-501ef6d4aa21', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:58:54.502066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f6150359-326f-46fa-8dda-189453a20769 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:54.504363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f6150359-326f-46fa-8dda-189453a20769 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:54.686110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f6150359-326f-46fa-8dda-189453a20769 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:54.708626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f6150359-326f-46fa-8dda-189453a20769 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1237 microversion: 2.1 time: 0.211312 Jul 18 02:58:54.714161 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2990/6040] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:54 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1237 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:55.672803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:58:55.676404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:58:55.677574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:58:55.679272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:58:55.680418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:58:55.698863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.699996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.701780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.703061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.742450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:55.747321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:55.756029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:58:55.795400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.801386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.806977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:55.810931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:55.821024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Getting quotas for project 10dad96c700646109b18fbb26494f801. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:58:55.844678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Getting quotas for user 3e360b4cd59d41b2b09d9fa2d52a34a2 and project 10dad96c700646109b18fbb26494f801. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:58:55.873966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:58:55.879597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:58:56.080867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8abde40-7372-469d-8878-46d5b7098d6c tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164620 Jul 18 02:58:56.088229 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3051/6041] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:58:56.101619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ec1f52aa-4dfb-4d1c-a850-47897681ba4f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:56.102580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ec1f52aa-4dfb-4d1c-a850-47897681ba4f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:56.182409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:56.240043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c607f3ce-839a-4934-81f9-ec144ab1fefd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1289 microversion: 2.1 time: 0.499040 Jul 18 02:58:56.246628 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2991/6042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:55 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1289 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:56.322213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ec1f52aa-4dfb-4d1c-a850-47897681ba4f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:56.374120 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ec1f52aa-4dfb-4d1c-a850-47897681ba4f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1219 microversion: 2.1 time: 0.276119 Jul 18 02:58:56.381716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3052/6043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:56 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1219 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:57.275376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:57.276180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:57.314015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:57.317168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:57.321665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:57.325447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:57.419553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d2c89096-248e-43ea-9b79-892c00b3f7e9 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:57.428597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d2c89096-248e-43ea-9b79-892c00b3f7e9 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:57.712426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d2c89096-248e-43ea-9b79-892c00b3f7e9 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:57.730693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:57.740545 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8bc83117-95e7-4a33-b4e7-2de067a95f02 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1295 microversion: 2.1 time: 0.470029 Jul 18 02:58:57.752336 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d2c89096-248e-43ea-9b79-892c00b3f7e9 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1219 microversion: 2.1 time: 0.343171 Jul 18 02:58:57.758942 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3053/6044] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:57 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1219 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:57.760360 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2992/6045] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:57 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1295 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:58:58.801983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:58.803485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:58:58.805901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:58.815203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:58:58.905653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.906590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.939212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.940058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.941113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.947859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:58.949151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:58:58.950209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:58:59.327320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:59.342029 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-534cabde-e1fb-40b3-b537-2226df70e2dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1271 microversion: 2.1 time: 0.567042 Jul 18 02:58:59.343212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:58:59.357288 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3054/6046] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:58 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1271 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:58:59.397213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-860f7a89-4f2d-47a8-ba98-813aed0a7198 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1295 microversion: 2.1 time: 0.607660 Jul 18 02:58:59.404392 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2993/6047] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:58:58 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1295 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:00.079946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.081171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.105684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.110164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.115933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.116103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.171134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 HTTP/1.1 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'baa4eaae-a19e-4e98-ab90-8a0559bca110'} Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:00.172785 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc95b59c-3e59-4cc6-a331-8ac5fda0a2a4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 404 len: 111 microversion: 2.1 time: 0.100511 Jul 18 02:59:00.187590 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3055/6048] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:00 2022] DELETE /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:00.228456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.230796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: baa4eaae-a19e-4e98-ab90-8a0559bca110] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.282940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.294175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.299200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.305818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.370910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.373168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.387692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.389643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.391690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.392812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.443047 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 HTTP/1.1 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'baa4eaae-a19e-4e98-ab90-8a0559bca110'} Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.460084 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. Jul 18 02:59:00.466473 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.471189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance baa4eaae-a19e-4e98-ab90-8a0559bca110 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:00.473382 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05bde201-061d-4c53-b5fc-38bf2ef08d1b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110" status: 404 len: 111 microversion: 2.1 time: 0.274931 Jul 18 02:59:00.480157 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2994/6049] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/baa4eaae-a19e-4e98-ab90-8a0559bca110 => generated 111 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:00.493295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.495209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.512253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.513551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.515314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.516497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.763585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:00.793190 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cb53e89b-5773-4c72-a16e-eb781fb70f7a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1277 microversion: 2.1 time: 0.432453 Jul 18 02:59:00.809847 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3056/6050] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1277 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:00.830850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:00.837888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:00.866212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.870619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.877465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:00.879029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:00.932605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a HTTP/1.1 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ec163ca3-3477-45e6-b206-9dc0d96c191a'} Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:00.938354 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:00.947238 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:00.953833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:00.953833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdf4c1e5-6362-45cb-9337-14137f25eca5 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 404 len: 111 microversion: 2.1 time: 0.138996 Jul 18 02:59:00.954655 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3057/6051] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:00 2022] DELETE /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:00.998628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:01.009329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: ec163ca3-3477-45e6-b206-9dc0d96c191a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:01.070474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.073859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:01.081937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.085146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:01.118762 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a HTTP/1.1 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ec163ca3-3477-45e6-b206-9dc0d96c191a'} Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:01.123392 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance ec163ca3-3477-45e6-b206-9dc0d96c191a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31e626a1-32f1-4d80-a448-ffe2626575fa tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a" status: 404 len: 111 microversion: 2.1 time: 0.165057 Jul 18 02:59:01.130467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3058/6052] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/ec163ca3-3477-45e6-b206-9dc0d96c191a => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:01.663138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:01.681097 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e54767b7-80cc-4a33-a56c-af7bd0b496b7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 1.197512 Jul 18 02:59:01.682010 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2995/6053] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:00 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:01.830394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:01.833517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:01.865942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.867338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:01.869131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:01.869824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:02.325185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:02.346380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e02e4182-e4d9-45a8-acdc-e33d0b50f2b7 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.522329 Jul 18 02:59:02.358232 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3059/6054] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:01 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:02.709459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:02.718564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:02.764254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:02.766922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:02.769128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:02.770385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.463349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c6730ef5-5df7-4a5c-9f07-0185956b0f5b req-4b72e633-7816-481a-bb9a-3bbef4aadb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "963bfa3f-7b36-48ba-a499-75be3dc7b517", "tag": "e6142ac1-4e01-4c96-92c9-72f76c4c2b92"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:03.485151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6730ef5-5df7-4a5c-9f07-0185956b0f5b req-4b72e633-7816-481a-bb9a-3bbef4aadb46 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.485648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c6730ef5-5df7-4a5c-9f07-0185956b0f5b req-4b72e633-7816-481a-bb9a-3bbef4aadb46 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.517157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c6730ef5-5df7-4a5c-9f07-0185956b0f5b req-4b72e633-7816-481a-bb9a-3bbef4aadb46 service nova] Creating event network-changed:e6142ac1-4e01-4c96-92c9-72f76c4c2b92 for instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 on n-h1-849796-1 Jul 18 02:59:03.575452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c6730ef5-5df7-4a5c-9f07-0185956b0f5b req-4b72e633-7816-481a-bb9a-3bbef4aadb46 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571196 Jul 18 02:59:03.588732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3060/6055] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:03.613823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:03.617529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:03.649558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.651221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.654142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:03.654604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:03.828142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:03.839673 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a726ceb7-d597-4ad9-a442-4674a526c84d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 1.138956 Jul 18 02:59:03.840465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2996/6056] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:02 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:04.192499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:04.220425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6977ce70-59b5-4b2e-ad26-f6a111c1e69d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.629717 Jul 18 02:59:04.222021 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3061/6057] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:03 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:04.869348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:04.870095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:04.884902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:04.900359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:04.904296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:04.906457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:04.909540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.158526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7c850262-4e3d-4deb-8a75-7f2dd736cb75 req-a141ed88-a1e9-491b-a987-77632360ecab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed", "tag": "d56a4be7-e755-488a-b2ee-8c1fb5aedced"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:05.224305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7c850262-4e3d-4deb-8a75-7f2dd736cb75 req-a141ed88-a1e9-491b-a987-77632360ecab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.232853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7c850262-4e3d-4deb-8a75-7f2dd736cb75 req-a141ed88-a1e9-491b-a987-77632360ecab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.295053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7c850262-4e3d-4deb-8a75-7f2dd736cb75 req-a141ed88-a1e9-491b-a987-77632360ecab service nova] Creating event network-changed:d56a4be7-e755-488a-b2ee-8c1fb5aedced for instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed on n-h2-849796-1 Jul 18 02:59:05.308115 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7c850262-4e3d-4deb-8a75-7f2dd736cb75 req-a141ed88-a1e9-491b-a987-77632360ecab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162145 Jul 18 02:59:05.309783 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3062/6058] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:05.321027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:05.323147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:05.340802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.343500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.345416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:05.347301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:05.393820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:05.421757 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0994ac18-fe32-43a8-b1a3-17207906d423 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 0.560888 Jul 18 02:59:05.423350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2997/6059] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:04 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:05.764080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:06.345386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:06.380289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-787edf2d-0016-463f-80a7-7b0641dafbbc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 1.052495 Jul 18 02:59:06.382629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3063/6060] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:05 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:06.448200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:06.458122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:06.510665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.517598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:06.520751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:06.529783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:07.416226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:07.422435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:07.510433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:07.528043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:07.537971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:07.542601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:07.743145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=16 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:07.841059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:07.850683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2870cbeb-2427-418a-bd35-d29b751d5831 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 1.413698 Jul 18 02:59:07.852775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2998/6061] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:06 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:08.353249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:08.381498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-caf3c6ce-82ef-4350-852e-e203afc491b0 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.975303 Jul 18 02:59:08.390208 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3064/6062] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:07 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:08.884598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:08.886211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:08.911698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.912385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:08.914497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:08.915149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.240590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:09.256437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97e4741d-0026-4383-a514-4d90d4a1cc2d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 0.374209 Jul 18 02:59:09.259770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 2999/6063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:08 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:09.419119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:09.423815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:09.456202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.462227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.466827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.471632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.739952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:09.740819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:09.768847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.769787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.775127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.776134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.853557 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c HTTP/1.1 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c'} Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:09.857225 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:09.865132 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:09.877958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:09.877958 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0bb8358-b790-47a0-9a7b-79e8701192d4 tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 404 len: 111 microversion: 2.1 time: 0.139354 Jul 18 02:59:09.883757 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3000/6064] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:09 2022] DELETE /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:09.896671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:09.912453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] [instance: 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:09.947997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.948970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:09.950516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:09.951311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.020554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] HTTP exception thrown: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Request method failure captured: Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c HTTP/1.1 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ml0yIgUhTmVMHs5kGGPf6I9EIIdJuPCRlQZs6Q6hbmuBFk7Thutjo5O7z4K6wwDdDzoQ9AQ8qDLFSujT73nGgkrS-vyiKAkSbaJedl-K1tWfgicfJOsTxWC2lqbpUx57_GNPVfHr7vzJwiVhAnwULG7Ey1OyJ12z2yd-4lHRAZ8bwA Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eb0087a8f0594e5386cec56e55efb4f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: eb0087a8f0594e5386cec56e55efb4f5 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-840287968 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: eafda3150bc849d28c0a5b95cef45a65 Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeNegativeTest-840287968-project Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c'} Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:10.024845 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] Returning 404 to user: Instance 73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:10.028419 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1ba7b12a-4675-4983-b8b6-7eb5ecdd480b tempest-AttachVolumeNegativeTest-840287968 tempest-AttachVolumeNegativeTest-840287968-project] 10.222.0.67 "GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c" status: 404 len: 111 microversion: 2.1 time: 0.141844 Jul 18 02:59:10.034121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3001/6065] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:09 2022] GET /compute/v2.1/servers/73ed6c9a-9fa8-4be8-905b-f0cefbf7fd7c => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:10.093389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f49915ae-0bd2-444d-ba62-71d04143b095 req-3a2ebc90-7893-4dea-a22c-2d8d71c2fc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963bfa3f-7b36-48ba-a499-75be3dc7b517", "name": "network-vif-plugged", "status": "completed", "tag": "e6142ac1-4e01-4c96-92c9-72f76c4c2b92"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:10.134674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f49915ae-0bd2-444d-ba62-71d04143b095 req-3a2ebc90-7893-4dea-a22c-2d8d71c2fc1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.135560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f49915ae-0bd2-444d-ba62-71d04143b095 req-3a2ebc90-7893-4dea-a22c-2d8d71c2fc1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.185558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f49915ae-0bd2-444d-ba62-71d04143b095 req-3a2ebc90-7893-4dea-a22c-2d8d71c2fc1c service nova] Creating event network-vif-plugged:e6142ac1-4e01-4c96-92c9-72f76c4c2b92 for instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 on n-h1-849796-1 Jul 18 02:59:10.212661 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f49915ae-0bd2-444d-ba62-71d04143b095 req-3a2ebc90-7893-4dea-a22c-2d8d71c2fc1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137830 Jul 18 02:59:10.215199 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3002/6066] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:10.295738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:10.297012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:10.322664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.323143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.323978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:10.324437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:10.349500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:10.367213 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9637d12e-261f-4c83-93af-64aadb923414 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.959772 Jul 18 02:59:10.370708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3065/6067] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:09 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:10.850263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:10.862667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bdc15e50-b29d-4efe-b9d1-a5cd764c7963 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 0.576496 Jul 18 02:59:10.863894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3003/6068] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:10 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:11.395890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:11.406080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:11.442142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.443414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:11.445914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.447349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:11.885530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:11.890852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:11.891651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:11.897447 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f64b71ab-ed87-4447-a628-7298fe6e2599 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.510855 Jul 18 02:59:11.899211 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3066/6069] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:11 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:11.907068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.907538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:11.909772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:11.914547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:12.332174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:12.344969 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44ce2197-566d-4f4e-81d4-d7f953a13339 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1363 microversion: 2.1 time: 0.459486 Jul 18 02:59:12.347081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3004/6070] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:11 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:12.925106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:12.925866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:12.940883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:12.940883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:12.942026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:12.942533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.336650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:13.353309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6419c360-2b84-44ba-9be6-573fd10ff38d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 0.432328 Jul 18 02:59:13.355412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3067/6071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:12 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:13.384525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:13.386182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:13.401266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.403224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.405063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.406157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.695168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:13.717555 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3e0a7f7-6396-43ae-8f69-ec0860c9bbcc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1549 microversion: 2.1 time: 0.342303 Jul 18 02:59:13.720531 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3068/6072] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:13 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1549 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:13.756545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:13.758693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:13.759898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5b68dde8-7ec4-4333-a626-10dacf63cd83 req-74171354-23cc-4ce7-996d-a7b0a91caebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed", "name": "network-vif-plugged", "status": "completed", "tag": "d56a4be7-e755-488a-b2ee-8c1fb5aedced"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:13.772244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.773959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.776675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.778252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.795333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:13.802299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5b68dde8-7ec4-4333-a626-10dacf63cd83 req-74171354-23cc-4ce7-996d-a7b0a91caebf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:13.802765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5b68dde8-7ec4-4333-a626-10dacf63cd83 req-74171354-23cc-4ce7-996d-a7b0a91caebf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:13.852280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5b68dde8-7ec4-4333-a626-10dacf63cd83 req-74171354-23cc-4ce7-996d-a7b0a91caebf service nova] Creating event network-vif-plugged:d56a4be7-e755-488a-b2ee-8c1fb5aedced for instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed on n-h2-849796-1 Jul 18 02:59:13.862738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5b68dde8-7ec4-4333-a626-10dacf63cd83 req-74171354-23cc-4ce7-996d-a7b0a91caebf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.834319 Jul 18 02:59:13.869889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3005/6073] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:14.084906 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3371e38-e216-4f69-9e07-fafda4e6aa7a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.336531 Jul 18 02:59:14.102810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3069/6074] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 02:59:13 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:14.382997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:14.385134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:14.401392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.401946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:14.402812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:14.413906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:15.704489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:15.721536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-516ca350-9dae-4ea8-b416-b929c4544d8e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1319 microversion: 2.1 time: 1.344231 Jul 18 02:59:15.722755 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3006/6075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:14 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1319 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:16.751681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:16.752802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:16.779059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:16.790084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.793167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.799894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:16.801079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:16.895088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=81 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:17.398445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:17.441374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a3ae166-25e6-40c7-b778-9b5fa08b76dc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1509 microversion: 2.1 time: 0.700141 Jul 18 02:59:17.446609 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3070/6076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:16 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1509 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:18.490273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0fbd82ea-2789-4eb1-86c1-adb8e4801923 req-f72f9b3f-77ff-413d-b5d3-3ea658349afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "963bfa3f-7b36-48ba-a499-75be3dc7b517", "tag": "e6142ac1-4e01-4c96-92c9-72f76c4c2b92"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:18.526888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0fbd82ea-2789-4eb1-86c1-adb8e4801923 req-f72f9b3f-77ff-413d-b5d3-3ea658349afc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:18.528648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0fbd82ea-2789-4eb1-86c1-adb8e4801923 req-f72f9b3f-77ff-413d-b5d3-3ea658349afc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:18.571993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0fbd82ea-2789-4eb1-86c1-adb8e4801923 req-f72f9b3f-77ff-413d-b5d3-3ea658349afc service nova] Creating event network-changed:e6142ac1-4e01-4c96-92c9-72f76c4c2b92 for instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 on n-h1-849796-1 Jul 18 02:59:18.589188 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0fbd82ea-2789-4eb1-86c1-adb8e4801923 req-f72f9b3f-77ff-413d-b5d3-3ea658349afc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106689 Jul 18 02:59:18.592039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3007/6077] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:22.870365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1309040526", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "29edfa9d-c639-4ff0-aac7-cec9f0567cb4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:23.045528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] validate_networks() for [('29edfa9d-c639-4ff0-aac7-cec9f0567cb4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:59:23.792524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:59:23.793111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:59:23.793447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:59:23.793872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:59:23.794304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:59:23.809811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.810356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.811208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:23.811691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:23.854958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Getting quotas for project 285aa3b324614f2283a857841e90b7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:59:23.869444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Getting quotas for user 18c43abec7bd4a3ba85cfada60e9da8b and project 285aa3b324614f2283a857841e90b7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:59:23.908266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:59:23.913893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:59:24.037164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55965ba0-156d-4f34-8221-9b97cee10de9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174660 Jul 18 02:59:24.045062 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3071/6078] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:59:24.059284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e61d09a-30f8-4a6f-bf32-0fc7e4df51fa tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:24.060745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e61d09a-30f8-4a6f-bf32-0fc7e4df51fa tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:24.278246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e61d09a-30f8-4a6f-bf32-0fc7e4df51fa tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:24.290891 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e61d09a-30f8-4a6f-bf32-0fc7e4df51fa tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1214 microversion: 2.1 time: 0.239123 Jul 18 02:59:24.295983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3008/6079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:24 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:25.315645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa88a247-5325-4618-9c12-529720cf477f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:25.316519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa88a247-5325-4618-9c12-529720cf477f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:25.473203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa88a247-5325-4618-9c12-529720cf477f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:25.493846 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa88a247-5325-4618-9c12-529720cf477f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1214 microversion: 2.1 time: 0.182653 Jul 18 02:59:25.495421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3072/6080] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:25 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:26.518791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:26.521602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:26.571749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:26.573152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:26.575642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:26.576721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:26.679214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=79 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:26.847786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:26.864977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-881d00a3-44fc-4116-aa5c-361adc7e63ee tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1210 microversion: 2.1 time: 0.356127 Jul 18 02:59:26.868116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3009/6081] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:26 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:27.889582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:27.895281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:27.919598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:27.920687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:27.922472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:27.923513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:28.070337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:28.080771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1c6998cd-60a6-4939-84b1-d2597e973e59 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1272 microversion: 2.1 time: 0.199177 Jul 18 02:59:28.082361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3073/6082] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:27 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:29.102594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:29.103426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:29.117334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:29.118458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:29.121291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:29.126392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:29.649044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:29.666870 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bae6c51d-002f-4bd2-aad7-e047bef62f03 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.569993 Jul 18 02:59:29.683827 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3010/6083] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:29 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:30.638644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-bfb29b69-0a38-454d-b813-6d3b8511fca6 req-83de3b3e-4b3f-4020-8805-2acc812f0bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58a7e3d-4bbe-4b9a-99ea-50fbc306272a", "tag": "d594a73c-7636-4337-acf6-b1ce8eb385b2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:30.667863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bfb29b69-0a38-454d-b813-6d3b8511fca6 req-83de3b3e-4b3f-4020-8805-2acc812f0bfd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.669706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bfb29b69-0a38-454d-b813-6d3b8511fca6 req-83de3b3e-4b3f-4020-8805-2acc812f0bfd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:30.689512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:30.693113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:30.706584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-bfb29b69-0a38-454d-b813-6d3b8511fca6 req-83de3b3e-4b3f-4020-8805-2acc812f0bfd service nova] Creating event network-changed:d594a73c-7636-4337-acf6-b1ce8eb385b2 for instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a on n-h1-849796-1 Jul 18 02:59:30.723058 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-bfb29b69-0a38-454d-b813-6d3b8511fca6 req-83de3b3e-4b3f-4020-8805-2acc812f0bfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093904 Jul 18 02:59:30.729107 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3074/6084] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:30.730626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.737928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:30.750563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:30.752443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:32.122059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:32.154135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2fcdba97-a4c1-4b01-bb4c-9fa513cf59cd tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 1.469147 Jul 18 02:59:32.161369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3011/6085] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:30 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:33.196676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:33.202883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:33.235019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.235960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.237452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:33.238233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:33.663010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:33.685260 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9cf48fd8-b02a-4d4e-8174-459784a5b7a6 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.497910 Jul 18 02:59:33.703416 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3075/6086] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:33 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:34.714875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:34.715954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:34.727931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:34.731293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.732389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:34.734678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:34.735452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:35.128363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:35.142233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e52c84fc-45cf-4692-872a-c762dd6e6779 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.435560 Jul 18 02:59:35.155852 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3012/6087] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:34 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:36.166085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:36.167630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:36.184083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:36.189594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:36.200444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.201820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.206550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:36.206550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:36.875722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:36.888681 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78e1b7cf-902d-4066-8ae9-544057db3e5e tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.726138 Jul 18 02:59:36.890401 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3076/6088] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:36 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:37.759272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4d00b5ff-574a-440c-ad18-a63a8e5f73e0 req-283a83d2-49db-4964-ba60-853816ad10eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58a7e3d-4bbe-4b9a-99ea-50fbc306272a", "name": "network-vif-plugged", "status": "completed", "tag": "d594a73c-7636-4337-acf6-b1ce8eb385b2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:37.785824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4d00b5ff-574a-440c-ad18-a63a8e5f73e0 req-283a83d2-49db-4964-ba60-853816ad10eb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:37.787079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4d00b5ff-574a-440c-ad18-a63a8e5f73e0 req-283a83d2-49db-4964-ba60-853816ad10eb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:37.822906 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4d00b5ff-574a-440c-ad18-a63a8e5f73e0 req-283a83d2-49db-4964-ba60-853816ad10eb service nova] Creating event network-vif-plugged:d594a73c-7636-4337-acf6-b1ce8eb385b2 for instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a on n-h1-849796-1 Jul 18 02:59:37.836590 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4d00b5ff-574a-440c-ad18-a63a8e5f73e0 req-283a83d2-49db-4964-ba60-853816ad10eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082426 Jul 18 02:59:37.840481 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3013/6089] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:37.908180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:37.909548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:37.920012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:37.920479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:37.921321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:37.921991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:38.207336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:38.224244 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-121d9410-b39a-4f6a-8eed-4d0b7ca8cfb9 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.318546 Jul 18 02:59:38.234823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3077/6090] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:37 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:39.246588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:39.247688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:39.277338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:39.277882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:39.281403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:39.282134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:39.593777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:39.605473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf89ebbf-9bc8-4066-855a-d230e9cdab6c tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1314 microversion: 2.1 time: 0.365871 Jul 18 02:59:39.606591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3014/6091] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:39 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:40.644955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:40.646526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:40.656017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.656748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.657948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:40.658856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:40.958928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:40.970988 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ce4668b-b69f-4a85-a18a-2eab26140a40 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1497 microversion: 2.1 time: 0.340065 Jul 18 02:59:40.971949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3078/6092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:40 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1497 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:41.729443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:41.730282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:41.738511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.739268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.740367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:41.740818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:41.794575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:59:42.086715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-31306950-83ac-4a12-a93c-e26125a9a324 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 204 len: 0 microversion: 2.1 time: 0.360596 Jul 18 02:59:42.088778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3015/6093] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 02:59:41 2022] DELETE /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:59:42.114656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:42.118720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:42.128574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:42.129344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:42.130464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:42.131000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:42.404367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:42.421662 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5a7751a-b36e-47a7-92e3-a9b1b472c7d3 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1503 microversion: 2.1 time: 0.322684 Jul 18 02:59:42.424437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3079/6094] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:42 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:43.442041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:43.443822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:43.456876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.457976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.459037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:43.459711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:43.728342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:43.737850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-baa428b8-2494-4cc3-93db-163215bae666 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1503 microversion: 2.1 time: 0.300133 Jul 18 02:59:43.738847 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3016/6095] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:43 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:44.710638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-601ecb8e-d8ea-43f0-8925-79dc6041cb56 req-6e77fa07-9838-4f8e-b03b-3574d644fc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58a7e3d-4bbe-4b9a-99ea-50fbc306272a", "name": "network-vif-deleted", "tag": "d594a73c-7636-4337-acf6-b1ce8eb385b2"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:44.738192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-601ecb8e-d8ea-43f0-8925-79dc6041cb56 req-6e77fa07-9838-4f8e-b03b-3574d644fc95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.739266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-601ecb8e-d8ea-43f0-8925-79dc6041cb56 req-6e77fa07-9838-4f8e-b03b-3574d644fc95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.761146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:44.762684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:44.777780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:44.789013 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-601ecb8e-d8ea-43f0-8925-79dc6041cb56 req-6e77fa07-9838-4f8e-b03b-3574d644fc95 service nova] Creating event network-vif-deleted:d594a73c-7636-4337-acf6-b1ce8eb385b2 for instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a on n-h1-849796-1 Jul 18 02:59:44.790792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.792722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.794389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:44.797608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:44.802868 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-601ecb8e-d8ea-43f0-8925-79dc6041cb56 req-6e77fa07-9838-4f8e-b03b-3574d644fc95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105329 Jul 18 02:59:44.821326 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3080/6096] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:59:45.017088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:45.034609 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-522bdaa8-f3c3-498f-8424-8fdc5322fe4f tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 200 len: 1299 microversion: 2.1 time: 0.273365 Jul 18 02:59:45.035770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3017/6097] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:44 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:46.073464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:46.076243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: f58a7e3d-4bbe-4b9a-99ea-50fbc306272a] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:46.111356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:46.117456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:46.129796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:46.131623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:46.197526 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] HTTP exception thrown: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Request method failure captured: Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a HTTP/1.1 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MyFAbt5sXWBo3zbx4v_2-dFeO6GP8jEmko-0TGWdMPoL8kJegl6A_4MMqc-6VHXgoV1tpKqGJfJ67m2yb8YulevNzL1WnldAJBqzMC9P2-WXewDcVqCK12UXDa3yV0fnbt_od8RXOZut6B1rIgnXAH1sJx2-M4i4cQAGV8T7fFkF2s Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 285aa3b324614f2283a857841e90b7c1 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesActionsTest-2069047100 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_285aa3b324614f2283a857841e90b7c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesActionsTest-2069047100 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 285aa3b324614f2283a857841e90b7c1 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesActionsTest-2069047100 Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesActionsTest-2069047100-project Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 18c43abec7bd4a3ba85cfada60e9da8b Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesActionsTest-2069047100-project Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'f58a7e3d-4bbe-4b9a-99ea-50fbc306272a'} Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:59:46.201445 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. Jul 18 02:59:46.212204 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 02:59:46.215333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Returning 404 to user: Instance f58a7e3d-4bbe-4b9a-99ea-50fbc306272a could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:59:46.217309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3924657e-044c-44d1-bba9-5ae8cbc7d168 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a" status: 404 len: 111 microversion: 2.1 time: 0.156722 Jul 18 02:59:46.230284 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3081/6098] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:46 2022] GET /compute/v2.1/servers/f58a7e3d-4bbe-4b9a-99ea-50fbc306272a => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:59:46.587927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-972491339", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "29edfa9d-c639-4ff0-aac7-cec9f0567cb4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:46.710196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] validate_networks() for [('29edfa9d-c639-4ff0-aac7-cec9f0567cb4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:59:47.783618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:59:47.785335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:59:47.786599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:59:47.787770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:59:47.788573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:59:47.801221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.801790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:47.803352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:47.803352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:47.827112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Getting quotas for project 285aa3b324614f2283a857841e90b7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:59:47.833791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Getting quotas for user 18c43abec7bd4a3ba85cfada60e9da8b and project 285aa3b324614f2283a857841e90b7c1. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:59:47.869090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:59:47.876771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:59:47.974686 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c64fd04-6173-465b-ba7d-8def3e49d5be tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397220 Jul 18 02:59:47.979856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3018/6099] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 02:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:59:47.994796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-908d1713-5dbb-40ff-8627-20264bdf37a0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:47.995500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-908d1713-5dbb-40ff-8627-20264bdf37a0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:48.019392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:48.131019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-908d1713-5dbb-40ff-8627-20264bdf37a0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:48.148191 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-908d1713-5dbb-40ff-8627-20264bdf37a0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1213 microversion: 2.1 time: 0.154680 Jul 18 02:59:48.148464 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3082/6100] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:47 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:49.169917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f58fe0bb-cf9a-451c-a0ea-c6de4d201157 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:49.171135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f58fe0bb-cf9a-451c-a0ea-c6de4d201157 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:49.371079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f58fe0bb-cf9a-451c-a0ea-c6de4d201157 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:49.383800 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f58fe0bb-cf9a-451c-a0ea-c6de4d201157 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1213 microversion: 2.1 time: 0.219503 Jul 18 02:59:49.385911 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3019/6101] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:49 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:50.402809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:50.403640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:50.417730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.418648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.419669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:50.420284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:50.467832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=50 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:50.543226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:50.555579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9262a7be-26da-4643-8db2-4f738a442f69 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1265 microversion: 2.1 time: 0.153899 Jul 18 02:59:50.556801 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3083/6102] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:50 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:51.603461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:51.609667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:51.631535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.632429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:51.646128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:51.646864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:52.412689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:52.426009 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-883cefed-5d66-41d3-a4ff-08018d4e37ae tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1271 microversion: 2.1 time: 0.833838 Jul 18 02:59:52.428348 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3020/6103] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:51 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1271 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:53.466515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:53.467074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:53.513028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.515986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.519463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:53.526743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:53.856114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:53.872184 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a16816a6-ef5b-4de8-9248-9d74a39896a2 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.410058 Jul 18 02:59:53.893189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3084/6104] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:53 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:54.167926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c7030d1b-e1a8-4d4e-91e6-3081a75d8d58 req-c977fa32-f93c-4b98-8390-10ecaebb71a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb91fac8-b33d-49e7-bcb5-33d25bda4d91", "tag": "3193ec7c-b259-4f0c-ac45-deb1b8b248f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:54.187678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c7030d1b-e1a8-4d4e-91e6-3081a75d8d58 req-c977fa32-f93c-4b98-8390-10ecaebb71a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.188135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c7030d1b-e1a8-4d4e-91e6-3081a75d8d58 req-c977fa32-f93c-4b98-8390-10ecaebb71a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.215229 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c7030d1b-e1a8-4d4e-91e6-3081a75d8d58 req-c977fa32-f93c-4b98-8390-10ecaebb71a5 service nova] Creating event network-changed:3193ec7c-b259-4f0c-ac45-deb1b8b248f7 for instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 on n-h1-849796-1 Jul 18 02:59:54.228743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c7030d1b-e1a8-4d4e-91e6-3081a75d8d58 req-c977fa32-f93c-4b98-8390-10ecaebb71a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070906 Jul 18 02:59:54.229666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3021/6105] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:54.912079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:54.913549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:54.932049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.934309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:54.935835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:54.936514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.171208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:55.180701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4e07667-c464-4987-b9ab-ab3b1938acdf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.273046 Jul 18 02:59:55.189458 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3085/6106] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:54 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:59:55.680880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ec67f8b-6ff6-41ef-9188-e007bc2e0aa5", "device": "/dev/sdb"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:55.682374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:55.694882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.695581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:55.696407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:55.697251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.135274 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c6a127f-73b3-4f16-a8ab-5fa86c3a387e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "POST /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.463443 Jul 18 02:59:56.136626 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3022/6107] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 02:59:55 2022] POST /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:59:56.201316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:56.202039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:56.214933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:56.217547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.221930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:56.224902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:56.436393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:56.447726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37d14e92-a9f2-439f-bec5-da36a3d0b1d0 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.250291 Jul 18 02:59:56.448962 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3086/6108] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:56 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:57.478435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:57.485322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:57.513346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:57.514740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:57.515878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:57.516503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:57.524674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:57.824249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:58.074871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:58.105552 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a66438da-2d42-46f0-81ed-f6cc70026aaf tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.628156 Jul 18 02:59:58.107106 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3023/6109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:57 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:59.127868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:59:59.128849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:59:59.142083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:59.149519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.150270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.153612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.154166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:59:59.452544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:59:59.466674 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c82c56a6-2a47-4412-a2a9-ca1a3acb4a34 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.343597 Jul 18 02:59:59.467325 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3087/6110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 02:59:59 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:59:59.929558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ea6076ac-a9c7-40c6-8e5f-4be14c80017e req-3803a09d-89e7-41f7-92a1-7e5674377780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb91fac8-b33d-49e7-bcb5-33d25bda4d91", "name": "network-vif-plugged", "status": "completed", "tag": "3193ec7c-b259-4f0c-ac45-deb1b8b248f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:59:59.934980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:59:59.967772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ea6076ac-a9c7-40c6-8e5f-4be14c80017e req-3803a09d-89e7-41f7-92a1-7e5674377780 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:59:59.968376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ea6076ac-a9c7-40c6-8e5f-4be14c80017e req-3803a09d-89e7-41f7-92a1-7e5674377780 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:00.007780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ea6076ac-a9c7-40c6-8e5f-4be14c80017e req-3803a09d-89e7-41f7-92a1-7e5674377780 service nova] Creating event network-vif-plugged:3193ec7c-b259-4f0c-ac45-deb1b8b248f7 for instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 on n-h1-849796-1 Jul 18 03:00:00.024096 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ea6076ac-a9c7-40c6-8e5f-4be14c80017e req-3803a09d-89e7-41f7-92a1-7e5674377780 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100524 Jul 18 03:00:00.028600 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3024/6111] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 02:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:00.494412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:00.495755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:00.520852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:00.521423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:00.523276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:00.528429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:00.984785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:01.004324 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b749c295-5b0e-453b-96fa-47d1b5cc5899 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1313 microversion: 2.1 time: 0.514722 Jul 18 03:00:01.006035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3088/6112] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:00 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:02.045248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:02.051960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:02.068876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:02.081676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:02.082593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:02.083082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:02.317083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:02.326793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1022d73a-9c61-4fe1-b517-07dc17cec571 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1496 microversion: 2.1 time: 0.295324 Jul 18 03:00:02.329576 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3025/6113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:02 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1496 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:03.697360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.698182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.708905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.709492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.711229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.711707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.789593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:03.956365 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d6373f3e-81a9-4c1f-90fb-56a744c52aa8 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 204 len: 0 microversion: 2.1 time: 0.266592 Jul 18 03:00:03.957926 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3089/6114] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:03 2022] DELETE /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:00:03.971466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:03.972312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:03.986074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.990810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:03.993077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:03.993918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:04.684204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:04.696473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb278bea-c818-4d9a-8b71-658a700d005b tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1502 microversion: 2.1 time: 0.731345 Jul 18 03:00:04.697850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3026/6115] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:03 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1502 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:05.735796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:05.737955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:05.756568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.759291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:05.760508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:05.761221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.033502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:06.042642 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d4220bb-520e-4298-9dc2-7df47eb4455a tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1502 microversion: 2.1 time: 0.315195 Jul 18 03:00:06.043259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3090/6116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:05 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:06.601878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7b928a2a-aa38-487e-8be9-93e4037c3d86 req-90ef4632-3c6f-4c8d-bb00-2f54d55bd146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb91fac8-b33d-49e7-bcb5-33d25bda4d91", "name": "network-vif-deleted", "tag": "3193ec7c-b259-4f0c-ac45-deb1b8b248f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:06.617856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7b928a2a-aa38-487e-8be9-93e4037c3d86 req-90ef4632-3c6f-4c8d-bb00-2f54d55bd146 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:06.618669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7b928a2a-aa38-487e-8be9-93e4037c3d86 req-90ef4632-3c6f-4c8d-bb00-2f54d55bd146 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:06.640412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7b928a2a-aa38-487e-8be9-93e4037c3d86 req-90ef4632-3c6f-4c8d-bb00-2f54d55bd146 service nova] Creating event network-vif-deleted:3193ec7c-b259-4f0c-ac45-deb1b8b248f7 for instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 on n-h1-849796-1 Jul 18 03:00:06.649232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7b928a2a-aa38-487e-8be9-93e4037c3d86 req-90ef4632-3c6f-4c8d-bb00-2f54d55bd146 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063258 Jul 18 03:00:06.650864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3027/6117] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:07.061215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:07.061919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:07.069976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.070435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.071316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.071800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.121919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:07.122363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:07.122823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lazy-loading 'fault' on Instance uuid cb91fac8-b33d-49e7-bcb5-33d25bda4d91 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:07.183175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c43abec7bd4a3ba85cfada60e9da8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285aa3b324614f2283a857841e90b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:00:07.198197 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a6cc2659-cfde-4bf2-912a-3461c0d718d1 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 200 len: 1303 microversion: 2.1 time: 0.140524 Jul 18 03:00:07.198813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3091/6118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:07 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:00:08.223745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:08.227532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] [instance: cb91fac8-b33d-49e7-bcb5-33d25bda4d91] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:08.246959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:08.248340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:08.271305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:08.275409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:08.316710 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] HTTP exception thrown: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Request method failure captured: Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 HTTP/1.1 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MyFAbt5sXWBo3zbx4v_2-dFeO6GP8jEmko-0TGWdMPoL8kJegl6A_4MMqc-6VHXgoV1tpKqGJfJ67m2yb8YulevNzL1WnldAJBqzMC9P2-WXewDcVqCK12UXDa3yV0fnbt_od8RXOZut6B1rIgnXAH1sJx2-M4i4cQAGV8T7fFkF2s Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 285aa3b324614f2283a857841e90b7c1 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesActionsTest-2069047100 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_285aa3b324614f2283a857841e90b7c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/285aa3b324614f2283a857841e90b7c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesActionsTest-2069047100 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 285aa3b324614f2283a857841e90b7c1 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesActionsTest-2069047100 Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesActionsTest-2069047100-project Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 18c43abec7bd4a3ba85cfada60e9da8b Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesActionsTest-2069047100-project Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'cb91fac8-b33d-49e7-bcb5-33d25bda4d91'} Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:00:08.322064 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. Jul 18 03:00:08.329238 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:00:08.334502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] Returning 404 to user: Instance cb91fac8-b33d-49e7-bcb5-33d25bda4d91 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:00:08.337740 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9664e9a4-8e7a-4b7f-b5d6-e56808d60082 tempest-VolumesActionsTest-2069047100 tempest-VolumesActionsTest-2069047100-project] 10.222.0.67 "GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91" status: 404 len: 111 microversion: 2.1 time: 0.123600 Jul 18 03:00:08.339607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3028/6119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:08 2022] GET /compute/v2.1/servers/cb91fac8-b33d-49e7-bcb5-33d25bda4d91 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:00:31.246676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:31.248564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:31.264796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:31.274623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:31.288037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:31.293693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:31.308516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:31.309148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:31.377150 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d3a37c79-d5d5-4895-a3fc-a25f02c9a9cc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/ips" status: 200 len: 145 microversion: 2.1 time: 0.134769 Jul 18 03:00:31.379254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3092/6120] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 03:00:31 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/ips => generated 145 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:00:38.390194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9317c596-a4ad-4988-b11b-3a31aefdde0c"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:00:38.391384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:38.411899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:38.425345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=23 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:38.468725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.469240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:38.470103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:38.470563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:39.508157 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33bdb015-5bb4-4494-8fef-74118d4e2ac1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104683 Jul 18 03:00:39.513539 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3029/6121] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:00:38 2022] POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:00:44.540316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:44.545580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:44.558573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:44.596035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:44.603697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:44.605182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:44.610109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:45.060711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lazy-loading 'services' on Instance uuid 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:00:45.595436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-df63e84a-262c-45c3-b5f5-7e014f83768f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed/os-volume_attachments/7ec67f8b-6ff6-41ef-9188-e007bc2e0aa5" status: 202 len: 0 microversion: 2.1 time: 1.062651 Jul 18 03:00:45.596773 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3093/6122] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:00:44 2022] DELETE /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed/os-volume_attachments/7ec67f8b-6ff6-41ef-9188-e007bc2e0aa5 => generated 0 bytes in 1066 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:00:59.540030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:59.541277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:59.554731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:59.559648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:59.563055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:59.564284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:59.566232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:59.567247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:59.648330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:00:59.810102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32a93d21-320a-4730-b890-219f7bb17741 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 204 len: 0 microversion: 2.1 time: 0.279435 Jul 18 03:00:59.811595 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3030/6123] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:00:59 2022] DELETE /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:00:59.823226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:00:59.824718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:00:59.830179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:59.831667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:00:59.839355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:59.840470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:00:59.841582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:00:59.842545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:00.627133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:00.637992 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7633b299-6c7a-4067-88e0-377269b595ad tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1515 microversion: 2.1 time: 0.821697 Jul 18 03:01:00.644196 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3094/6124] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:00:59 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1515 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:01.158099 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:01:01.158635 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:01:01.666331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:01.668258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:01.687872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:01.692048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:01.694433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:01.703187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.097371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Calling method '.version_select at 0x7fab052889d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:02.107877 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:01:02.107877 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 03:01:02.118989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:02.122624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.208174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:02.210233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.259932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:02.260790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:02.293922 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca714279-9686-46c2-8ff5-43635f487a53 tempest-PortsAdminExtendedAttrsTestJSON-1526048630 tempest-PortsAdminExtendedAttrsTestJSON-1526048630-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.843204 Jul 18 03:01:02.308303 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3031/6125] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 03:01:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:01:02.798455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:02.820062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d78ee7b4-3295-4e6b-a49b-116ceb482229 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1515 microversion: 2.1 time: 1.156049 Jul 18 03:01:02.821389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3095/6126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:01 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1515 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:03.821144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-85a25564-1896-4f06-b8ac-6dcc6565a975 req-ba1d8e2f-3389-4bdd-9054-a7af4eb1edbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed", "name": "network-vif-deleted", "tag": "d56a4be7-e755-488a-b2ee-8c1fb5aedced"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:03.831789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-85a25564-1896-4f06-b8ac-6dcc6565a975 req-ba1d8e2f-3389-4bdd-9054-a7af4eb1edbc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:03.839108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-85a25564-1896-4f06-b8ac-6dcc6565a975 req-ba1d8e2f-3389-4bdd-9054-a7af4eb1edbc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:03.851101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:03.852009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:03.870111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:03.871579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:03.876116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:03.876886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:03.888606 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-85a25564-1896-4f06-b8ac-6dcc6565a975 req-ba1d8e2f-3389-4bdd-9054-a7af4eb1edbc service nova] Creating event network-vif-deleted:d56a4be7-e755-488a-b2ee-8c1fb5aedced for instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed on n-h2-849796-1 Jul 18 03:01:03.896029 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-85a25564-1896-4f06-b8ac-6dcc6565a975 req-ba1d8e2f-3389-4bdd-9054-a7af4eb1edbc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352068 Jul 18 03:01:03.903396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3032/6127] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:03.965148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:03.967531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:03.968297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lazy-loading 'fault' on Instance uuid 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:01:04.158481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:04.179937 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1fbc8de5-2ee8-40fb-be69-2fdb6c01f8a6 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 200 len: 1309 microversion: 2.1 time: 0.334524 Jul 18 03:01:04.180364 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3096/6128] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:03 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:05.205729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:05.208399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:05.245866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:05.248277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:05.250329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:05.253547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:05.298700 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] HTTP exception thrown: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Request method failure captured: Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed HTTP/1.1 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Mu_ZbpTXuVqODvMXP5RBjCGWQGWQBb4L8usUCneCd2ko2SGPTbBN7ROkjwHEB1W58M-eWgbeaZHrf6ujkkv6N2EZ9BM6Mky1Wf2xvpFCO4CicnBhYnnbKn86bz_w8ZrpP4NcqG_r1kg2NBbipqRrzEY9QFrtkBX90237Bv-s9px5BQ Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 10dad96c700646109b18fbb26494f801 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/10dad96c700646109b18fbb26494f801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_10dad96c700646109b18fbb26494f801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/10dad96c700646109b18fbb26494f801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/10dad96c700646109b18fbb26494f801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 10dad96c700646109b18fbb26494f801 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesSnapshotTestJSON-1967052032-project Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3e360b4cd59d41b2b09d9fa2d52a34a2 Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesSnapshotTestJSON-1967052032-project Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed'} Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:01:05.309936 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. Jul 18 03:01:05.319288 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:01:05.322998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Returning 404 to user: Instance 3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:01:05.324963 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-268e5297-0f1a-4d70-b21b-5a130d0b3406 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed" status: 404 len: 111 microversion: 2.1 time: 0.124530 Jul 18 03:01:05.334992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3033/6129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:05 2022] GET /compute/v2.1/servers/3fcc7f97-ced4-433e-bafe-b9cb8c01e5ed => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:01:10.347850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed93f7e8-7533-4739-b6f0-4db02288a4f1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:10.373506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed93f7e8-7533-4739-b6f0-4db02288a4f1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:10.374155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed93f7e8-7533-4739-b6f0-4db02288a4f1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:10.462575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed93f7e8-7533-4739-b6f0-4db02288a4f1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Going to try to stop instance {{(pid=119439) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:01:10.602840 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed93f7e8-7533-4739-b6f0-4db02288a4f1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action" status: 202 len: 0 microversion: 2.1 time: 0.250554 Jul 18 03:01:10.606949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3097/6130] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:01:10 2022] POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:01:10.618891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:10.620254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:10.640627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:10.641849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:10.645092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:10.650072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:11.324554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:11.393077 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44bb9577-3928-4f1d-ba57-c151fcf148fe tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.777166 Jul 18 03:01:11.393077 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3034/6131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:10 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:12.435657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:12.437965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:12.461205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:12.461686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:12.462513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:12.462974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:12.827695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:12.843177 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b158fcb-c8e5-4783-8650-f9d3b7a37af6 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.421385 Jul 18 03:01:12.856797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3098/6132] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:12 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:13.870739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:13.876763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:13.903431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:13.919942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:13.921956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:13.931497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:15.203860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:15.239428 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-da28f05d-39de-46b5-9783-5f66ff8577ac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 1.376339 Jul 18 03:01:15.242274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3035/6133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:13 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:16.263685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:16.264727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:16.298287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:16.300118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:16.301601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:16.311805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:16.786062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:16.805258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98626a67-7cac-430d-a84d-0c804248363f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.549120 Jul 18 03:01:16.809182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3099/6134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:16 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:17.864413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:17.867387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:17.902378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:17.903291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:17.911315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:17.911831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:18.228911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:18.260242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-517be681-c20d-430f-888b-650485aa23a2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.424828 Jul 18 03:01:18.261736 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3036/6135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:17 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:19.225127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-702106008", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "5e09b9ce-285d-4cb5-89e5-501ef6d4aa21"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:19.345585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:19.356690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:19.378931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] validate_networks() for [('5e09b9ce-285d-4cb5-89e5-501ef6d4aa21', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:01:19.411344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.414081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.416347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:19.420189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:19.766299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:19.790154 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb790987-acbb-4cde-9f05-4049375a1c77 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.505806 Jul 18 03:01:19.792272 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3037/6136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:19 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:20.269069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:01:20.270453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:01:20.271148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:01:20.272735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:01:20.273756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:01:20.294474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:20.295466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:20.297313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:20.298186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:20.329822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Getting quotas for project 10dad96c700646109b18fbb26494f801. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:20.339728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Getting quotas for user 3e360b4cd59d41b2b09d9fa2d52a34a2 and project 10dad96c700646109b18fbb26494f801. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:20.363703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:01:20.369075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:01:20.460747 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03075041-4a5c-4f84-b8d8-2dfd0a7d909a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240664 Jul 18 03:01:20.464688 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3100/6137] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:01:20.477614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5374c34a-b053-48bf-a7bc-42b5d07b3b19 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:20.479077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5374c34a-b053-48bf-a7bc-42b5d07b3b19 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:20.622150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5374c34a-b053-48bf-a7bc-42b5d07b3b19 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:20.634613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5374c34a-b053-48bf-a7bc-42b5d07b3b19 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1218 microversion: 2.1 time: 0.161900 Jul 18 03:01:20.635509 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3038/6138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:20 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:20.814598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:20.815235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:20.834629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:20.841513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:20.842968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:20.843429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:21.148255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:21.183787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f65dee4b-78bb-4865-9855-7e5928de70f7 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.370784 Jul 18 03:01:21.191281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3101/6139] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:20 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:21.663654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:21.664635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:21.692866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:21.697514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:21.697645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:21.698433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:21.809327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:21.829753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef63300a-3e2d-46d9-95ed-4e4bc31fec1a tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1222 microversion: 2.1 time: 0.170543 Jul 18 03:01:21.831308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3039/6140] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:21 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:22.211198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:22.212782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:22.232198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.233794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.235185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.242315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.673454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:22.694390 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e147c539-63d3-41cf-9e6e-158ca6e1a62f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.487986 Jul 18 03:01:22.705642 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3102/6141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:22 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:22.848232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:22.848916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:22.858993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.859464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.860288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:22.860740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:22.992009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:23.022043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cc913efe-5cef-4e02-9581-c0d109468952 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1276 microversion: 2.1 time: 0.167626 Jul 18 03:01:23.026146 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3040/6142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:22 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:23.713080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:23.713915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:23.728577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:23.729235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:23.730221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:23.730975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:24.045948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:24.046747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:24.061553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:24.063425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:24.066910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:24.067644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:24.123175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:24.148230 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f045d363-8d14-4251-b421-0a56f0b910bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.439446 Jul 18 03:01:24.149481 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3103/6143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:23 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:24.461299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:24.495902 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0917de25-cdc8-4b28-8db6-e1986537f073 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.454350 Jul 18 03:01:24.503262 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3041/6144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:24 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:25.175527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:25.176386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:25.199523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.199957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:25.200790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.201188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:25.542225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:25.547701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:25.576707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.581155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:25.588354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:25.590047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:26.169463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:26.250741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31abdf40-f09c-4cef-a3c8-450470c1ee97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 1.079191 Jul 18 03:01:26.258629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3104/6145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:25 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:26.291980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:26.314437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-268ed705-62aa-49ec-988f-5e58d6931e84 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.787104 Jul 18 03:01:26.315524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3042/6146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:25 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:26.823956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-97a5cffd-7c34-4ca2-9f5b-d9c2e34ed2d6 req-7ed81094-c981-4fc6-9bc5-2c2ac0c3b3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5832c6a0-992e-4fe5-9a55-3239ed464eab", "tag": "d70f97f1-a4df-42d5-9149-799a170d6c1a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:26.860284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-97a5cffd-7c34-4ca2-9f5b-d9c2e34ed2d6 req-7ed81094-c981-4fc6-9bc5-2c2ac0c3b3b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:26.861591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-97a5cffd-7c34-4ca2-9f5b-d9c2e34ed2d6 req-7ed81094-c981-4fc6-9bc5-2c2ac0c3b3b8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:26.903319 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-97a5cffd-7c34-4ca2-9f5b-d9c2e34ed2d6 req-7ed81094-c981-4fc6-9bc5-2c2ac0c3b3b8 service nova] Creating event network-changed:d70f97f1-a4df-42d5-9149-799a170d6c1a for instance 5832c6a0-992e-4fe5-9a55-3239ed464eab on n-h2-849796-1 Jul 18 03:01:26.913325 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-97a5cffd-7c34-4ca2-9f5b-d9c2e34ed2d6 req-7ed81094-c981-4fc6-9bc5-2c2ac0c3b3b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117122 Jul 18 03:01:26.916253 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3105/6147] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:27.281225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:27.281954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:27.304420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.304904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.312749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.313298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.334983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:27.336530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:27.363874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.364399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.365869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:27.366605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:27.876482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:27.890576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d838390d-70c4-4520-9784-9b71580ec89d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.617126 Jul 18 03:01:27.894137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3043/6148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:27 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:28.142079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:28.159938 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5b39591-bfd9-4ef4-b643-80c2ed1ee559 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.829807 Jul 18 03:01:28.164320 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3106/6149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:27 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:28.915958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:28.917655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:28.940488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:28.942962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:28.951877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:28.952719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.187013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:29.188209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:29.219402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.225163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.228575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:29.230378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:29.642839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:29.663310 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84481b67-9aa8-4892-bd81-5e634b7fb68d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.482675 Jul 18 03:01:29.673188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3107/6150] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:29 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:29.966167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:29.971376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:30.009532 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96aa5f08-94c0-44c4-9f77-d329ad96825f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 1.094018 Jul 18 03:01:30.010771 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3044/6151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:28 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:30.685329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:30.685907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:30.705458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:30.721515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:30.727338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:30.735927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:30.741077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:30.746554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:30.750277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:30.824398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:31.046573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:31.048071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:31.072559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:31.074351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:31.085366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:31.088649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:31.089953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:31.093197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:31.772631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:31.811480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1796269-f24e-41e1-8dfd-7fd7f3e7143d tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 1.130700 Jul 18 03:01:31.814779 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3108/6152] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:30 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:31.836584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:31.884594 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2fd672e-1680-4a6b-bbec-2e04b02b544b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1723 microversion: 2.1 time: 0.845055 Jul 18 03:01:31.897781 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3045/6153] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:31 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1723 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:32.847673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:32.848905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:32.859394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:32.859973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:32.860990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:32.861567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:32.905509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:32.907563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:32.924456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:32.929992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:32.931232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:32.932471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.350244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:33.369176 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abfb7b95-b91f-4f24-90c5-2682165ddafb tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.526172 Jul 18 03:01:33.389927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3109/6154] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:32 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:33.633629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:33.660728 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0170a481-0cf5-48b3-8357-46babbd8ae66 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1700 microversion: 2.1 time: 0.761308 Jul 18 03:01:33.671324 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3046/6155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:32 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1700 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:33.723147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47b750f5-a156-4992-b479-cd14fcf10cdc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:33.737861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b750f5-a156-4992-b479-cd14fcf10cdc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:33.738333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47b750f5-a156-4992-b479-cd14fcf10cdc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:33.851040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47b750f5-a156-4992-b479-cd14fcf10cdc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Going to try to start instance {{(pid=119439) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:01:34.097025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47b750f5-a156-4992-b479-cd14fcf10cdc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action" status: 202 len: 0 microversion: 2.1 time: 0.386370 Jul 18 03:01:34.108749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3110/6156] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:01:33 2022] POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:01:34.124524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:34.136476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:34.186471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:34.190815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:34.195989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:34.197612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:34.411555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:34.429850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:34.456056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:34.457187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:34.458477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:34.459147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:34.971082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:34.994129 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d679b81-7a22-442c-8195-6d9e9cf5be57 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1709 microversion: 2.1 time: 0.881206 Jul 18 03:01:35.013585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3047/6157] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:34 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1709 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:35.092679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:35.128505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a307e564-7601-4c97-96a1-ee4935922b08 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.730811 Jul 18 03:01:35.164407 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3111/6158] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:34 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:36.034713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:36.042817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:36.069645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:36.070453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:36.074652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:36.076222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:36.172818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:36.174764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:36.190908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:36.194382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:36.197278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:36.198615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:36.709508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:36.722084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-adb8693f-a64d-4add-9fc3-09fb76da49eb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1709 microversion: 2.1 time: 0.711801 Jul 18 03:01:36.724955 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3048/6159] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:36 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1709 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:36.967253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:36.982605 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-820e3ff5-451f-46b5-9243-5dabe5bb026b tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.814409 Jul 18 03:01:36.983983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3112/6160] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:36 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:37.748027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:37.759574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:37.826095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:37.829977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:37.836321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:37.838149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.001569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:38.002402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:38.029541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:38.030038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.030982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:38.031281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.493784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:38.507735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-929b043b-805c-4189-b28e-eebf781d453f tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.510889 Jul 18 03:01:38.509286 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3113/6161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:37 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:38.715051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c304b120-7ff4-4902-8901-3fa8d4ccbcfd req-61a65a36-7685-4739-9c74-ae5c42cc632e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5832c6a0-992e-4fe5-9a55-3239ed464eab", "name": "network-vif-plugged", "status": "completed", "tag": "d70f97f1-a4df-42d5-9149-799a170d6c1a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:38.738479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c304b120-7ff4-4902-8901-3fa8d4ccbcfd req-61a65a36-7685-4739-9c74-ae5c42cc632e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:38.739443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c304b120-7ff4-4902-8901-3fa8d4ccbcfd req-61a65a36-7685-4739-9c74-ae5c42cc632e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:38.776180 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c304b120-7ff4-4902-8901-3fa8d4ccbcfd req-61a65a36-7685-4739-9c74-ae5c42cc632e service nova] Creating event network-vif-plugged:d70f97f1-a4df-42d5-9149-799a170d6c1a for instance 5832c6a0-992e-4fe5-9a55-3239ed464eab on n-h2-849796-1 Jul 18 03:01:38.793690 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c304b120-7ff4-4902-8901-3fa8d4ccbcfd req-61a65a36-7685-4739-9c74-ae5c42cc632e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085780 Jul 18 03:01:38.796899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3114/6162] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:39.043930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:39.064312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-031fb366-d11a-40b9-9c64-3f5750b10f4f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1709 microversion: 2.1 time: 1.324412 Jul 18 03:01:39.066887 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3049/6163] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:37 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1709 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:39.543630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:39.550427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:39.593996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.595359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:39.597182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:39.598553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.090579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:40.091763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:40.106660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:40.109126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.113428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:40.116792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:40.207045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:40.222886 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10de921f-8aaa-411f-8772-d700d8733e11 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1318 microversion: 2.1 time: 0.691521 Jul 18 03:01:40.232288 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3115/6164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:39 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:40.889342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:40.902767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e36eeed-693a-43d8-8e93-24aba7b62293 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1713 microversion: 2.1 time: 0.816217 Jul 18 03:01:40.904672 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3050/6165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:40 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1713 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:01:41.265221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:41.290377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:41.309471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.310568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.311442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:41.313820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:41.946619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:42.063233 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f29e5499-a71d-423e-b57d-56629025e6bc tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1508 microversion: 2.1 time: 0.814572 Jul 18 03:01:42.066921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3116/6166] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:41 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1508 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:42.127534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32eecabc-3de5-4b90-8ff3-50d7645699c8", "device": "/dev/sdb"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:42.137347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:42.165554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:42.166872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:42.168449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:42.169674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:43.078536 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba18654c-81f7-45ac-867c-4fee363801df tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "POST /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986851 Jul 18 03:01:43.081603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3051/6167] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:01:42 2022] POST /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:01:50.714385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1f8277a-7d3b-450a-b30a-5fbb31bb0c7e tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Action: 'create', calling method: .version_select at 0x7fab05a8e280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1614291137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuADriRX5oaW6haJIerhsnP23bHDrVpfRHMWSlmS8ERGGSHETkIuZZFFduIpLApiJ81AvY9kSPXMd2L0/Mr3KdrW1CUunQtj2PSQ6lNqMrtzmjaQNYtwvAUP8kjuE2oDw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:50.747632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c1f8277a-7d3b-450a-b30a-5fbb31bb0c7e tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for project c05317d0245b4b7f982e147c993554c8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:50.755580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-c1f8277a-7d3b-450a-b30a-5fbb31bb0c7e tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for user 6645d8af1e26496db7b9e4d43544a968 and project c05317d0245b4b7f982e147c993554c8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:50.800543 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c1f8277a-7d3b-450a-b30a-5fbb31bb0c7e tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.846307 Jul 18 03:01:50.801568 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3117/6168] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:01:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:01:54.000382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1340228290", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1614291137", "security_groups": [{"name": "tempest-secgroup-smoke-1475440368"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "6519f555-a4e3-465c-9067-da0fdb0e4433"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:01:54.044425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=13 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:54.048670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:54.412868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] validate_networks() for [('6519f555-a4e3-465c-9067-da0fdb0e4433', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:01:55.950655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for project c05317d0245b4b7f982e147c993554c8. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:55.960407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for user 6645d8af1e26496db7b9e4d43544a968 and project c05317d0245b4b7f982e147c993554c8. Resources: dict_keys(['metadata_items']) {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:55.992567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:01:55.993413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:01:55.997263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:01:55.998001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:01:56.001906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:01:56.046905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:56.048319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:56.053747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:01:56.055222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:01:56.120017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for project c05317d0245b4b7f982e147c993554c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:01:56.179676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Getting quotas for user 6645d8af1e26496db7b9e4d43544a968 and project c05317d0245b4b7f982e147c993554c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:01:56.243589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:01:56.248394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:01:56.446344 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-90ada769-81bd-4532-9284-82e46ddfb966 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.472351 Jul 18 03:01:56.461265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3052/6169] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:01:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:01:56.466523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:01:56.492882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61732f3c-2e1e-44f2-8acf-32f937c13857 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:56.494284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61732f3c-2e1e-44f2-8acf-32f937c13857 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:56.784589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61732f3c-2e1e-44f2-8acf-32f937c13857 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:56.805308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61732f3c-2e1e-44f2-8acf-32f937c13857 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1303 microversion: 2.1 time: 0.341521 Jul 18 03:01:56.815500 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3118/6170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:56 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1303 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:57.834879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8cc292a5-c1b0-495e-be18-814229c54f23 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:57.835481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8cc292a5-c1b0-495e-be18-814229c54f23 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:58.034113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8cc292a5-c1b0-495e-be18-814229c54f23 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:58.056109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8cc292a5-c1b0-495e-be18-814229c54f23 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1303 microversion: 2.1 time: 0.219670 Jul 18 03:01:58.070945 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3053/6171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:57 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:01:59.082760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-70b83278-7173-4304-9b58-dc1be2966858 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:01:59.085125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-70b83278-7173-4304-9b58-dc1be2966858 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:01:59.218616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-70b83278-7173-4304-9b58-dc1be2966858 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:01:59.226791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-70b83278-7173-4304-9b58-dc1be2966858 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1303 microversion: 2.1 time: 0.148558 Jul 18 03:01:59.227403 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3119/6172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:01:59 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:00.256767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:00.257649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:00.277496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:00.281911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:00.283519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:00.285554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:00.827739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:00.850596 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b440daf8-71ed-466d-98fa-4a7dbc0a51a2 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1355 microversion: 2.1 time: 0.593373 Jul 18 03:02:00.850596 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3054/6173] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:00 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1355 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:01.880551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:01.883572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:01.902167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:01.926702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:01.930602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:01.933024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:01.934256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:02.763292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:02.779869 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-057cd826-ebd1-4882-8d86-4d4cd6dba03b tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.903786 Jul 18 03:02:02.793827 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3120/6174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:01 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:03.752178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-498dc45b-d633-4d90-b136-6533411e02db req-0bc7c730-44c8-4eb7-ba67-c46b332def0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a091c676-6162-484b-908c-a51f6ed0979e", "tag": "b3c386b8-8d83-4eab-991a-9604cf517aa7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:03.774026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-498dc45b-d633-4d90-b136-6533411e02db req-0bc7c730-44c8-4eb7-ba67-c46b332def0e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:03.776780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-498dc45b-d633-4d90-b136-6533411e02db req-0bc7c730-44c8-4eb7-ba67-c46b332def0e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:03.813251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:03.821046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:03.833834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-498dc45b-d633-4d90-b136-6533411e02db req-0bc7c730-44c8-4eb7-ba67-c46b332def0e service nova] Creating event network-changed:b3c386b8-8d83-4eab-991a-9604cf517aa7 for instance a091c676-6162-484b-908c-a51f6ed0979e on n-h1-849796-1 Jul 18 03:02:03.853277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-498dc45b-d633-4d90-b136-6533411e02db req-0bc7c730-44c8-4eb7-ba67-c46b332def0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105164 Jul 18 03:02:03.854055 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3055/6175] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:03.917937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:03.923090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:03.925206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:03.927854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:04.488366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:04.501462 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e477ea56-a31d-45e6-8375-d48936a6123c tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.696422 Jul 18 03:02:04.512355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3121/6176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:03 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:05.530981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:05.534851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:05.566360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:05.567275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:05.568966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:05.569759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:06.076420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:06.108156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:06.138672 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-37fa908f-88d0-4abb-80e7-3a939fb38183 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.620341 Jul 18 03:02:06.146480 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3056/6177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:05 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:07.189415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:07.190656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:07.298161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:07.303724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:07.305132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:07.305824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:07.564109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:07.576705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19dfe338-7570-4fe6-a462-a925ed826e1f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.416084 Jul 18 03:02:07.587586 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3122/6178] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:07 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:08.598733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:08.602571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:08.623536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:08.641115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:08.650806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:08.653472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:08.654443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:08.960153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:08.973474 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27bcb90d-01e5-4242-831e-eb1f0f2f6c73 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.382017 Jul 18 03:02:08.976014 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3057/6179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:08 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:09.993154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:09.994128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:09.997118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:10.022579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.025702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.027366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.030494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.511846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:10.524574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e156fc07-0d0b-46ce-b89f-a60ff4819a4f tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.534594 Jul 18 03:02:10.525658 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3123/6180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:09 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:10.900082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a8d2982a-fec1-4d30-8ec9-4cc88e13f731 req-ea8ea3cd-c97e-4380-8e38-2999e5b57a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a091c676-6162-484b-908c-a51f6ed0979e", "name": "network-vif-plugged", "status": "completed", "tag": "b3c386b8-8d83-4eab-991a-9604cf517aa7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:10.939893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a8d2982a-fec1-4d30-8ec9-4cc88e13f731 req-ea8ea3cd-c97e-4380-8e38-2999e5b57a2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:10.945896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a8d2982a-fec1-4d30-8ec9-4cc88e13f731 req-ea8ea3cd-c97e-4380-8e38-2999e5b57a2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:10.969656 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a8d2982a-fec1-4d30-8ec9-4cc88e13f731 req-ea8ea3cd-c97e-4380-8e38-2999e5b57a2c service nova] Creating event network-vif-plugged:b3c386b8-8d83-4eab-991a-9604cf517aa7 for instance a091c676-6162-484b-908c-a51f6ed0979e on n-h1-849796-1 Jul 18 03:02:10.996909 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a8d2982a-fec1-4d30-8ec9-4cc88e13f731 req-ea8ea3cd-c97e-4380-8e38-2999e5b57a2c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103861 Jul 18 03:02:11.000217 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3058/6181] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:11.554263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:11.555622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:11.575081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:11.585732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:11.586940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:11.588966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:12.004136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:12.017600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5042b9e9-6b08-4c1c-bdad-992f0499ff51 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1429 microversion: 2.1 time: 0.469712 Jul 18 03:02:12.018828 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3124/6182] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:11 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1429 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:13.047255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:13.049000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:13.077473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.080251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.087515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.088432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.406316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:13.417388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e7f94f5-5cfc-4e06-bbed-ecf0fa162b4a tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1610 microversion: 2.1 time: 0.376926 Jul 18 03:02:13.418013 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3059/6183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:13 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1610 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:13.435652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:13.436369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:13.466169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.467068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.468199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.469026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.729144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:13.743678 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6c853eef-5a08-4f7e-b420-66cacb60b639 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1610 microversion: 2.1 time: 0.311946 Jul 18 03:02:13.745636 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3125/6184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:13 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1610 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:13.766506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:13.769249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:13.780443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.781451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:13.782627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:13.783055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:14.143561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:14.158881 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5be83b20-0143-47d4-a637-b07d4a3ce091 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1610 microversion: 2.1 time: 0.396683 Jul 18 03:02:14.159850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3060/6185] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:13 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1610 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:19.467053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7f20441c-97cb-435e-a1c1-8c11b5be7dd5 req-c01469ef-6d20-40f4-8cd4-c0d483c71a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a091c676-6162-484b-908c-a51f6ed0979e", "tag": "b3c386b8-8d83-4eab-991a-9604cf517aa7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:19.489535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7f20441c-97cb-435e-a1c1-8c11b5be7dd5 req-c01469ef-6d20-40f4-8cd4-c0d483c71a8a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:19.492445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7f20441c-97cb-435e-a1c1-8c11b5be7dd5 req-c01469ef-6d20-40f4-8cd4-c0d483c71a8a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:19.518955 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7f20441c-97cb-435e-a1c1-8c11b5be7dd5 req-c01469ef-6d20-40f4-8cd4-c0d483c71a8a service nova] Creating event network-changed:b3c386b8-8d83-4eab-991a-9604cf517aa7 for instance a091c676-6162-484b-908c-a51f6ed0979e on n-h1-849796-1 Jul 18 03:02:19.536620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7f20441c-97cb-435e-a1c1-8c11b5be7dd5 req-c01469ef-6d20-40f4-8cd4-c0d483c71a8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102390 Jul 18 03:02:19.550949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3126/6186] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:02:23.559035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:23.560239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:23.569525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:23.570796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:23.572557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:23.573546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:23.756442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lazy-loading 'services' on Instance uuid 5832c6a0-992e-4fe5-9a55-3239ed464eab {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:02:23.881850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52dd0643-195b-428d-8ebe-00607f13aefe tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab/os-volume_attachments/32eecabc-3de5-4b90-8ff3-50d7645699c8" status: 202 len: 0 microversion: 2.1 time: 0.327313 Jul 18 03:02:23.889647 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3061/6187] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:02:23 2022] DELETE /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab/os-volume_attachments/32eecabc-3de5-4b90-8ff3-50d7645699c8 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:02:30.818586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:30.819280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:30.822510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=13 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:30.823388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:30.830261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.830724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.831523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.831968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.863286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:02:30.967077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6848298-50b1-4189-870c-ec3b8f2d9c2e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 204 len: 0 microversion: 2.1 time: 0.153464 Jul 18 03:02:30.967793 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3127/6188] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:02:30 2022] DELETE /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:02:30.979129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:30.980022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:30.982187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:30.988640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.989197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.990918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:30.991382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:30.995038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:31.170422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:31.183379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5071ae58-34e9-48ae-8d8e-49c77f93843e tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1514 microversion: 2.1 time: 0.210399 Jul 18 03:02:31.184801 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3062/6189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:30 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:32.214909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:32.217457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:32.234133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:32.236272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:32.238952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:32.242127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:32.607477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:32.624787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed951e5f-862c-4a02-9ec7-45678ce29ac2 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1514 microversion: 2.1 time: 0.417661 Jul 18 03:02:32.626519 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3128/6190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:32 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:33.652327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:33.654335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:33.663312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:33.664148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:33.665256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:33.666076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:34.100119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-db591073-9cfc-4aa1-aa5f-517d020bfd89 req-e017bcb5-cde0-4abe-91c8-7e9fc682d9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5832c6a0-992e-4fe5-9a55-3239ed464eab", "name": "network-vif-deleted", "tag": "d70f97f1-a4df-42d5-9149-799a170d6c1a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:34.114164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db591073-9cfc-4aa1-aa5f-517d020bfd89 req-e017bcb5-cde0-4abe-91c8-7e9fc682d9aa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:34.115030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-db591073-9cfc-4aa1-aa5f-517d020bfd89 req-e017bcb5-cde0-4abe-91c8-7e9fc682d9aa service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:34.131828 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-db591073-9cfc-4aa1-aa5f-517d020bfd89 req-e017bcb5-cde0-4abe-91c8-7e9fc682d9aa service nova] Creating event network-vif-deleted:d70f97f1-a4df-42d5-9149-799a170d6c1a for instance 5832c6a0-992e-4fe5-9a55-3239ed464eab on n-h2-849796-1 Jul 18 03:02:34.138107 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-db591073-9cfc-4aa1-aa5f-517d020bfd89 req-e017bcb5-cde0-4abe-91c8-7e9fc682d9aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Jul 18 03:02:34.139436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3129/6191] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:02:34.188652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e360b4cd59d41b2b09d9fa2d52a34a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dad96c700646109b18fbb26494f801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:34.211668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8997994f-2994-4090-b547-d40137e80412 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 200 len: 1514 microversion: 2.1 time: 0.567492 Jul 18 03:02:34.213302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3063/6192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:33 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 1514 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:35.240686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:35.241947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] [instance: 5832c6a0-992e-4fe5-9a55-3239ed464eab] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:35.258523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:35.259733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:35.262159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:35.262983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:35.315648 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] HTTP exception thrown: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Request method failure captured: Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab HTTP/1.1 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Mu_ZbpTXuVqODvMXP5RBjCGWQGWQBb4L8usUCneCd2ko2SGPTbBN7ROkjwHEB1W58M-eWgbeaZHrf6ujkkv6N2EZ9BM6Mky1Wf2xvpFCO4CicnBhYnnbKn86bz_w8ZrpP4NcqG_r1kg2NBbipqRrzEY9QFrtkBX90237Bv-s9px5BQ Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 10dad96c700646109b18fbb26494f801 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/10dad96c700646109b18fbb26494f801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_10dad96c700646109b18fbb26494f801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/10dad96c700646109b18fbb26494f801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/10dad96c700646109b18fbb26494f801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 10dad96c700646109b18fbb26494f801 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1967052032 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesSnapshotTestJSON-1967052032-project Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 3e360b4cd59d41b2b09d9fa2d52a34a2 Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesSnapshotTestJSON-1967052032-project Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5832c6a0-992e-4fe5-9a55-3239ed464eab'} Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:02:35.319926 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] Returning 404 to user: Instance 5832c6a0-992e-4fe5-9a55-3239ed464eab could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7eeed926-798e-4b66-b714-cb61c1b7d951 tempest-VolumesSnapshotTestJSON-1967052032 tempest-VolumesSnapshotTestJSON-1967052032-project] 10.222.0.67 "GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab" status: 404 len: 111 microversion: 2.1 time: 0.095039 Jul 18 03:02:35.338295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3130/6193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:35 2022] GET /compute/v2.1/servers/5832c6a0-992e-4fe5-9a55-3239ed464eab => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:02:36.701895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:36.711033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:36.734299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:36.736147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:36.737924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:36.738683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:36.964172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lazy-loading 'services' on Instance uuid 963bfa3f-7b36-48ba-a499-75be3dc7b517 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:02:37.164820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c56e67c0-381b-47f6-bad3-55b4131830cb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments/9317c596-a4ad-4988-b11b-3a31aefdde0c" status: 202 len: 0 microversion: 2.1 time: 0.469770 Jul 18 03:02:37.167498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3064/6194] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:02:36 2022] DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments/9317c596-a4ad-4988-b11b-3a31aefdde0c => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:02:45.434598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-018886dc-5529-423f-a357-ae5c6d8696b1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:45.438226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:45.442963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:02:45.465050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-018886dc-5529-423f-a357-ae5c6d8696b1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.467555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-018886dc-5529-423f-a357-ae5c6d8696b1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.560026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-018886dc-5529-423f-a357-ae5c6d8696b1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Going to try to stop instance {{(pid=119439) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:02:45.699584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-018886dc-5529-423f-a357-ae5c6d8696b1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action" status: 202 len: 0 microversion: 2.1 time: 0.268462 Jul 18 03:02:45.700812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3131/6195] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:02:45 2022] POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:02:45.717807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:45.718627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:45.727503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.728006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.728914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:45.729457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:45.951879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:45.977941 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e4403eb2-e255-4693-a062-425c592bd5d0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.271697 Jul 18 03:02:45.979047 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3065/6196] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:45 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:47.000808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:47.002354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:47.017391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:47.018912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:47.020063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:47.021763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:47.410860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:47.428373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3e536693-1948-4945-8aa5-06964d47b6ee tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.432854 Jul 18 03:02:47.428373 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3132/6197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:46 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:48.453471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:48.454782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:48.481754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:48.482599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:48.497053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:48.498043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:49.175778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:49.200291 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e94fb49-94f9-4eeb-bade-0f4ff35a38bc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.749900 Jul 18 03:02:49.200992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3066/6198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:48 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:50.283871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:50.289059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:50.329501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:50.330340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:50.331929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:50.332812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:50.678268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:50.687880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbf5239a-e38c-4403-aff1-f273d59714dc tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.414566 Jul 18 03:02:50.688833 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3133/6199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:50 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:51.723574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:51.730644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:51.794814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:51.799427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:51.804780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:51.806546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:52.139316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:52.205228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef7f06bb-df8f-42f3-b149-8e8e72dded1d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.501128 Jul 18 03:02:52.206720 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3067/6200] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:51 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:53.233158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:53.234543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:53.256804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:53.257684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:53.258745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:53.259458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:53.633195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:53.660614 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-afb55751-0ce7-4588-ac2a-7aad890ef9af tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.431461 Jul 18 03:02:53.661794 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3134/6201] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:53 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:54.681575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:54.684653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:54.718260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:54.718743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:54.719690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:54.720105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:55.011751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:55.025721 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aaac3c13-32fe-4ac1-91db-ba9f58f42bac tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.349053 Jul 18 03:02:55.026614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3068/6202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:54 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:56.046744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:56.047506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:56.062330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.063690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.064639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:56.066028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:56.427434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:56.443239 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-633e8a07-dca7-47cc-a5f2-9d1c0fdf46b4 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1677 microversion: 2.1 time: 0.399680 Jul 18 03:02:56.445615 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3135/6203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:56 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1677 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:57.462977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:57.463627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:57.491409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:57.492297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:57.493363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:57.493989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:57.783572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:57.799363 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5535d2f-99ba-4f80-9d79-e43f34294e3d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1654 microversion: 2.1 time: 0.340379 Jul 18 03:02:57.802488 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3069/6204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:57 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1654 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:02:57.824827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f5f55a3b-a021-4be7-b185-906d0defc63d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:02:57.852306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5f55a3b-a021-4be7-b185-906d0defc63d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:57.853167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f5f55a3b-a021-4be7-b185-906d0defc63d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:57.913452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f5f55a3b-a021-4be7-b185-906d0defc63d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Going to try to start instance {{(pid=119439) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:02:58.000726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f5f55a3b-a021-4be7-b185-906d0defc63d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action" status: 202 len: 0 microversion: 2.1 time: 0.177601 Jul 18 03:02:58.002141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3136/6205] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:02:57 2022] POST /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:02:58.011630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:58.012278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:58.026812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:58.027703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:58.028806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:58.029614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:58.514332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:58.526415 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-767a02dd-1761-43ef-97b8-51c5b489621c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1663 microversion: 2.1 time: 0.518822 Jul 18 03:02:58.528829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3070/6206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:58 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1663 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:02:59.551972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:02:59.553196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:02:59.580421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:59.581346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:59.585842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:02:59.588204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:02:59.973967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:02:59.991131 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0928328d-a443-42e9-ac4c-c3e2eb288005 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1663 microversion: 2.1 time: 0.447664 Jul 18 03:02:59.992146 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3137/6207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:02:59 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1663 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:01.027461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:01.029603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:01.039035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=18 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:01.059321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:01.059826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:01.060715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:01.061212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:01.064529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:01.662816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:01.673530 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0ad73407-4d52-438c-9045-6a1c5ee3ea85 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1667 microversion: 2.1 time: 0.653665 Jul 18 03:03:01.688967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3071/6208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:01 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1667 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:11.101729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=14 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:11.106237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:11.360324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-326339477", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "29f8f555-9ee3-4d10-b1b2-fbf13f5ad600"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:11.469519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] validate_networks() for [('29f8f555-9ee3-4d10-b1b2-fbf13f5ad600', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:12.131589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:12.133773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:12.134771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:12.135486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:12.136347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:12.156645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:12.157852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:12.159161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:12.159976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:12.207393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Getting quotas for project 86a46b8f25384b038f7ef6e2f25cd416. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:12.216097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Getting quotas for user deb15c626aa44642a86136c31d5262c0 and project 86a46b8f25384b038f7ef6e2f25cd416. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:12.233841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:12.236730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:12.349348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8b344e67-d7f5-4362-95f0-a9aada5ee0f7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264366 Jul 18 03:03:12.353513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3138/6209] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:12.362416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3773345e-12e5-4347-a9c5-087af3fc6a4b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:12.363509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3773345e-12e5-4347-a9c5-087af3fc6a4b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:12.376698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:12.377631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:12.484785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3773345e-12e5-4347-a9c5-087af3fc6a4b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:12.512589 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3773345e-12e5-4347-a9c5-087af3fc6a4b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1214 microversion: 2.1 time: 0.157514 Jul 18 03:03:12.513261 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3072/6210] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:12 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:13.554214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:13.555413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:13.584461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.588159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.592305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:13.593972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:13.697801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:13.713003 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e77146f3-de6e-416a-acfb-18d50f6e6f18 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1266 microversion: 2.1 time: 0.167638 Jul 18 03:03:13.714061 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3139/6211] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:13 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:14.743954 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:14.746198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:14.760760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.761939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.763644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:14.764710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:14.883578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:14.900714 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43a8580f-7853-473e-8493-a59fb0a85b8b tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1272 microversion: 2.1 time: 0.163780 Jul 18 03:03:14.921401 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3073/6212] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:14 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:15.931074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:15.932524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:15.949732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.950547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:15.951042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:15.951670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:16.252698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:16.270821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dbfada1-5af6-4254-afa2-27df61edd3ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.345773 Jul 18 03:03:16.271867 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3140/6213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:15 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:17.245464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5d83c060-1e06-49e2-a5e4-0e36b982f7d2 req-6946043a-7441-4fe3-9413-d4c4f823e513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1371970b-f0f6-49a9-b1db-f57480a918b3", "tag": "c7085d26-d497-4e53-911a-9634abacff67"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:17.267539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d83c060-1e06-49e2-a5e4-0e36b982f7d2 req-6946043a-7441-4fe3-9413-d4c4f823e513 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.268278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d83c060-1e06-49e2-a5e4-0e36b982f7d2 req-6946043a-7441-4fe3-9413-d4c4f823e513 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.297277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5d83c060-1e06-49e2-a5e4-0e36b982f7d2 req-6946043a-7441-4fe3-9413-d4c4f823e513 service nova] Creating event network-changed:c7085d26-d497-4e53-911a-9634abacff67 for instance 1371970b-f0f6-49a9-b1db-f57480a918b3 on n-h2-849796-1 Jul 18 03:03:17.306924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:17.309019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5d83c060-1e06-49e2-a5e4-0e36b982f7d2 req-6946043a-7441-4fe3-9413-d4c4f823e513 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067029 Jul 18 03:03:17.309269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:17.311307 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3074/6214] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:17.340751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.343654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.344843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:17.345705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:17.715066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:17.730958 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee596ad3-715a-489c-91b8-d0af86521ed7 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.434635 Jul 18 03:03:17.732301 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3141/6215] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:17 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:18.759718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:18.760445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:18.768095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.768551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:18.769394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:18.769934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:19.019632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:19.034221 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5ceee628-41fa-4b97-9af3-216af579e04e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.279976 Jul 18 03:03:19.035404 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3075/6216] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:18 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:20.058320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:20.059750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:20.073207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.074469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.075900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:20.076654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:20.358448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:20.372282 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c190e78-eddd-488e-9b6f-e0980c2084ed tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.321461 Jul 18 03:03:20.374093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3142/6217] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:20 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:21.400822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:21.401625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:21.409192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.410110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.412648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:21.413383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:21.632786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:21.653947 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db907266-a3d6-4799-8db2-cb20d27a672e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.254732 Jul 18 03:03:21.654662 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3076/6218] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:21 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:22.673902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:22.674705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:22.677655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:22.680891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:22.698253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:22.701587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.702893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:22.703888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:22.902823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:22.916570 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4650a2ab-5a81-4752-a19f-a0d75999aa79 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.247563 Jul 18 03:03:22.917916 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3143/6219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:22 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:23.870728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-20804206-aaef-4924-b784-66e1d8939551 req-58779118-81df-456a-a93a-4c77a01fad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1371970b-f0f6-49a9-b1db-f57480a918b3", "name": "network-vif-plugged", "status": "completed", "tag": "c7085d26-d497-4e53-911a-9634abacff67"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:23.876875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:23.885775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-20804206-aaef-4924-b784-66e1d8939551 req-58779118-81df-456a-a93a-4c77a01fad23 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.886378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-20804206-aaef-4924-b784-66e1d8939551 req-58779118-81df-456a-a93a-4c77a01fad23 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.900686 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-20804206-aaef-4924-b784-66e1d8939551 req-58779118-81df-456a-a93a-4c77a01fad23 service nova] Creating event network-vif-plugged:c7085d26-d497-4e53-911a-9634abacff67 for instance 1371970b-f0f6-49a9-b1db-f57480a918b3 on n-h2-849796-1 Jul 18 03:03:23.907120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-20804206-aaef-4924-b784-66e1d8939551 req-58779118-81df-456a-a93a-4c77a01fad23 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043924 Jul 18 03:03:23.908513 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3077/6220] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:23.942139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:23.946424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:23.963037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.963824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:23.965188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:23.966222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:24.231158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:24.240802 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c6796634-ab30-4fba-85cc-e0dab0781c92 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.306263 Jul 18 03:03:24.250373 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3144/6221] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:23 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:25.261155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:25.262525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:25.270012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.270811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:25.271823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:25.272447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:25.495585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:25.503985 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-155db08d-fdb6-4a42-83ab-e8c31403dde2 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1314 microversion: 2.1 time: 0.248249 Jul 18 03:03:25.505160 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3078/6222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:25 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:26.534001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:26.535109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:26.548156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.548754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.549867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.550462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.742745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:26.751188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1a2d805-731a-4ed3-83c8-9d8e839a547a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1502 microversion: 2.1 time: 0.224794 Jul 18 03:03:26.751965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3145/6223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:26 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:26.770828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:26.771605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:26.780095 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.780716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.781609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:26.782068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:26.951825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:26.969341 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97580507-2356-4f3f-a7d5-d7bbcbb320a3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1502 microversion: 2.1 time: 0.203444 Jul 18 03:03:26.970983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3079/6224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:26 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:26.992876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:26.993548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:27.000392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.000859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.001920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.002392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.035008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lazy-loading 'flavor' on Instance uuid 1371970b-f0f6-49a9-b1db-f57480a918b3 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:03:27.240829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1eaa12be-4053-4ed5-83a3-2bdc6cfcee53 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action" status: 202 len: 0 microversion: 2.1 time: 0.255432 Jul 18 03:03:27.241792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3146/6225] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:03:26 2022] POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:03:27.255520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:27.256379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:27.268549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.269896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.270947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:27.271651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:27.467468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:27.480211 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb61f6f0-2406-4737-b58f-4039f4d69032 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1510 microversion: 2.1 time: 0.231917 Jul 18 03:03:27.481259 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3080/6226] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:27 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:28.513664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:28.514866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.527902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.528665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.530173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.531000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.712974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:28.722192 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d9cfabd-ac26-41f4-b65f-e4ee5e6f61e6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1493 microversion: 2.1 time: 0.225329 Jul 18 03:03:28.726332 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3147/6227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:28 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1493 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:28.740401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:28.741167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.748677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.749191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.749972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.750531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.828686 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-495dd2c9-d7f8-4e66-9b63-81b48995f57e tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action" status: 202 len: 0 microversion: 2.1 time: 0.092938 Jul 18 03:03:28.829395 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3081/6228] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:03:28 2022] POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:03:28.838958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:28.839406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:28.845531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.846012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:28.846968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:28.847574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:29.063171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:29.072246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-442a9e19-22ed-4c9e-898b-8a4c1ae0fb93 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1499 microversion: 2.1 time: 0.237404 Jul 18 03:03:29.072885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3148/6229] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:28 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1499 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:30.091535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:30.093643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:30.107015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.114170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.115769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:30.116561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:30.300947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:30.310970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09922f39-0aef-444e-8f30-0d8db5bec5ef tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1499 microversion: 2.1 time: 0.224619 Jul 18 03:03:30.311855 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3082/6230] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:30 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:31.330092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:31.330827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:31.339649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.340004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.340808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.341307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.575602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:31.584561 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d5eb0f7-9d20-4337-8049-97140dc1a60d tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1502 microversion: 2.1 time: 0.258913 Jul 18 03:03:31.593817 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3149/6231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:31 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:31.606270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:31.607536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:31.621625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.623515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.625431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.626320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.683510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lazy-loading 'flavor' on Instance uuid 1371970b-f0f6-49a9-b1db-f57480a918b3 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:03:31.774704 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ddc33a82-5de9-467a-a50d-48b44c662ad3 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action" status: 202 len: 0 microversion: 2.1 time: 0.174421 Jul 18 03:03:31.776581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3083/6232] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:03:31 2022] POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:03:31.792826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:31.795103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:31.810579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.811137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.812185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:31.812771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:31.979265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:31.990196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68b94da4-0fcc-4f17-92a7-7a86ed230ce8 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1510 microversion: 2.1 time: 0.208629 Jul 18 03:03:31.990984 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3150/6233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:31 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:33.011998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:33.015549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:33.037557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.038411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.039684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.040596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.510408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:33.520194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84bba9ec-a982-4d58-801d-e15366753f6a tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1493 microversion: 2.1 time: 0.515503 Jul 18 03:03:33.537968 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3084/6234] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:33 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1493 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:03:33.545786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:33.546993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:33.557163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.557877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.558887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.559551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.710407 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6296cec-f60e-4edf-a4c3-1c9e23da59ca tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action" status: 202 len: 0 microversion: 2.1 time: 0.168794 Jul 18 03:03:33.711478 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3151/6235] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:03:33 2022] POST /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:03:33.741650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:33.743615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:33.763255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.764154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:33.766208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:33.788203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:34.286657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:34.307038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3c755519-22eb-4fd8-8dba-ee77c842abc5 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1499 microversion: 2.1 time: 0.588052 Jul 18 03:03:34.308685 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3085/6236] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:33 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1499 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:35.332975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:35.334480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:35.344262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.344716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.345849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:35.346385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:35.369733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:35.593829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:35.610011 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93345669-02ec-48f5-ad82-4f52b041c676 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1499 microversion: 2.1 time: 0.286651 Jul 18 03:03:35.610810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3152/6237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:35 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1499 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:36.632147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:36.632825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:36.642774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.643235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.644272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.645497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.826316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:36.848447 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9a9955cf-4a88-460d-a9dd-380075c71ffa tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1502 microversion: 2.1 time: 0.219852 Jul 18 03:03:36.850890 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3086/6238] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:36 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:36.881915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:36.883676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:36.902221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.903405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.905062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:36.906261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:36.963481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:03:37.165376 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d6259f0-2dd5-4eda-960c-a02138f8fd43 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 204 len: 0 microversion: 2.1 time: 0.296816 Jul 18 03:03:37.169963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3153/6239] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:03:36 2022] DELETE /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:03:37.182658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:37.184029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:37.219161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.220062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.220995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:37.221530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:37.422739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:37.437470 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb2c3089-d61f-43f5-b46d-54fe50ab1339 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1508 microversion: 2.1 time: 0.264467 Jul 18 03:03:37.438529 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3087/6240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:37 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:38.462578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:38.463733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:38.477672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.479003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:38.480835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:38.482111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:38.755225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:38.771504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0e22503-eded-40ad-9093-923b5c3400b1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1508 microversion: 2.1 time: 0.317322 Jul 18 03:03:38.773238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3154/6241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:38 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:39.792349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:39.793898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:39.814022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:39.814498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:39.815337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:39.815790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:39.820982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:40.192500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb15c626aa44642a86136c31d5262c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a46b8f25384b038f7ef6e2f25cd416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:40.202597 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94367413-5c07-4b45-b207-67747330a9a6 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 200 len: 1508 microversion: 2.1 time: 0.415892 Jul 18 03:03:40.203536 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3088/6242] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:39 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:40.460871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c1f62a25-11b2-4d24-aec2-729454dced8e req-b4a95e85-3ab0-4d75-a03d-9310a3487553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1371970b-f0f6-49a9-b1db-f57480a918b3", "name": "network-vif-deleted", "tag": "c7085d26-d497-4e53-911a-9634abacff67"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:40.475677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:40.476651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c1f62a25-11b2-4d24-aec2-729454dced8e req-b4a95e85-3ab0-4d75-a03d-9310a3487553 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.477428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:40.477654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c1f62a25-11b2-4d24-aec2-729454dced8e req-b4a95e85-3ab0-4d75-a03d-9310a3487553 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.494216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.495305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.497253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:40.497621 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c1f62a25-11b2-4d24-aec2-729454dced8e req-b4a95e85-3ab0-4d75-a03d-9310a3487553 service nova] Creating event network-vif-deleted:c7085d26-d497-4e53-911a-9634abacff67 for instance 1371970b-f0f6-49a9-b1db-f57480a918b3 on n-h2-849796-1 Jul 18 03:03:40.500371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:40.505625 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c1f62a25-11b2-4d24-aec2-729454dced8e req-b4a95e85-3ab0-4d75-a03d-9310a3487553 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054846 Jul 18 03:03:40.506480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3155/6243] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:40.562324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef64218e-716c-4db5-a7fb-009da77e0a19 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.096100 Jul 18 03:03:40.563443 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3089/6244] 10.222.0.67 () {58 vars in 1292 bytes} [Mon Jul 18 03:03:40 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e/os-server-password => generated 116 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:03:41.239153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:41.241040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] [instance: 1371970b-f0f6-49a9-b1db-f57480a918b3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:41.250720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:41.255416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.256213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.257734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:41.259014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:41.289157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] HTTP exception thrown: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Request method failure captured: Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 HTTP/1.1 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M1sqwA6J7ru3AzY0OhCCP7XNMWXjSj6tG-xsY-Wwj8HXmCuRHnj8OLPzLM2qgjyE7iShOguP-B-VdeUCXSSB0QjnvCWGQZwh2nK910iIMFQ_cWfTYXv7e94_TzQmby3mUGFZnHU8df9rye6tQu77hw56eRcgIOIkUEKFkPvXdA5pjk Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 86a46b8f25384b038f7ef6e2f25cd416 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestServerAdvancedOps-1027926662 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/86a46b8f25384b038f7ef6e2f25cd416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_86a46b8f25384b038f7ef6e2f25cd416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/86a46b8f25384b038f7ef6e2f25cd416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/86a46b8f25384b038f7ef6e2f25cd416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestServerAdvancedOps-1027926662 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 86a46b8f25384b038f7ef6e2f25cd416 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestServerAdvancedOps-1027926662 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestServerAdvancedOps-1027926662-project Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: deb15c626aa44642a86136c31d5262c0 Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestServerAdvancedOps-1027926662-project Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1371970b-f0f6-49a9-b1db-f57480a918b3'} Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:03:41.293066 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. Jul 18 03:03:41.300993 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:03:41.304345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] Returning 404 to user: Instance 1371970b-f0f6-49a9-b1db-f57480a918b3 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:03:41.306026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05f9805c-f859-4e3e-a9ad-651bc91482e1 tempest-TestServerAdvancedOps-1027926662 tempest-TestServerAdvancedOps-1027926662-project] 10.222.0.67 "GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3" status: 404 len: 111 microversion: 2.1 time: 0.076166 Jul 18 03:03:41.307090 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3156/6245] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:41 2022] GET /compute/v2.1/servers/1371970b-f0f6-49a9-b1db-f57480a918b3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:03:41.966218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e71142b-31b0-47e3-a324-06b0d62610c1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: .version_select at 0x7faaf7343e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1952008376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2vC52ObQw5nLgNZRc1p83BCausngG+27c7kAF1haKIUZrHmbU/sF5pyKl8cQnbj4UsFdz9WB85h0itcn72xLTrq9D/NHNM4E15lsQ7Mo60z9eudyskPWPE75arPs32MQ=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:42.008809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9e71142b-31b0-47e3-a324-06b0d62610c1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:42.030545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9e71142b-31b0-47e3-a324-06b0d62610c1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:42.092339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e71142b-31b0-47e3-a324-06b0d62610c1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.469161 Jul 18 03:03:42.106074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3090/6246] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:03:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:03:54.464263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-618197032", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "362290e6-19e7-40a9-a8f3-0590a3c94bcf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1952008376", "security_groups": [{"name": "tempest-secgroup-smoke-1073516792"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:03:54.515343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:54.735065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] validate_networks() for [('362290e6-19e7-40a9-a8f3-0590a3c94bcf', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:03:55.837881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:03:55.838892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:03:55.839551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:03:55.840333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:03:55.841190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:03:55.866947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.867584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.870064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:55.871394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:55.933296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:03:55.946716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:03:55.999674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:03:56.011623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:03:56.182924 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c603ec5-5ae7-4e35-84b3-2e067f619460 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.726632 Jul 18 03:03:56.187584 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3157/6247] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:03:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:03:56.201937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:56.208696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:56.212365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:03:56.228602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d6827a6-908c-4423-b381-df61a637ea5d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:56.249533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d6827a6-908c-4423-b381-df61a637ea5d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:56.469421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d6827a6-908c-4423-b381-df61a637ea5d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:56.491554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d6827a6-908c-4423-b381-df61a637ea5d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1266 microversion: 2.1 time: 0.295383 Jul 18 03:03:56.505734 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3091/6248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:56 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:57.530261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:57.546613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:57.591880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.593766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.596874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:57.597407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:57.787391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:57.796723 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29ae72fa-f8df-4a63-a557-22592035d018 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1262 microversion: 2.1 time: 0.281502 Jul 18 03:03:57.798095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3158/6249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:57 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1262 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:03:58.841227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:03:58.842721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:03:58.870713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.871446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:58.873015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:03:58.873880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:03:59.044507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:03:59.061340 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d0d97ba2-3ad9-4122-80ef-8cd642afda44 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1324 microversion: 2.1 time: 0.241037 Jul 18 03:03:59.063317 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3092/6250] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:03:58 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:00.095958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:00.117852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:00.180375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:00.183076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:00.197960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:00.201163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:01.227449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:01.240400 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c12ee30d-9d2c-4ec5-82e2-50f3545f88ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 1.152886 Jul 18 03:04:01.244143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3159/6251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:00 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:02.299094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:02.302737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:02.350577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-899e4727-2ea0-4fbd-9b9b-3202ece0ae18 req-8584dcc9-1eee-4035-a7c1-06b1916f02b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:02.352437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.357291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.376018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.380327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.422344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-899e4727-2ea0-4fbd-9b9b-3202ece0ae18 req-8584dcc9-1eee-4035-a7c1-06b1916f02b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:02.434302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-899e4727-2ea0-4fbd-9b9b-3202ece0ae18 req-8584dcc9-1eee-4035-a7c1-06b1916f02b6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:02.502100 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-899e4727-2ea0-4fbd-9b9b-3202ece0ae18 req-8584dcc9-1eee-4035-a7c1-06b1916f02b6 service nova] Creating event network-changed:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h2-849796-1 Jul 18 03:04:02.521976 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-899e4727-2ea0-4fbd-9b9b-3202ece0ae18 req-8584dcc9-1eee-4035-a7c1-06b1916f02b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185281 Jul 18 03:04:02.531596 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3160/6252] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 03:04:02.815774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:02.830432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8954e8bc-3301-44f5-a87c-0c8b4ece1cb6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.554039 Jul 18 03:04:02.831397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3093/6253] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:02 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:03.876998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:03.877880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:03.887391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:03.887966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:03.888956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:03.889916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:04.286913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:04.299309 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-989fb41f-bd0b-480f-84cd-1befd535d50f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.437043 Jul 18 03:04:04.300554 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3161/6254] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:03 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:05.317314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:05.318274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:05.326577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:05.327214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:05.328125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:05.328715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:05.633607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:05.657237 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56a930b4-27c8-4451-ae6f-732aa4b52b95 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.344075 Jul 18 03:04:05.658616 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3094/6255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:05 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:06.594938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:06.596270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:06.677160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:06.678028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:06.684839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:06.694515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.697582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.698516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.699037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.863818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:06.865567 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:04:06.865567 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 03:04:06.867762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.868917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.871645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:06.872331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:06.922686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:06.938593 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53ca558a-bd5e-46dc-af0f-5581890c318d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.266247 Jul 18 03:04:06.954298 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3095/6256] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:06 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:06.970450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3284499c-ccde-48e7-ac47-d070801b7aef tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.382890 Jul 18 03:04:06.972899 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3162/6257] 10.222.0.67 () {58 vars in 1184 bytes} [Mon Jul 18 03:04:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:07.143756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-602568193", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "availability_zone": "nova:n-h1-849796-1", "networks": [{"uuid": "a95abdbc-d5c5-46ad-8ad3-5b35e8654c47"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:07.220900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] validate_networks() for [('a95abdbc-d5c5-46ad-8ad3-5b35e8654c47', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:07.248303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.249446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.261469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.265717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.266753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.269671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.319573 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fef501ea-9c62-4af1-b872-189264335d75 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076780 Jul 18 03:04:07.320141 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3163/6258] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:04:07 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 03:04:07.390370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.392594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.407704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.408513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.410445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.411543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.450017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:04:07.562509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39b445f7-293d-45d0-9981-e56b4812d4b9 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 204 len: 0 microversion: 2.1 time: 0.179858 Jul 18 03:04:07.564186 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3164/6259] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:07 2022] DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:04:07.576830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.578314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.588282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.589031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.590105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.590509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.738892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:07.739424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:07.739891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:07.740541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:07.741193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:07.753348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.755249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.761335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:07.762445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.763008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.769950 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b558488b-e9b7-4e6c-9a65-9fd0b9891213 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1673 microversion: 2.1 time: 0.199584 Jul 18 03:04:07.770761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3165/6260] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:07 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:07.789042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Getting quotas for project 9dd93daab0fa447b98b7a232b6b3de31. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:07.795641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Getting quotas for user 1d8c5ef7b4a5435d9f11dac47f5770ea and project 9dd93daab0fa447b98b7a232b6b3de31. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:07.813608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:07.816108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:07.865604 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [dda6786f-b8ef-4873-9fab-7548a5ee151b] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:04:07.967632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:07.968531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:07.976966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.977426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:07.978245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:07.978701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.176110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:08.190887 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37d240f4-a42f-47d6-8aac-b65589bbe2d1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.227938 Jul 18 03:04:08.192792 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3166/6261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:07 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:08.788105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:08.788794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:08.796670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.797560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.798644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:08.799335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:08.875996 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [dda6786f-b8ef-4873-9fab-7548a5ee151b] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 42964. Jul 18 03:04:08.883199 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-046076aa-7e94-4931-8596-b3c7c921c648 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743999 Jul 18 03:04:08.889375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3096/6262] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:04:08.905118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43adb986-8c33-45f1-8da6-ea8b1720ad88 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:08.906808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43adb986-8c33-45f1-8da6-ea8b1720ad88 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:09.034515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:09.037062 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43adb986-8c33-45f1-8da6-ea8b1720ad88 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1328 microversion: 2.1 time: 0.143231 Jul 18 03:04:09.046785 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3097/6263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:08 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1328 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:09.055026 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-647d821e-3d80-4f26-8e1e-4c6ba6b4d9bd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1673 microversion: 2.1 time: 0.269913 Jul 18 03:04:09.067206 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3167/6264] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:08 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:09.213926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:09.214607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:09.221684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:09.223005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:09.224580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:09.225072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:09.522610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:09.532364 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4a1c434-1c3e-4ceb-95f6-4d0c6a0fe364 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.327028 Jul 18 03:04:09.533391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3098/6265] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:09 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:10.047442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d7947b2d-b519-48c5-8bfb-c62c2dd3d5cd req-f930596a-cb16-4b2a-b4aa-f6cc77333f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "name": "network-vif-plugged", "status": "completed", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:10.059187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.060582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.078737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.080364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.083172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d7947b2d-b519-48c5-8bfb-c62c2dd3d5cd req-f930596a-cb16-4b2a-b4aa-f6cc77333f70 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.085040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.085919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d7947b2d-b519-48c5-8bfb-c62c2dd3d5cd req-f930596a-cb16-4b2a-b4aa-f6cc77333f70 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.090258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.116582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d7947b2d-b519-48c5-8bfb-c62c2dd3d5cd req-f930596a-cb16-4b2a-b4aa-f6cc77333f70 service nova] Creating event network-vif-plugged:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h2-849796-1 Jul 18 03:04:10.133783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d7947b2d-b519-48c5-8bfb-c62c2dd3d5cd req-f930596a-cb16-4b2a-b4aa-f6cc77333f70 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090323 Jul 18 03:04:10.134831 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3168/6266] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:10.144144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.147374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.167572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.168035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.168859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.169338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.268755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:10.292527 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be268e9b-4a6b-4840-930b-52a15680e3c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1605 microversion: 2.1 time: 0.154929 Jul 18 03:04:10.293767 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3169/6267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:10.564239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:10.564239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:10.569862 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-08acf212-d1d1-4a89-be42-c3193386ae7e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1415 microversion: 2.1 time: 0.519106 Jul 18 03:04:10.570834 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3099/6268] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1415 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:10.577363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.578265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.579332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:10.579979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:10.784358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:10.793779 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32571216-7d4f-4be6-84cf-340bb6c700e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.244364 Jul 18 03:04:10.794766 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3170/6269] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:10 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:11.116077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c5e9cace-7f7f-4fb2-a5b8-cbe3d6a589ce req-2b16c0c9-9120-497c-af92-1584cc907ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963bfa3f-7b36-48ba-a499-75be3dc7b517", "name": "network-vif-deleted", "tag": "e6142ac1-4e01-4c96-92c9-72f76c4c2b92"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:11.149997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c5e9cace-7f7f-4fb2-a5b8-cbe3d6a589ce req-2b16c0c9-9120-497c-af92-1584cc907ed6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.151860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c5e9cace-7f7f-4fb2-a5b8-cbe3d6a589ce req-2b16c0c9-9120-497c-af92-1584cc907ed6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.194826 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c5e9cace-7f7f-4fb2-a5b8-cbe3d6a589ce req-2b16c0c9-9120-497c-af92-1584cc907ed6 service nova] Creating event network-vif-deleted:e6142ac1-4e01-4c96-92c9-72f76c4c2b92 for instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 on n-h1-849796-1 Jul 18 03:04:11.203102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c5e9cace-7f7f-4fb2-a5b8-cbe3d6a589ce req-2b16c0c9-9120-497c-af92-1584cc907ed6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288903 Jul 18 03:04:11.204681 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3100/6270] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:11.314841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:11.315562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:11.326382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.327363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.328343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.328982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.370691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.371425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.372179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lazy-loading 'fault' on Instance uuid 963bfa3f-7b36-48ba-a499-75be3dc7b517 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:04:11.429213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:11.487148 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa2363f7-d1e9-4599-af94-108bc1e08f1a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 200 len: 1327 microversion: 2.1 time: 0.171211 Jul 18 03:04:11.495880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3171/6271] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:11 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:11.611277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:11.618605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:11.652366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.654838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.658848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.662143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.819796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:11.821462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:11.834726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.835890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:11.837636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:11.838684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.151070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:12.161659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74846ce2-f7af-4735-8738-38dcf0279cbd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1392 microversion: 2.1 time: 0.352139 Jul 18 03:04:12.173636 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3172/6272] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:11 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:12.181954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-faff825c-ecc2-413a-90be-c0572cc9aba6 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.590362 Jul 18 03:04:12.194222 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3101/6273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:11 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:12.519686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:12.521935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:12.535634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:12.536824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.538725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:12.539811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:12.583183 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 HTTP/1.1 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '963bfa3f-7b36-48ba-a499-75be3dc7b517'} Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:12.588157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:12.592407 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ada41c6-3947-4e47-842b-74666131b6a0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 404 len: 111 microversion: 2.1 time: 0.080817 Jul 18 03:04:12.593870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3173/6274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:12 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:12.602131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89ef0c94-acc9-4305-9bdb-51175ca1f109 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '.version_select at 0x7fab044cfd30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:12.675095 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89ef0c94-acc9-4305-9bdb-51175ca1f109 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391185178" status: 202 len: 0 microversion: 2.1 time: 0.075196 Jul 18 03:04:12.681661 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3102/6275] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Jul 18 03:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391185178 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:04:13.181838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:13.182463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:13.193796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.200230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.201152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.201617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.211185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:13.216069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:13.234750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.236647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.239261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.241466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.695420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:13.704191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:13.724907 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00a7bddb-2256-4830-8be7-2ca4acac5273 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1564 microversion: 2.1 time: 0.547203 Jul 18 03:04:13.725908 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3174/6276] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:13 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1564 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:13.739803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-becbe7ba-03e2-4220-9117-5a7d3ee9a49e req-a7fec9d8-a333-47ac-aada-76755162050c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17d52f2-76e5-4ef9-b51e-f78d22839ddf", "tag": "2e49d519-6c93-439b-acc5-29a1dd0cf6e6"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:13.779798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-becbe7ba-03e2-4220-9117-5a7d3ee9a49e req-a7fec9d8-a333-47ac-aada-76755162050c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.783034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-becbe7ba-03e2-4220-9117-5a7d3ee9a49e req-a7fec9d8-a333-47ac-aada-76755162050c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.810807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-becbe7ba-03e2-4220-9117-5a7d3ee9a49e req-a7fec9d8-a333-47ac-aada-76755162050c service nova] Creating event network-changed:2e49d519-6c93-439b-acc5-29a1dd0cf6e6 for instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf on n-h1-849796-1 Jul 18 03:04:13.835805 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-becbe7ba-03e2-4220-9117-5a7d3ee9a49e req-a7fec9d8-a333-47ac-aada-76755162050c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103679 Jul 18 03:04:13.837957 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3175/6277] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:13.868347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:13.869077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:13.871097 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-405947bd-c743-44b0-9e61-533c1eaaf719 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.673850 Jul 18 03:04:13.874104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3103/6278] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:13 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:13.886325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.886806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:13.887754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:13.888083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.370373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:14.388945 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dbdd0c7-e028-41d1-8e73-78cd4e00f463 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1564 microversion: 2.1 time: 0.537812 Jul 18 03:04:14.390554 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3176/6279] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:13 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1564 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:14.634530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d75c11d2-2242-4d0e-ab05-451445f6b90a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: .version_select at 0x7fab044cf9d0>, body: {"keypair": {"name": "tempest-keypair-1662926699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdbTULPbrnKx1WI0T5N8xAIw8X0HBNb0QNeHZXMy4I61QrTr38kk6t8hI9gktg6ZP6xv1Lg9RsbldB3tPTKvdifB2sQyy23W3yGr8+36wC5DSDHqji46CqdONaBh8YQ1A=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:14.657092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d75c11d2-2242-4d0e-ab05-451445f6b90a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:14.678458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d75c11d2-2242-4d0e-ab05-451445f6b90a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for user 57025f6e4a2842c6bbfd58050e2e7371 and project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:14.751439 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d75c11d2-2242-4d0e-ab05-451445f6b90a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120171 Jul 18 03:04:14.754169 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3104/6280] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:04:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:14.893369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:14.895474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:14.914871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.915759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:14.916958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:14.917617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:15.135921 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76f99f84-6889-4764-8a26-1599dcb3108d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.247278 Jul 18 03:04:15.136645 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3177/6281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:14 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:16.156209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:16.157511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:16.171338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:16.172130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:16.173420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:16.174008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:16.501450 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bec1fe14-49ed-4ad1-8597-c053b8fda3b2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.350439 Jul 18 03:04:16.513221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3105/6282] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:16 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:16.702340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1443071888", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9047773-5150-46e6-a690-6453ed3b301f"}], "security_groups": [{"name": "tempest-securitygroup--1303321839"}], "key_name": "tempest-keypair-1662926699", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:16.840406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] validate_networks() for [('a9047773-5150-46e6-a690-6453ed3b301f', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:16.916249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:17.521792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.523129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.542713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.544431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.548629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.551856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.754527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:17.755382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:17.755568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:17.755848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:17.756275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:17.767549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.768007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.769648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.770682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.783017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:17.794265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:17.801225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Getting quotas for user 57025f6e4a2842c6bbfd58050e2e7371 and project a2cfe382144846b1a9ae87d85c6eca38. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:17.817947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:17.820724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:17.872659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5bf2d06-e67d-47e5-a7f4-f4fba0fc62ef tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.175436 Jul 18 03:04:17.873374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3178/6283] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:04:17.883926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b19ae42c-8c11-4369-beff-a44ea5b8af59 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.884695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b19ae42c-8c11-4369-beff-a44ea5b8af59 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.948793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b19ae42c-8c11-4369-beff-a44ea5b8af59 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:17.958512 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b19ae42c-8c11-4369-beff-a44ea5b8af59 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1238 microversion: 2.1 time: 0.078152 Jul 18 03:04:17.968635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3179/6284] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:17.975630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:17.976573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:17.984074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.985550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:17.986896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:17.987553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.080959 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-84f5af44-3130-4297-b3ac-64f96022306d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.564070 Jul 18 03:04:18.082119 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3106/6285] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:18.101674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-29c5aacb-914e-4355-b579-fa1463795e4f req-896f556d-a03c-43e9-808d-2b91cf8d1c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:18.121637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-29c5aacb-914e-4355-b579-fa1463795e4f req-896f556d-a03c-43e9-808d-2b91cf8d1c79 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.122108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-29c5aacb-914e-4355-b579-fa1463795e4f req-896f556d-a03c-43e9-808d-2b91cf8d1c79 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.140825 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-29c5aacb-914e-4355-b579-fa1463795e4f req-896f556d-a03c-43e9-808d-2b91cf8d1c79 service nova] Creating event network-changed:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h2-849796-1 Jul 18 03:04:18.148317 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-29c5aacb-914e-4355-b579-fa1463795e4f req-896f556d-a03c-43e9-808d-2b91cf8d1c79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051274 Jul 18 03:04:18.148771 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3107/6286] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:18.172448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:18.198038 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc71f2aa-9403-450c-ae04-41ef1245745f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1564 microversion: 2.1 time: 0.226532 Jul 18 03:04:18.199616 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3180/6287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:17 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:18.978207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:18.979056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:18.987483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.989147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:18.990722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:18.991234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.079235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:19.092692 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5979baf-0a23-416f-8f2d-2d5aba7f4f35 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1290 microversion: 2.1 time: 0.120175 Jul 18 03:04:19.094125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3108/6288] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:18 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:19.101292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:19.102064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:19.109876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.110338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.111215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.111670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.368352 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16161f89-808d-4b4b-8fbd-322a16450937 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.273160 Jul 18 03:04:19.383469 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3181/6289] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:19 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:19.630534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c10e511a-46c0-404b-aadf-8a56c2aa8228 req-39cb19c3-ec6d-4241-bf1e-4454a51adfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d52f2-76e5-4ef9-b51e-f78d22839ddf", "name": "network-vif-plugged", "status": "completed", "tag": "2e49d519-6c93-439b-acc5-29a1dd0cf6e6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:19.640369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c10e511a-46c0-404b-aadf-8a56c2aa8228 req-39cb19c3-ec6d-4241-bf1e-4454a51adfd0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:19.640985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c10e511a-46c0-404b-aadf-8a56c2aa8228 req-39cb19c3-ec6d-4241-bf1e-4454a51adfd0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:19.656907 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c10e511a-46c0-404b-aadf-8a56c2aa8228 req-39cb19c3-ec6d-4241-bf1e-4454a51adfd0 service nova] Creating event network-vif-plugged:2e49d519-6c93-439b-acc5-29a1dd0cf6e6 for instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf on n-h1-849796-1 Jul 18 03:04:19.663988 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c10e511a-46c0-404b-aadf-8a56c2aa8228 req-39cb19c3-ec6d-4241-bf1e-4454a51adfd0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121700 Jul 18 03:04:19.664650 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3109/6290] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:20.111402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.113380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.121143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.121645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.122545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.122988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.216915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:20.226232 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d96e9dd0-5cbe-4251-b905-6e64a5689c49 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1296 microversion: 2.1 time: 0.118825 Jul 18 03:04:20.226927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3182/6291] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:20.394654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:20.396329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:20.407684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.408236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.409509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:20.411314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:20.630723 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c5d66b7-2225-4196-ad73-0bae25395ac2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1463 microversion: 2.1 time: 0.246121 Jul 18 03:04:20.632636 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3110/6292] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:20 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:21.245399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:21.246704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:21.255309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.255774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.256880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.261083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.340234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-aae8f92b-102f-4804-9326-8e6816c72b39 req-a4bc26ab-f5fe-43bb-b0ed-4da575b6bdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766a2888-b711-4fed-8b5b-3220a42b4538", "tag": "28b0b53f-359c-498f-920f-f8ce2c94bf52"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:21.360053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aae8f92b-102f-4804-9326-8e6816c72b39 req-a4bc26ab-f5fe-43bb-b0ed-4da575b6bdf5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.360389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-aae8f92b-102f-4804-9326-8e6816c72b39 req-a4bc26ab-f5fe-43bb-b0ed-4da575b6bdf5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.374121 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-aae8f92b-102f-4804-9326-8e6816c72b39 req-a4bc26ab-f5fe-43bb-b0ed-4da575b6bdf5 service nova] Creating event network-changed:28b0b53f-359c-498f-920f-f8ce2c94bf52 for instance 766a2888-b711-4fed-8b5b-3220a42b4538 on n-h2-849796-1 Jul 18 03:04:21.380510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-aae8f92b-102f-4804-9326-8e6816c72b39 req-a4bc26ab-f5fe-43bb-b0ed-4da575b6bdf5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050187 Jul 18 03:04:21.381241 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3111/6293] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:21.620472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:21.635461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-098311fd-6f9b-496a-a3c6-ccba2ec91c2b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.394688 Jul 18 03:04:21.636569 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3183/6294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:21 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:21.657488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:21.664965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:21.672028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.672491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.673519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.674006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.703062 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:04:21.703382 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:04:21.867228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2b11f51-2a53-4d4a-8e26-7cb73469f60b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1648 microversion: 2.1 time: 0.215140 Jul 18 03:04:21.867839 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3112/6295] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:21 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1648 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:21.885080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:21.885852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:21.887752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:21.894757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.895425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:21.896577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:21.897232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.041299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68026c06-1684-4e92-b65a-b63f1facac9e tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1648 microversion: 2.1 time: 0.159908 Jul 18 03:04:22.041888 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3184/6296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:21 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1648 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.057996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.058615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.065271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.065792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.067097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.067560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.219566 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65be9537-b98f-4a0a-9c0e-9774edec7bf4 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1648 microversion: 2.1 time: 0.165219 Jul 18 03:04:22.220179 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3113/6297] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1648 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.283176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1570952581", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "availability_zone": "nova:n-h2-849796-1", "networks": [{"uuid": "a95abdbc-d5c5-46ad-8ad3-5b35e8654c47"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:22.345990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] validate_networks() for [('a95abdbc-d5c5-46ad-8ad3-5b35e8654c47', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:04:22.666295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.667521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:22.679259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.680045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.681563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.682376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.782529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:04:22.783023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:04:22.783622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:04:22.784190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:04:22.785378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:04:22.799312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.799762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.801160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:22.801644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:22.821591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Getting quotas for project 9dd93daab0fa447b98b7a232b6b3de31. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:04:22.827512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Getting quotas for user 1d8c5ef7b4a5435d9f11dac47f5770ea and project 9dd93daab0fa447b98b7a232b6b3de31. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:04:22.845074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:04:22.849551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:04:22.850527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:22.856421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=100 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:22.865049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f666a67-3c6d-47c4-9f67-847745101c09 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.205975 Jul 18 03:04:22.866009 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3114/6298] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:22.924308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eac7775a-cd36-4698-bde6-77d05d206fd2 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636102 Jul 18 03:04:22.927270 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3185/6299] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:04:22.939600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04fa47aa-4c1b-455d-a79d-b2b29b9745b5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:22.939995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04fa47aa-4c1b-455d-a79d-b2b29b9745b5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:23.003581 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04fa47aa-4c1b-455d-a79d-b2b29b9745b5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1329 microversion: 2.1 time: 0.068019 Jul 18 03:04:23.003903 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3115/6300] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:22 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1329 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:23.891422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:23.892108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:23.900383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.900845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:23.901680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:23.902134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.021307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:24.022017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:24.030607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:24.031038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.031842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:24.032513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:24.050166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:24.059367 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-69761367-1bda-4387-911a-b9da9e459c80 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.172891 Jul 18 03:04:24.060254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3186/6301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:23 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:24.113522 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-98dd9046-0c5a-4105-922b-4a129edbf294 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1346 microversion: 2.1 time: 0.095271 Jul 18 03:04:24.114232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3116/6302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:24 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:25.082659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:25.083846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:25.097715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.098547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.100262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.101171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.131642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:25.134513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:25.148708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.150272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.151397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:25.152148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:25.257123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15952f4f-9341-4eb1-868f-a4df4201839b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1424 microversion: 2.1 time: 0.129268 Jul 18 03:04:25.267177 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3117/6303] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:25 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:25.638713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:25.648280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fdc37e9f-dfe9-4c07-9e69-72aed820d15b tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.574384 Jul 18 03:04:25.648900 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3187/6304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:25 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:26.277273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:26.278934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:26.288194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.289672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.290991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.291724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.461338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b6b2fac9-2df1-41f3-8040-872dd80f9da8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.189960 Jul 18 03:04:26.461948 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3118/6305] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:26 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:26.673199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:26.674834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:26.685677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.686449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:26.687653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:26.688110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.245598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:27.254409 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb2f2758-23f6-4c4a-be15-3c16ff5af654 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.590555 Jul 18 03:04:27.255042 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3188/6306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:26 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:27.396824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d07cdf07-783e-46fe-8b54-9ea06f5650e8 req-1c8a698b-883e-4247-b44e-c3ee40f5ad56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321eab91-59e7-43a7-adb7-1a1f243fbfc1", "tag": "d5617725-c817-472e-8f81-497398665109"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:27.408538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:27.417074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d07cdf07-783e-46fe-8b54-9ea06f5650e8 req-1c8a698b-883e-4247-b44e-c3ee40f5ad56 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.417811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d07cdf07-783e-46fe-8b54-9ea06f5650e8 req-1c8a698b-883e-4247-b44e-c3ee40f5ad56 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.432348 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d07cdf07-783e-46fe-8b54-9ea06f5650e8 req-1c8a698b-883e-4247-b44e-c3ee40f5ad56 service nova] Creating event network-changed:d5617725-c817-472e-8f81-497398665109 for instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 on n-h2-849796-1 Jul 18 03:04:27.444780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d07cdf07-783e-46fe-8b54-9ea06f5650e8 req-1c8a698b-883e-4247-b44e-c3ee40f5ad56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053591 Jul 18 03:04:27.445623 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3119/6307] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:27.479708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:27.480435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:27.487442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.488058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.488997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:27.489669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:27.741616 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d4657af-c4dc-45dd-8961-5710cd2e7d0a tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.265677 Jul 18 03:04:27.742640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3189/6308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:27 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:28.121317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-38f66469-a547-4ac3-bbef-9c365000fa31 req-28af2ffc-8cd5-4d10-8a7a-09c1f5745be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766a2888-b711-4fed-8b5b-3220a42b4538", "name": "network-vif-plugged", "status": "completed", "tag": "28b0b53f-359c-498f-920f-f8ce2c94bf52"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:28.131670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38f66469-a547-4ac3-bbef-9c365000fa31 req-28af2ffc-8cd5-4d10-8a7a-09c1f5745be3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.132130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38f66469-a547-4ac3-bbef-9c365000fa31 req-28af2ffc-8cd5-4d10-8a7a-09c1f5745be3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.144645 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-38f66469-a547-4ac3-bbef-9c365000fa31 req-28af2ffc-8cd5-4d10-8a7a-09c1f5745be3 service nova] Creating event network-vif-plugged:28b0b53f-359c-498f-920f-f8ce2c94bf52 for instance 766a2888-b711-4fed-8b5b-3220a42b4538 on n-h2-849796-1 Jul 18 03:04:28.149769 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-38f66469-a547-4ac3-bbef-9c365000fa31 req-28af2ffc-8cd5-4d10-8a7a-09c1f5745be3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Jul 18 03:04:28.150390 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3120/6309] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:28.274242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:28.274993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:28.282375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.282838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.283638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.284087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.444900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:28.453452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-853f8d4b-44f3-40a4-b593-98766aed109f tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.186232 Jul 18 03:04:28.454093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3190/6310] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:28 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:28.760487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:28.761429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:28.768033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.768498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.769933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:28.770486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:28.917654 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e50c5d0b-eeba-493d-8750-5859b41ac8f5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.162151 Jul 18 03:04:28.918276 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3121/6311] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:28 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:29.476385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:29.477348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:29.488756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.489369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.490493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.491226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.643230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:29.651533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3918c5de-e6d7-417c-a923-f04c3e765761 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.182819 Jul 18 03:04:29.652162 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3191/6312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:29 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:29.936156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:29.936699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:29.945118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.945617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:29.946429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:29.946881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.079887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f57fe29c-cabd-42ea-9da2-a9b352688f3c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.147794 Jul 18 03:04:30.080483 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3122/6313] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:29 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:30.671258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:30.672662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:30.683210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.683760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.684723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:30.685286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:30.955456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:30.964734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d029cb6-908c-4fe3-94b9-390f61ce31b0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.298254 Jul 18 03:04:30.965396 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3192/6314] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:30 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:31.098050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:31.098665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:31.106321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.106862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.107681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.108136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.255799 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cdc3a81a-4b32-43c4-84de-ed1d08683c22 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.162191 Jul 18 03:04:31.256400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3123/6315] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:31 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:31.981558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:31.982402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:31.989965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.990461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:31.991271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:31.991751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.224043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:32.236196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-479199c7-7ae8-4abb-b99b-f49fd104bdf8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1364 microversion: 2.1 time: 0.258312 Jul 18 03:04:32.237239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3193/6316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:31 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:32.273772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:32.274591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:32.281486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.281942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.282721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:32.283149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:32.430043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5c27cff6-3eb0-440f-b2a3-6a12d9617696 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.160670 Jul 18 03:04:32.430712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3124/6317] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:32 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:33.258223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:33.259159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:33.262010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:33.263172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=14 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:33.274076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.274626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.275492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.275978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.298872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:33.451189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:33.452317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:33.455887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:33.461569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:04:33.467592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.468274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.469680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.470155 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b0b6c85-ccac-407b-8a57-d0f941a6c41e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1549 microversion: 2.1 time: 0.219648 Jul 18 03:04:33.470459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.470776 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3194/6318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:33 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1549 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:04:33.489413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:33.491170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:33.501480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.502258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.509091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:33.510030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:33.639134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5b10feaf-ceae-4945-8f91-e43ed96504c1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154860 Jul 18 03:04:33.641078 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3195/6319] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:04:33 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:33.686480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d29b6ea-4bd9-42ac-a004-15159fa9ebde tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.241794 Jul 18 03:04:33.688347 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3125/6320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:33 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:34.161872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-69681847-b77b-4577-a1a0-f8fc4f11bfd8 req-5a46266c-ce89-4b6f-93cc-d2cda71f0623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321eab91-59e7-43a7-adb7-1a1f243fbfc1", "name": "network-vif-plugged", "status": "completed", "tag": "d5617725-c817-472e-8f81-497398665109"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:34.178781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-69681847-b77b-4577-a1a0-f8fc4f11bfd8 req-5a46266c-ce89-4b6f-93cc-d2cda71f0623 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.179617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-69681847-b77b-4577-a1a0-f8fc4f11bfd8 req-5a46266c-ce89-4b6f-93cc-d2cda71f0623 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.204673 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-69681847-b77b-4577-a1a0-f8fc4f11bfd8 req-5a46266c-ce89-4b6f-93cc-d2cda71f0623 service nova] Creating event network-vif-plugged:d5617725-c817-472e-8f81-497398665109 for instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 on n-h2-849796-1 Jul 18 03:04:34.213542 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-69681847-b77b-4577-a1a0-f8fc4f11bfd8 req-5a46266c-ce89-4b6f-93cc-d2cda71f0623 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062151 Jul 18 03:04:34.214924 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3196/6321] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:34.711196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:34.711830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:34.719386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.719844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.720694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.721311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.907495 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f859cb1c-c063-4eb8-8ce5-b24730fe888c tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.201034 Jul 18 03:04:34.908213 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3126/6322] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:34 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:34.955335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ba2af642-80d4-4eb9-9ba2-364f010b6d2e req-b91139df-ce3b-4230-b040-ae9bfc83b89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766a2888-b711-4fed-8b5b-3220a42b4538", "tag": "28b0b53f-359c-498f-920f-f8ce2c94bf52"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:34.968151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ba2af642-80d4-4eb9-9ba2-364f010b6d2e req-b91139df-ce3b-4230-b040-ae9bfc83b89a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:34.968690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ba2af642-80d4-4eb9-9ba2-364f010b6d2e req-b91139df-ce3b-4230-b040-ae9bfc83b89a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:34.981590 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ba2af642-80d4-4eb9-9ba2-364f010b6d2e req-b91139df-ce3b-4230-b040-ae9bfc83b89a service nova] Creating event network-changed:28b0b53f-359c-498f-920f-f8ce2c94bf52 for instance 766a2888-b711-4fed-8b5b-3220a42b4538 on n-h2-849796-1 Jul 18 03:04:34.987027 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ba2af642-80d4-4eb9-9ba2-364f010b6d2e req-b91139df-ce3b-4230-b040-ae9bfc83b89a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038740 Jul 18 03:04:34.988274 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3197/6323] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:04:35.932529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:35.933370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:35.942266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:35.942711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:35.943528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:35.943973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:36.126112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-323e11f0-c85d-4641-95f5-71cfc5e7f5c3 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1464 microversion: 2.1 time: 0.197053 Jul 18 03:04:36.126993 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3127/6324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:35 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:37.146666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:37.148504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:37.155749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.156309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.157488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.158064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.432452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f014a71-5d79-43cd-ae6a-b7c61c066cd8 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1649 microversion: 2.1 time: 0.291627 Jul 18 03:04:37.433386 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3198/6325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:37 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1649 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:37.454977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:37.455992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:37.469808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.470642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.472132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.473012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.667564 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef176ff2-bf49-4698-a00e-984f0a87e417 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1649 microversion: 2.1 time: 0.219485 Jul 18 03:04:37.668664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3128/6326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:37 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1649 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:37.687280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:37.687907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:37.697008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.697715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.698473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.699002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.862162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43dbda54-108f-4fa3-baf1-480cc027b10d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1649 microversion: 2.1 time: 0.178893 Jul 18 03:04:37.863295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3199/6327] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:37 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1649 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:37.881325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:37.881845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:37.888655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.889142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.889955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:37.890402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:37.919460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:04:38.012186 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2e7cdaf-1567-4f66-bd97-513d193c4362 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 204 len: 0 microversion: 2.1 time: 0.135973 Jul 18 03:04:38.013148 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3129/6328] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:37 2022] DELETE /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:04:38.024550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:38.025242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:38.031928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:38.032362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:38.033202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:38.033661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:38.181949 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-72088a1b-79d2-4d44-af7b-6a0f17311892 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1655 microversion: 2.1 time: 0.161548 Jul 18 03:04:38.182652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3200/6329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:38 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:39.204741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:39.206149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:39.218663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:39.219482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:39.220846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:39.221675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:39.408853 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a92601c1-e8b9-468d-8ed3-5a49a8e74af5 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1655 microversion: 2.1 time: 0.211896 Jul 18 03:04:39.409926 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3130/6330] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:39 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1655 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:40.307686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9bc1d6de-32a2-426d-b041-ae8b893ecbab req-307cf1d4-5ad3-4bab-a02d-1e17d269ac25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321eab91-59e7-43a7-adb7-1a1f243fbfc1", "name": "network-vif-deleted", "tag": "d5617725-c817-472e-8f81-497398665109"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:40.328402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9bc1d6de-32a2-426d-b041-ae8b893ecbab req-307cf1d4-5ad3-4bab-a02d-1e17d269ac25 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.329322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9bc1d6de-32a2-426d-b041-ae8b893ecbab req-307cf1d4-5ad3-4bab-a02d-1e17d269ac25 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.345245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9bc1d6de-32a2-426d-b041-ae8b893ecbab req-307cf1d4-5ad3-4bab-a02d-1e17d269ac25 service nova] Creating event network-vif-deleted:d5617725-c817-472e-8f81-497398665109 for instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 on n-h2-849796-1 Jul 18 03:04:40.353599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9bc1d6de-32a2-426d-b041-ae8b893ecbab req-307cf1d4-5ad3-4bab-a02d-1e17d269ac25 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050302 Jul 18 03:04:40.354552 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3201/6331] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:40.440471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:40.443614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:40.461591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.462265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.463632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.464404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.537149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:40.537746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:40.538457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lazy-loading 'fault' on Instance uuid 321eab91-59e7-43a7-adb7-1a1f243fbfc1 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:04:40.595617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:40.601694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8206ef61-a783-4eb4-ae63-edd515c8c28b tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 200 len: 1454 microversion: 2.1 time: 0.172249 Jul 18 03:04:40.602314 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3131/6332] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:40 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:41.621023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:41.621728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: 321eab91-59e7-43a7-adb7-1a1f243fbfc1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:41.628098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.628669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:41.629544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.629911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:41.644995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] HTTP exception thrown: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Request method failure captured: Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 HTTP/1.1 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M2mls4obRusNSy9Xrhj-A4_Xqos-DgnxUlzI7jr-4eXGp6wY7KPGTsmYM-E2jwV38B2QnwA6fgG6FfAsWQvB5YOPpHlCrego9aTjzZs0WJTvxpKuLQgV7yOa0YCe1HkMFo5MsAzQoV-qNtblfj76PQ5Nyr1E9dvCm4gN7PbXm9AF90 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 9dd93daab0fa447b98b7a232b6b3de31 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestServerMultinode-84938955 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestServerMultinode-84938955 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 9dd93daab0fa447b98b7a232b6b3de31 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestServerMultinode-84938955 Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestServerMultinode-84938955-project-admin Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 1d8c5ef7b4a5435d9f11dac47f5770ea Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestServerMultinode-84938955-project-admin Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '321eab91-59e7-43a7-adb7-1a1f243fbfc1'} Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:41.646675 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Returning 404 to user: Instance 321eab91-59e7-43a7-adb7-1a1f243fbfc1 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f126b48-315e-4342-8377-4e171402bd93 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1" status: 404 len: 111 microversion: 2.1 time: 0.032228 Jul 18 03:04:41.651784 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3202/6333] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:41 2022] GET /compute/v2.1/servers/321eab91-59e7-43a7-adb7-1a1f243fbfc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:41.657649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:41.658140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:41.666975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.667425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:41.668229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.668671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:41.695094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:04:41.775901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89f6bf37-c923-43a7-9381-7c2379278021 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 204 len: 0 microversion: 2.1 time: 0.122103 Jul 18 03:04:41.777014 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3132/6334] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:04:41 2022] DELETE /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:04:41.787696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:41.788317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:41.794531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.794997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:41.795777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:41.796250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:42.241895 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b1abaca-d2aa-43d1-85c1-c44f787bfb83 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1654 microversion: 2.1 time: 0.459834 Jul 18 03:04:42.242496 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3203/6335] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:41 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1654 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:43.260799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:43.261702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:43.269077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:43.269717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:43.270548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:43.271000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:43.416174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c90f6118-db55-4b16-98a3-1c119e9f138d tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 200 len: 1654 microversion: 2.1 time: 0.159503 Jul 18 03:04:43.416769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3133/6336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:43 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:04:43.882198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0754d1ea-5c14-4f48-8482-6efedc530185 req-2eff981f-3269-4a4d-8dfc-b24832dfa9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d52f2-76e5-4ef9-b51e-f78d22839ddf", "name": "network-vif-deleted", "tag": "2e49d519-6c93-439b-acc5-29a1dd0cf6e6"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:43.892059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0754d1ea-5c14-4f48-8482-6efedc530185 req-2eff981f-3269-4a4d-8dfc-b24832dfa9a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:43.892504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0754d1ea-5c14-4f48-8482-6efedc530185 req-2eff981f-3269-4a4d-8dfc-b24832dfa9a6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:43.904517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0754d1ea-5c14-4f48-8482-6efedc530185 req-2eff981f-3269-4a4d-8dfc-b24832dfa9a6 service nova] Creating event network-vif-deleted:2e49d519-6c93-439b-acc5-29a1dd0cf6e6 for instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf on n-h1-849796-1 Jul 18 03:04:43.910864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0754d1ea-5c14-4f48-8482-6efedc530185 req-2eff981f-3269-4a4d-8dfc-b24832dfa9a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032885 Jul 18 03:04:43.911638 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3204/6337] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:04:44.435000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:04:44.435560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] [instance: a17d52f2-76e5-4ef9-b51e-f78d22839ddf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:44.443025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.443482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.444277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:44.444722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:44.458927 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] HTTP exception thrown: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Request method failure captured: Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf HTTP/1.1 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M2mls4obRusNSy9Xrhj-A4_Xqos-DgnxUlzI7jr-4eXGp6wY7KPGTsmYM-E2jwV38B2QnwA6fgG6FfAsWQvB5YOPpHlCrego9aTjzZs0WJTvxpKuLQgV7yOa0YCe1HkMFo5MsAzQoV-qNtblfj76PQ5Nyr1E9dvCm4gN7PbXm9AF90 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 9dd93daab0fa447b98b7a232b6b3de31 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestServerMultinode-84938955 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9dd93daab0fa447b98b7a232b6b3de31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestServerMultinode-84938955 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 9dd93daab0fa447b98b7a232b6b3de31 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestServerMultinode-84938955 Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestServerMultinode-84938955-project-admin Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 1d8c5ef7b4a5435d9f11dac47f5770ea Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestServerMultinode-84938955-project-admin Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a17d52f2-76e5-4ef9-b51e-f78d22839ddf'} Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:04:44.460935 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] Returning 404 to user: Instance a17d52f2-76e5-4ef9-b51e-f78d22839ddf could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cabdcc13-baf0-464a-96e7-bffb3144f779 tempest-TestServerMultinode-84938955 tempest-TestServerMultinode-84938955-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf" status: 404 len: 111 microversion: 2.1 time: 0.031410 Jul 18 03:04:44.465383 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3134/6338] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:04:44 2022] GET /compute/v2.1/servers/a17d52f2-76e5-4ef9-b51e-f78d22839ddf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:04:52.777272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:04:52.778288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:04:52.780246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:04:52.786831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:52.787291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:52.788079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:04:52.788528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:04:52.866005 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b228535a-b1a5-4682-8364-2e332cad1cc9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action" status: 200 len: 24548 microversion: 2.1 time: 0.093861 Jul 18 03:04:52.866667 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3205/6339] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:04:52 2022] POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action => generated 24548 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:05:41.149916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:41.150562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.153082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:41.153766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:41.160974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.161462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.162388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.162830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.426011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5a4d2a3-a815-40b8-89c0-a92f68f46bab tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1834 microversion: 2.1 time: 0.280334 Jul 18 03:05:41.427610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3135/6340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:41 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1834 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:41.445677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:41.446390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.448878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:41.449786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=44 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:05:41.456564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.457057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.457854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.458312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.600722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:41.608357 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0ebebb15-b746-4254-afa3-5a4592c2650e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1683 microversion: 2.1 time: 0.167882 Jul 18 03:05:41.608947 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3206/6341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:41 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:05:41.704092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:41.705161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.712401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.712855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.713722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.714165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.777558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-933914ec-78dc-4f6c-943e-548c19b46061 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action" status: 200 len: 32614 microversion: 2.1 time: 0.078954 Jul 18 03:05:41.778288 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3136/6342] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:05:41 2022] POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action => generated 32614 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:05:41.889781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:41.890367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:41.903624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.904512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.905427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:41.905870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:41.948946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0160a42e925c477eb53a8f2f7ee9741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0f538bb3ef4361ad40273ae69f6638', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:41.949588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: cf42422a-e987-4990-9f97-e1cfef526880] flavor_id is None. Assuming migration. {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 03:05:41.950041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:05:42.173634 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6fa179e-c8ad-426f-ab77-35b8d39e0b19 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action" status: 202 len: 0 microversion: 2.1 time: 0.287624 Jul 18 03:05:42.174260 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3207/6343] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:05:41 2022] POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:05:42.184148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:42.184868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:42.193498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:42.193965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:42.194767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:42.195256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:42.347489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:42.359136 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9e6186f-22e1-47b0-b651-41a22ad85434 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1692 microversion: 2.1 time: 0.179319 Jul 18 03:05:42.359722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3137/6344] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:42 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:43.379580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:43.380265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:43.388579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.389276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.390072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:43.390520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:43.536421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:43.545404 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a27a7af-96eb-4cbe-a420-6a7cb4c227ea tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1692 microversion: 2.1 time: 0.171274 Jul 18 03:05:43.545984 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3208/6345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:43 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:44.563674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:44.564298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:44.571739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.572196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.573009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:44.573459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:44.707938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:44.716559 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f67dd137-a545-492c-ac0f-0d8b1a9bbb72 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.157284 Jul 18 03:05:44.717194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3138/6346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:44 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:45.734545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:45.735155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:45.742310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.742770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:45.743551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:45.743999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:46.169729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:46.177551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-103563dc-9268-4ff9-bff9-9a15a1900349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.446815 Jul 18 03:05:46.178140 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3209/6347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:45 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:47.194928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:47.195544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:47.202815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.203272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.204061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:47.204506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:47.345569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:47.353754 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12e69206-b348-4a23-944b-ea55e000140f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.163362 Jul 18 03:05:47.354333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3139/6348] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:47 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:48.371298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:48.371932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:48.379037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:48.379490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:48.380792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:48.381265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:48.522828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:48.530725 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1768b31f-2af5-4b04-9864-08de602d4316 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.163333 Jul 18 03:05:48.531318 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3210/6349] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:48 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:49.548314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:49.548879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:49.556643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:49.557142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:49.557944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:49.558392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:49.740625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:49.748693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0eecbcbc-4bdb-48a5-a650-2293fb3abc7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.204353 Jul 18 03:05:49.749319 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3140/6350] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:49 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:50.767317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:50.767940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:50.776252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:50.776718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:50.777687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:50.778145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:50.928521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:50.936297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06a34920-9ed8-4dc6-90e8-1d61d7449d83 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.173070 Jul 18 03:05:50.936893 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3211/6351] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:50 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:51.955007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:51.955614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:51.965298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:51.965752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:51.966701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:51.967141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:52.109696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:52.119194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7da8790b-776d-4475-89c8-7456ffc6a846 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.167889 Jul 18 03:05:52.119792 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3141/6352] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:51 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:53.136880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:53.137531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:53.144754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:53.145322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:53.146103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:53.146550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:53.284111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:53.297428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74acd823-1537-493f-8394-f73c7945084d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.164424 Jul 18 03:05:53.298033 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3212/6353] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:53 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:54.315178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:54.315794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:54.323258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:54.323715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:54.324502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:54.324974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:54.472474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:54.480793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6724532c-8ffd-4bac-8c08-94bd71212ccd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.169584 Jul 18 03:05:54.481399 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3142/6354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:54 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:55.498024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:55.498642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:55.505882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:55.506973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:55.507778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:55.508220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:55.646020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:55.653793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d7a2848e-2266-49d9-910d-56d6d985c867 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.159760 Jul 18 03:05:55.654372 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3213/6355] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:55 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:56.671358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:56.672043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:56.681144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:56.681596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:56.682406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:56.682847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:56.841425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:56.855369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41724d73-264d-430f-8e6c-983e41b83c96 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1697 microversion: 2.1 time: 0.187516 Jul 18 03:05:56.856543 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3143/6356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:56 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:57.299251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "name": "network-vif-unplugged", "status": "completed", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:57.321470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:57.321927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:57.334130 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] Creating event network-vif-unplugged:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h1-849796-1 Jul 18 03:05:57.340252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] Instance cf42422a-e987-4990-9f97-e1cfef526880 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:05:57.353413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8c20a825-6b5d-4e92-8bd3-3da6a526ecdc req-4d3d5748-536f-49a2-ba12-7c96ba4b3f5f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059124 Jul 18 03:05:57.354448 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3214/6357] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:05:57.881194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:57.882480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:57.891002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:57.891825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:57.892769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:57.893314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:58.117713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:58.125409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dae4c954-625a-463c-aaaf-e2579d5e7ca0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1696 microversion: 2.1 time: 0.248306 Jul 18 03:05:58.125992 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3144/6358] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:57 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1696 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:59.144436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:05:59.145174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:05:59.152140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:59.152594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:59.153416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:59.153863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:59.294076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:05:59.301793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc233cf4-0e79-4de6-b393-1d278f7281f9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1694 microversion: 2.1 time: 0.162513 Jul 18 03:05:59.302374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3215/6359] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:05:59 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:05:59.398389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:05:59.407676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:05:59.408050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:05:59.420734 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] Creating event network-changed:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h1-849796-1 Jul 18 03:05:59.426319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] Instance cf42422a-e987-4990-9f97-e1cfef526880 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:05:59.437314 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-86c6708c-7f4c-457d-89d8-b3247e8b27b6 req-16fe8964-ebd0-4954-8df7-9da012483b83 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043816 Jul 18 03:05:59.438132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3145/6360] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:00.320285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:00.320891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:00.327905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:00.328350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:00.329143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:00.329585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:00.474961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:00.482982 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c1b575ff-1eae-4046-bdfe-e422c29421f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1694 microversion: 2.1 time: 0.167212 Jul 18 03:06:00.483567 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3216/6361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:00 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:01.500669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:01.501535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:01.509519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:01.509973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:01.510761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:01.511213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:01.731477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:01.740073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b99676b7-dd2d-4778-8764-a6dfe4daf801 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1694 microversion: 2.1 time: 0.243459 Jul 18 03:06:01.740967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3146/6362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:01 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:02.758247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:02.759051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:02.766141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.766604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:02.767391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.767841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:02.912247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:02.920525 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67c6eca3-4283-481d-851a-fb1409b45cf7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1691 microversion: 2.1 time: 0.166807 Jul 18 03:06:02.921129 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3217/6363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:02 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:02.937033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:02.937588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:02.944793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.945293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:02.946106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:02.946554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.007717 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56bd0a9c-c7fc-4588-b046-64262393cb45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action" status: 204 len: 0 microversion: 2.1 time: 0.074519 Jul 18 03:06:03.008391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3147/6364] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:02 2022] POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:06:03.016774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:03.017588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:03.024640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:03.025131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.026110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:03.026709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.279107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:03.287205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a80c135a-7d92-4968-ae84-79970bde1a24 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1691 microversion: 2.1 time: 0.274516 Jul 18 03:06:03.288622 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3218/6365] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:03 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:03.804183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "name": "network-vif-plugged", "status": "completed", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:03.813596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:03.814327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:03.827400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] Creating event network-vif-plugged:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h1-849796-1 Jul 18 03:06:03.833053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] Instance cf42422a-e987-4990-9f97-e1cfef526880 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:06:03.845074 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2ce065da-72ac-4972-88a6-fb7a6d09d4fc req-b7a4bcf7-019b-466c-b2e2-3d1e06900ae9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045220 Jul 18 03:06:03.846189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3148/6366] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:04.305772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:04.306424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:04.313525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.313991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.314781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.315235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.465915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:04.473758 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-209bbc04-1450-40a6-b910-f3ee52fa3bd4 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1691 microversion: 2.1 time: 0.172097 Jul 18 03:06:04.476150 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3219/6367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:04 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:04.734179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:04.734769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:04.741837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.742294 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.743079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:04.743527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:04.767427 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96d85f7f-3945-48a5-a994-d9c8a8dd0e03 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/ips" status: 200 len: 145 microversion: 2.1 time: 0.038534 Jul 18 03:06:04.768005 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3149/6368] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 03:06:04 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:05.493882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:05.494504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:05.501688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:05.502154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:05.502946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:05.503399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:05.641770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:05.650510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ab8fec24-5a46-4a9b-bb28-51387da5bd13 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1683 microversion: 2.1 time: 0.161188 Jul 18 03:06:05.651106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3220/6369] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:05 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:06.087863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95e2c418-3995-4f81-b420-22861f33e20c"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:06.088973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:06.095869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:06.096328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:06.097145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:06.097593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:06.341117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:06.360396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e49e0e8-926f-4f19-a316-830bdbb91fc8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276819 Jul 18 03:06:06.361043 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3150/6370] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:06:06 2022] POST /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:17.083882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:17.085655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:17.089723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=32 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:17.090703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:17.097877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:17.098433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:17.099268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:17.099722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:17.137291 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4441fdae-2bba-4a10-a705-ecb0e02d9caf tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057874 Jul 18 03:06:17.137912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3221/6371] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:06:17 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:17.153072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:17.153742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:17.159123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=32 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:17.160477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:17.171448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:17.172104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:17.173113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:17.173630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:17.233312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf671498-c6bb-435c-b856-c39484cafa0a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c" status: 200 len: 194 microversion: 2.1 time: 0.087643 Jul 18 03:06:17.234596 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3151/6372] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Jul 18 03:06:17 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:18.626584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "457d3399-f401-4335-85fa-c00787b7a89d"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:18.627658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:18.634907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:18.635364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:18.636143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:18.636588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:18.919776 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-847252c3-3c1b-4e06-80c8-68b22afb8c6c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "POST /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296865 Jul 18 03:06:18.920545 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3222/6373] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:06:18 2022] POST /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:30.734021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:30.735000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:30.737470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.738139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.744072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.744537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.745368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.745813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.778129 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97e9de10-6608-428a-8296-514f6f06f7bb tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050691 Jul 18 03:06:30.778724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3152/6374] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:06:30 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:30.916689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:30.917366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:30.920306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.921026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:06:30.927886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.928344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.929210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.929721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.964686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2ada991-482d-4e48-b2d9-7d7599e95d8c tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c" status: 200 len: 194 microversion: 2.1 time: 0.052647 Jul 18 03:06:30.965346 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3223/6375] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Jul 18 03:06:30 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:30.975639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:30.977196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:30.985262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.985720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:30.986518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:30.986967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:31.072523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lazy-loading 'services' on Instance uuid 766a2888-b711-4fed-8b5b-3220a42b4538 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:06:31.152580 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c25864de-9221-4fc0-ba86-6524bb901442 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c" status: 202 len: 0 microversion: 2.1 time: 0.180361 Jul 18 03:06:31.153435 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3153/6376] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:06:30 2022] DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/95e2c418-3995-4f81-b420-22861f33e20c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:36.541704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:36.542343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:36.549664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.550158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.550955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.551408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.582736 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87999e30-4355-409d-b1e1-d488a53aff3e tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/457d3399-f401-4335-85fa-c00787b7a89d" status: 200 len: 194 microversion: 2.1 time: 0.047242 Jul 18 03:06:36.589301 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3224/6377] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Jul 18 03:06:36 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/457d3399-f401-4335-85fa-c00787b7a89d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:36.597741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:36.598380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:36.605992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.606457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.607257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:36.607705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:36.691111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lazy-loading 'services' on Instance uuid 766a2888-b711-4fed-8b5b-3220a42b4538 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:06:36.766131 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c00c714-369d-4ef3-9a73-95624bb58359 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/457d3399-f401-4335-85fa-c00787b7a89d" status: 202 len: 0 microversion: 2.1 time: 0.174825 Jul 18 03:06:36.766745 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3154/6378] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:06:36 2022] DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments/457d3399-f401-4335-85fa-c00787b7a89d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:37.904822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:37.905802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:37.912547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:37.913039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:37.915141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:37.915594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:37.981212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a1e3243b-6990-41af-9f9d-9a77b54914d2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action" status: 200 len: 24576 microversion: 2.1 time: 0.080229 Jul 18 03:06:37.982511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3225/6379] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:06:37 2022] POST /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880/action => generated 24576 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:06:42.172813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:42.173959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:42.180339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.180798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.181605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.182060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.214281 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-740b279b-3302-41aa-8be1-0727f4c9e96d tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046855 Jul 18 03:06:42.214876 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3155/6380] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:06:42 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:06:42.322266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:42.324155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:42.332296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.332752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.333605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.334083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.366338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9f3f9786-8bc0-4d34-b9b2-9e8b6e16d8c0 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049113 Jul 18 03:06:42.366927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3226/6381] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:06:42 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:06:42.427426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:42.427927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:42.434284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.434765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.435553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.435997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.462719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:06:42.548273 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c0b0df83-1574-4ff4-a024-349f0c3dadb5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 204 len: 0 microversion: 2.1 time: 0.122750 Jul 18 03:06:42.550000 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3156/6382] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:42 2022] DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:06:42.558708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:42.559352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:42.566092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.566555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.567348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:42.567804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:42.710913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:42.720267 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64087f8b-8ea3-4833-b29a-5fe1cef19ddd tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1674 microversion: 2.1 time: 0.165400 Jul 18 03:06:42.720941 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3227/6383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:42 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:43.738968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:43.739670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:43.747817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.748578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.750017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:43.750784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:43.892100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:43.900667 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c32c5a8-b9ea-4164-97fa-fc7c438900c5 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1674 microversion: 2.1 time: 0.166008 Jul 18 03:06:43.901298 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3157/6384] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:43 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:44.919105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:44.919779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:44.927035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:44.927498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:44.928300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:44.928795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:45.166915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:45.175314 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ffc5ccd-0cdf-449b-8373-415ed0c577b2 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1674 microversion: 2.1 time: 0.260140 Jul 18 03:06:45.175945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3228/6385] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:44 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:06:45.817335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dd590270-326a-4ab7-bb47-993b63330bb9 req-59353979-0e1b-42ed-a3de-0df043cf916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766a2888-b711-4fed-8b5b-3220a42b4538", "name": "network-vif-deleted", "tag": "28b0b53f-359c-498f-920f-f8ce2c94bf52"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:06:45.834126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd590270-326a-4ab7-bb47-993b63330bb9 req-59353979-0e1b-42ed-a3de-0df043cf916c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:45.834791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd590270-326a-4ab7-bb47-993b63330bb9 req-59353979-0e1b-42ed-a3de-0df043cf916c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:45.852867 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dd590270-326a-4ab7-bb47-993b63330bb9 req-59353979-0e1b-42ed-a3de-0df043cf916c service nova] Creating event network-vif-deleted:28b0b53f-359c-498f-920f-f8ce2c94bf52 for instance 766a2888-b711-4fed-8b5b-3220a42b4538 on n-h2-849796-1 Jul 18 03:06:45.861158 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dd590270-326a-4ab7-bb47-993b63330bb9 req-59353979-0e1b-42ed-a3de-0df043cf916c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130500 Jul 18 03:06:45.862153 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3158/6386] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:06:46.193936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:46.196661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:46.206492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:46.207322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:46.208369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:46.209096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:46.247100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:46.247550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:46.248024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lazy-loading 'fault' on Instance uuid 766a2888-b711-4fed-8b5b-3220a42b4538 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:06:46.318073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57025f6e4a2842c6bbfd58050e2e7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cfe382144846b1a9ae87d85c6eca38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:06:46.327465 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a225f269-01b4-4878-b8f2-016c2c02d269 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 200 len: 1328 microversion: 2.1 time: 0.138041 Jul 18 03:06:46.328359 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3229/6387] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:46 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:06:47.348972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:47.349683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:47.356201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.356660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.357474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:47.357927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:47.371532 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 HTTP/1.1 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '766a2888-b711-4fed-8b5b-3220a42b4538'} Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:47.373240 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-488bb220-59e8-4498-8335-3c65734f57b8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 404 len: 111 microversion: 2.1 time: 0.031267 Jul 18 03:06:47.378243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3159/6388] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:47 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:47.384609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98f54f7a-6c73-4c07-836f-6e2b903d4d97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '.version_select at 0x7fab04ea5160>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:47.410720 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98f54f7a-6c73-4c07-836f-6e2b903d4d97 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662926699" status: 202 len: 0 microversion: 2.1 time: 0.030727 Jul 18 03:06:47.411339 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3230/6389] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 03:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662926699 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:06:54.597639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.598479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.606668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.607313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.608227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.608742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.626896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 HTTP/1.1 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '766a2888-b711-4fed-8b5b-3220a42b4538'} Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:54.628515 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-513d4573-333d-4461-a080-6ae5404189d8 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 404 len: 111 microversion: 2.1 time: 0.036657 Jul 18 03:06:54.634407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3160/6390] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:54 2022] DELETE /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:54.640555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:54.641227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 766a2888-b711-4fed-8b5b-3220a42b4538] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:54.650148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.650617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.651432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:54.652041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:54.668247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 HTTP/1.1 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '766a2888-b711-4fed-8b5b-3220a42b4538'} Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:54.670037 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 766a2888-b711-4fed-8b5b-3220a42b4538 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a99899f4-3d0c-480c-9776-f3288296dcc1 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538" status: 404 len: 111 microversion: 2.1 time: 0.035953 Jul 18 03:06:54.674812 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3231/6391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:54 2022] GET /compute/v2.1/servers/766a2888-b711-4fed-8b5b-3220a42b4538 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:06:57.941082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:57.941656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.949704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.950162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.950953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.951401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.966412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 HTTP/1.1 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '963bfa3f-7b36-48ba-a499-75be3dc7b517'} Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:57.968008 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81ad0175-94eb-4f9d-a468-2a5f08cf982a tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 404 len: 111 microversion: 2.1 time: 0.032336 Jul 18 03:06:57.973457 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3161/6392] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:06:57 2022] DELETE /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:06:57.978133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:06:57.978760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] [instance: 963bfa3f-7b36-48ba-a499-75be3dc7b517] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:06:57.985896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.986360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:57.987196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:06:57.987609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:06:58.002186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] HTTP exception thrown: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Request method failure captured: Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 HTTP/1.1 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1MxjZMnly7-tzn-IhPOAYmDhE2uvCZXYhTUFYuLAYsLbKFkJdDmnXy9Bim0OIwzPmlU-Kw9BhABZE09iiE6VU-Dplvh5w70_5qkdeBPS6xrF0ENASoySMBRZYPhVie_-hFdsiycOSg55fALv5rTuzQ8jCL9glSp4wHaN-WLAsig6onI Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2cfe382144846b1a9ae87d85c6eca38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: a2cfe382144846b1a9ae87d85c6eca38 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-983456005 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 57025f6e4a2842c6bbfd58050e2e7371 Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-AttachVolumeTestJSON-983456005-project Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '963bfa3f-7b36-48ba-a499-75be3dc7b517'} Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:06:58.003760 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] Returning 404 to user: Instance 963bfa3f-7b36-48ba-a499-75be3dc7b517 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-319d798c-356f-4654-bd72-448c04080160 tempest-AttachVolumeTestJSON-983456005 tempest-AttachVolumeTestJSON-983456005-project] 10.222.0.67 "GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517" status: 404 len: 111 microversion: 2.1 time: 0.031031 Jul 18 03:06:58.009659 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3232/6393] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:06:57 2022] GET /compute/v2.1/servers/963bfa3f-7b36-48ba-a499-75be3dc7b517 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:07:00.746534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:00.747860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:00.752092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:00.765524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.766357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.767871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:00.768670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:00.777543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:01.170103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a03dc7f7-6432-44dd-b70f-18c1bcc95b33 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1834 microversion: 2.1 time: 0.432867 Jul 18 03:07:01.170913 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3162/6394] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:00 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1834 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:02.418172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.418824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-73cce2b3-116c-40f0-966f-eed3f1b49c28 req-1eba0ee6-eba6-4cad-8345-04e92ffd3a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:02.419278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.430635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73cce2b3-116c-40f0-966f-eed3f1b49c28 req-1eba0ee6-eba6-4cad-8345-04e92ffd3a7b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.431087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73cce2b3-116c-40f0-966f-eed3f1b49c28 req-1eba0ee6-eba6-4cad-8345-04e92ffd3a7b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.436242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:02.445089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-73cce2b3-116c-40f0-966f-eed3f1b49c28 req-1eba0ee6-eba6-4cad-8345-04e92ffd3a7b service nova] Creating event network-changed:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h1-849796-1 Jul 18 03:07:02.455652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-73cce2b3-116c-40f0-966f-eed3f1b49c28 req-1eba0ee6-eba6-4cad-8345-04e92ffd3a7b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040987 Jul 18 03:07:02.456534 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3163/6395] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:02.460142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.460881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.462146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.463115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.467352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=47 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:02.495540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:07:02.623173 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-897ada3c-ac0c-480d-ab0c-6a6754f49d7f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 204 len: 0 microversion: 2.1 time: 0.211326 Jul 18 03:07:02.633934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3233/6396] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:07:02 2022] DELETE /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:07:02.638355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:02.639062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:02.646926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.648155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.649405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:02.650182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:02.905285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:02.914869 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73614797-7e07-4ffe-8169-b182574a94b7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1689 microversion: 2.1 time: 0.280707 Jul 18 03:07:02.915503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3164/6397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:02 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1689 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:03.933399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:03.934170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:03.940999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.941994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:03.942812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:03.943264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.152968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96d53822-bff1-4ccc-ab03-e8ce266859d8 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Action: 'create', calling method: .version_select at 0x7faaf74c7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1433091014"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:04.321506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:04.338498 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-716c0bb9-e0bd-464a-8ed4-94804ce7fc37 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1689 microversion: 2.1 time: 0.409930 Jul 18 03:07:04.339910 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3234/6398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:03 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1689 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:04.668699 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96d53822-bff1-4ccc-ab03-e8ce266859d8 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.718402 Jul 18 03:07:04.669709 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3165/6399] 10.222.0.67 () {60 vars in 1154 bytes} [Mon Jul 18 03:07:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 722 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 03:07:04.681560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36c9eb01-abe4-4c5d-bd19-aa73a89e87e3 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab05818430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:04.743983 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36c9eb01-abe4-4c5d-bd19-aa73a89e87e3 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 200 len: 345 microversion: 2.1 time: 0.066670 Jul 18 03:07:04.744583 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3235/6400] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:04 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:04.968592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-081597f2-6d41-4fbc-8688-0d021b505417 req-096bbb6b-bd8e-42e0-847f-484640d36536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf42422a-e987-4990-9f97-e1cfef526880", "name": "network-vif-deleted", "tag": "8052b730-7346-4081-bd9e-26f966afd46a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:04.979260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-081597f2-6d41-4fbc-8688-0d021b505417 req-096bbb6b-bd8e-42e0-847f-484640d36536 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:04.979711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-081597f2-6d41-4fbc-8688-0d021b505417 req-096bbb6b-bd8e-42e0-847f-484640d36536 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:04.992885 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-081597f2-6d41-4fbc-8688-0d021b505417 req-096bbb6b-bd8e-42e0-847f-484640d36536 service nova] Creating event network-vif-deleted:8052b730-7346-4081-bd9e-26f966afd46a for instance cf42422a-e987-4990-9f97-e1cfef526880 on n-h1-849796-1 Jul 18 03:07:04.999489 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-081597f2-6d41-4fbc-8688-0d021b505417 req-096bbb6b-bd8e-42e0-847f-484640d36536 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Jul 18 03:07:05.000314 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3166/6401] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:05.360178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:05.360821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:05.369137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:05.369609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:05.370421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:05.370877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:05.408280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:05.408842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:05.409343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lazy-loading 'fault' on Instance uuid cf42422a-e987-4990-9f97-e1cfef526880 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:07:05.466890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:05.476074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce7ba9be-3318-4909-9285-0da749446b29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 200 len: 1356 microversion: 2.1 time: 0.121476 Jul 18 03:07:05.476531 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3236/6402] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:05 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:05.757358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-78f5cbde-5307-465e-bcb6-6eaa5b438772 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7faaf748e0d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:05.811841 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-78f5cbde-5307-465e-bcb6-6eaa5b438772 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 200 len: 346 microversion: 2.1 time: 0.059576 Jul 18 03:07:05.812429 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3167/6403] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:05 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:05.825739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27945ea9-ca34-4135-adef-5c4a84585015 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Action: 'create', calling method: .version_select at 0x7fab0a600670>, body: {"snapshot": {"volume_id": "b2d6c3b7-886f-4269-85a1-4aac1989d3ef", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-962058596"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:05.986852 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27945ea9-ca34-4135-adef-5c4a84585015 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.165061 Jul 18 03:07:05.987470 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3237/6404] 10.222.0.67 () {60 vars in 1161 bytes} [Mon Jul 18 03:07:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:05.999778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef6f3858-d014-4b00-9d3b-a89422c82d25 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7faaf7538b80>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:06.033931 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef6f3858-d014-4b00-9d3b-a89422c82d25 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 286 microversion: 2.1 time: 0.038835 Jul 18 03:07:06.034637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3168/6405] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:05 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:06.045217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-83a89218-4277-43d3-a93c-66ab0b613993 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab0561a700>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:06.079017 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-83a89218-4277-43d3-a93c-66ab0b613993 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037650 Jul 18 03:07:06.079605 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3238/6406] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Jul 18 03:07:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:06.091720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10060eb8-7eba-4aa0-bca5-34b838f80f35 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab0428aca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:06.127161 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10060eb8-7eba-4aa0-bca5-34b838f80f35 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 286 microversion: 2.1 time: 0.039838 Jul 18 03:07:06.128664 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3169/6407] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:06 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:06.494977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:06.495610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: cf42422a-e987-4990-9f97-e1cfef526880] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:06.502114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:06.502575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:06.503369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:06.503823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:06.518863 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] HTTP exception thrown: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Request method failure captured: Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 HTTP/1.1 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M2MvS_5yiFLlV5A0nJ4kWpt7ocUMzhl_AKiGqaO3XsS0BNPM92yExuRorJppWhkkeCN5ZJpWAvwE5ygF1J40ToOMCjUlKLMJ60OlFrn_gTJN1yXHK-zhYDEnl3NaRyS2ViGL_CRsjIjRKVaqDOb6Q5sUfV5z55XgAst1erIvLhzOLg Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0d0b369cbbf14f7695c1c2a69e174c85 Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'cf42422a-e987-4990-9f97-e1cfef526880'} Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:06.520501 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Returning 404 to user: Instance cf42422a-e987-4990-9f97-e1cfef526880 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c53a6cad-b0de-4b43-8cbe-fc51f5674349 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880" status: 404 len: 111 microversion: 2.1 time: 0.032873 Jul 18 03:07:06.529112 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3239/6408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:06 2022] GET /compute/v2.1/servers/cf42422a-e987-4990-9f97-e1cfef526880 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:07.141022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee510779-ff2e-4b9f-a3c3-6ad127574e3a tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab043af820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:07.176017 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee510779-ff2e-4b9f-a3c3-6ad127574e3a tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 286 microversion: 2.1 time: 0.039843 Jul 18 03:07:07.178492 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3170/6409] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:07 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:08.188152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10cadf84-d1b9-495e-9954-0b08e2385c93 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab05818e50>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:08.220786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10cadf84-d1b9-495e-9954-0b08e2385c93 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 287 microversion: 2.1 time: 0.036406 Jul 18 03:07:08.221588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3240/6410] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:08 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:08.233306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b3c9dc2-4e7d-48cc-a551-c3df45fd34cf tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab048395e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:08.296461 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b3c9dc2-4e7d-48cc-a551-c3df45fd34cf tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 202 len: 0 microversion: 2.1 time: 0.067895 Jul 18 03:07:08.297480 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3171/6411] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Jul 18 03:07:08 2022] DELETE /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:08.307245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48a883bf-78f2-4469-a06f-9367658edc1b tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab04bef430>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:08.341499 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48a883bf-78f2-4469-a06f-9367658edc1b tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 286 microversion: 2.1 time: 0.039668 Jul 18 03:07:08.345654 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3241/6412] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:08 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:09.354734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c642e86a-dc84-4d33-9056-cdb46cba0d35 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7faaf748e3a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:09.399143 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c642e86a-dc84-4d33-9056-cdb46cba0d35 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 200 len: 286 microversion: 2.1 time: 0.049406 Jul 18 03:07:09.399980 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3172/6413] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:09 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:10.412132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d519271-0893-40a1-aa97-d8c3eff73786 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab04befee0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:10.437892 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-8d519271-0893-40a1-aa97-d8c3eff73786 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] HTTP exception thrown: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d519271-0893-40a1-aa97-d8c3eff73786 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Request method failure captured: Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f HTTP/1.1 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M5X0Js0z5IwxavuThtEB3GUQpvpT84myrc1xL5fLi5zTxM4Q2d4ADC9PFxwHPMWHt_cyr7hQ6gYS1WF-RmUSvhU3VR9LEWFYb1gIjzQRt920BOLrbbWR993vm4wWZPdqSy8nu8194F9snJpjO2YsNHfyHarBSebZkdYSZSjp-RY5IU Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_063943bb2abb45b68685b2f71e26a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe6b818b7a4f4c07808ee726d68c0fbe Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: exception: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '982493e7-a21c-4de5-a979-7e3bc6d0e91f'} Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. (HTTP 404) (Request-ID: req-5f7a3568-476c-49c6-b69f-38a7bb55c5e3) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 03:07:10.445089 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d519271-0893-40a1-aa97-d8c3eff73786 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Returning 404 to user: Snapshot 982493e7-a21c-4de5-a979-7e3bc6d0e91f could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:10.449913 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d519271-0893-40a1-aa97-d8c3eff73786 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f" status: 404 len: 111 microversion: 2.1 time: 0.040676 Jul 18 03:07:10.458791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3242/6414] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 03:07:10 2022] GET /compute/v2.1/os-snapshots/982493e7-a21c-4de5-a979-7e3bc6d0e91f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:10.469913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c36442ed-1e44-4c3e-8d7e-e85b62f37728 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab042e40d0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:10.542020 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c36442ed-1e44-4c3e-8d7e-e85b62f37728 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 202 len: 0 microversion: 2.1 time: 0.078257 Jul 18 03:07:10.542630 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3173/6415] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 03:07:10 2022] DELETE /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:10.551449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d838fd3b-42d5-4721-994b-50523c8ea527 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab05767c10>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:10.609693 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d838fd3b-42d5-4721-994b-50523c8ea527 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 200 len: 345 microversion: 2.1 time: 0.062715 Jul 18 03:07:10.610803 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3243/6416] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:10 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:10.690456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a4a15f8-d5c7-4266-be62-ac061bca1f30 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '.version_select at 0x7faaf7538790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:10.714813 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a4a15f8-d5c7-4266-be62-ac061bca1f30 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1952008376" status: 202 len: 0 microversion: 2.1 time: 0.028073 Jul 18 03:07:10.715522 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3174/6417] 10.222.0.67 () {58 vars in 1283 bytes} [Mon Jul 18 03:07:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1952008376 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:07:10.746527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4f91ce55-588a-4734-a7a0-6afc8507b92e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: .version_select at 0x7fab0a600670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1304913508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0QHLAsvZ+Ua1AnAC2TRvF0TXD2MYv+bcMAtjxJ5oAfKs8WZcMuWp8q8KljAOZjXv2f+j0l8ToSzAgfXyZEML1Xqq78/yPQXyKglPOx651ua3hHyiqQK2gsX4+tzPA7Xg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:10.762906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4f91ce55-588a-4734-a7a0-6afc8507b92e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:07:10.768640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-4f91ce55-588a-4734-a7a0-6afc8507b92e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:07:10.799151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4f91ce55-588a-4734-a7a0-6afc8507b92e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056448 Jul 18 03:07:10.809116 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3244/6418] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:07:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:11.622909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a175c639-5712-4910-9e52-106d63ac1f3e tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab043af820>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:11.687429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a175c639-5712-4910-9e52-106d63ac1f3e tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 200 len: 345 microversion: 2.1 time: 0.068733 Jul 18 03:07:11.688192 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3175/6419] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:11 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:12.701326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ceb19416-cbb1-4585-b28f-f8a0447fdfe2 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab04ea2940>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:12.737128 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ceb19416-cbb1-4585-b28f-f8a0447fdfe2 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] HTTP exception thrown: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ceb19416-cbb1-4585-b28f-f8a0447fdfe2 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Request method failure captured: Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef HTTP/1.1 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M5X0Js0z5IwxavuThtEB3GUQpvpT84myrc1xL5fLi5zTxM4Q2d4ADC9PFxwHPMWHt_cyr7hQ6gYS1WF-RmUSvhU3VR9LEWFYb1gIjzQRt920BOLrbbWR993vm4wWZPdqSy8nu8194F9snJpjO2YsNHfyHarBSebZkdYSZSjp-RY5IU Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_063943bb2abb45b68685b2f71e26a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe6b818b7a4f4c07808ee726d68c0fbe Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b2d6c3b7-886f-4269-85a1-4aac1989d3ef'} Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. (HTTP 404) (Request-ID: req-b6129ace-1034-45b7-82a5-b345f9a997a7) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 03:07:12.739133 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ceb19416-cbb1-4585-b28f-f8a0447fdfe2 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Returning 404 to user: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ceb19416-cbb1-4585-b28f-f8a0447fdfe2 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 404 len: 109 microversion: 2.1 time: 0.044306 Jul 18 03:07:12.746330 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3245/6420] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:12 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:12.755392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12dfe749-3d2d-4cfa-a2a1-381e56293eb4 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab043051f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:12.787178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-12dfe749-3d2d-4cfa-a2a1-381e56293eb4 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] HTTP exception thrown: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12dfe749-3d2d-4cfa-a2a1-381e56293eb4 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Request method failure captured: Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef HTTP/1.1 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M5X0Js0z5IwxavuThtEB3GUQpvpT84myrc1xL5fLi5zTxM4Q2d4ADC9PFxwHPMWHt_cyr7hQ6gYS1WF-RmUSvhU3VR9LEWFYb1gIjzQRt920BOLrbbWR993vm4wWZPdqSy8nu8194F9snJpjO2YsNHfyHarBSebZkdYSZSjp-RY5IU Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_063943bb2abb45b68685b2f71e26a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: fe6b818b7a4f4c07808ee726d68c0fbe Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: method: Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: exception: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'b2d6c3b7-886f-4269-85a1-4aac1989d3ef'} Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. (HTTP 404) (Request-ID: req-9d9e3a9d-fa12-468e-bec8-bd949435b7fe) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 03:07:12.790699 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12dfe749-3d2d-4cfa-a2a1-381e56293eb4 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Returning 404 to user: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:12.795571 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12dfe749-3d2d-4cfa-a2a1-381e56293eb4 tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 404 len: 109 microversion: 2.1 time: 0.042572 Jul 18 03:07:12.801739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3176/6421] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Jul 18 03:07:12 2022] DELETE /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:12.808422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f48b4959-3ba2-4dae-a5aa-44b78f8166ae tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Calling method '.version_select at 0x7fab0a7953a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:12.842513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f48b4959-3ba2-4dae-a5aa-44b78f8166ae tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] HTTP exception thrown: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f48b4959-3ba2-4dae-a5aa-44b78f8166ae tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Request method failure captured: Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef HTTP/1.1 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M5X0Js0z5IwxavuThtEB3GUQpvpT84myrc1xL5fLi5zTxM4Q2d4ADC9PFxwHPMWHt_cyr7hQ6gYS1WF-RmUSvhU3VR9LEWFYb1gIjzQRt920BOLrbbWR993vm4wWZPdqSy8nu8194F9snJpjO2YsNHfyHarBSebZkdYSZSjp-RY5IU Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_063943bb2abb45b68685b2f71e26a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/063943bb2abb45b68685b2f71e26a171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 063943bb2abb45b68685b2f71e26a171 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-178728911 Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: fe6b818b7a4f4c07808ee726d68c0fbe Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-VolumesSnapshotsTestJSON-178728911-project Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: method: Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: exception: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'b2d6c3b7-886f-4269-85a1-4aac1989d3ef'} Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. (HTTP 404) (Request-ID: req-a7b4ff45-6f55-4eaa-83c7-cf5e120ab2be) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 03:07:12.844807 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. Jul 18 03:07:12.849561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:12.855189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f48b4959-3ba2-4dae-a5aa-44b78f8166ae tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] Returning 404 to user: Volume b2d6c3b7-886f-4269-85a1-4aac1989d3ef could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:12.855189 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f48b4959-3ba2-4dae-a5aa-44b78f8166ae tempest-VolumesSnapshotsTestJSON-178728911 tempest-VolumesSnapshotsTestJSON-178728911-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef" status: 404 len: 109 microversion: 2.1 time: 0.050258 Jul 18 03:07:12.855189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3246/6422] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Jul 18 03:07:12 2022] GET /compute/v2.1/os-volumes/b2d6c3b7-886f-4269-85a1-4aac1989d3ef => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:16.963713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=15 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:16.967987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-498809947", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ca7f4491-f77b-461b-9389-2cdefda6c7d4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1304913508", "security_groups": [{"name": "tempest-secgroup-smoke-1163104433"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:17.186153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] validate_networks() for [('ca7f4491-f77b-461b-9389-2cdefda6c7d4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:07:17.970680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:07:17.971901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:07:17.972579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:07:17.973359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:07:17.976543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:07:18.013021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:18.014062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:18.015344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:18.028242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:18.106854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:07:18.120703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:07:18.160509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:07:18.166573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:07:18.317482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-667edfc7-35e0-411b-8c29-2a8050231d32 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.355225 Jul 18 03:07:18.321015 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3177/6423] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:07:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:07:18.329164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:18.342792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-293360ed-ea6d-4825-83ec-f21fc74a5bb2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:18.344097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-293360ed-ea6d-4825-83ec-f21fc74a5bb2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:18.459029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-293360ed-ea6d-4825-83ec-f21fc74a5bb2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:18.467949 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-293360ed-ea6d-4825-83ec-f21fc74a5bb2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1266 microversion: 2.1 time: 0.140562 Jul 18 03:07:18.469901 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3247/6424] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:18 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:19.496129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:19.502422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:19.534749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:19.535590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:19.537155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:19.539166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:19.733560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:19.750737 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2a7adc3-d305-45a2-82af-1fc9cea2df2b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1270 microversion: 2.1 time: 0.266809 Jul 18 03:07:19.752585 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3178/6425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:19 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:20.773254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:20.774064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:20.804059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:20.804771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:20.806071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:20.806738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:20.942022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:20.963653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c84c299d-dc0f-4b9d-a5da-760ee6f59d29 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1324 microversion: 2.1 time: 0.195619 Jul 18 03:07:20.965434 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3248/6426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:20 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1324 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:07:21.994290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:21.995523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:22.007213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:22.011823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:22.013167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:22.013961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:22.348563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:22.359055 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-745e3154-2d10-4013-bd2f-ac82675ef2fd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.375468 Jul 18 03:07:22.360090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3179/6427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:21 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:22.869272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e91d33f2-013c-43df-85d4-7c6ddc78e907 req-cad31cfb-4b27-4a55-a4a2-7be25574059f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:22.889504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e91d33f2-013c-43df-85d4-7c6ddc78e907 req-cad31cfb-4b27-4a55-a4a2-7be25574059f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:22.889963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e91d33f2-013c-43df-85d4-7c6ddc78e907 req-cad31cfb-4b27-4a55-a4a2-7be25574059f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:22.908330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e91d33f2-013c-43df-85d4-7c6ddc78e907 req-cad31cfb-4b27-4a55-a4a2-7be25574059f service nova] Creating event network-changed:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:07:22.921406 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e91d33f2-013c-43df-85d4-7c6ddc78e907 req-cad31cfb-4b27-4a55-a4a2-7be25574059f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062627 Jul 18 03:07:22.929635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3249/6428] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:23.389289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:23.389965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:23.402032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:23.402493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:23.403373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:23.404538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:23.606467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:23.614848 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ebc05eb-3d24-46af-a0c7-35d393940066 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.230361 Jul 18 03:07:23.615465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3180/6429] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:23 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:24.636648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:24.637391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:24.650108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:24.650108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:24.650108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:24.650108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:24.860383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:24.869438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-644b3719-cfab-41b7-b03f-029768cb0105 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.238941 Jul 18 03:07:24.870633 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3250/6430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:24 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:25.898384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:25.899612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:25.912453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:25.914728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:25.915895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:25.916301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:26.134251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:26.144713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1c7a220-2a30-4da8-8061-2e19ae9b498c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.251647 Jul 18 03:07:26.145682 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3181/6431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:25 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:27.163924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:27.164600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:27.171473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:27.172037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:27.172732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:27.173228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:27.641643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:27.655340 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8d57ee7-b04e-4770-9fda-4fd1b70f3a3f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.495377 Jul 18 03:07:27.666337 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3251/6432] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:27 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:28.672641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:28.673307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:28.676092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:28.676767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:28.682618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:28.683080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:28.684016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:28.684299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:28.874434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:28.884234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c0169ca-0831-40a9-a613-1a9eee939161 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.215230 Jul 18 03:07:28.893999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3182/6433] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:28 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:28.894221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6c61787c-3e33-49b7-9f8a-68ca8fcc37d0 req-2a6e7849-5200-4caf-bbf2-a4e8430bc62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "name": "network-vif-plugged", "status": "completed", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:28.899959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:28.902241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6c61787c-3e33-49b7-9f8a-68ca8fcc37d0 req-2a6e7849-5200-4caf-bbf2-a4e8430bc62b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:28.902693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6c61787c-3e33-49b7-9f8a-68ca8fcc37d0 req-2a6e7849-5200-4caf-bbf2-a4e8430bc62b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:28.921193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6c61787c-3e33-49b7-9f8a-68ca8fcc37d0 req-2a6e7849-5200-4caf-bbf2-a4e8430bc62b service nova] Creating event network-vif-plugged:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:07:28.926770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6c61787c-3e33-49b7-9f8a-68ca8fcc37d0 req-2a6e7849-5200-4caf-bbf2-a4e8430bc62b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039113 Jul 18 03:07:28.927638 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3252/6434] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:07:29.902405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:29.903016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:29.910457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:29.910916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:29.911706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:29.912163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:30.065184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:30.073160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f9b266e8-8a53-4c52-8630-0c072a90df53 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1392 microversion: 2.1 time: 0.174678 Jul 18 03:07:30.073759 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3183/6435] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:29 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:31.092424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:31.093186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:31.101471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.101938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.102743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.103458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.268197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:31.277250 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0e99862-6a77-477d-85a6-7ea38ffa2d63 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1563 microversion: 2.1 time: 0.190104 Jul 18 03:07:31.277987 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3253/6436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:31 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:31.296951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:31.296951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:31.299873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:31.307943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.308398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.309521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:31.309688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:31.466252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:31.476657 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea6c2059-a6dc-4850-ae1d-2f15581613a5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1563 microversion: 2.1 time: 0.186263 Jul 18 03:07:31.477306 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3184/6437] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:31 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:33.768618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:33.771174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:33.772724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:33.773419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b2a73b39-3a5b-4819-9a25-ed2f575b1d73 req-25c139ca-b8ff-4a5f-87c4-7d35b30d54cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:33.780076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:33.781433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:33.781433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:33.781827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:33.790232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2a73b39-3a5b-4819-9a25-ed2f575b1d73 req-25c139ca-b8ff-4a5f-87c4-7d35b30d54cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:33.790732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b2a73b39-3a5b-4819-9a25-ed2f575b1d73 req-25c139ca-b8ff-4a5f-87c4-7d35b30d54cb service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:33.808085 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b2a73b39-3a5b-4819-9a25-ed2f575b1d73 req-25c139ca-b8ff-4a5f-87c4-7d35b30d54cb service nova] Creating event network-changed:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:07:33.814565 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b2a73b39-3a5b-4819-9a25-ed2f575b1d73 req-25c139ca-b8ff-4a5f-87c4-7d35b30d54cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Jul 18 03:07:33.815197 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3185/6438] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:34.062440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:34.079013 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ad7f6e3-32a8-4d50-95f6-9d36907c0d98 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1563 microversion: 2.1 time: 0.314981 Jul 18 03:07:34.081098 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3254/6439] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:33 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1563 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:44.154756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:44.155429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=46 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:44.394784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:44.395556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:44.403010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.403487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:44.404529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.405427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:44.446636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:07:44.541096 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27c77da4-5a71-4c6f-8d99-1dd247e2af37 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 204 len: 0 microversion: 2.1 time: 0.388072 Jul 18 03:07:44.544815 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3186/6440] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:07:44 2022] DELETE /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:07:44.561422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:44.563853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:44.568000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:44.569580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=34 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:07:44.576944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.577427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:44.578243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:44.578719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:44.722455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:44.730977 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46064ac5-3ca0-4378-82c6-1ce5ca6788f1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1733 microversion: 2.1 time: 0.184602 Jul 18 03:07:44.731589 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3255/6441] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:44 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:45.752859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:45.754581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:45.763511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:45.764145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:45.765175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:45.765782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:46.014467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6645d8af1e26496db7b9e4d43544a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05317d0245b4b7f982e147c993554c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:07:46.023780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-545ca354-9599-42dc-8241-95e11e39e0c1 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 200 len: 1733 microversion: 2.1 time: 0.278166 Jul 18 03:07:46.024604 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3187/6442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:45 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:07:46.439210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-80c56a41-5140-44e2-af8d-6a00b7b9baca req-da22763f-379e-4ada-8117-a70c0a09066d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a091c676-6162-484b-908c-a51f6ed0979e", "name": "network-vif-deleted", "tag": "b3c386b8-8d83-4eab-991a-9604cf517aa7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:07:46.459611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80c56a41-5140-44e2-af8d-6a00b7b9baca req-da22763f-379e-4ada-8117-a70c0a09066d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:46.460456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80c56a41-5140-44e2-af8d-6a00b7b9baca req-da22763f-379e-4ada-8117-a70c0a09066d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:46.475891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-80c56a41-5140-44e2-af8d-6a00b7b9baca req-da22763f-379e-4ada-8117-a70c0a09066d service nova] Creating event network-vif-deleted:b3c386b8-8d83-4eab-991a-9604cf517aa7 for instance a091c676-6162-484b-908c-a51f6ed0979e on n-h1-849796-1 Jul 18 03:07:46.482761 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-80c56a41-5140-44e2-af8d-6a00b7b9baca req-da22763f-379e-4ada-8117-a70c0a09066d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047173 Jul 18 03:07:46.493549 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3256/6443] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:07:47.042340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:47.043045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:47.050829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.051291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.052093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.052544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.068148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] HTTP exception thrown: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Request method failure captured: Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e HTTP/1.1 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M0MT5rQAHiitzLocXawXybICBtFlwNdxM9Nx9LqS46wcfr87Fk2INR1LRrwQ06jryPM8bAM_uzp6ZP05famivASiGOBZ6ZdoGfR3QfOokhgOmfO9_idtRHXViAn40JdgxbeMErAMNmDK0qURhJxegsJG_8OnyS5WDOIuEzGz5FDgFU Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c05317d0245b4b7f982e147c993554c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 6645d8af1e26496db7b9e4d43544a968 Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a091c676-6162-484b-908c-a51f6ed0979e'} Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.070675 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.075523 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.077150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Returning 404 to user: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:47.078705 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-057d3834-4472-49b4-b4c8-812d65da13b5 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 404 len: 111 microversion: 2.1 time: 0.040484 Jul 18 03:07:47.082845 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3188/6444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:47 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:47.623295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:47.624001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:47.632549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.633187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.634089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.634645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.649156 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] HTTP exception thrown: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Request method failure captured: Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e HTTP/1.1 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M0MT5rQAHiitzLocXawXybICBtFlwNdxM9Nx9LqS46wcfr87Fk2INR1LRrwQ06jryPM8bAM_uzp6ZP05famivASiGOBZ6ZdoGfR3QfOokhgOmfO9_idtRHXViAn40JdgxbeMErAMNmDK0qURhJxegsJG_8OnyS5WDOIuEzGz5FDgFU Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c05317d0245b4b7f982e147c993554c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 6645d8af1e26496db7b9e4d43544a968 Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'a091c676-6162-484b-908c-a51f6ed0979e'} Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:47.651007 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Returning 404 to user: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:47.656880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dba6339-1952-45f7-9ab5-f9cab6020fe3 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 404 len: 111 microversion: 2.1 time: 0.038678 Jul 18 03:07:47.658052 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3257/6445] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:07:47 2022] DELETE /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:07:47.668220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:47.669015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] [instance: a091c676-6162-484b-908c-a51f6ed0979e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:07:47.676465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.677047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.679257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:07:47.679257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:07:47.697268 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] HTTP exception thrown: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Request method failure captured: Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e HTTP/1.1 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M0MT5rQAHiitzLocXawXybICBtFlwNdxM9Nx9LqS46wcfr87Fk2INR1LRrwQ06jryPM8bAM_uzp6ZP05famivASiGOBZ6ZdoGfR3QfOokhgOmfO9_idtRHXViAn40JdgxbeMErAMNmDK0qURhJxegsJG_8OnyS5WDOIuEzGz5FDgFU Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c05317d0245b4b7f982e147c993554c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c05317d0245b4b7f982e147c993554c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: c05317d0245b4b7f982e147c993554c8 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestServerBasicOps-690211050 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 6645d8af1e26496db7b9e4d43544a968 Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestServerBasicOps-690211050-project Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'a091c676-6162-484b-908c-a51f6ed0979e'} Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:07:47.698962 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Returning 404 to user: Instance a091c676-6162-484b-908c-a51f6ed0979e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-32997380-7acf-4672-ab2c-c78e8817060d tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e" status: 404 len: 111 microversion: 2.1 time: 0.038025 Jul 18 03:07:47.703253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3189/6446] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:07:47 2022] GET /compute/v2.1/servers/a091c676-6162-484b-908c-a51f6ed0979e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:07:47.895046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b81e59e6-3420-457b-bd80-ae1c45d96c55 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] Calling method '.version_select at 0x7fab04e1e040>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:07:47.931576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b81e59e6-3420-457b-bd80-ae1c45d96c55 tempest-TestServerBasicOps-690211050 tempest-TestServerBasicOps-690211050-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1614291137" status: 202 len: 0 microversion: 2.1 time: 0.046251 Jul 18 03:07:47.932118 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3258/6447] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Jul 18 03:07:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1614291137 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:08:10.581430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:08:10.582880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:10.586268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:10.589388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:10.609151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:10.610094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:10.611396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:10.612118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:10.692293 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-49be5ae3-54f8-43ae-9e2d-c039b0c83764 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action" status: 200 len: 24561 microversion: 2.1 time: 0.115793 Jul 18 03:08:10.698818 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3190/6448] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:08:10 2022] POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action => generated 24561 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:08:49.667679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=10 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:49.669539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:49.904121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:49.904973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:49.913901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:49.914624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:49.915664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:49.916322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:50.226094 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a1ad2e3-d572-46ee-bfa5-c5e77c3ac3d4 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1833 microversion: 2.1 time: 0.564915 Jul 18 03:08:50.226954 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3259/6449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:49 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1833 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:50.246616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:50.247460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:08:50.408157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:50.408869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:50.418008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:50.418487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:50.419297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:50.419733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:50.639120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:50.647595 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1cde903-4fb6-4eb1-b565-bec79b8867ca tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1682 microversion: 2.1 time: 0.406485 Jul 18 03:08:50.648673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3191/6450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:50 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1682 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:50.746298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:08:50.747930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:50.757074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:50.757781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:50.758841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:50.759291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:50.848553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-55a66937-de5b-420b-955a-4960a786960c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action" status: 200 len: 32637 microversion: 2.1 time: 0.106533 Jul 18 03:08:50.852906 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3260/6451] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:08:50 2022] POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action => generated 32637 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:08:51.005112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:08:51.005881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:51.017926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:51.018497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:51.019389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:51.020161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:51.070048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0160a42e925c477eb53a8f2f7ee9741d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0f538bb3ef4361ad40273ae69f6638', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:51.072962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] flavor_id is None. Assuming migration. {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 18 03:08:51.072962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:08:51.374674 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95aedb91-220c-4e0e-862d-d5cee04799c6 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action" status: 202 len: 0 microversion: 2.1 time: 0.376398 Jul 18 03:08:51.376065 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3192/6452] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:08:50 2022] POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:08:51.384952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:51.385699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:51.394435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:51.394984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:51.397325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:51.397823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:52.056159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:52.066479 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-749b4fbd-e9e8-4020-ad56-095b93821f82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1691 microversion: 2.1 time: 0.685761 Jul 18 03:08:52.068405 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3261/6453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:51 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1691 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:53.090990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:53.092424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:53.104860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:53.105535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:53.106699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:53.107310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:53.303766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:53.315583 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-44928a96-5818-4fd3-a62e-280a75fc594a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1691 microversion: 2.1 time: 0.227229 Jul 18 03:08:53.315583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3193/6454] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:53 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:54.332610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:54.335048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:54.343062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:54.343773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:54.344801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:54.345283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:54.523831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:54.538808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c95ee763-9914-48f6-8a92-26f642356f47 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.210982 Jul 18 03:08:54.539438 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3262/6455] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:54 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:55.562828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:55.564172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:55.571839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:55.572386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:55.573357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:55.573887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:55.736736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:55.745663 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2ba80b5-71d7-4e23-babd-c1977afe6323 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.192837 Jul 18 03:08:55.746546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3194/6456] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:55 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:56.767417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:56.768727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:56.777451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:56.779772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:56.780693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:56.781177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:56.954251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:56.964285 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c05222ba-86d0-4f2b-91ef-d7467ec5ce04 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.203762 Jul 18 03:08:56.971352 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3263/6457] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:56 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:57.982057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:57.983430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:57.990944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:57.991390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:57.992177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:57.992616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:58.188264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:58.196633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a90d9a87-e95c-49ff-9f6c-d8fb0b4bc028 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.218493 Jul 18 03:08:58.197310 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3195/6458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:57 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:08:59.215973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:08:59.216976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:08:59.227015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:59.227647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:59.228513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:08:59.228995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:08:59.419133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:08:59.429459 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8817da73-7738-4cd5-a052-045525690d3d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.218329 Jul 18 03:08:59.430366 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3264/6459] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:08:59 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:00.447672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:00.448484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:00.456994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:00.457491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:00.458937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:00.459321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:00.792088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:00.803454 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca6a0497-8647-424a-8270-8c6a53538731 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.357730 Jul 18 03:09:00.804088 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3196/6460] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:00 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:01.822461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:01.823127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:01.847498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:01.848766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:01.851839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:01.855482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:02.090319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:02.098494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1973f11f-a149-4285-a4eb-c84def601023 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.281250 Jul 18 03:09:02.099486 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3265/6461] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:01 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:03.116517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:03.117348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:03.124443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:03.124892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:03.126002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:03.126448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:03.297230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:03.315443 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cae0f58c-30d6-4f78-b60a-d4a1eb180ee6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.202898 Jul 18 03:09:03.316297 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3197/6462] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:03 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:04.342565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:04.344143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:04.354293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:04.354977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:04.355866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:04.356396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:04.546315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:04.562434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfec8c12-0a26-4e51-aefc-95e7a43c3060 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.226022 Jul 18 03:09:04.563706 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3266/6463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:04 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:05.582228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:05.583108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:05.590962 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:05.591417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:05.592211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:05.592655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:05.785287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:05.796137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cd045eb-6695-40dd-b060-8b8c693cf79b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.217754 Jul 18 03:09:05.799685 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3198/6464] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:05 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:06.815868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:06.818549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:06.826178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:06.826998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:06.828022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:06.828705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:07.004150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:07.013996 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-422bbaa8-1d4e-435b-abcd-ea6ddb6789b2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.201900 Jul 18 03:09:07.016256 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3267/6465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:06 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:08.033779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:08.041339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:08.052338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:08.053206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:08.054073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:08.054765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:08.271438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:08.279919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-159d733b-f59f-4ceb-bd23-44b5a1841182 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.250048 Jul 18 03:09:08.280836 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3199/6466] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:08 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:09.298141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:09.299357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:09.307264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:09.308096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:09.309166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:09.309838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:09.507881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:09.524739 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63ef556d-72be-4830-b019-6cb54a1de5b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.230034 Jul 18 03:09:09.529693 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3268/6467] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:09 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:10.555649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:10.557589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:10.571689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:10.573098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:10.574833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:10.575930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:10.971427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:10.988484 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01c2c691-6f33-4005-b391-c8f94f969284 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1696 microversion: 2.1 time: 0.438019 Jul 18 03:09:11.001426 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3200/6468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:10 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1696 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:12.017309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:12.019135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:12.029917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:12.031062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:12.032117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:12.033099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:12.180616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "name": "network-vif-unplugged", "status": "completed", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:12.192224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:12.192883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:12.224238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] Creating event network-vif-unplugged:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h1-849796-1 Jul 18 03:09:12.250001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] Instance 39072854-06f9-4909-9e9d-9f88f0c3038d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:09:12.282806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:12.294124 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6c8ce1eb-78bc-4716-bd28-a1139b1c9aac req-cb1655fd-cede-48c6-b45e-d3748d817f1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.251108 Jul 18 03:09:12.295137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3201/6469] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:09:12.295470 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5d68a5a-0b50-4f51-8942-084379e1b73c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1695 microversion: 2.1 time: 0.283369 Jul 18 03:09:12.296072 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3269/6470] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:12 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:13.314837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:13.316423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:13.326070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:13.326782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:13.327769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:13.328376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:13.510762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:13.521198 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf5b16ad-cd5f-484c-9e3c-7d35f3dcf45d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1695 microversion: 2.1 time: 0.210682 Jul 18 03:09:13.521737 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3202/6471] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:13 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:14.314613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:14.325303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:14.325844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:14.339239 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] Creating event network-changed:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h1-849796-1 Jul 18 03:09:14.344964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] Instance 39072854-06f9-4909-9e9d-9f88f0c3038d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:09:14.357835 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-68526ba0-9737-491e-a2e2-43b99b041d90 req-3e00b07b-440f-4601-96ea-ebe50adc29a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046791 Jul 18 03:09:14.358706 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3270/6472] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:09:14.539810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:14.541496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:14.564837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:14.565663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:14.566549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:14.567824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:14.740600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:14.750820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e5064716-8649-43df-a5c1-5c6206b792b0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1693 microversion: 2.1 time: 0.215555 Jul 18 03:09:14.753343 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3203/6473] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:14 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1693 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:15.771512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:15.772859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:15.780859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:15.781620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:15.782627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:15.783253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:15.938022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:15.950362 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3379a52-1c98-4404-8188-7d1b856f61b6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1693 microversion: 2.1 time: 0.183848 Jul 18 03:09:15.951348 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3271/6474] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:15 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:16.980481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:16.981053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:16.990711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:16.990711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:16.992250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:16.992250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:17.172838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:17.181734 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35924a58-a3b6-443b-ab5e-58a762625844 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1690 microversion: 2.1 time: 0.208425 Jul 18 03:09:17.182455 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3204/6475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:16 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:17.204560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:17.206567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:17.220166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:17.221026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:17.222465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:17.223571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:17.381350 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a598d11-8a19-4845-900f-ea795275c088 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action" status: 202 len: 0 microversion: 2.1 time: 0.185071 Jul 18 03:09:17.381965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3272/6476] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:09:17 2022] POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:09:17.390851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:17.391467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:17.399557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:17.400082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:17.401370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:17.402102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:17.650387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:17.658996 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dac0dfaa-0bcc-4fbf-996c-a8880b58cefb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.272006 Jul 18 03:09:17.659601 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3205/6477] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:17 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:09:18.677130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:18.677857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:18.701090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:18.701703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:18.702559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:18.703016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:18.960468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:18.969452 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a3dd855-d30f-4c43-967a-4ff1b471be38 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.297394 Jul 18 03:09:18.970440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3273/6478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:18 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:19.990750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:19.991419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:20.003335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:20.003774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:20.005429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:20.005994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:20.011929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:20.223228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:20.250406 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cc251c1-e2cc-480e-8e36-ba91bded317b tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.266022 Jul 18 03:09:20.269115 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3206/6479] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:19 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:21.288155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:21.288852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:21.300635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=35 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:21.303705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:21.304546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:21.305749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:21.306460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:21.312983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:21.656102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:21.666123 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87f7d7eb-0e08-4e43-9fd4-726dd6e6d240 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.382570 Jul 18 03:09:21.674628 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3274/6480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:21 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:21.909376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:21.923156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=35 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:09:21.931990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:21.932825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:21.948247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] Creating event network-changed:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:09:21.954899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] Instance 39072854-06f9-4909-9e9d-9f88f0c3038d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:09:21.983940 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fce175e9-7019-44a0-bfb5-2151f03cab5d req-5a2c94e9-7fea-454e-a239-4ba76df844c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077008 Jul 18 03:09:21.987702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3207/6481] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:09:22.686403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:22.687294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:22.696653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:22.697130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:22.698196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:22.698692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:22.871966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:22.881019 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-834fa996-8142-4622-b1af-1790565cd5bf tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.198775 Jul 18 03:09:22.881629 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3275/6482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:22 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:23.900917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:23.902168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:23.909926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:23.911428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:23.912543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:23.913029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:24.461459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:24.474901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-91d3d85b-3f7f-4650-a9e1-53305d5f8625 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.580376 Jul 18 03:09:24.476352 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3208/6483] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:23 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:25.493201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:25.494001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:25.509809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:25.510867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:25.512177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:25.512908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:25.883656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:25.894533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8ab9e4c8-cc28-4205-a1b6-7601cd3c0770 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1689 microversion: 2.1 time: 0.406528 Jul 18 03:09:25.896347 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3276/6484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:25 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1689 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:09:26.914087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:09:26.914944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:09:26.923025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:26.923473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:26.924473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:26.924975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:27.084818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:09:27.093238 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-859531f1-8031-43cd-891f-f152abfa9781 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1682 microversion: 2.1 time: 0.183969 Jul 18 03:09:27.093949 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3209/6485] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:09:26 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:09:27.695378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-80848cd6-a0c2-4680-a564-17364c7516da req-dc1ebece-1624-441f-8442-432ca0d12e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "name": "network-vif-plugged", "status": "completed", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:09:27.703836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80848cd6-a0c2-4680-a564-17364c7516da req-dc1ebece-1624-441f-8442-432ca0d12e9f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:09:27.704281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80848cd6-a0c2-4680-a564-17364c7516da req-dc1ebece-1624-441f-8442-432ca0d12e9f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:09:27.719030 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-80848cd6-a0c2-4680-a564-17364c7516da req-dc1ebece-1624-441f-8442-432ca0d12e9f service nova] Creating event network-vif-plugged:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:09:27.725158 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-80848cd6-a0c2-4680-a564-17364c7516da req-dc1ebece-1624-441f-8442-432ca0d12e9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143726 Jul 18 03:09:27.726114 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3277/6486] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:10:03.397494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:03.398519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:03.401186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=5 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:03.401926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=20 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:03.408463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:03.409219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:03.411151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:03.411600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:03.481019 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93a80172-eb59-4573-af0f-b06a91b89445 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action" status: 200 len: 63016 microversion: 2.1 time: 0.088025 Jul 18 03:10:03.482873 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3210/6487] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:10:03 2022] POST /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d/action => generated 63016 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:10:16.873949 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:10:16.874564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=7 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:16.875353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=19 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:16.881053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3428d4e6-1fac-4a72-a204-f228803cc232 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Action: 'create', calling method: .version_select at 0x7fab0a74f670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1918966322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaAbgm2qot0WV6fXk7cWT3jKRYHf62g5EB+2T/Q+9UnYTs9r5F0p6OiClYh4Z7kXgoMcRqAW7cSu5pcsScRQ83a0u1rMcKxxok4juu610n6xMrtnOF74gqtJUX+MawqEg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:16.905176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3428d4e6-1fac-4a72-a204-f228803cc232 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Getting quotas for project 1c9bb21d93bb43d59300e8dd21433c01. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:10:16.912090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3428d4e6-1fac-4a72-a204-f228803cc232 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Getting quotas for user 82d0303cb2f84eb8a51d2d5806a81fa9 and project 1c9bb21d93bb43d59300e8dd21433c01. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:10:16.947305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3428d4e6-1fac-4a72-a204-f228803cc232 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.074995 Jul 18 03:10:16.953884 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3278/6488] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:10:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:18.342536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1532974984", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "71678eb2-14cd-4cc4-8557-555c00409b55", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1918966322", "security_groups": [{"name": "tempest-secgroup-smoke-1102685943"}], "networks": [{"uuid": "67559f90-324a-4a85-beb0-3a0e685ec68c"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:18.359103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:18.360359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:18.498753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] validate_networks() for [('67559f90-324a-4a85-beb0-3a0e685ec68c', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:10:19.197265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:10:19.198020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:10:19.198857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:10:19.199671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:10:19.200440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:10:19.221621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.223392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:19.225317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:19.226107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:19.270856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Getting quotas for project 1c9bb21d93bb43d59300e8dd21433c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:10:19.278799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Getting quotas for user 82d0303cb2f84eb8a51d2d5806a81fa9 and project 1c9bb21d93bb43d59300e8dd21433c01. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:10:19.354893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:10:19.357351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71678eb2-14cd-4cc4-8557-555c00409b55',volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:10:19.501496 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f86c5ca0-4cd5-48bd-9eed-bffa37cbbf66 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.166831 Jul 18 03:10:19.502625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3211/6489] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:10:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:10:19.514376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cc572283-67e7-4e16-8664-11b5755544c4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:19.515233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cc572283-67e7-4e16-8664-11b5755544c4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:19.531789 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 46860. Jul 18 03:10:19.590107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cc572283-67e7-4e16-8664-11b5755544c4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:19.600210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cc572283-67e7-4e16-8664-11b5755544c4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1099 microversion: 2.1 time: 0.090736 Jul 18 03:10:19.601109 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3279/6490] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:19 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1099 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:20.620348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:20.621126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:20.631649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:20.632583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:20.633960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:20.634895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:20.728104 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:20.737157 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e5de3bf-788f-48c8-924a-1d3813970936 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1215 microversion: 2.1 time: 0.121695 Jul 18 03:10:20.738532 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3212/6491] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:20 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:21.757026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:21.758037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:21.782202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:21.783528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:21.785980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:21.787227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:22.079271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:22.089051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0181479e-2e40-43cf-816f-fa43e98e04f5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.337166 Jul 18 03:10:22.090497 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3280/6492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:21 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:23.116270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:23.120028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:23.138491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3f2436ae-efd1-43f1-960b-7769c10e89c4 req-1b319779-afd2-4d3d-aaa8-19b6df9717ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "869fd7cd-2d8b-442e-9c1b-8c7eaaa4bba6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:23.143088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:23.143933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:23.146954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:23.148013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:23.148719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3f2436ae-efd1-43f1-960b-7769c10e89c4 req-1b319779-afd2-4d3d-aaa8-19b6df9717ce service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:23.149379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3f2436ae-efd1-43f1-960b-7769c10e89c4 req-1b319779-afd2-4d3d-aaa8-19b6df9717ce service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:23.163831 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3f2436ae-efd1-43f1-960b-7769c10e89c4 req-1b319779-afd2-4d3d-aaa8-19b6df9717ce service nova] Creating event network-changed:869fd7cd-2d8b-442e-9c1b-8c7eaaa4bba6 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h1-849796-1 Jul 18 03:10:23.183950 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3f2436ae-efd1-43f1-960b-7769c10e89c4 req-1b319779-afd2-4d3d-aaa8-19b6df9717ce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127339 Jul 18 03:10:23.188470 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3213/6493] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:23.338424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:23.349364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f123642d-354b-4409-bfce-376835b7d801 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.244856 Jul 18 03:10:23.350095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3281/6494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:23 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:24.370321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:24.371661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:24.382702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:24.383375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:24.384544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:24.385248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:24.568027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:24.576816 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b0d9a98-0410-4264-9220-1e2467191ca8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.212117 Jul 18 03:10:24.577461 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3214/6495] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:24 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:25.595809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:25.598162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:25.606819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:25.607293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:25.608199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:25.608659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:25.804696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:25.818892 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-903ca212-a01c-4d22-8f8b-643072b0b07d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.227798 Jul 18 03:10:25.819926 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3282/6496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:25 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:26.223685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:26.224989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:26.239041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:26.240253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:26.242059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:26.242818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:26.439612 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a9a5033-2383-4147-885d-4b9f9fbc1ccc tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1833 microversion: 2.1 time: 0.221074 Jul 18 03:10:26.442075 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3215/6497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:26 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1833 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:26.838041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:26.838851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:26.847925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:26.848403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:26.849444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:26.850072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:27.055135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:27.079236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-14c38383-13a9-41a8-ba81-d4a6d48cf67f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.245958 Jul 18 03:10:27.104274 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3283/6498] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:26 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:27.797753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:27.798293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:27.799182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ee2941bc-695a-42e9-b2a7-881c8d0d8a55 req-85f522ab-b085-4f05-813e-86975542cc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:27.809771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee2941bc-695a-42e9-b2a7-881c8d0d8a55 req-85f522ab-b085-4f05-813e-86975542cc3a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:27.810324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee2941bc-695a-42e9-b2a7-881c8d0d8a55 req-85f522ab-b085-4f05-813e-86975542cc3a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:27.823673 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ee2941bc-695a-42e9-b2a7-881c8d0d8a55 req-85f522ab-b085-4f05-813e-86975542cc3a service nova] Creating event network-changed:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:10:27.823902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:27.824173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:27.825010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:27.825456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:27.829751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ee2941bc-695a-42e9-b2a7-881c8d0d8a55 req-85f522ab-b085-4f05-813e-86975542cc3a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034958 Jul 18 03:10:27.836433 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3284/6499] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:10:27.890019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:10:28.101863 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-849cd3b5-f80d-4179-a655-9101350caa66 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 204 len: 0 microversion: 2.1 time: 0.308056 Jul 18 03:10:28.103333 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3216/6500] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:10:27 2022] DELETE /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:10:28.117115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:28.124430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:28.132436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:28.136994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:28.142463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:28.144050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:28.152607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:28.153101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:28.158496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:28.160002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:28.161358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:28.162987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:28.432897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:28.455573 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1721deb8-9b56-473d-b242-e34e53131d27 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1688 microversion: 2.1 time: 0.344688 Jul 18 03:10:28.457414 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3217/6501] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:28 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:28.459134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:28.476973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34ce7bc1-0404-4267-85e5-ef30eda50cd4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.369632 Jul 18 03:10:28.477905 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3285/6502] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:28 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:29.488530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:29.489546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:29.503627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:29.504692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:29.509568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:29.510509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:29.516986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:29.517720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:29.519894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:29.520573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:29.524163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:29.524866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:29.525861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:29.530149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:29.598675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:29.845305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:29.857512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7a194d2-a228-4753-84bf-85f8166f6675 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1688 microversion: 2.1 time: 0.377995 Jul 18 03:10:29.869624 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3218/6503] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:29 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1688 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:30.342843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:30.353891 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0357bcf3-bc90-41d0-b28b-3c7fe0e126b8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.855565 Jul 18 03:10:30.365014 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3286/6504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:29 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:30.876964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:30.879178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:30.888509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:30.890447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:30.893771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:30.894649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:31.152780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:31.164371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8aa0c52a-db7c-4908-9986-d0bda991ea45 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 200 len: 1688 microversion: 2.1 time: 0.291440 Jul 18 03:10:31.165936 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3219/6505] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:30 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:31.376330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:31.377995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:31.394500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:31.394500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:31.395451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:31.395928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:31.709895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:31.719368 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8788f11-2515-4546-b662-d02776204708 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.350507 Jul 18 03:10:31.720480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3287/6506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:31 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:31.853758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d2859bfb-25f8-4c7c-93da-6470e0816906 req-4d299182-6926-429f-b416-5f3e50ad92d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39072854-06f9-4909-9e9d-9f88f0c3038d", "name": "network-vif-deleted", "tag": "96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:31.875246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d2859bfb-25f8-4c7c-93da-6470e0816906 req-4d299182-6926-429f-b416-5f3e50ad92d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:31.876112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d2859bfb-25f8-4c7c-93da-6470e0816906 req-4d299182-6926-429f-b416-5f3e50ad92d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:31.901880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d2859bfb-25f8-4c7c-93da-6470e0816906 req-4d299182-6926-429f-b416-5f3e50ad92d2 service nova] Creating event network-vif-deleted:96f4bdad-f9b1-4b14-b42e-7ce1a45b0df3 for instance 39072854-06f9-4909-9e9d-9f88f0c3038d on n-h2-849796-1 Jul 18 03:10:31.909784 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d2859bfb-25f8-4c7c-93da-6470e0816906 req-4d299182-6926-429f-b416-5f3e50ad92d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281423 Jul 18 03:10:31.911270 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3220/6507] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:32.186886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:32.187509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: 39072854-06f9-4909-9e9d-9f88f0c3038d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:32.199377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:32.201040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:32.201870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:32.202317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:32.220344 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] HTTP exception thrown: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Request method failure captured: Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d HTTP/1.1 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M2MvS_5yiFLlV5A0nJ4kWpt7ocUMzhl_AKiGqaO3XsS0BNPM92yExuRorJppWhkkeCN5ZJpWAvwE5ygF1J40ToOMCjUlKLMJ60OlFrn_gTJN1yXHK-zhYDEnl3NaRyS2ViGL_CRsjIjRKVaqDOb6Q5sUfV5z55XgAst1erIvLhzOLg Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0d0b369cbbf14f7695c1c2a69e174c85 Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '39072854-06f9-4909-9e9d-9f88f0c3038d'} Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:10:32.223048 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. Jul 18 03:10:32.231648 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:10:32.234405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Returning 404 to user: Instance 39072854-06f9-4909-9e9d-9f88f0c3038d could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:10:32.235759 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c860fb75-6f3c-4bc6-baf6-937d0adb3690 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d" status: 404 len: 111 microversion: 2.1 time: 0.056824 Jul 18 03:10:32.242640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3288/6508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:32 2022] GET /compute/v2.1/servers/39072854-06f9-4909-9e9d-9f88f0c3038d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:10:32.744089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:32.748299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:32.772007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:32.772478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:32.773329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:32.773886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:33.073282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:33.094081 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-abdccb01-8e8f-4bc7-918e-f91004285fe1 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.359112 Jul 18 03:10:33.097003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3221/6509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:32 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:34.113593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:34.115109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:34.122597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:34.123171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:34.124163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:34.124614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:34.352698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:34.365586 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-306e75bb-5d7b-4e2b-8da3-7d002c8a1bf6 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1215 microversion: 2.1 time: 0.257066 Jul 18 03:10:34.366193 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3289/6510] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:34 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:34.853141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e4e49eee-5113-474a-96a0-59637c400e78 req-c0780509-ad08-45f4-81c3-4dd42bef707a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "name": "network-vif-deleted", "tag": "869fd7cd-2d8b-442e-9c1b-8c7eaaa4bba6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:34.870362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e4e49eee-5113-474a-96a0-59637c400e78 req-c0780509-ad08-45f4-81c3-4dd42bef707a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:34.871418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e4e49eee-5113-474a-96a0-59637c400e78 req-c0780509-ad08-45f4-81c3-4dd42bef707a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:34.891591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_external_events [req-e4e49eee-5113-474a-96a0-59637c400e78 req-c0780509-ad08-45f4-81c3-4dd42bef707a service nova] Unable to find a host for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2. Dropping event network-vif-deleted {{(pid=119440) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 03:10:34.892871 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e4e49eee-5113-474a-96a0-59637c400e78 req-c0780509-ad08-45f4-81c3-4dd42bef707a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043778 Jul 18 03:10:34.894474 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3222/6511] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 03:10:35.397004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:35.398965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:35.426313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:35.427560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:35.428648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:35.429336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:35.534901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:35.549852 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-241d0ac9-2eb8-42a7-b546-06afe6ab943c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1145 microversion: 2.1 time: 0.162435 Jul 18 03:10:35.559580 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3290/6512] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:35 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1145 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:36.567671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:36.568676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:36.590990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:36.591465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:36.592286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:36.595099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:36.755257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:36.769803 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c0123ac-6242-4346-a869-eac6d93fbcf9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1141 microversion: 2.1 time: 0.206955 Jul 18 03:10:36.770401 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3223/6513] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:36 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1141 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:37.788528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:37.789356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:37.797323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:37.798173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:37.804311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:37.805066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:37.901161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:37.915455 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3b4dafe2-cadf-45b0-92fa-7a9fa6033470 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1215 microversion: 2.1 time: 0.131412 Jul 18 03:10:37.919671 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3291/6514] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:37 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:38.386468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22aa913a-a656-4f68-83b9-fd135c8ca1fa tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '.version_select at 0x7faaf74c7ca0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:38.424326 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22aa913a-a656-4f68-83b9-fd135c8ca1fa tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304913508" status: 202 len: 0 microversion: 2.1 time: 0.041742 Jul 18 03:10:38.426281 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3224/6515] 10.222.0.67 () {58 vars in 1283 bytes} [Mon Jul 18 03:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1304913508 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:10:38.508622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3147a8fa-05a2-43eb-bc03-705f8da65f85 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: .version_select at 0x7fab04af2b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1293789667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9u2xxopj8zfVpsrZgnXNVqbjS6enmyE0M5myjq0IKNnkxaU3G982tuLFb5t7OHolJvPV95jhT5+dtioWC1KNgVsE5N6vBEOs8Ct7dIxxcokeO78WtAibnZu7URNvoVIg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:38.545327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3147a8fa-05a2-43eb-bc03-705f8da65f85 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:10:38.575185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-3147a8fa-05a2-43eb-bc03-705f8da65f85 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:10:38.680508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3147a8fa-05a2-43eb-bc03-705f8da65f85 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.185677 Jul 18 03:10:38.682407 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3292/6516] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:10:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:38.944468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:38.945468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:38.959946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:38.970233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:38.971318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:38.972582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:39.334402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:39.344480 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ddf28a9d-002d-4424-b2d9-ca90dd73f837 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.406194 Jul 18 03:10:39.354856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3225/6517] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:38 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:40.369107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:40.370326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:40.398972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:40.402408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:40.402408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:40.402408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:40.710398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2446dc95-2d5d-4c56-a4f1-f47c975ff9e7 req-9df1adf8-8339-4c31-ba19-e960e4297dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:40.747760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2446dc95-2d5d-4c56-a4f1-f47c975ff9e7 req-9df1adf8-8339-4c31-ba19-e960e4297dc6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:40.748545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2446dc95-2d5d-4c56-a4f1-f47c975ff9e7 req-9df1adf8-8339-4c31-ba19-e960e4297dc6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:40.771806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:40.824321 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ccb2cfe4-c04c-478a-b2b0-99743fc358e9 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.464337 Jul 18 03:10:40.839228 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3293/6518] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:40 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:40.845989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2446dc95-2d5d-4c56-a4f1-f47c975ff9e7 req-9df1adf8-8339-4c31-ba19-e960e4297dc6 service nova] Creating event network-changed:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:10:40.870215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2446dc95-2d5d-4c56-a4f1-f47c975ff9e7 req-9df1adf8-8339-4c31-ba19-e960e4297dc6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164481 Jul 18 03:10:40.872857 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3226/6519] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:41.867809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:41.874255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:41.898958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:41.900215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:41.902771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:41.907926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:42.320053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:42.335245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8218ecea-8dbf-43c0-a85d-576de9467763 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.490653 Jul 18 03:10:42.336878 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3294/6520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:41 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:43.359203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:43.360479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:43.378194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:43.379022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:43.380357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:43.381746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:43.611472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:43.630310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c536679b-2aa8-47dd-81c2-045232278847 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1283 microversion: 2.1 time: 0.278786 Jul 18 03:10:43.631820 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3227/6521] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:43 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1283 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:44.653355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:44.655927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:44.664653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:44.666862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:44.668793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:44.669511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:44.899743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:44.909660 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59fff3d5-f700-404e-99bb-e1e0f99778e4 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.261826 Jul 18 03:10:44.910593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3295/6522] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:44 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:45.932802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:45.933672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:45.941789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:45.942361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:45.943254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:45.944039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:46.519404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:46.528407 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71efebbf-6c43-4d44-b744-d691813ff9b0 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.601507 Jul 18 03:10:46.532114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3228/6523] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:45 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:47.555500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:47.558194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:47.568014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:47.586639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:47.587854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:47.588908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:47.589388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:47.602511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=83 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:47.909360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:47.922405 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7da5e68-26ce-4e03-900c-91214187ba4a tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.366201 Jul 18 03:10:47.922841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3296/6524] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:47 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:48.095412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-692112141", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "e3991728-7d00-425c-b9a3-a9a040e09338"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1293789667", "security_groups": [{"name": "tempest-secgroup-smoke-940289118"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:48.244029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] validate_networks() for [('e3991728-7d00-425c-b9a3-a9a040e09338', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:10:48.537878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:48.928096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:10:48.930896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:10:48.932966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:10:48.933410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:10:48.934367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:10:48.945055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:48.946315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:48.951000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:48.959688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:48.960593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:48.961687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:48.962849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:48.966306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:48.967935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:48.971765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:48.980632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:48.993688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:49.065476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:10:49.081545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:10:49.110349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:10:49.115485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:10:49.194514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04168a4b-e02e-4065-9a85-6b555e2007f7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.104497 Jul 18 03:10:49.196156 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3229/6525] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:10:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:10:49.207617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:49.208520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e4cf7a4-b410-4d33-94b2-79eb8beb08e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:49.210440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e4cf7a4-b410-4d33-94b2-79eb8beb08e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:49.216579 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-845a0305-ca18-4dfa-88a7-763ad962326f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.276840 Jul 18 03:10:49.217217 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3297/6526] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:48 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:49.361319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e4cf7a4-b410-4d33-94b2-79eb8beb08e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:49.382540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e4cf7a4-b410-4d33-94b2-79eb8beb08e7 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1266 microversion: 2.1 time: 0.179202 Jul 18 03:10:49.391673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3230/6527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:49 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:50.234709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:50.235952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:50.244323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:50.245178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:50.246162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:50.246781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:50.402340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:50.402957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:50.412599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:50.413163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:50.413982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:50.414431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:50.471742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:50.490589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a8d5143-facb-4000-8a57-b14b40a17b6e tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.259168 Jul 18 03:10:50.492111 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3298/6528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:50 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:50.541012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:50.552554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-757be4ec-525e-4c75-b1b0-c2596f165038 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1262 microversion: 2.1 time: 0.154041 Jul 18 03:10:50.554679 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3231/6529] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:50 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:51.508251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:51.509245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:51.522370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:51.523645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:51.524750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:51.525236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:51.580490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:51.582578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:51.590838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:51.591292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:51.592783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:51.593266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:51.665231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:51.673962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2cefaf46-a32c-4c63-9001-ed7aa233c95c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1326 microversion: 2.1 time: 0.097648 Jul 18 03:10:51.674910 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3232/6530] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:51 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:51.693266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:51.703941 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cacac964-9d87-4860-aa4a-1a074af03cfb tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.198063 Jul 18 03:10:51.704567 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3299/6531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:51 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:52.694896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:52.696059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:52.707785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:52.708533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:52.709820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:52.711409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:52.756800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:52.763541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:52.790557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:52.792384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:52.794116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:52.795183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:52.800556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:52.813178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-54fe1259-b9a9-4b94-a43c-ef3e8cf4bdd3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1324 microversion: 2.1 time: 0.124843 Jul 18 03:10:52.817478 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3233/6532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:52 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1324 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:53.045258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:53.055639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-942e614a-6994-46e8-806f-ff7feeac596f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.336385 Jul 18 03:10:53.056562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3300/6533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:52 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:53.832074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:53.833639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:53.851463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:53.852090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:53.852900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:53.853581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:54.046411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a4c3e67b-7b96-4908-8412-0d1512e4fc64 req-6989c23e-021e-49d0-a6f6-cd710fdad7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:54.060220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a4c3e67b-7b96-4908-8412-0d1512e4fc64 req-6989c23e-021e-49d0-a6f6-cd710fdad7cf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:54.061009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a4c3e67b-7b96-4908-8412-0d1512e4fc64 req-6989c23e-021e-49d0-a6f6-cd710fdad7cf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:54.075379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:54.085966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4dcb603-6d1c-4e29-abcb-fca4f76ca92c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.258626 Jul 18 03:10:54.087152 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3234/6534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:53 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:54.093073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:54.093971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:54.097862 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a4c3e67b-7b96-4908-8412-0d1512e4fc64 req-6989c23e-021e-49d0-a6f6-cd710fdad7cf service nova] Creating event network-changed:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:10:54.101500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:54.102319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:54.103387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:54.104977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:54.117578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a4c3e67b-7b96-4908-8412-0d1512e4fc64 req-6989c23e-021e-49d0-a6f6-cd710fdad7cf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077707 Jul 18 03:10:54.119136 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3301/6535] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:54.307679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:54.317335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3036abd0-a030-4476-ae24-2f6b714082ea tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.228164 Jul 18 03:10:54.318209 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3235/6536] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:54 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:54.420737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-29446df1-6e72-471a-8c2d-5daf7c01276b req-dfd19107-ecb0-4308-b5b8-20b442c2c16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "name": "network-vif-plugged", "status": "completed", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:10:54.431160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-29446df1-6e72-471a-8c2d-5daf7c01276b req-dfd19107-ecb0-4308-b5b8-20b442c2c16c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:54.431621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-29446df1-6e72-471a-8c2d-5daf7c01276b req-dfd19107-ecb0-4308-b5b8-20b442c2c16c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:54.445220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-29446df1-6e72-471a-8c2d-5daf7c01276b req-dfd19107-ecb0-4308-b5b8-20b442c2c16c service nova] Creating event network-vif-plugged:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:10:54.450506 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-29446df1-6e72-471a-8c2d-5daf7c01276b req-dfd19107-ecb0-4308-b5b8-20b442c2c16c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101373 Jul 18 03:10:54.451106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3302/6537] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:10:55.108656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:55.110591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:55.121581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:55.122335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:55.123150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:55.123637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:55.276852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:55.285871 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-330bf4ed-af44-449e-8810-91fcfa240b92 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.185192 Jul 18 03:10:55.286500 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3236/6538] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:55 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:55.336976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:55.337694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:55.344540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:55.345041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:55.345834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:55.347562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:55.499329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:55.507776 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd209ea3-3928-40a6-980a-16a39527c16f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.176642 Jul 18 03:10:55.508371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3303/6539] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:55 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:56.304053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:56.304709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:56.312825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.313308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.314099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.314542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.467218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:56.476364 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ed89ba7-83ed-408e-8009-ca83856c0a1c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.176937 Jul 18 03:10:56.477188 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3237/6540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:56 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:56.527797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:56.528506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:56.538614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.539074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.539912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:56.540344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:56.697102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:56.706639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d5bfee9e-fef6-4d85-b364-79ce748f276d tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.184076 Jul 18 03:10:56.707219 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3304/6541] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:56 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:57.495936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:57.496698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:57.505131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.505392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.506418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.506868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.664722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:57.676408 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ea7e456-2f89-417c-9d3a-ebf7221b3d8e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.183998 Jul 18 03:10:57.677534 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3238/6542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:57 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:57.727292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:57.728276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:57.734693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.735189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.736029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:57.736568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:57.923780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:57.936090 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9ec6724-fbf4-4547-bc96-5b7ac59e1db3 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1271 microversion: 2.1 time: 0.213645 Jul 18 03:10:57.936703 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3305/6543] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:57 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:58.696066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:58.697477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:58.709708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.713911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.717419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.718358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.954982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:58.957150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:58.967830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.968719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.970012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:58.972146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:58.994929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:10:59.050682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:59.063215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9858cb2-d245-4f08-b203-af6d1ffe182d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.371584 Jul 18 03:10:59.076123 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3239/6544] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:58 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:10:59.162535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:59.171042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bdb8e48a-0c68-4970-a43e-6028bd62f865 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1459 microversion: 2.1 time: 0.222276 Jul 18 03:10:59.171794 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3306/6545] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:58 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1459 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:10:59.188882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:10:59.189466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:10:59.197112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:59.197610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:59.198505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:10:59.198958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:10:59.368687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:10:59.378851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-344f5a34-2b66-40f7-a5eb-354d5ba79a89 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1459 microversion: 2.1 time: 0.192753 Jul 18 03:10:59.379837 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3240/6546] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:10:59 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:00.083119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:00.083767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:00.100763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:00.101896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:00.102147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:00.102532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:00.133905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b514aeec-5bfa-4c44-84d1-359bbe3f1d84 req-24c95ce4-b166-485d-8c2b-02d64a99fc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "name": "network-vif-plugged", "status": "completed", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:00.139507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:00.153739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b514aeec-5bfa-4c44-84d1-359bbe3f1d84 req-24c95ce4-b166-485d-8c2b-02d64a99fc7e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:00.155902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b514aeec-5bfa-4c44-84d1-359bbe3f1d84 req-24c95ce4-b166-485d-8c2b-02d64a99fc7e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:00.186910 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b514aeec-5bfa-4c44-84d1-359bbe3f1d84 req-24c95ce4-b166-485d-8c2b-02d64a99fc7e service nova] Creating event network-vif-plugged:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:11:00.196225 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b514aeec-5bfa-4c44-84d1-359bbe3f1d84 req-24c95ce4-b166-485d-8c2b-02d64a99fc7e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066236 Jul 18 03:11:00.197418 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3241/6547] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:11:00.298203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:00.307237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e8dcc37-db33-4124-a7be-35976e551219 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.228643 Jul 18 03:11:00.309011 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3307/6548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:00 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:01.327440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:01.328329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:01.337090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:01.338012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:01.339313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:01.340215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:01.609564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:01.620591 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2476152a-cba1-4c45-9429-01334f8f3854 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1391 microversion: 2.1 time: 0.297835 Jul 18 03:11:01.621225 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3242/6549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:01 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:01.859637 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:11:01.860161 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:11:01.934082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-64afe849-5b04-433a-86ad-e8ead4458060 req-52135f6d-e907-40d4-9ec2-9b27eb80390f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:01.954193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-64afe849-5b04-433a-86ad-e8ead4458060 req-52135f6d-e907-40d4-9ec2-9b27eb80390f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:01.955479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-64afe849-5b04-433a-86ad-e8ead4458060 req-52135f6d-e907-40d4-9ec2-9b27eb80390f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:01.973630 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-64afe849-5b04-433a-86ad-e8ead4458060 req-52135f6d-e907-40d4-9ec2-9b27eb80390f service nova] Creating event network-changed:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:11:01.979974 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-64afe849-5b04-433a-86ad-e8ead4458060 req-52135f6d-e907-40d4-9ec2-9b27eb80390f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049811 Jul 18 03:11:01.981308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3308/6550] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:02.639809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:02.641431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:02.650007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.651178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:02.652250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.653106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:02.946177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:02.954832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3069018b-fb88-4ac3-938a-7e0fbcbad0ab tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1563 microversion: 2.1 time: 0.318907 Jul 18 03:11:02.955764 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3243/6551] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:02 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1563 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:02.974065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:02.974774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:02.982234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.982700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:02.983559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:02.984028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:03.147575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:03.159568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-30882f79-c18c-4441-a325-f15389ade821 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1563 microversion: 2.1 time: 0.190573 Jul 18 03:11:03.160275 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3309/6552] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:02 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:04.007448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}, {"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:04.022903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:04.023706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:04.036989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] Creating event network-changed:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:11:04.037516 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] Creating event network-changed:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:11:04.045004 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6a5fce90-e88a-4bc1-9595-c643b7239421 req-f2793d4f-f1da-4b7c-955e-cf30c1b6e4ce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040420 Jul 18 03:11:04.045927 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3244/6553] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:05.995256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c4252271-9879-4086-9a02-9585955b72e8 req-d73ef080-f9ad-43cd-ad0e-f326518765ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:05.998987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:06.000387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:06.023711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.024170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:06.024988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.025442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:06.031947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c4252271-9879-4086-9a02-9585955b72e8 req-d73ef080-f9ad-43cd-ad0e-f326518765ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:06.035273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c4252271-9879-4086-9a02-9585955b72e8 req-d73ef080-f9ad-43cd-ad0e-f326518765ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:06.054728 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c4252271-9879-4086-9a02-9585955b72e8 req-d73ef080-f9ad-43cd-ad0e-f326518765ff service nova] Creating event network-changed:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:11:06.061187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c4252271-9879-4086-9a02-9585955b72e8 req-d73ef080-f9ad-43cd-ad0e-f326518765ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070500 Jul 18 03:11:06.062254 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3245/6554] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:06.526380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:06.537548 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3935c71e-d824-43c2-a9f1-b27f84f752f6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1563 microversion: 2.1 time: 0.553040 Jul 18 03:11:06.538895 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3310/6555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:05 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1563 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:37.337305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:37.337913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:37.339264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-baae79c8-6c08-4dda-9b07-625d79b77261 req-5ec6e678-f2a2-4bb0-9de7-3c0397bb691c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:37.341516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:37.342195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=79 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:37.348825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:37.349654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=77 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:11:37.351910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-baae79c8-6c08-4dda-9b07-625d79b77261 req-5ec6e678-f2a2-4bb0-9de7-3c0397bb691c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.352648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-baae79c8-6c08-4dda-9b07-625d79b77261 req-5ec6e678-f2a2-4bb0-9de7-3c0397bb691c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.365596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.365807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-baae79c8-6c08-4dda-9b07-625d79b77261 req-5ec6e678-f2a2-4bb0-9de7-3c0397bb691c service nova] Creating event network-changed:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:11:37.366504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.367681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.368487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.372198 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-baae79c8-6c08-4dda-9b07-625d79b77261 req-5ec6e678-f2a2-4bb0-9de7-3c0397bb691c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037101 Jul 18 03:11:37.373494 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3311/6556] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:37.401041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:11:37.502328 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c4edb9b-06bf-448f-bcc7-7684cd977d30 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "DELETE /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 204 len: 0 microversion: 2.1 time: 0.168150 Jul 18 03:11:37.506851 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3246/6557] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:11:37 2022] DELETE /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:11:37.512420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:37.513289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:37.520713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.521469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.522555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:37.523185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:37.739476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:37.747253 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dae7d9fb-80bf-40e7-803a-3feec2996b01 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1584 microversion: 2.1 time: 0.239220 Jul 18 03:11:37.747962 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3312/6558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:37 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1584 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:38.767812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:38.768799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:38.776111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:38.776797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:38.777739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:38.779237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:38.927941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:38.935961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a33dc7b4-ee7e-4d17-8683-1dcd9a877a5c tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1584 microversion: 2.1 time: 0.173023 Jul 18 03:11:38.936662 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3247/6559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:38 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1584 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:39.924419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2ee14356-54ec-4ded-8887-22ff1390d95c req-fd814ee7-5b05-4ae3-a9b4-190c1b6abe9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735eb30e-ba95-42a5-9ac9-52cc3c4e44d2", "name": "network-vif-deleted", "tag": "30c408b1-e4f9-4a55-883a-1018901e5445"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:39.934371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2ee14356-54ec-4ded-8887-22ff1390d95c req-fd814ee7-5b05-4ae3-a9b4-190c1b6abe9d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:39.934850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2ee14356-54ec-4ded-8887-22ff1390d95c req-fd814ee7-5b05-4ae3-a9b4-190c1b6abe9d service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:39.947659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2ee14356-54ec-4ded-8887-22ff1390d95c req-fd814ee7-5b05-4ae3-a9b4-190c1b6abe9d service nova] Creating event network-vif-deleted:30c408b1-e4f9-4a55-883a-1018901e5445 for instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 on n-h2-849796-1 Jul 18 03:11:39.954792 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2ee14356-54ec-4ded-8887-22ff1390d95c req-fd814ee7-5b05-4ae3-a9b4-190c1b6abe9d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Jul 18 03:11:39.955203 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3313/6560] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:11:39.957848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:39.959014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:39.968721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:39.969361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:39.970329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:39.971590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:40.068470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:40.077290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c6dcb62-3cd2-4b83-9189-8b4d9eff4dda tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1230 microversion: 2.1 time: 0.126964 Jul 18 03:11:40.078769 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3248/6561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:39 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:41.097820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:41.098531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:41.108232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:41.109055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:41.109544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:41.109986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:41.189010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:41.203402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40169268-211d-409f-b60c-ae0c33b6c450 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1230 microversion: 2.1 time: 0.111603 Jul 18 03:11:41.204011 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3314/6562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:41 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:42.221485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:42.222198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:42.229166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:42.229614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:42.230391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:42.230968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:42.305079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:42.313659 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-488c1fb5-83d5-4a9b-81c0-c55a57f3d5b5 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1230 microversion: 2.1 time: 0.096455 Jul 18 03:11:42.315122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3249/6563] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:42 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:43.332664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:43.333597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:43.341538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.342097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.342985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.343515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.444674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:43.454992 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-006e3ab0-b876-435c-af9e-b3da2a6f2b1f tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1230 microversion: 2.1 time: 0.126915 Jul 18 03:11:43.464341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3315/6564] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:43 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:11:43.882434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:11:43.884627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:43.892658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.894606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.895459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:43.895914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:43.973040 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33caba70-ec6c-4ff5-9dd8-ea932dbb5381 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action" status: 200 len: 24566 microversion: 2.1 time: 0.094805 Jul 18 03:11:43.974368 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3250/6565] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:11:43 2022] POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action => generated 24566 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:11:44.476369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:44.477121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:44.484032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:44.484496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:44.485323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:44.486314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:44.525759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:44.526289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:44.526761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lazy-loading 'fault' on Instance uuid 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:11:44.575054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0303cb2f84eb8a51d2d5806a81fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9bb21d93bb43d59300e8dd21433c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:11:44.588411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8537314-9b37-4893-82fd-054cb5ed4600 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 200 len: 1235 microversion: 2.1 time: 0.115834 Jul 18 03:11:44.589649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3316/6566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:44 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 1235 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:11:45.616739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:45.617486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] [instance: 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:11:45.625719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:45.626179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:45.627499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:11:45.627940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:11:45.643980 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] HTTP exception thrown: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Request method failure captured: Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 HTTP/1.1 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M6TDshe4a0W0bi3kx3-dROzMhODO5rDc80CpyE0QGJS_xnMODlhW41Nco9UMhGXaVbJ4Wy1WJF1PRcHy7piFgLw08jtG6lwxA5YjQLGYvXApaio8sRHny9jPkux2_-d-Io00jow06UYaRPupFy-Sli0ZYDMrXonqNS8clX-P1krkU4 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 1c9bb21d93bb43d59300e8dd21433c01 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBackupRestore-849337130 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1c9bb21d93bb43d59300e8dd21433c01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1c9bb21d93bb43d59300e8dd21433c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1c9bb21d93bb43d59300e8dd21433c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1c9bb21d93bb43d59300e8dd21433c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBackupRestore-849337130 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 1c9bb21d93bb43d59300e8dd21433c01 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBackupRestore-849337130 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBackupRestore-849337130-project Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 82d0303cb2f84eb8a51d2d5806a81fa9 Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBackupRestore-849337130-project Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '735eb30e-ba95-42a5-9ac9-52cc3c4e44d2'} Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:11:45.645756 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Returning 404 to user: Instance 735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53034d1e-2dfc-4d6c-bd27-8d584621f0d8 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2" status: 404 len: 111 microversion: 2.1 time: 0.034846 Jul 18 03:11:45.650997 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3251/6567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:11:45 2022] GET /compute/v2.1/servers/735eb30e-ba95-42a5-9ac9-52cc3c4e44d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:11:45.819790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4564d40f-50a3-4966-b04f-3c1f7ccff457 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] Calling method '.version_select at 0x7fab055d1a60>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:11:45.843970 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4564d40f-50a3-4966-b04f-3c1f7ccff457 tempest-TestVolumeBackupRestore-849337130 tempest-TestVolumeBackupRestore-849337130-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1918966322" status: 202 len: 0 microversion: 2.1 time: 0.027996 Jul 18 03:11:45.848502 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3317/6568] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 03:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1918966322 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:12:12.584466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:12.585610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:12.852021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-698bba4c-8d6e-4211-a428-052621ce2b81 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Action: 'create', calling method: .version_select at 0x7fab04a84820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-918058328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwe/DhaEjMZPujs8jEKVESFGOlwK/CMmE0IVkTbo0u4I6wDXdkuCLAZTkCT+256aqh59V1M9FA8+/HASBBBbaIQDFhvq2CbLZan9u6MxWJ4ZvD8Fgr3xpdspfYEliES6g=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:12.869566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-698bba4c-8d6e-4211-a428-052621ce2b81 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:12:12.876485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-698bba4c-8d6e-4211-a428-052621ce2b81 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for user 36729ebc27b34ef2a78632acfaf90b3e and project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:12:12.913569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-698bba4c-8d6e-4211-a428-052621ce2b81 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.335614 Jul 18 03:12:12.914780 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3252/6569] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:12:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:14.066769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1021860211", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7d1031a5-ad24-400e-8570-8cd6dc2d61de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:14.077212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=30 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:14.077875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:14.136334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:12:15.490320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:12:15.490903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:12:15.491211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:12:15.491629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:12:15.492045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:12:15.502651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:15.503102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:15.504240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:15.504849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:15.536747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:12:15.546785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:12:15.640130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:12:15.643955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d1031a5-ad24-400e-8570-8cd6dc2d61de',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:12:15.816247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1cba4f76-7e67-4c0b-b1cb-71f92994ff8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760771 Jul 18 03:12:15.817273 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3318/6570] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:12:15.831873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd511ce9-9666-4f4a-a256-0bcf24e0ff16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:15.833527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd511ce9-9666-4f4a-a256-0bcf24e0ff16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:15.930678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd511ce9-9666-4f4a-a256-0bcf24e0ff16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:15.938525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd511ce9-9666-4f4a-a256-0bcf24e0ff16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1057 microversion: 2.1 time: 0.114136 Jul 18 03:12:15.939970 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3253/6571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:15 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1057 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:16.956623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:16.957926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:16.974472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:16.974933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:16.975968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:16.976425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:17.165057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:17.182381 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a41246e-ef59-41f7-9562-fd65454dcfbe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1155 microversion: 2.1 time: 0.230362 Jul 18 03:12:17.185237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3319/6572] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:16 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1155 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:18.205849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:18.209243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:18.236818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:18.237649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:18.238701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:18.239392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:18.346285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:18.358809 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0217315e-cbc0-423e-a1b2-844c1c08590a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1173 microversion: 2.1 time: 0.161302 Jul 18 03:12:18.360110 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3254/6573] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:18 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1173 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:19.378399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:19.379729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:19.397458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:19.397655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:19.398477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:19.398976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:20.270403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:20.284362 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-437a443a-8c80-4bc8-a52e-c6189428cb13 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1215 microversion: 2.1 time: 0.909807 Jul 18 03:12:20.285015 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3320/6574] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:19 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1215 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:21.313731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:21.314893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:21.352632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:21.354979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:21.357071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:21.359472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:21.669928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:21.685505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb1c89ea-d87e-4ee1-be68-d34cacff3c35 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1215 microversion: 2.1 time: 0.384373 Jul 18 03:12:21.686972 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3255/6575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:21 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:21.789557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1400ad95-4256-4bdc-a09b-4562dc5a27bb req-3e39aa41-bc5a-435d-b3be-4075f7ed1a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3beafdec-11d9-4254-bf27-b4b2db447541", "tag": "cde5ea48-9f9e-4362-8bce-cddc348e97b6"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:21.817529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1400ad95-4256-4bdc-a09b-4562dc5a27bb req-3e39aa41-bc5a-435d-b3be-4075f7ed1a01 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:21.818490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1400ad95-4256-4bdc-a09b-4562dc5a27bb req-3e39aa41-bc5a-435d-b3be-4075f7ed1a01 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:21.847150 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1400ad95-4256-4bdc-a09b-4562dc5a27bb req-3e39aa41-bc5a-435d-b3be-4075f7ed1a01 service nova] Creating event network-changed:cde5ea48-9f9e-4362-8bce-cddc348e97b6 for instance 3beafdec-11d9-4254-bf27-b4b2db447541 on n-h2-849796-1 Jul 18 03:12:21.859568 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1400ad95-4256-4bdc-a09b-4562dc5a27bb req-3e39aa41-bc5a-435d-b3be-4075f7ed1a01 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081714 Jul 18 03:12:21.862386 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3321/6576] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:12:22.706407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:22.707167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:22.730938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:22.731412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:22.732227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:22.732675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:22.944735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:22.945514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:22.963063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:22.963533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:22.970485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:22.971335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:23.078017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:23.095386 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28c05070-cc51-4ba4-862b-1c1fa27a0465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1215 microversion: 2.1 time: 0.393975 Jul 18 03:12:23.096173 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3256/6577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:22 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1215 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:23.178911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1208313734-access_point-1998447265", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "2ac6867c-94df-4aff-b7e3-e79037f9d955"}], "key_name": "tempest-TestSecurityGroupsBasicOps-918058328", "security_groups": [{"name": "tempest-secgroup_access--1930076886"}, {"name": "tempest-secgroup_general--2011470815"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:23.446926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:23.458155 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fae49c9c-3822-417d-99b0-279570f85741 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1682 microversion: 2.1 time: 0.518679 Jul 18 03:12:23.459093 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3322/6578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:22 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1682 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:23.470948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] validate_networks() for [('2ac6867c-94df-4aff-b7e3-e79037f9d955', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:12:23.635722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:23.636695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:23.649647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:23.650432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:23.652669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:23.657361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:23.771574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e6c3aaa-0f1a-4317-b99e-a9cf7650ea20 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action" status: 200 len: 32638 microversion: 2.1 time: 0.139025 Jul 18 03:12:23.772529 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3323/6579] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:12:23 2022] POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action => generated 32638 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 03:12:23.951284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:23.952788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:23.961881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:23.962796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:23.964562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:23.966359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.090126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:12:24.091107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:12:24.091906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:12:24.092054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:12:24.092450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:12:24.107082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.108398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.109737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.113164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.143641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:12:24.150283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for user 36729ebc27b34ef2a78632acfaf90b3e and project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:12:24.169653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:12:24.174306 n-d-849796-1 devstack@n-api.service[119440]: WARNING nova.utils [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1208313734-access_point-1998447265 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1208313734-ac Jul 18 03:12:24.176170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:12:24.207242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c785b294-4a90-4670-b9ff-5e5e7e28a799 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1833 microversion: 2.1 time: 0.256973 Jul 18 03:12:24.212231 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3324/6580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:23 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1833 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:24.230913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:24.233531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:24.247904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.251542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.255414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.255954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.301253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2c9d3e0-de4e-498e-ae6a-460f6543e7fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.124952 Jul 18 03:12:24.303144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3257/6581] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:12:23 2022] POST /compute/v2.1/servers => generated 458 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:12:24.308461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:24.309952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:24.318911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.319703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.320681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:24.321969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:24.366777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lazy-loading 'flavor' on Instance uuid e8ae9798-bed8-4641-9d43-0c4a8c04e543 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:12:24.397278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Going to try to live migrate instance to another host {{(pid=119440) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 18 03:12:24.508001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:24.530936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59aaf359-29fc-4758-acb6-d70506d7e745 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1215 microversion: 2.1 time: 0.311961 Jul 18 03:12:24.531611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3325/6582] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:24 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:24.537131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26779ce7-2d2e-45c7-b65d-93c3efd82055 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:24.544124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26779ce7-2d2e-45c7-b65d-93c3efd82055 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:24.676756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26779ce7-2d2e-45c7-b65d-93c3efd82055 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:24.689611 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26779ce7-2d2e-45c7-b65d-93c3efd82055 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1294 microversion: 2.1 time: 0.156286 Jul 18 03:12:24.691470 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3326/6583] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:24 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:25.559952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:25.561157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:25.582169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:25.590592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.592394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.593627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.594417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.841729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:25.850982 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5169d949-9a36-4e42-80ea-af075197b10c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1215 microversion: 2.1 time: 0.304611 Jul 18 03:12:25.854787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3327/6584] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:25 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:25.859226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:25.860619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:25.870834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.871636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.872674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:25.873394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:25.946710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:25.955045 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d3ace4f-65cd-4a55-98d0-f8d6f47c0f99 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1346 microversion: 2.1 time: 0.101952 Jul 18 03:12:25.955662 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3328/6585] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:25 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:26.874330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:26.875070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:26.882474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:26.882934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:26.883735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:26.884185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:27.039998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:27.049697 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-116dd3f7-87c4-4d1b-92c8-e8ce2326f4cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.179282 Jul 18 03:12:27.050319 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3329/6586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:26 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:27.055234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:27.055862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:27.062567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:27.063029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:27.066278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:27.066741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:27.136949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:27.146236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b21561d-d514-45d0-90dc-6f26d2763094 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1346 microversion: 2.1 time: 0.094805 Jul 18 03:12:27.146854 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3330/6587] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:27 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:27.809621 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-609c40fb-4553-4859-884a-031ed2996cfe tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action" status: 202 len: 0 microversion: 2.1 time: 3.504974 Jul 18 03:12:27.815685 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3258/6588] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:12:24 2022] POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action => generated 0 bytes in 3512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:12:27.837219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:27.839378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:27.850142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:27.850637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:27.852180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:27.852966 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.068309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:28.068844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:28.076614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.077442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.078262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.079247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.095226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:28.112169 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38b94521-8221-4fa8-9bbe-d3d616319f51 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.292366 Jul 18 03:12:28.121273 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3331/6589] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:27 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:28.168457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:28.169116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:28.177175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.177631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.178669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:28.179121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:28.276696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:28.291427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0186cf6-cef0-4029-aa43-9211887610fe tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1352 microversion: 2.1 time: 0.129164 Jul 18 03:12:28.292148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3332/6590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:28 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:28.329512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:28.338083 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bba3baf9-8397-4fc9-8d4e-c402190a0b3c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.273983 Jul 18 03:12:28.338991 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3259/6591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:28 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:29.151271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:29.151271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:29.158869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.159431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.172899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.173517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.183234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9dd9de5e-a36c-41dd-a4b3-1d0ca8d34c31 req-a4142d06-1364-456e-98bc-444ea4e28dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bb424e-c424-4a22-bdcd-c8b88f75fbda", "tag": "a7c6a59f-fe40-4c9e-a77f-0d5884f3b409"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:29.208364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9dd9de5e-a36c-41dd-a4b3-1d0ca8d34c31 req-a4142d06-1364-456e-98bc-444ea4e28dc3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.209389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9dd9de5e-a36c-41dd-a4b3-1d0ca8d34c31 req-a4142d06-1364-456e-98bc-444ea4e28dc3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.261331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9dd9de5e-a36c-41dd-a4b3-1d0ca8d34c31 req-a4142d06-1364-456e-98bc-444ea4e28dc3 service nova] Creating event network-changed:a7c6a59f-fe40-4c9e-a77f-0d5884f3b409 for instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda on n-h2-849796-1 Jul 18 03:12:29.290862 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9dd9de5e-a36c-41dd-a4b3-1d0ca8d34c31 req-a4142d06-1364-456e-98bc-444ea4e28dc3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112145 Jul 18 03:12:29.291603 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3260/6592] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:12:29.297526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b8da1983-5692-4ddd-8360-555e434e32ee req-a222b899-27f1-4d72-822f-23d248bba7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "name": "network-vif-unplugged", "status": "completed", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:29.310747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b8da1983-5692-4ddd-8360-555e434e32ee req-a222b899-27f1-4d72-822f-23d248bba7f2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.311645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b8da1983-5692-4ddd-8360-555e434e32ee req-a222b899-27f1-4d72-822f-23d248bba7f2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.339845 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b8da1983-5692-4ddd-8360-555e434e32ee req-a222b899-27f1-4d72-822f-23d248bba7f2 service nova] Creating event network-vif-unplugged:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:12:29.351155 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b8da1983-5692-4ddd-8360-555e434e32ee req-a222b899-27f1-4d72-822f-23d248bba7f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056842 Jul 18 03:12:29.355461 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3261/6593] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:29.367795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:29.369759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:29.381102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.381842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.383151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.383779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.654650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:29.664034 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5d2ff09-0939-42cc-9d00-588c115af960 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.304190 Jul 18 03:12:29.664770 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3262/6594] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:29 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:29.669781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:29.670569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:29.677948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.678703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.679907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:29.680506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:29.869293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:29.885226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66fb3bc0-ceb6-45cd-b014-7c06889b089e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.749406 Jul 18 03:12:29.897016 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3333/6595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:29 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:29.979615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:29.992981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1980a1b5-48c7-4b92-9ea4-2645a675a294 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.326821 Jul 18 03:12:29.993619 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3263/6596] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:29 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:30.682705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:30.683321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:30.694880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.695338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:30.696126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.696579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:30.842765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:30.851985 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-048b9e29-38fb-4f67-84ef-f4b78256e473 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.173342 Jul 18 03:12:30.852588 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3334/6597] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:30 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:30.918844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:30.919462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:30.926491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.926950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:30.927743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:30.928230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.011102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:31.011724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:31.018676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.019144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.019994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.020438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.075787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:31.084410 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-486e57b3-31d4-4c4a-8fc9-aefa5c024b9f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.169462 Jul 18 03:12:31.085136 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3264/6598] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:30 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:31.155443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:31.163789 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-beb94a77-83e0-4f05-8e55-18c4c16718db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.156816 Jul 18 03:12:31.164379 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3335/6599] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:31 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:31.411068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-63c31f47-6d09-4e21-80a3-b7375862a787 req-463a56e7-cc77-47a2-9e76-2916ec8bf11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:31.419298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-63c31f47-6d09-4e21-80a3-b7375862a787 req-463a56e7-cc77-47a2-9e76-2916ec8bf11b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.419748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-63c31f47-6d09-4e21-80a3-b7375862a787 req-463a56e7-cc77-47a2-9e76-2916ec8bf11b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.431226 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-63c31f47-6d09-4e21-80a3-b7375862a787 req-463a56e7-cc77-47a2-9e76-2916ec8bf11b service nova] Creating event network-changed:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:12:31.436018 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-63c31f47-6d09-4e21-80a3-b7375862a787 req-463a56e7-cc77-47a2-9e76-2916ec8bf11b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029232 Jul 18 03:12:31.436601 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3265/6600] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:31.868378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:31.869030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:31.877310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.877767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:31.878558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:31.879005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.023361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:32.030902 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ce439db-996a-4c98-ad95-b9e29e66bc13 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.166637 Jul 18 03:12:32.031488 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3336/6601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:31 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:32.104869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:32.105536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:32.112527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.113012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.113804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.114534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.181068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:32.181702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:32.187946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.188491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.189658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:32.190120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:32.194424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:32.268472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:32.276277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9fbad794-df08-4bc5-935b-efbb85ebe21c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.176544 Jul 18 03:12:32.276867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3266/6602] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:32 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:32.329824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:32.337837 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71e65958-845f-4c99-bba7-99b776812908 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.160979 Jul 18 03:12:32.338415 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3337/6603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:32 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:33.050121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:33.050961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:33.058309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.058998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.059950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.060468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.252689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:33.260840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-40feb5ec-e5fa-4d73-b981-53b486193ceb tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.215383 Jul 18 03:12:33.262255 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3267/6604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:33 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:33.294259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:33.295049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:33.303354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.303816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.304619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.305182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.355951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:33.356707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:33.363896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.364439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.365339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:33.365873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:33.452653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:33.461330 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-afc477bd-a11c-4a06-a331-03be0ccec3ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.170952 Jul 18 03:12:33.461977 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3338/6605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:33 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:33.505237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:33.512834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-36ff2a0b-c035-49b0-a183-c4333a178844 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.161232 Jul 18 03:12:33.513468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3268/6606] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:33 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:34.278084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:34.278707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:34.285250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.285695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.286482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.286930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.478415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:34.479297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:34.485768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:34.486395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:34.494204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.495514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.496324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.496966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.661190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:34.669497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:34.671501 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-872b81f8-d287-4865-bf6a-da47559b781a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.397392 Jul 18 03:12:34.680668 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d7aa23ce-7375-4f66-9c2a-a9c769135509 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.204541 Jul 18 03:12:34.682762 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3269/6607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:34 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:34.683359 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3339/6608] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:34 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:34.689060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:34.690061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:34.697288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.697874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.698905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:34.699857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:34.836145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:34.844130 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cdb6f197-b8d2-44aa-8453-2f008ea9ddd2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.160059 Jul 18 03:12:34.846392 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3270/6609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:34 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.690511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.691237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.695508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:35.701216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.701682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.702302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.702789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.702906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.703109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.710787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.711403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.712565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.713161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.736178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:35.868450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:35.880554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dca33ff2-5e44-4fe4-bc24-55ba59f22e4f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.182969 Jul 18 03:12:35.881396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3271/6610] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.881824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:35.890285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:35.890900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:35.891781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-536688f1-6e89-4f14-8c99-cd727f725968 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.205734 Jul 18 03:12:35.892384 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3340/6611] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:35.898284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.898736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:35.899536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:35.902389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.041345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:36.049751 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0a4b755c-4794-4f47-86ad-576970c6bd4e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.165980 Jul 18 03:12:36.050350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3272/6612] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:35 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:36.748514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d22f8f3e-3563-4005-8543-7b1cbda91458 req-d71822f4-0712-4c39-8551-9a75c90369a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bb424e-c424-4a22-bdcd-c8b88f75fbda", "name": "network-vif-plugged", "status": "completed", "tag": "a7c6a59f-fe40-4c9e-a77f-0d5884f3b409"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:36.759844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d22f8f3e-3563-4005-8543-7b1cbda91458 req-d71822f4-0712-4c39-8551-9a75c90369a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.760419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d22f8f3e-3563-4005-8543-7b1cbda91458 req-d71822f4-0712-4c39-8551-9a75c90369a8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.773494 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d22f8f3e-3563-4005-8543-7b1cbda91458 req-d71822f4-0712-4c39-8551-9a75c90369a8 service nova] Creating event network-vif-plugged:a7c6a59f-fe40-4c9e-a77f-0d5884f3b409 for instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda on n-h2-849796-1 Jul 18 03:12:36.778752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d22f8f3e-3563-4005-8543-7b1cbda91458 req-d71822f4-0712-4c39-8551-9a75c90369a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033913 Jul 18 03:12:36.779380 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3341/6613] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:36.902193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:36.903568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:36.912724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:36.913871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:36.915997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.916561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.917535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.918057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.923789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.924572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:36.925640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:36.926199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:37.083064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:37.091477 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8d1d04ec-63a6-46bb-9611-93856600e874 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.192838 Jul 18 03:12:37.092095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3273/6614] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:36 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:37.097922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:37.098546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:37.105084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:37.105741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:37.106546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:37.107234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:37.127786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:37.135821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b3ebf889-8877-4e5f-94d1-0681d898fbe9 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.229531 Jul 18 03:12:37.136591 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3342/6615] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:36 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:37.260802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:37.269415 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b3da7d43-5a82-4af9-89fe-b060286a2864 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.176220 Jul 18 03:12:37.270122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3274/6616] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:37 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:38.112027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:38.113019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:38.120076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.120539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.121379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.121868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.153449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:38.154064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:38.161484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.161942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.162751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.163192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.275186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:38.287006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6bb5c344-6ee2-4af3-a58b-dbf17d719392 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.180587 Jul 18 03:12:38.287622 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3343/6617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:38 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:38.292331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:38.293131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:38.299493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.299952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.300747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.301225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.317424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:38.325682 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f82d062-9acc-438e-add0-fffe4c291bd4 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1472 microversion: 2.1 time: 0.176326 Jul 18 03:12:38.326283 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3275/6618] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:38 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:38.440243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:38.447903 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f84d282-ae28-438c-ae37-be4953edd28b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.159276 Jul 18 03:12:38.448489 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3344/6619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:38 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:38.801125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3b0ebe7a-db1a-4287-903e-7532ace086d5 req-e3640bc9-070e-4032-92cb-ab12755a7bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beafdec-11d9-4254-bf27-b4b2db447541", "name": "network-vif-plugged", "status": "completed", "tag": "cde5ea48-9f9e-4362-8bce-cddc348e97b6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:38.810149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3b0ebe7a-db1a-4287-903e-7532ace086d5 req-e3640bc9-070e-4032-92cb-ab12755a7bee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:38.810707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3b0ebe7a-db1a-4287-903e-7532ace086d5 req-e3640bc9-070e-4032-92cb-ab12755a7bee service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:38.822887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3b0ebe7a-db1a-4287-903e-7532ace086d5 req-e3640bc9-070e-4032-92cb-ab12755a7bee service nova] Creating event network-vif-plugged:cde5ea48-9f9e-4362-8bce-cddc348e97b6 for instance 3beafdec-11d9-4254-bf27-b4b2db447541 on n-h2-849796-1 Jul 18 03:12:38.827752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3b0ebe7a-db1a-4287-903e-7532ace086d5 req-e3640bc9-070e-4032-92cb-ab12755a7bee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Jul 18 03:12:38.828355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3276/6620] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:39.304795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.305444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.312480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.313708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.314522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.314973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.345906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.346621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.352946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.353410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.354192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.354831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.450689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:39.459316 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c220aff9-f55b-4082-8e74-a40adca9a7df tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.158403 Jul 18 03:12:39.459924 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3345/6621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:39.464580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.465150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.472683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.473177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.473973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.474423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.506863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:39.514804 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-034b1bb4-2289-4db5-8dbb-322b4902e562 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1644 microversion: 2.1 time: 0.174178 Jul 18 03:12:39.515498 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3277/6622] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1644 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:39.531529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.532808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.544273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.544728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.545562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.546002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.621330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:39.629687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c4f3bb3-627f-4d94-a181-13e98ec0566d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.168754 Jul 18 03:12:39.630280 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3346/6623] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:39.693794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:39.701476 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f1990d4f-6256-4c68-81f1-cbdce0398bfd tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1644 microversion: 2.1 time: 0.173947 Jul 18 03:12:39.702071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3278/6624] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1644 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:39.718201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:39.718825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:39.725349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.725809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.726592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:39.727051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:39.974879 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a2824321-7de2-47a7-a4c8-a1af290207ee tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1795 microversion: 2.1 time: 0.260674 Jul 18 03:12:39.975476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3347/6625] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:39 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1795 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:40.476445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:40.477132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:40.484224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.484712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:40.486460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.487015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:40.632234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:40.646962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:40.647570 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9d7c748b-b3e8-4321-ba1b-427b8989f674 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.174645 Jul 18 03:12:40.648634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:40.657881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3279/6626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:40 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:40.659421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.659967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:40.660825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:40.662349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:40.912510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:40.920098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0865724-f8aa-4552-91bc-a2e4b81649fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1203 microversion: 2.1 time: 0.276996 Jul 18 03:12:40.920687 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3348/6627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:40 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:41.664192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:41.665064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:41.672417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:41.672877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:41.673697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:41.674161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:41.818576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:41.826528 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0bc1e61a-7eb6-4e66-874c-d2f4720f5b82 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.166376 Jul 18 03:12:41.827321 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3280/6628] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:41 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:41.938779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:41.939895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:41.949378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:41.949840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:41.950643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:41.951102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.283016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:42.291121 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d31af794-5afb-4921-89ab-556f07e0a486 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1389 microversion: 2.1 time: 0.356969 Jul 18 03:12:42.291727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3349/6629] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:41 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1389 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:42.308153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:42.308813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:42.316438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.317062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.317950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.318429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.355128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-62d53fbf-0054-4e45-8ab3-34bb439eeb6c req-c95b68c5-93b9-4d16-8acd-d6d4b38f9199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "name": "network-vif-unplugged", "status": "completed", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:42.364854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62d53fbf-0054-4e45-8ab3-34bb439eeb6c req-c95b68c5-93b9-4d16-8acd-d6d4b38f9199 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.365420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62d53fbf-0054-4e45-8ab3-34bb439eeb6c req-c95b68c5-93b9-4d16-8acd-d6d4b38f9199 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.377967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-62d53fbf-0054-4e45-8ab3-34bb439eeb6c req-c95b68c5-93b9-4d16-8acd-d6d4b38f9199 service nova] Creating event network-vif-unplugged:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h2-849796-1 Jul 18 03:12:42.384403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-62d53fbf-0054-4e45-8ab3-34bb439eeb6c req-c95b68c5-93b9-4d16-8acd-d6d4b38f9199 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033143 Jul 18 03:12:42.385168 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3350/6630] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:12:42.471248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:42.486975 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04069067-7e61-4e90-839f-c2e0bbac0cf6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1389 microversion: 2.1 time: 0.182770 Jul 18 03:12:42.488622 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3281/6631] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:42 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:42.504416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:42.505171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:42.512275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.512751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.513584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.514034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.803127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:42.814036 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba3b13c2-97e6-4947-9c07-e15c160bb6a8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1389 microversion: 2.1 time: 0.313388 Jul 18 03:12:42.815949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3351/6632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:42 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:42.832837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:42.834179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:42.840481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:42.845776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.846558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.848352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:42.848960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.849112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:42.849941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.864239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.864706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.865544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:42.865999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:42.883060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:12:42.995917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a572524b-dafb-43e0-bffd-8c3a8adb2d4c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 204 len: 0 microversion: 2.1 time: 0.166964 Jul 18 03:12:42.996865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3282/6633] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:12:42 2022] DELETE /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:12:43.007555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:43.008376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:43.018348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:43.018814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:43.019619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:43.020067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:43.179522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:43.187317 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-04013a8a-88e7-40e5-979a-6c1c973c5810 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1395 microversion: 2.1 time: 0.185136 Jul 18 03:12:43.188521 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3283/6634] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:43 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1395 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:43.292809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:43.300877 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4808e953-5631-4205-82a3-b6c3e7677691 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.460594 Jul 18 03:12:43.301511 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3352/6635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:42 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:44.205264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:44.205885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:44.213773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.214250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.215115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.215560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.318386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:44.319012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:44.321840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:44.327448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.327898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.328682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.329961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.428619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:44.442811 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e4bb46c4-e783-4f96-b013-0878fd782c82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1395 microversion: 2.1 time: 0.242192 Jul 18 03:12:44.443610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3284/6636] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:44 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1395 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:44.459107 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e2faad67-82fc-4933-a8f6-662f3fec93dd req-a89f4500-154c-4b3d-815b-ab51c4c1a62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bb424e-c424-4a22-bdcd-c8b88f75fbda", "tag": "a7c6a59f-fe40-4c9e-a77f-0d5884f3b409"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:44.471375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e2faad67-82fc-4933-a8f6-662f3fec93dd req-a89f4500-154c-4b3d-815b-ab51c4c1a62f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:44.472651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e2faad67-82fc-4933-a8f6-662f3fec93dd req-a89f4500-154c-4b3d-815b-ab51c4c1a62f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:44.487698 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e2faad67-82fc-4933-a8f6-662f3fec93dd req-a89f4500-154c-4b3d-815b-ab51c4c1a62f service nova] Creating event network-changed:a7c6a59f-fe40-4c9e-a77f-0d5884f3b409 for instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda on n-h2-849796-1 Jul 18 03:12:44.492806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:44.493367 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e2faad67-82fc-4933-a8f6-662f3fec93dd req-a89f4500-154c-4b3d-815b-ab51c4c1a62f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Jul 18 03:12:44.494179 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3285/6637] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:44.503303 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0bb21d98-cbc7-4dde-87a1-f7a795475021 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1692 microversion: 2.1 time: 0.188913 Jul 18 03:12:44.504471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3353/6638] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:44 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:45.462541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:45.464132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:45.472744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.473601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.474637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.475157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.524426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:45.525639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:45.541812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.542905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.543817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.544430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.730771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:45.741068 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55af27cd-5aa4-4d97-988e-f226c7fcc8dd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1395 microversion: 2.1 time: 0.284280 Jul 18 03:12:45.742105 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3286/6639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:45 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1395 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:45.894404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:45.906463 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3061077e-f862-41dc-958d-9e20df94e514 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1682 microversion: 2.1 time: 0.389005 Jul 18 03:12:45.908501 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3354/6640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:45 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:45.927700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:45.928458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:45.937282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.937741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:45.939400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:45.939949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.106030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:46.116900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d67841af-4753-464b-ba63-c2aab8a2a1d7 tempest-TestNetworkAdvancedServerOps-1472063266 tempest-TestNetworkAdvancedServerOps-1472063266-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1833 microversion: 2.1 time: 0.194061 Jul 18 03:12:46.120965 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3287/6641] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:45 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1833 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:46.135986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:46.136597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:46.144284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.144783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.145619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.146069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.150523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:12:46.292875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:46.301231 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-18902b89-dfac-431f-8916-eb26fdaaf3d0 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1682 microversion: 2.1 time: 0.169083 Jul 18 03:12:46.301825 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3355/6642] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:46 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:46.509536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c078a999-6018-4ec8-aec5-23630e482777 req-a87a42df-3c8f-4cff-aa29-e6c039e5dc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3beafdec-11d9-4254-bf27-b4b2db447541", "name": "network-vif-deleted", "tag": "cde5ea48-9f9e-4362-8bce-cddc348e97b6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:46.521534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c078a999-6018-4ec8-aec5-23630e482777 req-a87a42df-3c8f-4cff-aa29-e6c039e5dc17 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.521870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c078a999-6018-4ec8-aec5-23630e482777 req-a87a42df-3c8f-4cff-aa29-e6c039e5dc17 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.538139 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c078a999-6018-4ec8-aec5-23630e482777 req-a87a42df-3c8f-4cff-aa29-e6c039e5dc17 service nova] Creating event network-vif-deleted:cde5ea48-9f9e-4362-8bce-cddc348e97b6 for instance 3beafdec-11d9-4254-bf27-b4b2db447541 on n-h2-849796-1 Jul 18 03:12:46.543016 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c078a999-6018-4ec8-aec5-23630e482777 req-a87a42df-3c8f-4cff-aa29-e6c039e5dc17 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037494 Jul 18 03:12:46.543699 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3288/6643] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:46.759600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:46.760256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:46.768299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.768753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.769602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:46.770052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:46.835427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:46.843600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9cc23c8-b74c-4d1c-b5eb-b7e59fdb5eeb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1188 microversion: 2.1 time: 0.088040 Jul 18 03:12:46.844189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3356/6644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:46 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:47.864352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:47.865086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:47.871593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:47.872052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:47.872840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:47.873314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:47.938285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:47.946601 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a23e0fb0-b849-4e31-b146-ed400c7b9474 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1188 microversion: 2.1 time: 0.088401 Jul 18 03:12:47.947189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3289/6645] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:47 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:48.407981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:48.409000 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:48.416109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.416573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:48.417436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.417888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:48.475627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-de62239a-1ece-4541-bf00-8ebb9c3fa07e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action" status: 200 len: 38743 microversion: 2.1 time: 0.071703 Jul 18 03:12:48.476616 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3357/6646] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:12:48 2022] POST /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543/action => generated 38743 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:12:48.965305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:48.967378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:48.977175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.978289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:48.979300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:48.979967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.083031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:49.108266 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80721f90-07eb-403f-b3be-2f7acdf7fa50 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1188 microversion: 2.1 time: 0.147753 Jul 18 03:12:49.109668 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3290/6647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:48 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:12:49.902170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f98efb60-4456-469a-8dc5-fcf0c7d3c878 req-7a6c8214-62a8-49ae-81cc-b1d79eda5320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:49.906718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:49.908158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:49.911621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f98efb60-4456-469a-8dc5-fcf0c7d3c878 req-7a6c8214-62a8-49ae-81cc-b1d79eda5320 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:49.912808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f98efb60-4456-469a-8dc5-fcf0c7d3c878 req-7a6c8214-62a8-49ae-81cc-b1d79eda5320 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.922042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:49.923901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.925405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:49.926068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:49.926835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f98efb60-4456-469a-8dc5-fcf0c7d3c878 req-7a6c8214-62a8-49ae-81cc-b1d79eda5320 service nova] Creating event network-changed:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h1-849796-1 Jul 18 03:12:49.935144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f98efb60-4456-469a-8dc5-fcf0c7d3c878 req-7a6c8214-62a8-49ae-81cc-b1d79eda5320 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036299 Jul 18 03:12:49.938865 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3291/6648] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:49.959361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:12:50.087067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9f369b3-dae5-48a0-b48d-19354b4a939e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 204 len: 0 microversion: 2.1 time: 0.190081 Jul 18 03:12:50.090909 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3358/6649] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:12:49 2022] DELETE /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:12:50.097850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:50.099458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:50.114071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.117131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.118286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.120711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.128233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:50.129278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:50.140911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.149710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.150889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:50.151522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:50.232723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:50.242044 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac817c6e-3621-4a59-94d5-434d8bf53bb6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 200 len: 1188 microversion: 2.1 time: 0.119391 Jul 18 03:12:50.252968 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3359/6650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:50 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 1188 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:50.771584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:12:50.779926 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60a84fcf-6076-4315-86e5-1aca91e411fe tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 200 len: 1688 microversion: 2.1 time: 0.687109 Jul 18 03:12:50.785632 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3292/6651] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:50 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 1688 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:12:51.259794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:51.261154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 3beafdec-11d9-4254-bf27-b4b2db447541] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:51.269751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.270218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.271018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.271470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.286849 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 HTTP/1.1 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '3beafdec-11d9-4254-bf27-b4b2db447541'} Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:51.288756 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 3beafdec-11d9-4254-bf27-b4b2db447541 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3768ef30-87ee-4c60-abb2-d560b7f38616 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541" status: 404 len: 111 microversion: 2.1 time: 0.034618 Jul 18 03:12:51.295006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3360/6652] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:51 2022] GET /compute/v2.1/servers/3beafdec-11d9-4254-bf27-b4b2db447541 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:12:51.453008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fe91c979-23b1-4428-9f7d-8f855c29935b req-7491c383-faaf-4f4c-abe0-891589fd3cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ae9798-bed8-4641-9d43-0c4a8c04e543", "name": "network-vif-deleted", "tag": "190d3a08-6d50-496c-bdf7-bbdec24042f6"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:51.468255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fe91c979-23b1-4428-9f7d-8f855c29935b req-7491c383-faaf-4f4c-abe0-891589fd3cfe service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.468715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fe91c979-23b1-4428-9f7d-8f855c29935b req-7491c383-faaf-4f4c-abe0-891589fd3cfe service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.489146 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fe91c979-23b1-4428-9f7d-8f855c29935b req-7491c383-faaf-4f4c-abe0-891589fd3cfe service nova] Creating event network-vif-deleted:190d3a08-6d50-496c-bdf7-bbdec24042f6 for instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 on n-h1-849796-1 Jul 18 03:12:51.495278 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fe91c979-23b1-4428-9f7d-8f855c29935b req-7491c383-faaf-4f4c-abe0-891589fd3cfe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046355 Jul 18 03:12:51.496320 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3293/6653] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:12:51.799041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:51.799674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: e8ae9798-bed8-4641-9d43-0c4a8c04e543] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:12:51.806784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.807529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.808483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:12:51.809114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:12:51.825370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] HTTP exception thrown: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Request method failure captured: Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 HTTP/1.1 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M2MvS_5yiFLlV5A0nJ4kWpt7ocUMzhl_AKiGqaO3XsS0BNPM92yExuRorJppWhkkeCN5ZJpWAvwE5ygF1J40ToOMCjUlKLMJ60OlFrn_gTJN1yXHK-zhYDEnl3NaRyS2ViGL_CRsjIjRKVaqDOb6Q5sUfV5z55XgAst1erIvLhzOLg Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 0d0b369cbbf14f7695c1c2a69e174c85 Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e8ae9798-bed8-4641-9d43-0c4a8c04e543'} Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.827370 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. Jul 18 03:12:51.833456 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:12:51.835157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Returning 404 to user: Instance e8ae9798-bed8-4641-9d43-0c4a8c04e543 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:12:51.836580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-850dd286-1a52-4d23-861d-ab27d10200d6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543" status: 404 len: 111 microversion: 2.1 time: 0.042547 Jul 18 03:12:51.837190 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3361/6654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:12:51 2022] GET /compute/v2.1/servers/e8ae9798-bed8-4641-9d43-0c4a8c04e543 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:12:55.409661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3c4a51b-2fbf-430d-8211-69105cfbfec9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '.version_select at 0x7faaf72b5310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:12:55.458323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3c4a51b-2fbf-430d-8211-69105cfbfec9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1293789667" status: 202 len: 0 microversion: 2.1 time: 0.054360 Jul 18 03:12:55.460302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3294/6655] 10.222.0.67 () {58 vars in 1283 bytes} [Mon Jul 18 03:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1293789667 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:12:55.494608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f101f713-417a-4617-92ff-7020265d1c60 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: .version_select at 0x7fab04684ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1681802277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlLY4JnfHvq3fnpfjyJqQJC0yUuV642QuY6M1n6VuR5coJ9onl9xOMa2S1A3aMR2fOwlM264d9f4QC2K4+hixsmBR8wLDs14LI9sJbZw1RoeluZ1GXgn13qY9qZOJdYDQ=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:12:55.524468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f101f713-417a-4617-92ff-7020265d1c60 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:12:55.530925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f101f713-417a-4617-92ff-7020265d1c60 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:12:55.579986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f101f713-417a-4617-92ff-7020265d1c60 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.082157 Jul 18 03:12:55.585183 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3362/6656] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:12:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:02.307103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-894899837", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "e019dbd4-1109-42ab-a02b-542e45c1d96d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1681802277", "security_groups": [{"name": "tempest-secgroup-smoke-1936853401"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:02.325246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=24 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:02.479041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] validate_networks() for [('e019dbd4-1109-42ab-a02b-542e45c1d96d', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:13:03.132127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:13:03.133041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:13:03.133533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:13:03.133951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:13:03.134381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:13:03.154595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:03.155055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:03.156792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:03.157382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:03.195435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:13:03.204234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Getting quotas for user 0d0b369cbbf14f7695c1c2a69e174c85 and project 303eb0cf44dc4e43a016b79f3e14d8f8. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:13:03.221593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:13:03.224366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:13:03.288592 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d6fd67d6-2097-4fec-843b-954587c5cabb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.985377 Jul 18 03:13:03.292998 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3295/6657] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:13:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:13:03.302118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0f266090-45b3-4517-98ac-dc1065f49395 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:03.302742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0f266090-45b3-4517-98ac-dc1065f49395 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:03.311164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:03.388005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0f266090-45b3-4517-98ac-dc1065f49395 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:03.398083 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0f266090-45b3-4517-98ac-dc1065f49395 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1266 microversion: 2.1 time: 0.102253 Jul 18 03:13:03.398690 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3363/6658] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:03 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:04.425050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:04.431449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:04.443867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:04.444328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:04.445162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:04.447915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:04.546214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:04.555288 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a804ba96-9dd1-4ac7-9b04-2ad79ea766cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1318 microversion: 2.1 time: 0.143797 Jul 18 03:13:04.556217 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3296/6659] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:04 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:05.575902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:05.576401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:05.593202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:05.593667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:05.594659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:05.595114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:06.249970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:06.260101 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8afd3f71-a0e7-4ee9-8122-e259533e05c2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.690175 Jul 18 03:13:06.261080 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3364/6660] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:05 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:06.923193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5ce23497-f5e8-473a-8b3b-ac222e8a4048 req-ef701d40-a097-47da-8fcd-90535fad7169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:06.939282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5ce23497-f5e8-473a-8b3b-ac222e8a4048 req-ef701d40-a097-47da-8fcd-90535fad7169 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:06.941189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5ce23497-f5e8-473a-8b3b-ac222e8a4048 req-ef701d40-a097-47da-8fcd-90535fad7169 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:06.958510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5ce23497-f5e8-473a-8b3b-ac222e8a4048 req-ef701d40-a097-47da-8fcd-90535fad7169 service nova] Creating event network-changed:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:13:06.964712 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5ce23497-f5e8-473a-8b3b-ac222e8a4048 req-ef701d40-a097-47da-8fcd-90535fad7169 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046674 Jul 18 03:13:06.965684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3297/6661] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:07.294527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:07.296627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:07.313325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:07.314267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:07.315357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:07.315933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:07.553557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:07.561580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dfaced72-1672-48a4-b007-728f565480d9 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.276949 Jul 18 03:13:07.564105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3365/6662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:07 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:08.581863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:08.582515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:08.589395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:08.589849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:08.590640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:08.591084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:08.742234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:08.751506 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1157de99-e2ee-4dea-b7be-139436b8af7d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.174588 Jul 18 03:13:08.760767 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3298/6663] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:08 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:09.770534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:09.771304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:09.778805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:09.779263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:09.780055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:09.780503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:09.955980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:09.964205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8ca455b-18e0-40eb-a0a9-02ba2ce90a2a tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.199535 Jul 18 03:13:09.964808 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3366/6664] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:09 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:10.983088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:10.983884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:10.991114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:10.991563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:10.992346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:10.992786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:11.138448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:11.154113 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c3447c05-952b-4032-846d-a0b1f8d5e414 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.174740 Jul 18 03:13:11.155336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3299/6665] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:10 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:12.173337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:12.174178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:12.186107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.186541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.187346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:12.188542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:12.330566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:12.338425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47973264-3349-4290-8de1-6a6d853112cb tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.170126 Jul 18 03:13:12.339392 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3367/6666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:12 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:13.361519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:13.363078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:13.373593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:13.375227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:13.376826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:13.381755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:13.382594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:13.384118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:13.385004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:13.611457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:13.622404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52577348-6674-4bd2-8309-b097374e9053 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.267694 Jul 18 03:13:13.623089 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3300/6667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:13 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:14.639601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:14.640304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:14.643787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:14.644696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:14.651438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.651983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.652792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.654208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.814938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:14.846144 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f0a51b4-d57d-4e6a-907a-671de437bf09 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.210340 Jul 18 03:13:14.850072 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3368/6668] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:14 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:14.858651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d9a02e07-6d92-4411-afc1-8958bea352d5 req-791ad037-f03d-4587-ae27-a8d374d39bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "name": "network-vif-plugged", "status": "completed", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:14.869751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9a02e07-6d92-4411-afc1-8958bea352d5 req-791ad037-f03d-4587-ae27-a8d374d39bbc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:14.870207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d9a02e07-6d92-4411-afc1-8958bea352d5 req-791ad037-f03d-4587-ae27-a8d374d39bbc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:14.885176 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d9a02e07-6d92-4411-afc1-8958bea352d5 req-791ad037-f03d-4587-ae27-a8d374d39bbc service nova] Creating event network-vif-plugged:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:13:14.891504 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d9a02e07-6d92-4411-afc1-8958bea352d5 req-791ad037-f03d-4587-ae27-a8d374d39bbc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036293 Jul 18 03:13:14.892640 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3301/6669] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:13:15.866435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:15.867231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:15.874324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:15.874784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:15.876682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:15.877732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:16.038830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:16.049058 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a93d8fdb-bb19-46f2-b246-862174a354e1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1392 microversion: 2.1 time: 0.186916 Jul 18 03:13:16.049846 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3369/6670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:15 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:17.007018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-943288121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8b281b5f-5cb4-496f-86ca-a0eff9e25997", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:17.066919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:17.067663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:17.074731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.075197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.075992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.076442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.103407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:13:17.229381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:17.238700 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e68c7bae-7d86-4e99-846e-17513879789e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1563 microversion: 2.1 time: 0.176924 Jul 18 03:13:17.239304 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3370/6671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:17 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:17.257058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:17.258063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:17.264793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.265415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.267022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.267616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.410153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:17.419284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd81e527-d92b-4035-b95e-6d61578bab57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1563 microversion: 2.1 time: 0.165920 Jul 18 03:13:17.419805 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3371/6672] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:17 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:17.548551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:13:17.549292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:13:17.550042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:13:17.550724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:13:17.551240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:13:17.561723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.562218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.563268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:17.563832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:17.585080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:13:17.591240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:13:17.608284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:13:17.612766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8b281b5f-5cb4-496f-86ca-a0eff9e25997',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:13:17.701993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ba44b0ef-eb8f-48e3-b687-4083795ed521 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697152 Jul 18 03:13:17.703879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3302/6673] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:13:17.719268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-28033f76-1802-432d-a5d7-a626fd25cec4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:17.720811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-28033f76-1802-432d-a5d7-a626fd25cec4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:17.822496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-28033f76-1802-432d-a5d7-a626fd25cec4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:17.831308 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-28033f76-1802-432d-a5d7-a626fd25cec4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1056 microversion: 2.1 time: 0.119537 Jul 18 03:13:17.831911 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3372/6674] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:17 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1056 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:18.850530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:18.851187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:18.860041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:18.861584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:18.862427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:18.862883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:18.948875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:18.959560 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30116e4f-8fd3-4c03-864d-9db4c39447fb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1116 microversion: 2.1 time: 0.113117 Jul 18 03:13:18.960915 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3303/6675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:18 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1116 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:19.688577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:19.689297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:19.698173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5bb667d1-0901-4e79-81ce-46ad0039265d req-4b8290a8-90a4-4b52-be57-277df1a6b368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:19.698916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:19.699384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:19.700150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:19.700826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:19.716211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5bb667d1-0901-4e79-81ce-46ad0039265d req-4b8290a8-90a4-4b52-be57-277df1a6b368 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:19.717030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5bb667d1-0901-4e79-81ce-46ad0039265d req-4b8290a8-90a4-4b52-be57-277df1a6b368 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:19.742017 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5bb667d1-0901-4e79-81ce-46ad0039265d req-4b8290a8-90a4-4b52-be57-277df1a6b368 service nova] Creating event network-changed:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:13:19.752862 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5bb667d1-0901-4e79-81ce-46ad0039265d req-4b8290a8-90a4-4b52-be57-277df1a6b368 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058026 Jul 18 03:13:19.754225 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3304/6676] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:13:19.979675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:19.981527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:19.991132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:19.991970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:19.993139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:19.993931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:20.008608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:20.028458 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01aee34d-6a88-467f-9bad-811c1c474e75 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1563 microversion: 2.1 time: 0.337328 Jul 18 03:13:20.029467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3373/6677] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:19 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1563 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:20.309653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:20.319713 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5a1d0e3c-1f10-4f65-ad3d-25c3007f6445 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.344174 Jul 18 03:13:20.320705 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3305/6678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:19 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:21.347402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:21.348678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:21.359131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:21.362180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:21.363245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:21.363812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:21.695924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:21.707119 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ab419e3-3e9e-40aa-803c-445f9528c2cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.371741 Jul 18 03:13:21.718550 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3374/6679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:21 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:21.870119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f647165c-11ab-403c-b1fb-9dc39ad46a79 req-2839c51b-0edd-4760-9c60-b3cd262cf3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d924899-c4cf-4c6c-9958-bbf76fd98cea", "tag": "f6b7da3a-0350-4976-a26c-19470ea0ae5e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:21.890466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f647165c-11ab-403c-b1fb-9dc39ad46a79 req-2839c51b-0edd-4760-9c60-b3cd262cf3a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:21.891566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f647165c-11ab-403c-b1fb-9dc39ad46a79 req-2839c51b-0edd-4760-9c60-b3cd262cf3a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:21.912124 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f647165c-11ab-403c-b1fb-9dc39ad46a79 req-2839c51b-0edd-4760-9c60-b3cd262cf3a3 service nova] Creating event network-changed:f6b7da3a-0350-4976-a26c-19470ea0ae5e for instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea on n-h2-849796-1 Jul 18 03:13:21.918153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f647165c-11ab-403c-b1fb-9dc39ad46a79 req-2839c51b-0edd-4760-9c60-b3cd262cf3a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062841 Jul 18 03:13:21.919157 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3306/6680] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:22.729337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:22.730691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:22.741477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:22.742514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:22.743714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:22.744370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:23.055724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:23.065242 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c79cd5f1-a572-4169-bee7-3e58c38d2d97 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.342713 Jul 18 03:13:23.074520 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3375/6681] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:22 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:24.088110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:24.089499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:24.098444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:24.098903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:24.099692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:24.100140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:24.283583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:24.293613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6246d0b9-763d-482d-8998-3c8e214c0bc2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.215114 Jul 18 03:13:24.294211 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3307/6682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:24 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:25.313360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:25.314924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:25.322516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.322965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.323857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:25.324359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:25.521412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:25.537198 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b7a22fde-a4b8-4c58-8769-34ee2b8536c6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.228558 Jul 18 03:13:25.539761 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3376/6683] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:25 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:26.561036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:26.562383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:26.572420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:26.573234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:26.574591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:26.575344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:26.746722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:26.754840 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55000bb7-93eb-4598-8884-6638b53cb9db tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.198180 Jul 18 03:13:26.755462 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3308/6684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:26 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:27.773049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:27.773860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:27.781846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:27.782460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:27.783272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:27.783713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:27.828622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:27.920542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:27.928685 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce931a6f-7a8d-4a56-a239-faa0c8be9993 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.160270 Jul 18 03:13:27.929295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3377/6685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:27 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:28.945861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:28.946502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:28.949515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:28.950201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:28.956691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:28.957175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:28.957965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:28.958408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:29.096478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:29.104191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0b3f712-b1e5-43f3-b43f-d5c946bc6703 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.162284 Jul 18 03:13:29.104774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3309/6686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:28 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:30.121585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:30.123036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:30.130292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:30.130741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:30.131524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:30.131965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:30.283359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:30.291369 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0d9ee6ab-a6d2-4a65-af16-c0995203e27a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.173776 Jul 18 03:13:30.291988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3378/6687] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:30 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:31.308090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:31.308763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:31.316425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:31.316880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:31.317772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:31.318145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:31.455591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:31.465824 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e391b63-3424-40ff-abab-e208632180f6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.161424 Jul 18 03:13:31.466689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3310/6688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:31 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:32.483693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:32.485230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:32.492324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:32.492792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:32.493624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:32.494122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:32.633514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:32.642170 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e0f6e99-7772-4ecd-a22b-ac6804dc4a46 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1168 microversion: 2.1 time: 0.162316 Jul 18 03:13:32.642784 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3379/6689] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:32 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:33.659191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:33.659807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:33.666902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:33.667350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:33.668136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:33.668572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:33.672120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=73 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:33.825523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:33.833409 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-42972a78-417c-4bdc-be27-eaf76838123c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1214 microversion: 2.1 time: 0.178465 Jul 18 03:13:33.834020 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3311/6690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:33 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:34.850655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:34.851253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:34.858214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:34.858664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:34.860076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:34.860650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:34.863240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=91 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:34.996096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:35.004348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d500c970-d8cc-4397-b73f-9531deab69a1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.157630 Jul 18 03:13:35.004937 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3380/6691] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:34 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:36.022731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:36.023338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:36.030347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:36.030804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:36.031829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:36.032273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:36.164620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:36.173539 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce6bab1c-37f6-4064-bc26-d81ca34a7990 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.154641 Jul 18 03:13:36.174137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3312/6692] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:36 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:37.190406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:37.191024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:37.199172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:37.199622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:37.200394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:37.200833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:37.333651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:37.341323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed9bd09f-14ff-4333-a174-0f1755cae0cb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.154838 Jul 18 03:13:37.342166 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3381/6693] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:37 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:38.359127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:38.359887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:38.368585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:38.369079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:38.370173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:38.370906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:38.520282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:38.528088 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd05efb1-e410-424a-9c70-07cb8843b83a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.172964 Jul 18 03:13:38.528973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3313/6694] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:38 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:39.544736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:39.545495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:39.552719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:39.553200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:39.553976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:39.555164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:39.688534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:39.696206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e11ebf3-0e38-43a8-90ac-fa7f02b97ab8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.155407 Jul 18 03:13:39.696782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3382/6695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:39 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:40.713765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:40.714385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:40.722309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:40.722763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:40.723533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:40.723975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:40.854948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:40.863793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ad0a41c-8116-4f5d-bb51-7fbdca00140d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.153966 Jul 18 03:13:40.864388 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3314/6696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:40 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:41.880876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:41.881625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:41.888682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:41.889167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:41.889949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:41.890394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:42.036091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:42.043687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a354be59-9ec1-416d-a914-3169523e78f5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.166861 Jul 18 03:13:42.044279 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3383/6697] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:41 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:43.061410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:43.062150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:43.069638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:43.070101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:43.070898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:43.071349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:43.209800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:43.217617 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1937dff2-cebf-4ab8-816f-436c4e804a42 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.160455 Jul 18 03:13:43.218194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3315/6698] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:43 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:44.235979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:44.236812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:44.245871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:44.246332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:44.247126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:44.247574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:44.381748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:44.389370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4c462ce0-51b3-432b-a930-de219a781367 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.158550 Jul 18 03:13:44.389954 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3384/6699] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:44 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:45.094490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7e64d643-f5d9-49d8-b233-fd5a7e609cdc req-a997f729-58e5-4e62-9bd2-41eb39201fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d924899-c4cf-4c6c-9958-bbf76fd98cea", "name": "network-vif-plugged", "status": "completed", "tag": "f6b7da3a-0350-4976-a26c-19470ea0ae5e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:45.098991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:45.105713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7e64d643-f5d9-49d8-b233-fd5a7e609cdc req-a997f729-58e5-4e62-9bd2-41eb39201fc6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:45.106168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7e64d643-f5d9-49d8-b233-fd5a7e609cdc req-a997f729-58e5-4e62-9bd2-41eb39201fc6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:45.120231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7e64d643-f5d9-49d8-b233-fd5a7e609cdc req-a997f729-58e5-4e62-9bd2-41eb39201fc6 service nova] Creating event network-vif-plugged:f6b7da3a-0350-4976-a26c-19470ea0ae5e for instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea on n-h2-849796-1 Jul 18 03:13:45.126688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7e64d643-f5d9-49d8-b233-fd5a7e609cdc req-a997f729-58e5-4e62-9bd2-41eb39201fc6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036864 Jul 18 03:13:45.127247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3316/6700] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:45.407307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:45.408140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:45.410871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=36 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:13:45.418222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:45.418720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:45.419526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:45.419981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:45.566012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:45.573347 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1433419e-dcc1-431b-bbaf-a6154bca1173 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.170961 Jul 18 03:13:45.573925 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3385/6701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:45 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:46.592526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:46.593258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:46.600166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:46.600618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:46.601430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:46.601870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:46.742664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:46.750836 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d37fa681-0328-41b6-82b2-ba43c3dfc03a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1202 microversion: 2.1 time: 0.163800 Jul 18 03:13:46.751561 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3317/6702] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:46 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:47.768364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:47.769057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:47.776267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.776774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:47.777689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.778133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:47.914509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:47.922360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f29850dd-e136-473b-97b1-ff75db9ad79e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1389 microversion: 2.1 time: 0.158238 Jul 18 03:13:47.922935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3386/6703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:47 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:47.938727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:47.939334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:47.946389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.946855 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:47.947703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:47.948156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.078974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:48.086617 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3ed8994f-4232-4a64-832a-6e37d4497e62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1389 microversion: 2.1 time: 0.152276 Jul 18 03:13:48.087205 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3318/6704] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:47 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:48.102946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:48.103570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:48.110608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.111059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.111829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.112267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.242346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:48.249993 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af80c1fd-386c-44ff-9d6f-3e477236b26a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1389 microversion: 2.1 time: 0.150957 Jul 18 03:13:48.250571 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3387/6705] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:48 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:48.322862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:48.323499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:48.330391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.330852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.331647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.332094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.359491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:13:48.441440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b97fed32-589f-474a-bcce-25ebe8e08f4a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 204 len: 0 microversion: 2.1 time: 0.122242 Jul 18 03:13:48.442063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3319/6706] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:13:48 2022] DELETE /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:13:48.450323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:48.450946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:48.457406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.457868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.458668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:48.459119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:48.595695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:48.603420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15e7707b-379f-43e8-864c-dcd6721d7d36 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1395 microversion: 2.1 time: 0.157051 Jul 18 03:13:48.603997 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3388/6707] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:48 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:13:49.621698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:49.622286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:49.630673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:49.631124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:49.631920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:49.632358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:49.773446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:49.782394 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3fb1e680-7a0c-415a-bfff-837050dbb440 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1395 microversion: 2.1 time: 0.165147 Jul 18 03:13:49.783012 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3320/6708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:49 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:50.801140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:50.801793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:50.809392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:50.809854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:50.810650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:50.811099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:51.003021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:51.011294 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-02dcd464-f002-49d1-8b81-cfa23772ad2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1395 microversion: 2.1 time: 0.215358 Jul 18 03:13:51.021009 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3389/6709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:50 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1395 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:51.101395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cf38a63b-bb64-442f-90be-24ba1f5c016a req-c3684145-f162-4d16-969c-0b69861c216e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d924899-c4cf-4c6c-9958-bbf76fd98cea", "name": "network-vif-deleted", "tag": "f6b7da3a-0350-4976-a26c-19470ea0ae5e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:51.114925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cf38a63b-bb64-442f-90be-24ba1f5c016a req-c3684145-f162-4d16-969c-0b69861c216e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:51.115372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cf38a63b-bb64-442f-90be-24ba1f5c016a req-c3684145-f162-4d16-969c-0b69861c216e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:51.130443 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cf38a63b-bb64-442f-90be-24ba1f5c016a req-c3684145-f162-4d16-969c-0b69861c216e service nova] Creating event network-vif-deleted:f6b7da3a-0350-4976-a26c-19470ea0ae5e for instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea on n-h2-849796-1 Jul 18 03:13:51.137185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cf38a63b-bb64-442f-90be-24ba1f5c016a req-c3684145-f162-4d16-969c-0b69861c216e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 Jul 18 03:13:51.137948 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3321/6710] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:13:52.028278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:52.029118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:52.038981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:52.039582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:52.040525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:52.041216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:52.109960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:52.118006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c2cdd1ed-87c6-41a2-baf7-a5883cb50066 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1187 microversion: 2.1 time: 0.093879 Jul 18 03:13:52.118587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3390/6711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:52 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:53.138064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:53.138717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:53.145551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:53.146005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:53.146796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:53.147239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:53.214326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:53.223998 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-14ff38e5-4cad-465d-a4ce-a7a24dae0766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1187 microversion: 2.1 time: 0.091553 Jul 18 03:13:53.226612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3322/6712] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:53 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:54.243855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:54.244618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:54.257651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:54.257651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:54.257651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:54.257651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:54.333971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:54.342566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f4f24290-dca8-49cb-8f60-1816a0176fd4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1187 microversion: 2.1 time: 0.103743 Jul 18 03:13:54.343159 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3391/6713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:54 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:55.364146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:55.364958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:55.377714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:55.378179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:55.379002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:55.379450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:55.451115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:13:55.459933 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f2bbf908-cde4-4a05-96c2-7364ec79dc40 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 200 len: 1187 microversion: 2.1 time: 0.101224 Jul 18 03:13:55.460620 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3323/6714] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:55 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:13:56.482022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:56.482635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:56.490426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:56.490875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:56.491652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:56.492093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:56.506318 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea HTTP/1.1 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5d924899-c4cf-4c6c-9958-bbf76fd98cea'} Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:56.507868 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0bcce0f-9dde-4a3f-85a8-5db506d96cdd tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 404 len: 111 microversion: 2.1 time: 0.031202 Jul 18 03:13:56.513620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3392/6715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:56 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:13:57.528939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:13:57.529938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:57.536670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:57.537151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:57.537943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:57.538381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:57.614679 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2caf1a7b-8f43-4599-9386-7a1d2e9eb9a3 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action" status: 200 len: 24572 microversion: 2.1 time: 0.170731 Jul 18 03:13:57.615531 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3324/6716] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:13:57 2022] POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action => generated 24572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:13:58.655398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:58.656338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:58.663938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.664486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.665397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.665915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.681225 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea HTTP/1.1 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '5d924899-c4cf-4c6c-9958-bbf76fd98cea'} Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:13:58.682946 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21f5254d-4f6d-4e28-b3f0-29042f16407b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 404 len: 111 microversion: 2.1 time: 0.033085 Jul 18 03:13:58.691732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3393/6717] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:13:58 2022] DELETE /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:13:58.696062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:13:58.696959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 5d924899-c4cf-4c6c-9958-bbf76fd98cea] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:13:58.705394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.705894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.706699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:13:58.707149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:13:58.722925 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea HTTP/1.1 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '5d924899-c4cf-4c6c-9958-bbf76fd98cea'} Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:13:58.724639 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 5d924899-c4cf-4c6c-9958-bbf76fd98cea could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c083ecc2-c69a-45fe-8f5c-8e40307a5a8c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea" status: 404 len: 111 microversion: 2.1 time: 0.035949 Jul 18 03:13:58.729777 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3325/6718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:13:58 2022] GET /compute/v2.1/servers/5d924899-c4cf-4c6c-9958-bbf76fd98cea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:17.331148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-385341182", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "9985f825-482b-4fad-9b2c-d3e4aac1ee1c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-918058328", "security_groups": []}, "os:scheduler_hints": {"different_host": ["70bb424e-c424-4a22-bdcd-c8b88f75fbda"]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:17.381043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=17 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:17.382277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=75 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:17.463634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] validate_networks() for [('9985f825-482b-4fad-9b2c-d3e4aac1ee1c', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:14:18.199089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:14:18.199567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:14:18.200355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:14:18.200780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:14:18.201268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:14:18.211707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:18.212166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:18.213268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:18.213916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:18.235921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:14:18.243153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Getting quotas for user 36729ebc27b34ef2a78632acfaf90b3e and project f33715ca8a5c4921b643ee9d8a604c45. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:14:18.261134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:14:18.263928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:14:18.322581 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9bb3a84-3de2-4e35-9ded-5b2fd482a335 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.996161 Jul 18 03:14:18.323504 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3394/6719] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:14:17 2022] POST /compute/v2.1/servers => generated 361 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:14:18.342305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c1efab00-c2d2-4c47-9485-d1ce8ae714ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:18.344818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c1efab00-c2d2-4c47-9485-d1ce8ae714ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:18.357256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:18.359636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:18.583025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c1efab00-c2d2-4c47-9485-d1ce8ae714ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:18.601756 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c1efab00-c2d2-4c47-9485-d1ce8ae714ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1240 microversion: 2.1 time: 0.267336 Jul 18 03:14:18.611284 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3326/6720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:18 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1240 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:19.622421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:19.623280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:19.632438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:19.632996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:19.633967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:19.634572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:19.910277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:19.938282 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66fa28ab-c855-4ddf-96e8-5de5e0bb95ad tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1292 microversion: 2.1 time: 0.322638 Jul 18 03:14:19.940619 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3395/6721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:19 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:20.958352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:20.959006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:20.971432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:20.971905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:20.972721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:20.973211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:21.133564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:21.156400 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5ca3860-e575-4f6e-b140-c323fab55afc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.201162 Jul 18 03:14:21.178081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3327/6722] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:20 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:21.879035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d062ff16-62f2-4736-8ea2-589ddb471909 req-b28abf70-3f2e-4111-94cd-924e6538e3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3173123d-93ce-47ab-9712-cb0d1b038132", "tag": "29f5d37e-5b79-41fa-8cba-44a2cc378071"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:21.895126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d062ff16-62f2-4736-8ea2-589ddb471909 req-b28abf70-3f2e-4111-94cd-924e6538e3a4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:21.899064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d062ff16-62f2-4736-8ea2-589ddb471909 req-b28abf70-3f2e-4111-94cd-924e6538e3a4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:21.926973 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d062ff16-62f2-4736-8ea2-589ddb471909 req-b28abf70-3f2e-4111-94cd-924e6538e3a4 service nova] Creating event network-changed:29f5d37e-5b79-41fa-8cba-44a2cc378071 for instance 3173123d-93ce-47ab-9712-cb0d1b038132 on n-h1-849796-1 Jul 18 03:14:21.933422 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d062ff16-62f2-4736-8ea2-589ddb471909 req-b28abf70-3f2e-4111-94cd-924e6538e3a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059344 Jul 18 03:14:21.934597 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3396/6723] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:22.184264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:22.184785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:22.194815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:22.195418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:22.196552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:22.197112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:22.327680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:22.335657 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8603b59-f0b8-410c-8692-a197f506bcd1 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.156272 Jul 18 03:14:22.336249 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3328/6724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:22 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:22.942733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-404079985", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b1273cba-e79d-49fa-9518-016ab669cb1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:23.004138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:14:23.354136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:23.354872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:23.365341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.366157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.367481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.368284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.407150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:14:23.407604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:14:23.408422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:14:23.408777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:14:23.409249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:14:23.419826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.420276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.421248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:23.421917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:23.440762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:14:23.447189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:14:23.502759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:23.510957 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8af1d39c-c5b5-4a1b-ac2b-46fa9de1cb5c tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.161247 Jul 18 03:14:23.511575 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3329/6725] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:23 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:23.528013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:14:23.530865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1273cba-e79d-49fa-9518-016ab669cb1f',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:14:23.663053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49632d68-a670-4ed0-b1a9-695f7e21e037 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725636 Jul 18 03:14:23.663714 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3397/6726] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:14:23.673792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8a3b865-8c44-4ded-858f-3c5407915c62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:23.674413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8a3b865-8c44-4ded-858f-3c5407915c62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:23.735805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a8a3b865-8c44-4ded-858f-3c5407915c62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:23.743526 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8a3b865-8c44-4ded-858f-3c5407915c62 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1070 microversion: 2.1 time: 0.073645 Jul 18 03:14:23.744118 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3330/6727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:23 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1070 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:24.529229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:24.530008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:24.537665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.538126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.538927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.539379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.645173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:24.653563 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47951693-e387-482a-aa55-8700f980a63a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.129137 Jul 18 03:14:24.654323 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3398/6728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:24 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:24.763314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:24.764542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:24.773997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.774697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.775877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:24.776563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:24.878679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:24.896011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b5eb0e5-d85f-4d0f-a74c-5efcaf92122b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1186 microversion: 2.1 time: 0.136666 Jul 18 03:14:24.896625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3331/6729] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:24 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1186 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:25.671683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:25.672663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:25.679141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.679609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.680398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.680834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.839522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:25.850041 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b04ae3f-7922-46c9-9273-d006e3dbf7ba tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.183081 Jul 18 03:14:25.851159 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3399/6730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:25 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:25.913941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:25.915265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:25.924677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.925479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:25.926477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:25.927123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:26.088054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:26.097910 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-814fc1a4-358c-42bb-9278-26ce6af59798 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1228 microversion: 2.1 time: 0.188188 Jul 18 03:14:26.098621 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3332/6731] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:25 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1228 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:26.623644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-82fc4918-68fd-4736-8114-8706a68eec4c req-3f92a4eb-295e-4b20-959e-c9109fb3da62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cefd79b-019e-4ec6-aa27-43ca616723be", "tag": "843a4acf-a4c2-42e8-9624-389c10fe893b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:26.635222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-82fc4918-68fd-4736-8114-8706a68eec4c req-3f92a4eb-295e-4b20-959e-c9109fb3da62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:26.636061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-82fc4918-68fd-4736-8114-8706a68eec4c req-3f92a4eb-295e-4b20-959e-c9109fb3da62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:26.667767 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-82fc4918-68fd-4736-8114-8706a68eec4c req-3f92a4eb-295e-4b20-959e-c9109fb3da62 service nova] Creating event network-changed:843a4acf-a4c2-42e8-9624-389c10fe893b for instance 6cefd79b-019e-4ec6-aa27-43ca616723be on n-h2-849796-1 Jul 18 03:14:26.678311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-82fc4918-68fd-4736-8114-8706a68eec4c req-3f92a4eb-295e-4b20-959e-c9109fb3da62 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058128 Jul 18 03:14:26.679650 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3400/6732] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:26.868608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:26.870312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:26.878355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:26.878807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:26.879598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:26.880042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:26.971284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:26.979545 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad73a5e8-8cf9-4154-ae8a-400a1447b774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.115507 Jul 18 03:14:26.989546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3333/6733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:26 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:27.116785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:27.117711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:27.128131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:27.128686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:27.129536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:27.129989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:27.335119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:27.343965 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b94d4f78-9f91-4f8c-9d86-471647c087d2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1228 microversion: 2.1 time: 0.232489 Jul 18 03:14:27.344611 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3401/6734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:27 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:27.997212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:27.997890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:28.008767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.009275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.010075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.010525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.106989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:28.115971 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24b4c8bc-4eb8-40b3-9bd9-2d75a1fda1fa tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.122757 Jul 18 03:14:28.116581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3334/6735] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:27 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:28.355996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1521281a-ea48-479e-b7c5-2e2294e9b721 req-1821ab53-d339-4100-9f0b-06d27d2a4979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3173123d-93ce-47ab-9712-cb0d1b038132", "name": "network-vif-plugged", "status": "completed", "tag": "29f5d37e-5b79-41fa-8cba-44a2cc378071"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:28.363308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:28.366011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:28.377941 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1521281a-ea48-479e-b7c5-2e2294e9b721 req-1821ab53-d339-4100-9f0b-06d27d2a4979 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.381823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.382484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.383353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:28.383906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.385950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1521281a-ea48-479e-b7c5-2e2294e9b721 req-1821ab53-d339-4100-9f0b-06d27d2a4979 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:28.404133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1521281a-ea48-479e-b7c5-2e2294e9b721 req-1821ab53-d339-4100-9f0b-06d27d2a4979 service nova] Creating event network-vif-plugged:29f5d37e-5b79-41fa-8cba-44a2cc378071 for instance 3173123d-93ce-47ab-9712-cb0d1b038132 on n-h1-849796-1 Jul 18 03:14:28.412627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1521281a-ea48-479e-b7c5-2e2294e9b721 req-1821ab53-d339-4100-9f0b-06d27d2a4979 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061352 Jul 18 03:14:28.414121 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3402/6736] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:28.568621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:28.577525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7559a45e-0c5b-4772-acd3-2247b91cc39b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1228 microversion: 2.1 time: 0.219657 Jul 18 03:14:28.578132 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3335/6737] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:28 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1228 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:29.134422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:29.135059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:29.143141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:29.143614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:29.144425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:29.144881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:29.246273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:29.262445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5cb095c8-1288-4bc0-8b46-49db1e30cedf tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1298 microversion: 2.1 time: 0.131267 Jul 18 03:14:29.272994 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3403/6738] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:29 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:29.595728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:29.596366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:29.603473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:29.603934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:29.604733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:29.605204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:29.770902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:29.780386 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a70d0185-7668-4a49-94bf-068304ab0d30 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1228 microversion: 2.1 time: 0.189319 Jul 18 03:14:29.787711 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3336/6739] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:29 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1228 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.288338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.288959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.295866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.296316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.297176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.297619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.380216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:30.387798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-311d7e67-4e54-4e0b-a4b1-e06f2e00e4a0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1471 microversion: 2.1 time: 0.103446 Jul 18 03:14:30.388387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3404/6740] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1471 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.404322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.404998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.411820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.412274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.413111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.413559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.498421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:30.506540 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6922f7e5-3994-4bf3-b44a-09be714638ff tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1471 microversion: 2.1 time: 0.106149 Jul 18 03:14:30.507122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3337/6741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1471 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.523006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.523505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.529751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.530213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.530999 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.532151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.615165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca082635-9152-4c77-a82f-7f229de9924b tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1622 microversion: 2.1 time: 0.095978 Jul 18 03:14:30.615750 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3405/6742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.632221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.632847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.639965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.640422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.642284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.642729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.783587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-13fb22a1-b66e-4206-8b4d-58f7daad20b6 tempest-TestSecurityGroupsBasicOps-1604287249 tempest-TestSecurityGroupsBasicOps-1604287249-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1913 microversion: 2.1 time: 0.155121 Jul 18 03:14:30.784104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3338/6743] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1913 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.798188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.798803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.805200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.805590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.806370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.806811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.847538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.848048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.854496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.854960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.855751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.856204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.884061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:14:30.951255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:30.960079 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba807dbf-0390-4c31-8a7c-1c6898046047 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.165908 Jul 18 03:14:30.969499 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-264bf0ce-6f05-45c4-801b-57014a890774 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 204 len: 0 microversion: 2.1 time: 0.125965 Jul 18 03:14:30.970322 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3339/6744] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:14:30 2022] DELETE /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:14:30.971089 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3406/6745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:30.978971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:30.979685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:30.986048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.986509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:30.987298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:30.987742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:31.073404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:31.081720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eb5e7478-2198-4898-b6ec-bb0845b6e3ae tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1477 microversion: 2.1 time: 0.106927 Jul 18 03:14:31.082308 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3340/6746] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:30 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1477 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:31.978240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:31.978863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:31.987302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:31.987764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:31.988565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:31.989049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:32.100809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:32.101471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:32.108915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:32.109401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:32.110424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:32.110805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:32.126912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:32.136944 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7ca0fd0-6eca-4bb4-ac15-f3eb0f97d629 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.162557 Jul 18 03:14:32.137758 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3407/6747] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:31 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:32.197806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:32.206830 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dd2803f6-c65e-4674-a327-afded2c4500e tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1477 microversion: 2.1 time: 0.109439 Jul 18 03:14:32.207437 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3341/6748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:32 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1477 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:32.863252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-63d6d87a-98d4-476f-bf3e-c6c8d8a5d644 req-b025ab70-a9ac-4f51-92b6-6d01903a7e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3173123d-93ce-47ab-9712-cb0d1b038132", "name": "network-vif-deleted", "tag": "29f5d37e-5b79-41fa-8cba-44a2cc378071"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:32.873372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-63d6d87a-98d4-476f-bf3e-c6c8d8a5d644 req-b025ab70-a9ac-4f51-92b6-6d01903a7e50 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:32.874776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-63d6d87a-98d4-476f-bf3e-c6c8d8a5d644 req-b025ab70-a9ac-4f51-92b6-6d01903a7e50 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:32.896855 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-63d6d87a-98d4-476f-bf3e-c6c8d8a5d644 req-b025ab70-a9ac-4f51-92b6-6d01903a7e50 service nova] Creating event network-vif-deleted:29f5d37e-5b79-41fa-8cba-44a2cc378071 for instance 3173123d-93ce-47ab-9712-cb0d1b038132 on n-h1-849796-1 Jul 18 03:14:32.903408 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-63d6d87a-98d4-476f-bf3e-c6c8d8a5d644 req-b025ab70-a9ac-4f51-92b6-6d01903a7e50 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044689 Jul 18 03:14:32.904034 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3408/6749] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:33.155600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:33.156230 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:33.163622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:33.164082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:33.164902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:33.165388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:33.225530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:33.226245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:33.235179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:33.235633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:33.236429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:33.236910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:33.281126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:33.281623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:33.282084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lazy-loading 'fault' on Instance uuid 3173123d-93ce-47ab-9712-cb0d1b038132 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:14:33.348834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:33.358306 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f999bcbb-8184-4d76-90df-e7a34398a796 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 200 len: 1330 microversion: 2.1 time: 0.138095 Jul 18 03:14:33.358912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3409/6750] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:33 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:33.366778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:33.370740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:33.377174 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b25d0935-9d1f-48c6-92bb-d4e3b39f21b6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.225505 Jul 18 03:14:33.377772 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3342/6751] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:33 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:34.375674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:34.376297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 3173123d-93ce-47ab-9712-cb0d1b038132] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:34.378816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:34.379511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:34.386304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:34.386771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:34.387557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:34.388008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:34.396199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:34.396817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:34.399034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:34.403073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] HTTP exception thrown: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Request method failure captured: Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 HTTP/1.1 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-LZZXA4k76bBnruEs5E11eRYhCrrxKCk6KxARTdTDPxG3wqr88_mDDbloWJ45sPp7gwQMRVFQxMdd5CG69gPKmRgiDMXX9bJOBOM9EJtwdHYnpkRGhClMUM8TJtVHyV0HWxofuWN6S8B5yqr4PawmSqB0kmD09Ckbl25xKpn27JPU Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f33715ca8a5c4921b643ee9d8a604c45 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f33715ca8a5c4921b643ee9d8a604c45 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestSecurityGroupsBasicOps-1208313734-project Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 36729ebc27b34ef2a78632acfaf90b3e Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1208313734-project Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '3173123d-93ce-47ab-9712-cb0d1b038132'} Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:34.404757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Returning 404 to user: Instance 3173123d-93ce-47ab-9712-cb0d1b038132 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:14:34.408534 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-711a368f-4d18-4014-9664-71d8152bb3dc tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132" status: 404 len: 111 microversion: 2.1 time: 0.034508 Jul 18 03:14:34.409321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:34.409421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3410/6752] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:34 2022] GET /compute/v2.1/servers/3173123d-93ce-47ab-9712-cb0d1b038132 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:34.409499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:34.409499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:34.409499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:34.643177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:34.651986 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-383db6de-65fb-4fad-9967-f9b0a14e6a23 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.260229 Jul 18 03:14:34.652689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3343/6753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:34 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:35.669791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:35.670635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:35.678242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:35.678725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:35.679607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:35.680082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:35.829175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:35.837791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-35d05365-2de9-464d-9ff8-0565336d2ac7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.172110 Jul 18 03:14:35.838385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3411/6754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:35 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:36.616802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:36.618054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:36.630696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.631493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.632304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.632905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.727305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:14:36.728286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:14:36.729054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:14:36.730223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:14:36.731028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:14:36.811602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:36.819245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.819902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.821098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.821699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.853911 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c98f8d11-8011-403d-b945-c6fe0d4291f5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action" status: 202 len: 1136 microversion: 2.1 time: 0.242597 Jul 18 03:14:36.854657 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3344/6755] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:14:36 2022] POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action => generated 1136 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 18 03:14:36.857390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:36.858012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:36.868241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.868861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.870170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.870766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.873381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:36.874010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:36.883493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.883958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:36.884757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:36.885233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:37.035482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:37.044305 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c57a3077-ca8e-4de3-84d1-caa2247ac088 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.191634 Jul 18 03:14:37.045358 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3412/6756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:36 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:37.182315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:37.194622 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5debe99b-8aa0-45dd-9920-6890791c8794 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.327945 Jul 18 03:14:37.204794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3345/6757] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:36 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:38.062485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:38.063144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:38.071518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:38.071981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:38.072817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:38.073313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:38.210564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:38.215293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:38.216480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:38.218992 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5cdc55c9-3dc5-40f4-ad3b-7ae67e2187ec tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.160415 Jul 18 03:14:38.219745 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3413/6758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:38 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:38.225102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:38.225771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:38.226732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:38.227213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:38.473707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:38.481516 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-089e12e5-4599-4f74-b14e-38f3f82c440e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.272810 Jul 18 03:14:38.491908 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3346/6759] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:38 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:39.238954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:39.239884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:39.247196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.247818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.248718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.249300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.323662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:39.324437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:39.333431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.335110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.336166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.336987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.373581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:14:39.410798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:39.414542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:39.420518 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d24f375b-6772-4c2f-89e1-882a1d55d893 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.187180 Jul 18 03:14:39.421513 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3414/6760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:39 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:39.426983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-77f17673-4066-462a-873f-ad7a50c3a462 req-5efd97bf-c750-4244-bb0e-aabd950c51c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bb424e-c424-4a22-bdcd-c8b88f75fbda", "tag": "a7c6a59f-fe40-4c9e-a77f-0d5884f3b409"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:39.436493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-77f17673-4066-462a-873f-ad7a50c3a462 req-5efd97bf-c750-4244-bb0e-aabd950c51c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.437028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-77f17673-4066-462a-873f-ad7a50c3a462 req-5efd97bf-c750-4244-bb0e-aabd950c51c0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.450521 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-77f17673-4066-462a-873f-ad7a50c3a462 req-5efd97bf-c750-4244-bb0e-aabd950c51c0 service nova] Creating event network-changed:a7c6a59f-fe40-4c9e-a77f-0d5884f3b409 for instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda on n-h2-849796-1 Jul 18 03:14:39.456961 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-77f17673-4066-462a-873f-ad7a50c3a462 req-5efd97bf-c750-4244-bb0e-aabd950c51c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Jul 18 03:14:39.457826 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3415/6761] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:39.491107 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c2c087a-73bf-46c7-b9d1-d00c7c563fed tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "DELETE /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 204 len: 0 microversion: 2.1 time: 0.171576 Jul 18 03:14:39.492640 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3347/6762] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:14:39 2022] DELETE /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:14:39.502202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:39.503197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:39.504247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:39.505491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:39.511314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.511889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.515808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.516636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.517829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.519401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.525557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:39.527440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:39.710668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:39.719114 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5ba542d-bacf-49fc-b89e-ebe42a058ad6 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1768 microversion: 2.1 time: 0.221647 Jul 18 03:14:39.719969 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3348/6763] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:39 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1768 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:39.738294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:39.746259 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd98a80a-cbe8-4fd8-b3e3-5c70c39e8092 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.249058 Jul 18 03:14:39.747142 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3416/6764] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:39 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:40.440448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:40.441147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:40.448899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.449533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.450475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.451066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.589673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:40.598755 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4b51bee1-80ee-465e-88ed-b8be99dc920a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.164544 Jul 18 03:14:40.599346 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3349/6765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:40 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:40.738271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:40.738860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:40.746146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.746602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.747389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.747833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.764697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:40.765502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:40.771675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.772141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.773099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:40.773543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:40.916173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:40.932200 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a79d220-9015-426d-9a31-e1df4563bdcc tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.172099 Jul 18 03:14:40.933296 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3350/6766] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:40 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:40.995439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:41.004420 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e583353a-668e-4e11-b9a7-3f91d4b076f0 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1768 microversion: 2.1 time: 0.270668 Jul 18 03:14:41.005430 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3417/6767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:40 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1768 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:41.334448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-42f64df5-d68c-4d3a-b20f-77895403fada req-17cf124c-ef96-4884-b794-948fc49c9c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cefd79b-019e-4ec6-aa27-43ca616723be", "name": "network-vif-plugged", "status": "completed", "tag": "843a4acf-a4c2-42e8-9624-389c10fe893b"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:41.344444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42f64df5-d68c-4d3a-b20f-77895403fada req-17cf124c-ef96-4884-b794-948fc49c9c35 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:41.345196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42f64df5-d68c-4d3a-b20f-77895403fada req-17cf124c-ef96-4884-b794-948fc49c9c35 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:41.358920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-42f64df5-d68c-4d3a-b20f-77895403fada req-17cf124c-ef96-4884-b794-948fc49c9c35 service nova] Creating event network-vif-plugged:843a4acf-a4c2-42e8-9624-389c10fe893b for instance 6cefd79b-019e-4ec6-aa27-43ca616723be on n-h2-849796-1 Jul 18 03:14:41.364280 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-42f64df5-d68c-4d3a-b20f-77895403fada req-17cf124c-ef96-4884-b794-948fc49c9c35 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Jul 18 03:14:41.365198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3351/6768] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:41.617524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:41.618249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:41.624480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:41.625058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:41.625926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:41.626465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:41.849458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:41.857175 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73ca36c1-969e-4c7b-aef3-db71845fb09a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.244815 Jul 18 03:14:41.857776 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3418/6769] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:41 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:41.954309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:41.956858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:41.963883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:41.964366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:41.966430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:41.967466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:42.021924 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:42.022553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:42.032138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:42.032598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:42.033410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:42.034412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:42.111154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:42.120341 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b2f2362-4a6f-4f51-b239-bf7a28422936 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1530 microversion: 2.1 time: 0.102418 Jul 18 03:14:42.121316 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3419/6770] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:42 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1530 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:42.125530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9dc1c1a6-b337-4acd-ab61-5b872776cb58 req-9f603074-f2db-4268-a77d-05706ed108ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bb424e-c424-4a22-bdcd-c8b88f75fbda", "name": "network-vif-deleted", "tag": "a7c6a59f-fe40-4c9e-a77f-0d5884f3b409"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:42.130919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:42.135597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9dc1c1a6-b337-4acd-ab61-5b872776cb58 req-9f603074-f2db-4268-a77d-05706ed108ab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:42.136056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9dc1c1a6-b337-4acd-ab61-5b872776cb58 req-9f603074-f2db-4268-a77d-05706ed108ab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:42.138791 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-362bebfb-0e05-4970-af37-a989c50a2e39 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.189752 Jul 18 03:14:42.139393 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3352/6771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:41 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:42.148299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9dc1c1a6-b337-4acd-ab61-5b872776cb58 req-9f603074-f2db-4268-a77d-05706ed108ab service nova] Creating event network-vif-deleted:a7c6a59f-fe40-4c9e-a77f-0d5884f3b409 for instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda on n-h2-849796-1 Jul 18 03:14:42.153284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9dc1c1a6-b337-4acd-ab61-5b872776cb58 req-9f603074-f2db-4268-a77d-05706ed108ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031164 Jul 18 03:14:42.153887 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3420/6772] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:42.873941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:42.874555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:42.880647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:42.881142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:42.881913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:42.882349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.023856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:43.031607 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb31feef-edc8-414c-8621-3e453d711bc8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1216 microversion: 2.1 time: 0.161496 Jul 18 03:14:43.032191 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3353/6773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:42 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:43.140234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:43.141084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:43.149174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:43.149640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.150433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:43.150888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.156798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:43.157526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:43.164396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:43.164956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.165801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:43.166411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.186325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:43.186832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:43.187243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lazy-loading 'fault' on Instance uuid 70bb424e-c424-4a22-bdcd-c8b88f75fbda {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:14:43.231389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36729ebc27b34ef2a78632acfaf90b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33715ca8a5c4921b643ee9d8a604c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:43.239590 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f256728-1b9c-463d-b5b0-6ca96726be9a tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 200 len: 1384 microversion: 2.1 time: 0.105368 Jul 18 03:14:43.240376 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3421/6774] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:43 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 1384 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:43.317751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:43.326343 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e7e15f24-9400-41ad-972f-f57b5d0115a2 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.174210 Jul 18 03:14:43.326950 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3354/6775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:43 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:44.049778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:44.050603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:44.057070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.057529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.058315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.058758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.198053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:44.206892 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63d43f94-a256-492c-9fd1-598b6c5f0dba tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1402 microversion: 2.1 time: 0.160184 Jul 18 03:14:44.207476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3422/6776] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:44 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:44.223616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:44.224257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:44.231202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.231665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.232426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.232870 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.258713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:44.259732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] [instance: 70bb424e-c424-4a22-bdcd-c8b88f75fbda] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:44.266640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.267097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.267888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.268914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.284255 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] HTTP exception thrown: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Request method failure captured: Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda HTTP/1.1 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-LZZXA4k76bBnruEs5E11eRYhCrrxKCk6KxARTdTDPxG3wqr88_mDDbloWJ45sPp7gwQMRVFQxMdd5CG69gPKmRgiDMXX9bJOBOM9EJtwdHYnpkRGhClMUM8TJtVHyV0HWxofuWN6S8B5yqr4PawmSqB0kmD09Ckbl25xKpn27JPU Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: f33715ca8a5c4921b643ee9d8a604c45 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f33715ca8a5c4921b643ee9d8a604c45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: f33715ca8a5c4921b643ee9d8a604c45 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1208313734 Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestSecurityGroupsBasicOps-1208313734-project Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 36729ebc27b34ef2a78632acfaf90b3e Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1208313734-project Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '70bb424e-c424-4a22-bdcd-c8b88f75fbda'} Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:14:44.286801 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Returning 404 to user: Instance 70bb424e-c424-4a22-bdcd-c8b88f75fbda could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ccf5310-1009-4680-978e-14a2c512ed64 tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda" status: 404 len: 111 microversion: 2.1 time: 0.033893 Jul 18 03:14:44.290159 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3423/6777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:44 2022] GET /compute/v2.1/servers/70bb424e-c424-4a22-bdcd-c8b88f75fbda => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:14:44.344298 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:44.345515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:44.352768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.353272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.354083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.354531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.383315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:44.391939 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c01bd79e-49c9-4b74-a286-8ddecb3ee450 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1402 microversion: 2.1 time: 0.172641 Jul 18 03:14:44.392541 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3355/6778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:44 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1402 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:44.408436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1806715613"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:44.410081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:44.416507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.417019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.417820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:44.418265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:44.438497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:44.584587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:44.588676 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Attempting to quiesce instance before volume snapshot. Jul 18 03:14:44.592697 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce47fd77-1822-4984-b126-c0ed22a7045e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.252516 Jul 18 03:14:44.593652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3424/6779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:44 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:44.666000 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 18 03:14:44.743386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Creating snapshot from volume b1273cba-e79d-49fa-9518-016ab669cb1f. {{(pid=119440) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 18 03:14:45.610169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:45.611466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:45.628628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:45.629443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:45.630178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:45.630619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:45.805157 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35050728-b518-480f-a325-125669ddf92f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be/action" status: 202 len: 0 microversion: 2.1 time: 1.400544 Jul 18 03:14:45.805815 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3356/6780] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:14:44 2022] POST /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be/action => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 18 03:14:45.960705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:45.971268 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bd8b8678-1971-4b6e-ba21-e9a2a0711195 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.364865 Jul 18 03:14:45.973067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3425/6781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:45 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:46.988125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-96523661", "imageRef": "827ac775-f835-45b1-b91f-522793e41008", "flavorRef": "452", "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:46.994010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:46.995760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:47.005470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:47.008033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:47.008547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:47.009656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:47.010058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:47.069210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:14:47.316371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:47.340029 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3cac1b2-66eb-4429-9644-dfb099d665c8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.345256 Jul 18 03:14:47.342102 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3426/6782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:46 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:47.572671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:14:47.573470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:14:47.574112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:14:47.574703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:14:47.575274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:14:47.593779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:47.594259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:47.595087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:47.595537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:47.616848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:14:47.623067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:14:47.642601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:14:47.646240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='793cc63c-a54e-4af4-a1cc-e84df4fe5bb8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:14:47.778622 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d91269e-c67b-4f47-9142-b11980664eed tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796531 Jul 18 03:14:47.794652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2c8ef7a0-e11d-4f95-b696-fe6c09a20a85 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:47.796128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3357/6783] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:14:47.796655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2c8ef7a0-e11d-4f95-b696-fe6c09a20a85 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:47.896205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2c8ef7a0-e11d-4f95-b696-fe6c09a20a85 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:47.908298 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2c8ef7a0-e11d-4f95-b696-fe6c09a20a85 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1228 microversion: 2.1 time: 0.120663 Jul 18 03:14:47.931377 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3427/6784] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:47 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1228 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:48.360880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:48.362150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:48.366631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:48.371477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:48.371988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:48.372804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:48.373336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:48.525472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:48.534459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-70f5db80-d95f-4453-950c-5c2c62416a3e tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.177859 Jul 18 03:14:48.535571 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3358/6785] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:48 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:48.943134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:48.945694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:48.957252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:48.957808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:48.958176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:48.958621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:49.074035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:49.076376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8aac5f1-364c-4e53-a570-91706ded367b tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] Calling method '.version_select at 0x7faaf72b5dc0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:49.092746 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2fcc2136-e004-4afb-9792-ed1ad1947c2d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1298 microversion: 2.1 time: 0.154396 Jul 18 03:14:49.106230 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3428/6786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:48 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:49.124850 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8aac5f1-364c-4e53-a570-91706ded367b tempest-TestSecurityGroupsBasicOps-1208313734 tempest-TestSecurityGroupsBasicOps-1208313734-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-918058328" status: 202 len: 0 microversion: 2.1 time: 0.060045 Jul 18 03:14:49.125505 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3359/6787] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-918058328 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:14:49.552449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:49.554527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:49.567030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:49.567760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:49.568686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:49.579664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:49.865654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:49.875549 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f29c74e5-dcd3-47d9-abc7-a8259edec0e6 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.327229 Jul 18 03:14:49.888361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3429/6788] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:49 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:50.113448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:50.114240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:50.128130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:50.131823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:50.136502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:50.137289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:50.454212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:50.464877 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a223865f-3ca4-4fea-8007-947677133243 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.357002 Jul 18 03:14:50.465503 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3360/6789] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:50 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:50.897061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:50.897858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:50.916213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:50.916688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:50.920568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:50.923465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:51.219509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-28140617-bbe7-41a9-91cc-f2a5ea92e1ff req-f22b828c-6a9d-446e-8383-2f716b3629b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e10367f-3ffb-49ee-ad5a-e16ffaec13b5", "tag": "33afda19-fa91-47e8-9c1e-beb88b0d366a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:51.238926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-28140617-bbe7-41a9-91cc-f2a5ea92e1ff req-f22b828c-6a9d-446e-8383-2f716b3629b1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:51.239885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-28140617-bbe7-41a9-91cc-f2a5ea92e1ff req-f22b828c-6a9d-446e-8383-2f716b3629b1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:51.243127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:51.261443 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdd8d4c2-4e85-4721-8206-261c4ee38ee5 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.366398 Jul 18 03:14:51.262680 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3430/6790] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:50 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:51.288106 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-28140617-bbe7-41a9-91cc-f2a5ea92e1ff req-f22b828c-6a9d-446e-8383-2f716b3629b1 service nova] Creating event network-changed:33afda19-fa91-47e8-9c1e-beb88b0d366a for instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 on n-h1-849796-1 Jul 18 03:14:51.297860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-28140617-bbe7-41a9-91cc-f2a5ea92e1ff req-f22b828c-6a9d-446e-8383-2f716b3629b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083314 Jul 18 03:14:51.298523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3361/6791] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:14:51.484873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:51.486194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:51.499348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:51.501765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:51.505384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:51.507566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:51.710456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:51.722770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13aa3670-addd-4cb5-afef-527a65c8a62f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.243660 Jul 18 03:14:51.725890 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3431/6792] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:51 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:52.289676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:52.291265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:52.299051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:52.300494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:52.301593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:52.302243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:52.546605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:52.555258 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-83c69935-1d4f-464d-aae9-77e9171fa238 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.277136 Jul 18 03:14:52.555884 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3362/6793] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:52 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:52.744029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:52.744661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:52.773713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:52.774187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:52.775200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:52.775667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:52.935608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:52.943917 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64077681-7e1e-4b55-9d5c-d2a58895499b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.203845 Jul 18 03:14:52.944495 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3432/6794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:52 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:53.574603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:53.575549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:53.583818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:53.584365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:53.585212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:53.586033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:53.781298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:53.794314 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d5059d1-1ae3-43b7-93bd-37c5ff67fb2d tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1691 microversion: 2.1 time: 0.224245 Jul 18 03:14:53.806048 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3363/6795] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:53 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:53.962702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:53.963450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:53.971873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:53.972454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:53.973278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:53.973732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:54.163304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:54.173400 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64049f66-bc74-4915-b6b7-fc9eee0b383a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.214901 Jul 18 03:14:54.174251 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3433/6796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:53 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:54.814471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:54.816558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:54.827988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:54.828860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:54.832427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:54.833240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:55.020102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:55.032992 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2cda4994-c1cb-4981-ba6e-31c9e937f60c tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1709 microversion: 2.1 time: 0.221723 Jul 18 03:14:55.033244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3364/6797] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:54 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:55.192377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:55.194070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:55.202345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:55.203027 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:55.204300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:55.204757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:55.210667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:55.407332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:55.424676 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5098cb1b-461d-4b0d-ac35-f3ad7255500f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.236061 Jul 18 03:14:55.425713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3434/6798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:55 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:14:56.053550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:56.056457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:56.063869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:56.065571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:56.065830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:56.066529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:56.250811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:56.266875 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-488f3159-6a6c-4fd8-92ec-938b5d80f788 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1697 microversion: 2.1 time: 0.218338 Jul 18 03:14:56.267817 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3365/6799] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:56 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1697 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:56.453168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:56.454402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:56.468196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:56.468693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:56.469533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:56.469985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:56.623570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:56.632368 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94fe6fc9-4956-450b-b82a-ac0a6ed20016 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.188137 Jul 18 03:14:56.632970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3435/6800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:56 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:57.286613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:57.288001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:57.295689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:57.296225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:57.297137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:57.297815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:57.383753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2450c894-4d15-4f42-9073-06da54f2cd7d req-101502c2-25f1-4733-957e-0e777f625f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "name": "network-vif-unplugged", "status": "completed", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:14:57.397858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2450c894-4d15-4f42-9073-06da54f2cd7d req-101502c2-25f1-4733-957e-0e777f625f2b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:57.398320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2450c894-4d15-4f42-9073-06da54f2cd7d req-101502c2-25f1-4733-957e-0e777f625f2b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:57.412593 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2450c894-4d15-4f42-9073-06da54f2cd7d req-101502c2-25f1-4733-957e-0e777f625f2b service nova] Creating event network-vif-unplugged:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:14:57.422263 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2450c894-4d15-4f42-9073-06da54f2cd7d req-101502c2-25f1-4733-957e-0e777f625f2b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040569 Jul 18 03:14:57.424783 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3436/6801] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:14:57.484282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:57.492588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a61c90fd-987e-49f2-a8cb-7a127b15a35f tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1697 microversion: 2.1 time: 0.210913 Jul 18 03:14:57.503177 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3366/6802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:57 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:57.652162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:57.652874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:57.659832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:57.660638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:57.661576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:57.661939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:57.804648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:57.812485 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-debbd62c-63b0-4149-b7aa-bb4581bcfd2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.165701 Jul 18 03:14:57.813094 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3437/6803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:57 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:58.510724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:58.511397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:58.513489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:58.514177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:58.521607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:58.522079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:58.522881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:58.523368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:58.660181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:58.667831 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5bcfa545-e24d-4be1-b3cc-7c188e1b4341 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1697 microversion: 2.1 time: 0.161073 Jul 18 03:14:58.668415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3367/6804] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:58 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:58.830995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:58.831565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:58.833464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:14:58.839690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:58.840140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:58.841018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:58.841462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:58.976814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:58.985487 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c62319c-bc8a-455b-8eaa-7a834d80aa95 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.158923 Jul 18 03:14:58.986055 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3438/6805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:58 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:14:59.686253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:14:59.686803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:14:59.695405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:59.695871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:59.696694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:14:59.697187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:14:59.843846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:14:59.855161 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-356ae918-d0d8-4117-8232-b370f32e09ce tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1697 microversion: 2.1 time: 0.172972 Jul 18 03:14:59.855766 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3368/6806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:59 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:00.004472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:00.005050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:00.012771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:00.013920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:00.014773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:00.015222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:00.173159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:00.180879 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7e508ede-06e6-44c4-88d0-f4dd4865e1c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.181512 Jul 18 03:15:00.183025 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3439/6807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:14:59 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:00.874157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:00.874701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:00.883290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:00.883783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:00.884589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:00.885082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:01.030072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:01.038692 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-64a3a842-ad00-4a30-bc3f-02e1b29c1b18 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1682 microversion: 2.1 time: 0.168511 Jul 18 03:15:01.039288 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3369/6808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:00 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:01.200547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:01.201237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:01.210021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:01.210612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:01.211508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:01.212333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:01.370862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:01.380780 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-823ec10c-da11-4ad6-ab4d-bb5fdc8e8312 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.185646 Jul 18 03:15:01.381411 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3440/6809] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:01 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:02.125034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4a339812-b690-4368-914a-c00d7fc8be75 req-06412433-d143-492a-9f78-865f08cf3ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "name": "network-vif-plugged", "status": "completed", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:02.137450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4a339812-b690-4368-914a-c00d7fc8be75 req-06412433-d143-492a-9f78-865f08cf3ece service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:02.138736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4a339812-b690-4368-914a-c00d7fc8be75 req-06412433-d143-492a-9f78-865f08cf3ece service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:02.150657 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4a339812-b690-4368-914a-c00d7fc8be75 req-06412433-d143-492a-9f78-865f08cf3ece service nova] Creating event network-vif-plugged:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:15:02.156500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4a339812-b690-4368-914a-c00d7fc8be75 req-06412433-d143-492a-9f78-865f08cf3ece service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035520 Jul 18 03:15:02.157756 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3370/6810] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:02.398761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:02.399285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:02.406410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:02.406862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:02.407634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:02.408074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:02.553655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:02.561509 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01d497f8-2e43-4ec8-ad4e-08c4207a2b82 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.166859 Jul 18 03:15:02.562095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3441/6811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:02 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:03.580219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:03.581590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:03.588271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:03.588782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:03.589687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:03.590278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:03.734034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:03.742219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cdd9acd8-525d-4e17-93ae-669cecf7a730 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1340 microversion: 2.1 time: 0.167125 Jul 18 03:15:03.742826 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3371/6812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:03 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:04.760031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:04.760653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:04.770111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.770581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.771568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:04.772128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:04.913151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:04.921035 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-89dae62a-7519-45ad-9f74-b0add927b01f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.164975 Jul 18 03:15:04.921635 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3442/6813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:04 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:05.941211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:05.942224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:05.950676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.951145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:05.951994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:05.952453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:06.109335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:06.118213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b4809be-6535-4914-9401-a6915e8a31d4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.181355 Jul 18 03:15:06.118815 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3372/6814] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:05 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:07.136141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:07.136831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:07.146299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:07.148068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:07.150550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:07.151099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:07.310740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:07.319103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a61f4b36-c897-4825-b953-0fc720f58670 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.187486 Jul 18 03:15:07.319705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3443/6815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:07 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:08.337077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:08.337711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:08.347271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:08.347861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:08.350167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:08.350759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:08.504646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:08.512785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-07f515c2-0888-47e7-a038-cbc578b0cc2e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.180386 Jul 18 03:15:08.513407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3373/6816] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:08 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:09.530611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:09.531228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:09.538690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:09.539440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:09.540584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:09.541068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:09.671783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:09.680689 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a9d237c6-10fb-4e7a-8642-85d19792d916 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.154062 Jul 18 03:15:09.681314 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3444/6817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:09 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:10.698766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:10.699310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:10.706474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:10.706943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:10.707737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:10.708253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:10.711676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:10.849803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:10.858026 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-790f7fcb-a15a-4891-a748-5c644219eb59 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.164306 Jul 18 03:15:10.858612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3374/6818] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:10 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:11.875347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:11.876076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:11.883100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:11.883564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:11.885042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:11.885703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:12.048091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:12.057677 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f79bc66-c65c-49eb-802e-e00d6646227e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.186076 Jul 18 03:15:12.058414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3445/6819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:11 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:13.074858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:13.075491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:13.083239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:13.083787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:13.084756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:13.085332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:13.243262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:13.251839 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5eaec7b9-3817-4386-b2b1-d2afcf614ce9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.180891 Jul 18 03:15:13.252525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3375/6820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:13 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:14.269851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:14.270547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:14.278285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:14.278809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:14.279672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:14.280157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:14.427533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:14.436177 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-190df51d-d3f8-4075-94ea-b240a28e629f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.170386 Jul 18 03:15:14.436773 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3446/6821] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:14 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:15.453749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:15.454388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:15.461389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:15.461861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:15.462886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:15.463350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:15.607916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:15.615912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f068b87-1809-4255-b9a0-852d5cba524a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.166018 Jul 18 03:15:15.616539 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3376/6822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:15 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:16.471385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b1066b47-d1e1-42ac-9b85-a28bdf60b141 req-fa00077f-28a3-4867-9da0-8fc32e3aaae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e10367f-3ffb-49ee-ad5a-e16ffaec13b5", "name": "network-vif-plugged", "status": "completed", "tag": "33afda19-fa91-47e8-9c1e-beb88b0d366a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:16.480770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1066b47-d1e1-42ac-9b85-a28bdf60b141 req-fa00077f-28a3-4867-9da0-8fc32e3aaae7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:16.481222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b1066b47-d1e1-42ac-9b85-a28bdf60b141 req-fa00077f-28a3-4867-9da0-8fc32e3aaae7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:16.493532 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b1066b47-d1e1-42ac-9b85-a28bdf60b141 req-fa00077f-28a3-4867-9da0-8fc32e3aaae7 service nova] Creating event network-vif-plugged:33afda19-fa91-47e8-9c1e-beb88b0d366a for instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 on n-h1-849796-1 Jul 18 03:15:16.499480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b1066b47-d1e1-42ac-9b85-a28bdf60b141 req-fa00077f-28a3-4867-9da0-8fc32e3aaae7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Jul 18 03:15:16.500124 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3447/6823] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:15:16.636782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:16.637630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:16.647479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:16.647948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:16.648967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:16.649497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:16.801652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:16.809311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-012ce003-3c03-4808-b309-3c0a36481b16 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.177375 Jul 18 03:15:16.809967 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3377/6824] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:16 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:17.827523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:17.828226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:17.830204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=45 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:17.835829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:17.836286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:17.837090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:17.837539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:17.983951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:17.991621 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-767540a2-e114-40ef-95ca-fad75d09cf73 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1374 microversion: 2.1 time: 0.169919 Jul 18 03:15:17.992206 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3448/6825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:17 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:19.008747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:19.010058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:19.012724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:19.018702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.019174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.019965 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.020415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.154046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:19.162093 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad8fd211-fc1f-4d7b-9b9f-837ed0ce3684 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1560 microversion: 2.1 time: 0.157271 Jul 18 03:15:19.162673 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3378/6826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:19 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:19.178320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:19.178931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:19.186906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.187499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.188285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.188741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.330462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:19.338119 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8699acb7-6be1-46c9-8743-d96efbe3e1c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1560 microversion: 2.1 time: 0.163864 Jul 18 03:15:19.338789 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3449/6827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:19 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:19.410092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:19.410462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:19.416568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.417081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.417873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.418330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.445667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:15:19.527932 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59869776-030f-4a5a-95f2-ba57cec0ed6c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 204 len: 0 microversion: 2.1 time: 0.121591 Jul 18 03:15:19.528704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3379/6828] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:15:19 2022] DELETE /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:15:19.537163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:19.537883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:19.544642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.545667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.546464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:19.546914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:19.680707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:19.688935 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db0aac9b-516b-4e7e-9ad4-d22a83012cea tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1566 microversion: 2.1 time: 0.155790 Jul 18 03:15:19.689528 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3450/6829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:19 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:20.707744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:20.708544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:20.715718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:20.716344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:20.717970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:20.718516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:20.854785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:20.863215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-136f9679-b731-4172-8f65-6a9f167c7eab tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1566 microversion: 2.1 time: 0.160719 Jul 18 03:15:20.863876 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3380/6830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:20 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:21.716765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0960e386-d803-4e1f-8b05-d4baa91458c9 req-a1c30652-9213-4806-b410-b48b48deac06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e10367f-3ffb-49ee-ad5a-e16ffaec13b5", "name": "network-vif-deleted", "tag": "33afda19-fa91-47e8-9c1e-beb88b0d366a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:21.729633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0960e386-d803-4e1f-8b05-d4baa91458c9 req-a1c30652-9213-4806-b410-b48b48deac06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:21.730356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0960e386-d803-4e1f-8b05-d4baa91458c9 req-a1c30652-9213-4806-b410-b48b48deac06 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:21.744907 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0960e386-d803-4e1f-8b05-d4baa91458c9 req-a1c30652-9213-4806-b410-b48b48deac06 service nova] Creating event network-vif-deleted:33afda19-fa91-47e8-9c1e-beb88b0d366a for instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 on n-h1-849796-1 Jul 18 03:15:21.751946 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0960e386-d803-4e1f-8b05-d4baa91458c9 req-a1c30652-9213-4806-b410-b48b48deac06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038803 Jul 18 03:15:21.752575 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3451/6831] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:21.880147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:21.880776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:21.888100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:21.888565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:21.890183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:21.890636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:21.961448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:21.970390 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4c5b5e0-85a9-4486-b711-a1ed86bfe137 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1359 microversion: 2.1 time: 0.094471 Jul 18 03:15:21.970975 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3381/6832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:21 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1359 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:22.990496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:22.991202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:22.998021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:22.998585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:22.999555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:23.000162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:23.077919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:23.078417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=100 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:23.083464 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12840163-ad05-4ace-b408-b72ac540794e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1359 microversion: 2.1 time: 0.098525 Jul 18 03:15:23.084284 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3452/6833] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:22 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1359 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:24.102119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:24.102744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:24.111026 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:24.111486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:24.112405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:24.112858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:24.181629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:24.192005 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a5f0ee7-39e9-420a-9675-1ee423782299 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1359 microversion: 2.1 time: 0.093847 Jul 18 03:15:24.192605 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3382/6834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:24 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1359 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:25.212019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:25.213190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:25.223815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:25.224589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:25.225564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:25.225943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:25.308297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:25.320144 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b6e27f0-5360-4dfc-a5b3-0552c1d45cce tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1359 microversion: 2.1 time: 0.113584 Jul 18 03:15:25.320763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3453/6835] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:25 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1359 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:26.340288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:26.340882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:26.350751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.351584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:26.352670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.353205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:26.399399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:26.399912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:26.400399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lazy-loading 'fault' on Instance uuid 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:15:26.463154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:26.472888 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-794278a7-a9c1-4010-8cd4-cae5f60a4678 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 200 len: 1364 microversion: 2.1 time: 0.138531 Jul 18 03:15:26.473616 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3383/6836] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:26 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:27.490510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:27.491129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:27.498270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:27.498799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:27.499603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:27.500047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:27.514372 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 HTTP/1.1 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9e10367f-3ffb-49ee-ad5a-e16ffaec13b5'} Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:27.516044 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-43d2062f-d4e4-4940-aa2c-1acc1a8b8964 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 404 len: 111 microversion: 2.1 time: 0.030914 Jul 18 03:15:27.523057 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3454/6837] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:27 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:31.815834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:31.816428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:31.823818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.824317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:31.825196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.825652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:31.854517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:15:31.951166 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-66c64c6d-081b-4e1a-ad81-2dba2829fe9a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 204 len: 0 microversion: 2.1 time: 0.140543 Jul 18 03:15:31.952279 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3384/6838] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:15:31 2022] DELETE /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:15:31.960790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:31.961535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:31.970881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.971340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:31.972140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:31.972591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:32.133686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:32.141846 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06b95e02-812c-4e98-bb17-72becf430deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1408 microversion: 2.1 time: 0.185000 Jul 18 03:15:32.142442 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3455/6839] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:31 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:33.159914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:33.160690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:33.167832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:33.168297 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:33.169134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:33.169623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:33.309634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:33.318834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6c6e4f7-e113-4a15-a289-5dd4451a413c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1408 microversion: 2.1 time: 0.163904 Jul 18 03:15:33.319527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3385/6840] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:33 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:34.340347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:34.340347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:34.347859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:34.348433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:34.349726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:34.350421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:34.418028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:34.427580 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bd673496-6e1c-4f1a-a96b-7dde2cbf1341 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1201 microversion: 2.1 time: 0.093351 Jul 18 03:15:34.428341 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3386/6841] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:34 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:15:34.492162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4ba053ea-3f2c-4e2c-9313-385eac25d32d req-621ae2bc-d134-4dcc-9018-21ef93800be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cefd79b-019e-4ec6-aa27-43ca616723be", "name": "network-vif-deleted", "tag": "843a4acf-a4c2-42e8-9624-389c10fe893b"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:34.501622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4ba053ea-3f2c-4e2c-9313-385eac25d32d req-621ae2bc-d134-4dcc-9018-21ef93800be2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:34.502076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4ba053ea-3f2c-4e2c-9313-385eac25d32d req-621ae2bc-d134-4dcc-9018-21ef93800be2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:34.523248 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4ba053ea-3f2c-4e2c-9313-385eac25d32d req-621ae2bc-d134-4dcc-9018-21ef93800be2 service nova] Creating event network-vif-deleted:843a4acf-a4c2-42e8-9624-389c10fe893b for instance 6cefd79b-019e-4ec6-aa27-43ca616723be on n-h2-849796-1 Jul 18 03:15:34.532596 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4ba053ea-3f2c-4e2c-9313-385eac25d32d req-621ae2bc-d134-4dcc-9018-21ef93800be2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281894 Jul 18 03:15:34.533893 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3456/6842] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:15:35.445599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:35.446405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:35.454223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:35.454681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:35.455476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:35.455923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:35.458869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:15:35.526086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:35.534816 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0da84331-3cfc-47af-a274-91978c064ed2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1201 microversion: 2.1 time: 0.093201 Jul 18 03:15:35.535479 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3387/6843] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:35 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:36.555103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:36.555883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:36.563485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.564088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.565044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:36.565566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:36.632867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:36.641952 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-abc588a9-3bf0-4aa8-bea1-3092df29d42d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1201 microversion: 2.1 time: 0.092316 Jul 18 03:15:36.642664 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3457/6844] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:36 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:37.661823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:37.663333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:37.670934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:37.671406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:37.672335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:37.672586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:37.741766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:37.750370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45a846b8-e666-4912-8a8f-191f18f2843b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1201 microversion: 2.1 time: 0.092422 Jul 18 03:15:37.751184 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3388/6845] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:37 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:38.769244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:38.770205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:38.777519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:38.778090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:38.779704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:38.780400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:38.819855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:38.820318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:38.820786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lazy-loading 'fault' on Instance uuid 6cefd79b-019e-4ec6-aa27-43ca616723be {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:15:38.865742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:15:38.875024 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6863c24b-127b-433e-ba98-a7a47dab5dee tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 200 len: 1206 microversion: 2.1 time: 0.110076 Jul 18 03:15:38.886349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3458/6846] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:38 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 1206 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:15:39.895270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:39.895807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:39.905299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:39.906048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:39.907182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:39.907674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:39.923548 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be HTTP/1.1 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6cefd79b-019e-4ec6-aa27-43ca616723be'} Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:39.925309 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6b8dc6b6-1855-43ec-9a45-20bf50aba766 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 404 len: 111 microversion: 2.1 time: 0.035649 Jul 18 03:15:39.929071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3389/6847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:39 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:41.331253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:41.332200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:41.340337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:41.340809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:41.343170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:41.343632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:41.409479 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9a069a7d-c978-4844-aee7-eae4d54608dd tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action" status: 200 len: 24571 microversion: 2.1 time: 0.081957 Jul 18 03:15:41.415634 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3459/6848] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:15:41 2022] POST /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84/action => generated 24571 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:15:42.070535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:42.071241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:42.083738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.084208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.085103 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.085569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.104964 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 HTTP/1.1 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9e10367f-3ffb-49ee-ad5a-e16ffaec13b5'} Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:42.106614 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81d76d1e-bc39-425e-98ee-3dd4b323230e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 404 len: 111 microversion: 2.1 time: 0.041616 Jul 18 03:15:42.111195 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3390/6849] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:15:42 2022] DELETE /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:42.119224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:42.120143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:42.129861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.130367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.131359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.131818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.149055 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 HTTP/1.1 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9e10367f-3ffb-49ee-ad5a-e16ffaec13b5'} Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.150757 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a397908-6b1f-4de8-b821-a6683640d9cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5" status: 404 len: 111 microversion: 2.1 time: 0.038023 Jul 18 03:15:42.155053 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3460/6850] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:42 2022] GET /compute/v2.1/servers/9e10367f-3ffb-49ee-ad5a-e16ffaec13b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:42.744802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:42.745480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:42.752522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.753065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.753869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.754321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.769233 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be HTTP/1.1 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6cefd79b-019e-4ec6-aa27-43ca616723be'} Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:42.770835 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f93b45f-6812-42ae-a961-0a1bcdc7a453 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 404 len: 111 microversion: 2.1 time: 0.031385 Jul 18 03:15:42.774765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3391/6851] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:15:42 2022] DELETE /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:42.782589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:15:42.783212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 6cefd79b-019e-4ec6-aa27-43ca616723be] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:15:42.791642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.791968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.792810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:15:42.793294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:15:42.811435 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be HTTP/1.1 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '6cefd79b-019e-4ec6-aa27-43ca616723be'} Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:15:42.813113 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 6cefd79b-019e-4ec6-aa27-43ca616723be could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fe9f3006-2a6c-4c5e-90a7-469b04581d6d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be" status: 404 len: 111 microversion: 2.1 time: 0.037437 Jul 18 03:15:42.816825 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3461/6852] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:15:42 2022] GET /compute/v2.1/servers/6cefd79b-019e-4ec6-aa27-43ca616723be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:15:42.895916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9b8afcef-a5f9-4f34-af8a-790fd7d8af22 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: .version_select at 0x7faaf74a8f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-928969416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBaz8sCYq8gXOyEhPYopwoViq+CFCHdEMppa3ZSJBM+4WBTuj0FncKG+QWynd3JXpsTs2t6HfnCy1ELrozSEdobNAeNS4Y44KqSgrCeXvQgDZHv2DfutlFH4bIFu9V4Eg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:15:42.910942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9b8afcef-a5f9-4f34-af8a-790fd7d8af22 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:15:42.916075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9b8afcef-a5f9-4f34-af8a-790fd7d8af22 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:15:42.941178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9b8afcef-a5f9-4f34-af8a-790fd7d8af22 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.049398 Jul 18 03:15:42.941794 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3392/6853] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:15:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:00.301720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-594842327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-928969416", "security_groups": [{"name": "tempest-secgroup-smoke-1636622886"}], "block_device_mapping_v2": [{"uuid": "841dc7e6-80a9-45b4-84cc-08543074ffc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:00.310404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:00.311110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:00.418774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:16:00.803037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:16:00.803471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:16:00.803955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:16:00.804375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:16:00.804801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:16:00.813817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:00.814283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:00.815114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:00.815567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:00.832248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:16:00.837537 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:16:00.896616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:16:00.898829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='841dc7e6-80a9-45b4-84cc-08543074ffc1',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:16:01.031238 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5245d415-ab01-4cb7-a889-06a614f2adf3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733542 Jul 18 03:16:01.031881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3462/6854] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:16:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:16:01.040310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=17 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:01.041115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:01.041862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:01.046968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-296e2beb-9509-4bb7-90f5-ac28765e164d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:01.047646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-296e2beb-9509-4bb7-90f5-ac28765e164d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:01.108722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-296e2beb-9509-4bb7-90f5-ac28765e164d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:01.115749 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-296e2beb-9509-4bb7-90f5-ac28765e164d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1093 microversion: 2.1 time: 0.077666 Jul 18 03:16:01.116353 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3393/6855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:01 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:01.724724 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:16:01.725441 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:16:02.134345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:02.135869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:02.143128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:02.143734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:02.144735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:02.145280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:02.227164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:02.236584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98dabbc1-275b-46ca-8e4b-abadd5cf871b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1209 microversion: 2.1 time: 0.107312 Jul 18 03:16:02.237204 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3463/6856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:02 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:03.256810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:03.258085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:03.271256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:03.272696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:03.274330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:03.274918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:03.500938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:03.509228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24adbe1a-59b7-431f-a631-b7d766b35d57 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1277 microversion: 2.1 time: 0.257735 Jul 18 03:16:03.509744 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3394/6857] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:03 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:03.995408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9fa6561f-6dd2-474a-9cf7-05a8d9d4d7d6 req-9e386a28-c34f-4d6e-912c-5becd1f93189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dface792-c21c-497c-9888-62b7fb990a6e", "tag": "48501fe4-675a-4f61-85a3-865ce37b2678"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:04.010777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9fa6561f-6dd2-474a-9cf7-05a8d9d4d7d6 req-9e386a28-c34f-4d6e-912c-5becd1f93189 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:04.011606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9fa6561f-6dd2-474a-9cf7-05a8d9d4d7d6 req-9e386a28-c34f-4d6e-912c-5becd1f93189 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:04.027820 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9fa6561f-6dd2-474a-9cf7-05a8d9d4d7d6 req-9e386a28-c34f-4d6e-912c-5becd1f93189 service nova] Creating event network-changed:48501fe4-675a-4f61-85a3-865ce37b2678 for instance dface792-c21c-497c-9888-62b7fb990a6e on n-h1-849796-1 Jul 18 03:16:04.034098 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9fa6561f-6dd2-474a-9cf7-05a8d9d4d7d6 req-9e386a28-c34f-4d6e-912c-5becd1f93189 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131013 Jul 18 03:16:04.035686 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3464/6858] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:04.527844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:04.528570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:04.535872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:04.536432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:04.537331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:04.537955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:04.756614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:04.765240 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a9868bc-d0fb-4c0b-b4d5-b578e8b47fe2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1277 microversion: 2.1 time: 0.241310 Jul 18 03:16:04.765829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3395/6859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:04 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:05.785116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:05.785883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:05.793194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:05.793660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:05.794452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:05.795663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:05.932474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:05.941135 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-398c58c8-a22c-4c75-a715-98a7d7ce22f2 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1277 microversion: 2.1 time: 0.162672 Jul 18 03:16:05.941715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3465/6860] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:05 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:06.958393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:06.959033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:06.966056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:06.967204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:06.968315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:06.968777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:07.108621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:07.116101 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7079592f-85d9-4e00-af34-cc9e0ceea8e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1277 microversion: 2.1 time: 0.161806 Jul 18 03:16:07.116674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3396/6861] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:06 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:16:08.133272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:08.133955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:08.141587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:08.142043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:08.142817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:08.143261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:08.614874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:08.622397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce5346b7-1176-432a-9149-19c4ad562061 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.493076 Jul 18 03:16:08.623830 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3466/6862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:08 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:09.640101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:09.640731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:09.647747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:09.648213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:09.649040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:09.649498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:09.782536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:09.790569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fadbd87-d330-4eda-847f-85015295c43e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.154419 Jul 18 03:16:09.791151 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3397/6863] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:09 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:10.807495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:10.808112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:10.815969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:10.816425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:10.817234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:10.817681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:10.823140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:10.849320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:10.952630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:10.960222 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cbd2aafa-79d6-4a7e-a31a-c4059f30beb5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.156624 Jul 18 03:16:10.960830 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3467/6864] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:10 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:11.977242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:11.980348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:11.980619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:16:11.986449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:11.986914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:11.987744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:11.988200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:12.131176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:12.139320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2edda237-fac9-4c72-ae0f-d3f27a3932c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.165497 Jul 18 03:16:12.140088 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3398/6865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:11 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:13.156138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:13.156766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:13.164035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:13.164498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:13.165331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:13.165923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:13.307549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:13.315283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e97dca85-57d4-4abf-b7bd-2f9f97e49554 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.163647 Jul 18 03:16:13.315861 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3468/6866] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:13 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:14.333247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:14.333883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:14.341363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:14.341834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:14.342797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:14.343525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:14.479426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:14.488440 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1156177f-5f16-4680-9ab5-22fbb3eaadd1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.159107 Jul 18 03:16:14.489037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3399/6867] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:14 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:15.505982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:15.506606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:15.513645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:15.514692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:15.515482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:15.515934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:15.651445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:15.659067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cda2f04d-0471-49da-be93-5cc04058876c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.157037 Jul 18 03:16:15.659641 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3469/6868] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:15 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:16.676098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:16.676730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:16.683818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:16.684316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:16.685149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:16.685952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:16.830484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:16.838569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c5896619-950f-4c18-99e4-16f036823dc6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.166598 Jul 18 03:16:16.839163 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3400/6869] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:16 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:17.856498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:17.857143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:17.865647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:17.866101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:17.866889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:17.867338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:17.998765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:18.006472 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f84bac8f-225c-4022-a9a6-087711258184 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.153860 Jul 18 03:16:18.007044 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3470/6870] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:17 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:18.835701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7f21f5db-ea20-4567-b8f7-d88df8d7e0d8 req-f2d3108a-a599-4049-864f-16bdde3b364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dface792-c21c-497c-9888-62b7fb990a6e", "name": "network-vif-plugged", "status": "completed", "tag": "48501fe4-675a-4f61-85a3-865ce37b2678"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:18.844089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7f21f5db-ea20-4567-b8f7-d88df8d7e0d8 req-f2d3108a-a599-4049-864f-16bdde3b364c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:18.844552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7f21f5db-ea20-4567-b8f7-d88df8d7e0d8 req-f2d3108a-a599-4049-864f-16bdde3b364c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:18.855775 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7f21f5db-ea20-4567-b8f7-d88df8d7e0d8 req-f2d3108a-a599-4049-864f-16bdde3b364c service nova] Creating event network-vif-plugged:48501fe4-675a-4f61-85a3-865ce37b2678 for instance dface792-c21c-497c-9888-62b7fb990a6e on n-h1-849796-1 Jul 18 03:16:18.861145 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7f21f5db-ea20-4567-b8f7-d88df8d7e0d8 req-f2d3108a-a599-4049-864f-16bdde3b364c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094910 Jul 18 03:16:18.861751 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3401/6871] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:19.024057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:19.024677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:19.031793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:19.032247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:19.033063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:19.033515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:19.171466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:19.179101 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95b2b5bf-1c2f-4fcb-a59c-39f4f4121fde tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.159074 Jul 18 03:16:19.179674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3471/6872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:19 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:20.197128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:20.198057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:20.205287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:20.205757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:20.206559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:20.207013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:20.352701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:20.361545 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4703059-dfa5-4b47-b49a-8c029065de0c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1265 microversion: 2.1 time: 0.169503 Jul 18 03:16:20.362432 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3402/6873] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:20 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:21.033828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:21.034434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:21.041938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-079958c5-78f0-4eef-b42b-1115cab9b73e req-5143d617-7b95-43d0-8ef0-69bd899f496f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:21.051827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-079958c5-78f0-4eef-b42b-1115cab9b73e req-5143d617-7b95-43d0-8ef0-69bd899f496f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.052040 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.052379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.052521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-079958c5-78f0-4eef-b42b-1115cab9b73e req-5143d617-7b95-43d0-8ef0-69bd899f496f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.053202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.053655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.065002 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-079958c5-78f0-4eef-b42b-1115cab9b73e req-5143d617-7b95-43d0-8ef0-69bd899f496f service nova] Creating event network-changed:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:16:21.070505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-079958c5-78f0-4eef-b42b-1115cab9b73e req-5143d617-7b95-43d0-8ef0-69bd899f496f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Jul 18 03:16:21.071415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3403/6874] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:21.084747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:16:21.181311 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ae29fe24-8966-480a-8260-24a37afe8b57 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 204 len: 0 microversion: 2.1 time: 0.152220 Jul 18 03:16:21.182070 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3472/6875] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:16:21 2022] DELETE /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:16:21.190951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:21.191676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:21.199125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.199762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.200378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.201619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.352397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:21.360702 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e892e44d-d3e5-4023-b5ce-458fbe9f8fe1 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1688 microversion: 2.1 time: 0.173966 Jul 18 03:16:21.361334 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3404/6876] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:21 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:21.379851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:21.380751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:21.387416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.387866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.389183 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.389645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.524843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:21.533220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e2ea4397-32b8-427e-8332-ec5a7a142deb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1451 microversion: 2.1 time: 0.157628 Jul 18 03:16:21.533825 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3473/6877] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:21 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:21.549568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:21.550195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:21.556574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.557078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.557873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:21.558330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:21.698340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:21.706825 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-83152637-9f08-4f0d-be86-fd38fc92b94f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1451 microversion: 2.1 time: 0.161117 Jul 18 03:16:21.707391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3405/6878] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:21 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:22.379525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:22.380158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:22.387407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:22.387963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:22.388876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:22.389794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:22.680517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:22.688411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6630dc73-11ba-4fbe-8a2d-7c27efda7710 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1688 microversion: 2.1 time: 0.312801 Jul 18 03:16:22.689022 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3474/6879] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:22 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:23.707400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:23.707957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:23.715310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:23.715782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:23.716591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:23.717681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:23.869638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b369cbbf14f7695c1c2a69e174c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303eb0cf44dc4e43a016b79f3e14d8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:16:23.878269 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-46cc0e02-1a70-47fc-ae59-a9259df44e61 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 200 len: 1569 microversion: 2.1 time: 0.175176 Jul 18 03:16:23.878891 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3406/6880] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:23 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:16:24.322556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b3d268be-c665-4aed-9060-a08e65b7df95 req-34534013-d482-40b6-98bd-7591ae216de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af91064e-10c3-47c6-aa77-62b531a3ae84", "name": "network-vif-deleted", "tag": "8bae696d-537d-4001-9193-02269f56763e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:24.331922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b3d268be-c665-4aed-9060-a08e65b7df95 req-34534013-d482-40b6-98bd-7591ae216de8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:24.332375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b3d268be-c665-4aed-9060-a08e65b7df95 req-34534013-d482-40b6-98bd-7591ae216de8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:24.345006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b3d268be-c665-4aed-9060-a08e65b7df95 req-34534013-d482-40b6-98bd-7591ae216de8 service nova] Creating event network-vif-deleted:8bae696d-537d-4001-9193-02269f56763e for instance af91064e-10c3-47c6-aa77-62b531a3ae84 on n-h2-849796-1 Jul 18 03:16:24.350095 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b3d268be-c665-4aed-9060-a08e65b7df95 req-34534013-d482-40b6-98bd-7591ae216de8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 Jul 18 03:16:24.351969 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3475/6881] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:24.897099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:24.897740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] [instance: af91064e-10c3-47c6-aa77-62b531a3ae84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:16:24.904512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:24.905012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:24.906019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:24.906482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:24.921256 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] HTTP exception thrown: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Request method failure captured: Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 HTTP/1.1 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M2MvS_5yiFLlV5A0nJ4kWpt7ocUMzhl_AKiGqaO3XsS0BNPM92yExuRorJppWhkkeCN5ZJpWAvwE5ygF1J40ToOMCjUlKLMJ60OlFrn_gTJN1yXHK-zhYDEnl3NaRyS2ViGL_CRsjIjRKVaqDOb6Q5sUfV5z55XgAst1erIvLhzOLg Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/303eb0cf44dc4e43a016b79f3e14d8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 303eb0cf44dc4e43a016b79f3e14d8f8 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1680096804 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 0d0b369cbbf14f7695c1c2a69e174c85 Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1680096804-project Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'af91064e-10c3-47c6-aa77-62b531a3ae84'} Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:16:24.922902 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Returning 404 to user: Instance af91064e-10c3-47c6-aa77-62b531a3ae84 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea2f0381-2756-4111-8590-0c52ef9e9d74 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84" status: 404 len: 111 microversion: 2.1 time: 0.032040 Jul 18 03:16:24.926933 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3407/6882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:16:24 2022] GET /compute/v2.1/servers/af91064e-10c3-47c6-aa77-62b531a3ae84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:16:26.377412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2f8fcf02-1966-4eaa-8f76-feb4d2442f24 req-609628a5-908a-4080-84b7-447d162c9441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dface792-c21c-497c-9888-62b7fb990a6e", "tag": "48501fe4-675a-4f61-85a3-865ce37b2678"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:16:26.385760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2f8fcf02-1966-4eaa-8f76-feb4d2442f24 req-609628a5-908a-4080-84b7-447d162c9441 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:16:26.386219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2f8fcf02-1966-4eaa-8f76-feb4d2442f24 req-609628a5-908a-4080-84b7-447d162c9441 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:16:26.398669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2f8fcf02-1966-4eaa-8f76-feb4d2442f24 req-609628a5-908a-4080-84b7-447d162c9441 service nova] Creating event network-changed:48501fe4-675a-4f61-85a3-865ce37b2678 for instance dface792-c21c-497c-9888-62b7fb990a6e on n-h1-849796-1 Jul 18 03:16:26.403632 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2f8fcf02-1966-4eaa-8f76-feb4d2442f24 req-609628a5-908a-4080-84b7-447d162c9441 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032458 Jul 18 03:16:26.405555 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3476/6883] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:16:28.176454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b8099abf-2ebc-4e1d-88ec-b8c527704cf8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] Calling method '.version_select at 0x7faaf74a8d30>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:16:28.207488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b8099abf-2ebc-4e1d-88ec-b8c527704cf8 tempest-TestNetworkAdvancedServerOps-1680096804 tempest-TestNetworkAdvancedServerOps-1680096804-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1681802277" status: 202 len: 0 microversion: 2.1 time: 0.037122 Jul 18 03:16:28.211420 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3408/6884] 10.222.0.67 () {58 vars in 1283 bytes} [Mon Jul 18 03:16:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1681802277 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:17:41.179869 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:17:41.180588 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:17:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:18:19.970329 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:18:19.971179 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:18:19.971844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:19.972596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:20.150317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:20.150920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:20.157319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:20.157827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:20.158569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:20.159019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:20.186281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:18:20.268219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93591cdc-a166-462c-9af0-f101a7299f2c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 204 len: 0 microversion: 2.1 time: 0.299625 Jul 18 03:18:20.269408 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3477/6885] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:18:19 2022] DELETE /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:18:20.275551 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:18:20.277366 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:18:20.277915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=72 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:20.278676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:20.283057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:20.283684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:20.291475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:20.291941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:20.292727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:20.293357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:20.426999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:20.435473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1b297e5c-eaa0-4138-aa82-47682601e50f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1576 microversion: 2.1 time: 0.161765 Jul 18 03:18:20.436051 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3409/6886] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:20 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:21.454760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:21.455502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:21.471619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:21.472080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:21.472875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:21.473356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:21.481595 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51104. Jul 18 03:18:21.482499 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51102. Jul 18 03:18:21.618448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:21.626095 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d275b822-70b3-4799-b5cb-a6c7e2a4de31 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1576 microversion: 2.1 time: 0.176348 Jul 18 03:18:21.626664 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3478/6887] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:21 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:22.644191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:22.644729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:22.660726 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51112. Jul 18 03:18:22.667841 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 51110. Jul 18 03:18:22.670766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.671244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.672048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:22.672509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:22.890782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:22.905103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88aa5760-a045-48f7-9a4e-d0200c4468b4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1576 microversion: 2.1 time: 0.264410 Jul 18 03:18:22.906709 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3410/6888] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:22 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:23.282607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ccd3b34b-6705-45ef-90e9-8cabde6b919a req-afc3d151-befd-418a-8905-5d113202f582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dface792-c21c-497c-9888-62b7fb990a6e", "name": "network-vif-deleted", "tag": "48501fe4-675a-4f61-85a3-865ce37b2678"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:23.294373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ccd3b34b-6705-45ef-90e9-8cabde6b919a req-afc3d151-befd-418a-8905-5d113202f582 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:23.295017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ccd3b34b-6705-45ef-90e9-8cabde6b919a req-afc3d151-befd-418a-8905-5d113202f582 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:23.310704 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ccd3b34b-6705-45ef-90e9-8cabde6b919a req-afc3d151-befd-418a-8905-5d113202f582 service nova] Creating event network-vif-deleted:48501fe4-675a-4f61-85a3-865ce37b2678 for instance dface792-c21c-497c-9888-62b7fb990a6e on n-h1-849796-1 Jul 18 03:18:23.316897 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ccd3b34b-6705-45ef-90e9-8cabde6b919a req-afc3d151-befd-418a-8905-5d113202f582 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Jul 18 03:18:23.317949 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3479/6889] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:18:23.928096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:23.929772 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:23.937261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:23.937735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:23.938620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:23.939084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:24.014141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:24.023243 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-660ee69d-3bf2-4cd1-ae5a-a32a29923a6b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1224 microversion: 2.1 time: 0.099118 Jul 18 03:18:24.024285 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3411/6890] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:23 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:25.043415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:25.044122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:25.050844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:25.051296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:25.052263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:25.053336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:25.122967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:25.130727 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c825973-b3d2-4552-a11d-493a5712c326 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1224 microversion: 2.1 time: 0.093755 Jul 18 03:18:25.131389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3480/6891] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:25 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:26.147712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:26.148270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:26.155371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:26.155839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:26.156622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:26.157117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:26.219753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:26.227748 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56ea3b5a-1d5c-4050-b4c0-435861e57ab4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1224 microversion: 2.1 time: 0.084708 Jul 18 03:18:26.228336 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3412/6892] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:26 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:27.244093 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:27.244704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:27.252512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:27.252993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:27.253795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:27.254245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:27.327505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:27.336304 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b7e1494-0804-44e0-991e-7c42df34a529 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 200 len: 1224 microversion: 2.1 time: 0.096318 Jul 18 03:18:27.336885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3481/6893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:27 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:28.354024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:28.354651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:28.361873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:28.362340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:28.363127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:28.363579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:28.377430 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e HTTP/1.1 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'dface792-c21c-497c-9888-62b7fb990a6e'} Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:18:28.378982 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56f7db50-09d6-45b5-9a3a-a75e986bd63b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 404 len: 111 microversion: 2.1 time: 0.030899 Jul 18 03:18:28.383374 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3413/6894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:28 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:18:28.427108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1110988865", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-928969416", "security_groups": [{"name": "tempest-secgroup-smoke-1636622886"}], "block_device_mapping_v2": [{"uuid": "841dc7e6-80a9-45b4-84cc-08543074ffc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:28.542316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:18:29.048807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:18:29.049281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:18:29.049763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:18:29.050190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:18:29.050617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:18:29.060034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:29.060496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:29.061345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:29.061798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:29.079429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:18:29.085885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:18:29.144440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:18:29.146704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='841dc7e6-80a9-45b4-84cc-08543074ffc1',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:18:29.276059 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a26fb8d1-73df-44df-a8f5-a292c2dfb3d5 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852827 Jul 18 03:18:29.276763 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3482/6895] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:18:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:18:29.286745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bd60bd29-7728-497b-bee4-ee83a2be7092 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:29.287372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bd60bd29-7728-497b-bee4-ee83a2be7092 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:29.346572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd60bd29-7728-497b-bee4-ee83a2be7092 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:29.354629 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bd60bd29-7728-497b-bee4-ee83a2be7092 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1094 microversion: 2.1 time: 0.071725 Jul 18 03:18:29.355239 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3414/6896] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:29 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:30.373658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:30.374331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:30.380545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:30.381024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:30.382568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:30.383508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:30.453521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:30.462833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f9d43694-2bd5-4d30-a8dd-172443393c1a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1210 microversion: 2.1 time: 0.093863 Jul 18 03:18:30.463426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3483/6897] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:30 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:31.480120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:31.481432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:31.492560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:31.493210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:31.494123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:31.494681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:31.742585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:31.751054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41cab8ea-d57c-4bce-bf51-90789e77bf2a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1278 microversion: 2.1 time: 0.274806 Jul 18 03:18:31.752068 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3415/6898] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:31 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:31.854215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-6f6193f5-5dae-4ee4-8135-327060ca5c64 req-aa8f5e5c-5b89-41a9-8e6b-bd5bd1fd6447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416d9a93-9707-4295-8591-5aeb60914333", "tag": "638a4ae8-01e3-451c-a150-d82086ac0210"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:31.873305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6f6193f5-5dae-4ee4-8135-327060ca5c64 req-aa8f5e5c-5b89-41a9-8e6b-bd5bd1fd6447 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:31.874033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-6f6193f5-5dae-4ee4-8135-327060ca5c64 req-aa8f5e5c-5b89-41a9-8e6b-bd5bd1fd6447 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:31.889195 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-6f6193f5-5dae-4ee4-8135-327060ca5c64 req-aa8f5e5c-5b89-41a9-8e6b-bd5bd1fd6447 service nova] Creating event network-changed:638a4ae8-01e3-451c-a150-d82086ac0210 for instance 416d9a93-9707-4295-8591-5aeb60914333 on n-h1-849796-1 Jul 18 03:18:31.895438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-6f6193f5-5dae-4ee4-8135-327060ca5c64 req-aa8f5e5c-5b89-41a9-8e6b-bd5bd1fd6447 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045833 Jul 18 03:18:31.896506 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3484/6899] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:32.769374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:32.770634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:32.779062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:32.779692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:32.780669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:32.781153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:32.964644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:32.972985 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10054d66-1e81-4e58-b086-49789c3394ca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1278 microversion: 2.1 time: 0.208381 Jul 18 03:18:32.973584 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3416/6900] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:32 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:33.993081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:33.993782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:34.000653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:34.001141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:34.001925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:34.002365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:34.145919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:34.154413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cbbd32a8-ea81-4b8a-88ed-feb5187402d8 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1278 microversion: 2.1 time: 0.167378 Jul 18 03:18:34.155008 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3485/6901] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:33 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:35.171935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:35.172798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:35.180286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:35.180753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:35.181609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:35.182071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:35.335622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:35.343605 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82037442-8358-4566-818f-fbb534606007 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1278 microversion: 2.1 time: 0.175707 Jul 18 03:18:35.344302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3417/6902] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:35 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:36.361378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:36.361992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:36.369288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:36.369748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:36.370520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:36.370960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:36.506567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:36.514325 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d153129-eb37-42e6-ad89-927b451eb8a7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.156770 Jul 18 03:18:36.514838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3486/6903] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:36 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:37.532415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:37.533081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:37.540888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:37.541380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:37.542197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:37.542658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:37.692005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:37.700614 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-896ed3b7-737e-4a6d-83d5-cafd6e055506 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.172189 Jul 18 03:18:37.701262 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3418/6904] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:37 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:38.718805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:38.719453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:38.727755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:38.728226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:38.729072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:38.729525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:38.861744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:38.870368 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ecd610d-5e38-4286-b9ac-8d0ebef7f52e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.155582 Jul 18 03:18:38.870974 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3487/6905] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:38 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:39.888124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:39.888730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:39.891487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:39.898338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:39.898640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:39.899275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:39.899722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:40.044981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:40.052711 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-03114580-dba2-4511-86a1-ffd471a1ff72 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.168633 Jul 18 03:18:40.053881 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3419/6906] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:39 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:41.070951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:41.071598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:41.073685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:41.074361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:41.081360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:41.081817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:41.082613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:41.083057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:41.231544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:41.241413 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24c84e8d-1972-4c0c-a0d7-e5de924751d0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.174433 Jul 18 03:18:41.242294 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3488/6907] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:41 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:42.259139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:42.259786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:42.267120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:42.268081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:42.269066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:42.269375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:42.417141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:42.424988 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0d117762-7f94-4b28-9729-8bb6a584f4e0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.170410 Jul 18 03:18:42.425581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3420/6908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:42 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:43.442662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:43.443292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:43.451600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:43.452057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:43.452849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:43.453326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:43.597134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:43.605577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-be306fdb-df13-441f-941f-6846837d830e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.166943 Jul 18 03:18:43.606173 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3489/6909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:43 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:44.622459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:44.623008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:44.630434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:44.630904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:44.632404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:44.632997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:44.777834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:44.785566 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1878f002-ef1b-447f-9f12-7ec21526133e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.167199 Jul 18 03:18:44.786187 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3421/6910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:44 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:45.802712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:45.803331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:45.810532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:45.810985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:45.811766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:45.812209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:45.968824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:45.977198 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9cdd1afc-a23b-4974-9d76-454006ad928c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.178437 Jul 18 03:18:45.977927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3490/6911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:45 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:46.996113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:46.997811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:47.005002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:47.005478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:47.006376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:47.007019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:47.158795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:47.167727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eff44397-6945-4bfa-8376-fa842aa9eff7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.175762 Jul 18 03:18:47.168316 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3422/6912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:46 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:47.503645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-609bc6f2-00da-4f92-99a0-508240d853b3 req-701f912f-bb2e-4632-ab90-dd8021bd56ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416d9a93-9707-4295-8591-5aeb60914333", "name": "network-vif-plugged", "status": "completed", "tag": "638a4ae8-01e3-451c-a150-d82086ac0210"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:47.513275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-609bc6f2-00da-4f92-99a0-508240d853b3 req-701f912f-bb2e-4632-ab90-dd8021bd56ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:47.513720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-609bc6f2-00da-4f92-99a0-508240d853b3 req-701f912f-bb2e-4632-ab90-dd8021bd56ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:47.527237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-609bc6f2-00da-4f92-99a0-508240d853b3 req-701f912f-bb2e-4632-ab90-dd8021bd56ea service nova] Creating event network-vif-plugged:638a4ae8-01e3-451c-a150-d82086ac0210 for instance 416d9a93-9707-4295-8591-5aeb60914333 on n-h1-849796-1 Jul 18 03:18:47.534243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-609bc6f2-00da-4f92-99a0-508240d853b3 req-701f912f-bb2e-4632-ab90-dd8021bd56ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Jul 18 03:18:47.535362 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3491/6913] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:18:48.184689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:48.185359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:48.192535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:48.193038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:48.194384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:48.194849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:48.337129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:48.345350 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-430eedff-bd00-4e56-958d-2db2935937e6 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1266 microversion: 2.1 time: 0.164237 Jul 18 03:18:48.345945 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3423/6914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:48 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:49.363415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:49.364124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:49.371981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.372441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.373257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.373706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.538950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:49.548074 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e8e77412-2c1e-4e82-bf22-ee35388ff755 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1452 microversion: 2.1 time: 0.188849 Jul 18 03:18:49.548720 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3492/6915] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:49 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:18:49.564570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:18:49.565229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:18:49.574192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.574661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.575485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:49.575926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:49.721753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:18:49.731231 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-31b61fb2-6b23-4c84-b833-05e5302d6f9b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1452 microversion: 2.1 time: 0.170467 Jul 18 03:18:49.731823 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3424/6916] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:18:49 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:18:51.938784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-99fcc7f2-75c9-4310-963d-51b04b9836d6 req-407dc9da-6abf-47e7-8ff1-9ee71396ba05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416d9a93-9707-4295-8591-5aeb60914333", "tag": "638a4ae8-01e3-451c-a150-d82086ac0210"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:18:51.944016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:51.953325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-99fcc7f2-75c9-4310-963d-51b04b9836d6 req-407dc9da-6abf-47e7-8ff1-9ee71396ba05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:18:51.953875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-99fcc7f2-75c9-4310-963d-51b04b9836d6 req-407dc9da-6abf-47e7-8ff1-9ee71396ba05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:18:51.958549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:18:51.969150 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-99fcc7f2-75c9-4310-963d-51b04b9836d6 req-407dc9da-6abf-47e7-8ff1-9ee71396ba05 service nova] Creating event network-changed:638a4ae8-01e3-451c-a150-d82086ac0210 for instance 416d9a93-9707-4295-8591-5aeb60914333 on n-h1-849796-1 Jul 18 03:18:51.978219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-99fcc7f2-75c9-4310-963d-51b04b9836d6 req-407dc9da-6abf-47e7-8ff1-9ee71396ba05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043326 Jul 18 03:18:51.978977 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3493/6917] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:19:21.192864 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:19:21.193528 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:19:21.733583 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:19:21.734169 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:19:26.659871 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:19:26.660402 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:20:31.584433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=34 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:31.585231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=86 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:31.589692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-393311941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-928969416", "security_groups": [{"name": "tempest-secgroup-smoke-1636622886"}], "block_device_mapping_v2": [{"uuid": "29862031-183b-4ffe-bd4a-7bc8118a6657", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df4e9d03-10fe-4950-bb01-897655501437"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:31.836210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] validate_networks() for [('df4e9d03-10fe-4950-bb01-897655501437', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:20:32.295505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:20:32.296586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:20:32.297116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:20:32.297542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:20:32.297969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:20:32.306824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:32.307285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:32.308098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:32.308555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:32.325402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:20:32.331664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Getting quotas for user 21150b21d9704d189d8932ca8e3a640d and project dc364d31d5094fcaa5cd3eb4d7b11f00. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:20:32.391584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:20:32.393784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29862031-183b-4ffe-bd4a-7bc8118a6657',volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:20:32.524974 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ddf51ec6-defe-4895-a3cb-b8ac7f6ca0c0 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.942429 Jul 18 03:20:32.525649 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3425/6918] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:20:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:20:32.535703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:32.540912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c0914516-b3ab-4574-8d40-20965c97e18b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:32.541826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c0914516-b3ab-4574-8d40-20965c97e18b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:32.651677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c0914516-b3ab-4574-8d40-20965c97e18b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:32.661076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c0914516-b3ab-4574-8d40-20965c97e18b tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1093 microversion: 2.1 time: 0.128038 Jul 18 03:20:32.661665 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3494/6919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:32 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1093 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:33.679130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:33.679775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:33.689721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:33.689721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:33.690215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:33.690876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:33.759331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:33.768319 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1e6d708-88d4-4424-8447-783f86068364 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1209 microversion: 2.1 time: 0.093077 Jul 18 03:20:33.769137 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3426/6920] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:33 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:34.786771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:34.787305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:34.798579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:34.799846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:34.800887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:34.801412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:35.039903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:35.054695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1845219b-4ad2-42f2-a155-f5b364df5beb tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1277 microversion: 2.1 time: 0.271821 Jul 18 03:20:35.056018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3495/6921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:34 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1277 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:35.397469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-6f2408af-bb61-4e72-b49d-056ef77f4ba6 req-a726baa4-985a-4509-b735-d90544f097d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a5f212-b345-4bee-a1f5-49b1210322c1", "tag": "7da99e14-99a3-448e-999f-5ce7e0ff341e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:35.407623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6f2408af-bb61-4e72-b49d-056ef77f4ba6 req-a726baa4-985a-4509-b735-d90544f097d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:35.408456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-6f2408af-bb61-4e72-b49d-056ef77f4ba6 req-a726baa4-985a-4509-b735-d90544f097d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:35.426742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-6f2408af-bb61-4e72-b49d-056ef77f4ba6 req-a726baa4-985a-4509-b735-d90544f097d2 service nova] Creating event network-changed:7da99e14-99a3-448e-999f-5ce7e0ff341e for instance 00a5f212-b345-4bee-a1f5-49b1210322c1 on n-h2-849796-1 Jul 18 03:20:35.433671 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-6f2408af-bb61-4e72-b49d-056ef77f4ba6 req-a726baa4-985a-4509-b735-d90544f097d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165554 Jul 18 03:20:35.434567 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3427/6922] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:20:36.071904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:36.072773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:36.080556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:36.081193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:36.082253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:36.082842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:36.329635 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:36.338257 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c9b3a020-4228-4da1-b1a8-f20d8cc87725 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1277 microversion: 2.1 time: 0.270395 Jul 18 03:20:36.339226 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3496/6923] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:36 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:37.357447 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:37.358243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:37.365188 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:37.365656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:37.366460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:37.366921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:37.510379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:37.518821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-835ee91e-23f0-420c-b162-15eccabb4860 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1277 microversion: 2.1 time: 0.166642 Jul 18 03:20:37.519411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3428/6924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:37 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:20:38.536719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:38.537280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:38.544609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:38.545085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:38.546112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:38.546788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:38.685189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:38.694417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-217edba4-2821-4d8d-96fd-3752397a364f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1277 microversion: 2.1 time: 0.161771 Jul 18 03:20:38.695014 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3497/6925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:38 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:39.713005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:39.713641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:39.721463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:39.721928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:39.722728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:39.723186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:39.860537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:39.868396 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-defc3e42-8b57-474b-88ee-ba90aae1f86c tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.159380 Jul 18 03:20:39.869009 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3429/6926] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:39 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:40.884684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:40.885342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:40.895068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:40.895530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:40.896319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:40.896769 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:41.037854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:41.046065 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d4b1deb-3a9a-41f4-9dd2-c7e055ed96d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.165171 Jul 18 03:20:41.046820 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3498/6927] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:40 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:42.065762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:42.066925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:42.076321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:42.077057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:42.078081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:42.078681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:42.230632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:42.241770 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cff3c745-c4d4-4ceb-9101-7d929d189605 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.182150 Jul 18 03:20:42.242736 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3430/6928] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:42 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:43.260518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:43.261187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:43.264057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:43.269921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:43.270376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:43.271174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:43.271621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:43.410725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:43.419510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ba2f4b0-87bb-4f78-8daf-acca3fbc666d tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.163011 Jul 18 03:20:43.420132 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3499/6929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:43 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:44.436832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:44.437408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:44.440369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:44.441097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:20:44.448375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:44.448843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:44.449663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:44.450119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:44.603072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:44.611344 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c3aee75-70fa-491f-8749-9150fc2e1108 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.178509 Jul 18 03:20:44.611926 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3431/6930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:44 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:45.629347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:45.629867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:45.636829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:45.637333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:45.638115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:45.638571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:45.778178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:45.786085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0148e380-5b5f-40f3-8da3-c3ceb83d2aca tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.161800 Jul 18 03:20:45.786657 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3500/6931] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:45 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:46.803930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:46.804580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:46.811824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:46.812288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:46.813689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:46.814146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:46.951589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:46.959688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8908871-e6db-4f0f-bc7d-e2ee0deca31e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.159876 Jul 18 03:20:46.960287 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3432/6932] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:46 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:47.977241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:47.978675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:47.986119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:47.986574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:47.987353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:47.987803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:48.126295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:48.134256 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e4bc278-8fa6-4c39-8720-8a821cb6057a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.160955 Jul 18 03:20:48.134824 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3501/6933] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:47 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:49.153265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:49.153908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:49.162315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:49.162781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:49.164055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:49.164055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:49.324269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:49.333078 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7cdb0067-9dd4-4297-912f-449f38c61c6f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.184982 Jul 18 03:20:49.333689 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3433/6934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:49 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:49.737470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b4924a11-4ebf-4d74-bfa3-f61b5d624c94 req-9eb7a0bf-3ec8-402f-aac1-25043740fde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a5f212-b345-4bee-a1f5-49b1210322c1", "name": "network-vif-plugged", "status": "completed", "tag": "7da99e14-99a3-448e-999f-5ce7e0ff341e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:49.747453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b4924a11-4ebf-4d74-bfa3-f61b5d624c94 req-9eb7a0bf-3ec8-402f-aac1-25043740fde6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:49.748182 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b4924a11-4ebf-4d74-bfa3-f61b5d624c94 req-9eb7a0bf-3ec8-402f-aac1-25043740fde6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:49.761935 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b4924a11-4ebf-4d74-bfa3-f61b5d624c94 req-9eb7a0bf-3ec8-402f-aac1-25043740fde6 service nova] Creating event network-vif-plugged:7da99e14-99a3-448e-999f-5ce7e0ff341e for instance 00a5f212-b345-4bee-a1f5-49b1210322c1 on n-h2-849796-1 Jul 18 03:20:49.767943 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b4924a11-4ebf-4d74-bfa3-f61b5d624c94 req-9eb7a0bf-3ec8-402f-aac1-25043740fde6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034255 Jul 18 03:20:49.769385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3502/6935] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:20:50.350747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:50.351373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:50.358353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:50.358829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:50.360167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:50.360736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:50.501173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:50.509248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bfb1cd26-b991-48b3-84b4-71d54173a7d3 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1265 microversion: 2.1 time: 0.162291 Jul 18 03:20:50.509920 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3434/6936] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:50 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:51.528673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:51.529346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:51.538887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.539351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:51.540162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.540606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:51.677223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:51.684882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60a3dbf7-cd1e-46dd-8aa8-16f236121778 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1451 microversion: 2.1 time: 0.160598 Jul 18 03:20:51.685563 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3503/6937] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:51 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:20:51.701995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:20:51.702614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:20:51.710139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.710597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:51.711378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:51.711827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:51.843079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:20:51.851501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17a7a328-d213-4bb3-926a-67585402b6cc tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1451 microversion: 2.1 time: 0.153318 Jul 18 03:20:51.852072 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3435/6938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:20:51 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:20:53.794846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d9c2e52b-5813-429e-9c53-9ed4c8655969 req-aa0e024a-d6ea-4cb4-878d-faa3fd5252b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a5f212-b345-4bee-a1f5-49b1210322c1", "tag": "7da99e14-99a3-448e-999f-5ce7e0ff341e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:20:53.804461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d9c2e52b-5813-429e-9c53-9ed4c8655969 req-aa0e024a-d6ea-4cb4-878d-faa3fd5252b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:20:53.804913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d9c2e52b-5813-429e-9c53-9ed4c8655969 req-aa0e024a-d6ea-4cb4-878d-faa3fd5252b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:20:53.817926 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d9c2e52b-5813-429e-9c53-9ed4c8655969 req-aa0e024a-d6ea-4cb4-878d-faa3fd5252b7 service nova] Creating event network-changed:7da99e14-99a3-448e-999f-5ce7e0ff341e for instance 00a5f212-b345-4bee-a1f5-49b1210322c1 on n-h2-849796-1 Jul 18 03:20:53.822999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d9c2e52b-5813-429e-9c53-9ed4c8655969 req-aa0e024a-d6ea-4cb4-878d-faa3fd5252b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 Jul 18 03:20:53.823829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3504/6939] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:21:01.890961 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:21:01.891881 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:21:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:22:23.155858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:23.156835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=58 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:23.161080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=24 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:23.161949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=53 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:22:23.162356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.163359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.171670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.172414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.173481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.174090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.211175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:22:23.269845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-26967fbd-e1b9-4534-ae28-9af887fb3a0d req-2cc8cc77-34fc-48f3-bfb2-ed620f27cdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a5f212-b345-4bee-a1f5-49b1210322c1", "tag": "7da99e14-99a3-448e-999f-5ce7e0ff341e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:23.287212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-26967fbd-e1b9-4534-ae28-9af887fb3a0d req-2cc8cc77-34fc-48f3-bfb2-ed620f27cdcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.288123 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-26967fbd-e1b9-4534-ae28-9af887fb3a0d req-2cc8cc77-34fc-48f3-bfb2-ed620f27cdcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.311193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-26967fbd-e1b9-4534-ae28-9af887fb3a0d req-2cc8cc77-34fc-48f3-bfb2-ed620f27cdcd service nova] Creating event network-changed:7da99e14-99a3-448e-999f-5ce7e0ff341e for instance 00a5f212-b345-4bee-a1f5-49b1210322c1 on n-h2-849796-1 Jul 18 03:22:23.319753 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-366e4dc0-3d7e-47ab-a8c4-ffee54e1e633 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 204 len: 0 microversion: 2.1 time: 0.166261 Jul 18 03:22:23.321350 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3436/6940] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:23 2022] DELETE /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:22:23.328174 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-26967fbd-e1b9-4534-ae28-9af887fb3a0d req-2cc8cc77-34fc-48f3-bfb2-ed620f27cdcd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171859 Jul 18 03:22:23.329439 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3505/6941] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:22:23.336612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:23.337380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:23.343751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.344412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.345070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:23.346330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:23.499220 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:23.507458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b2a3b930-7685-45a6-a14e-c3f2acca19c7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1575 microversion: 2.1 time: 0.178224 Jul 18 03:22:23.508044 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3437/6942] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:23 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:24.531808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:24.532526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:24.540325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:24.540868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:24.541711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:24.542159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:24.702861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:24.711425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2a513680-335e-4dc6-a3ad-dd51228b09f9 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1575 microversion: 2.1 time: 0.186314 Jul 18 03:22:24.712017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3506/6943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:24 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:25.731262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:25.731883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:25.739099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.739563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.740348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:25.740799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:25.880081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:25.888213 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bf2314e4-f463-4365-94b2-681a33d18a12 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1575 microversion: 2.1 time: 0.160810 Jul 18 03:22:25.888807 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3438/6944] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:25 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:26.095332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0900260d-f418-41a1-91fa-e43878436e86 req-449b27c4-bb69-4a66-801c-359e0d62fcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a5f212-b345-4bee-a1f5-49b1210322c1", "name": "network-vif-deleted", "tag": "7da99e14-99a3-448e-999f-5ce7e0ff341e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:26.106397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0900260d-f418-41a1-91fa-e43878436e86 req-449b27c4-bb69-4a66-801c-359e0d62fcfd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:26.106838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0900260d-f418-41a1-91fa-e43878436e86 req-449b27c4-bb69-4a66-801c-359e0d62fcfd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:26.120821 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0900260d-f418-41a1-91fa-e43878436e86 req-449b27c4-bb69-4a66-801c-359e0d62fcfd service nova] Creating event network-vif-deleted:7da99e14-99a3-448e-999f-5ce7e0ff341e for instance 00a5f212-b345-4bee-a1f5-49b1210322c1 on n-h2-849796-1 Jul 18 03:22:26.126099 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0900260d-f418-41a1-91fa-e43878436e86 req-449b27c4-bb69-4a66-801c-359e0d62fcfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Jul 18 03:22:26.126696 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3507/6945] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:22:26.906055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:26.906630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:26.914623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:26.915079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:26.915871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:26.916519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:26.989936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:26.999137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c9258cc9-a4d1-4436-b784-3f2b51ff03ac tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1224 microversion: 2.1 time: 0.096988 Jul 18 03:22:26.999765 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3439/6946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:26 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:28.017791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:28.018851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:28.026412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:28.026874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:28.027667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:28.028114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:28.098744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:28.107640 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a0dde76-338e-44ff-a9fd-69370d65b220 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1224 microversion: 2.1 time: 0.095512 Jul 18 03:22:28.108237 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3508/6947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:28 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:29.127428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:29.128061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:29.136168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:29.136637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:29.137473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:29.137933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:29.207500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:29.215640 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9dd298b-ab22-4906-b149-46f5b4e95a18 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1224 microversion: 2.1 time: 0.092308 Jul 18 03:22:29.216233 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3440/6948] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:29 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:30.233481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:30.234108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:30.242017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:30.242474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:30.243324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:30.243853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:30.323589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:30.333032 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9693ec84-cfb3-4983-817e-cd1d870249d7 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 200 len: 1224 microversion: 2.1 time: 0.103460 Jul 18 03:22:30.333904 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3509/6949] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:30 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:31.351457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:31.352756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 00a5f212-b345-4bee-a1f5-49b1210322c1] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:31.360124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:31.360592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:31.361436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:31.361894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:31.376810 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 HTTP/1.1 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '00a5f212-b345-4bee-a1f5-49b1210322c1'} Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:31.378584 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 00a5f212-b345-4bee-a1f5-49b1210322c1 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d276777-259a-4c54-a927-575c7a4590fe tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1" status: 404 len: 111 microversion: 2.1 time: 0.034130 Jul 18 03:22:31.383248 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3441/6950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:31 2022] GET /compute/v2.1/servers/00a5f212-b345-4bee-a1f5-49b1210322c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:37.770613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7f26bf77-5727-4a3a-b0e6-ce067829817d req-7a8875c2-fba8-42c4-b8a5-d60f9b31df98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416d9a93-9707-4295-8591-5aeb60914333", "tag": "638a4ae8-01e3-451c-a150-d82086ac0210"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:37.773447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:37.773953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:37.781188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:37.781651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:37.782450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:37.782899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:37.793848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7f26bf77-5727-4a3a-b0e6-ce067829817d req-7a8875c2-fba8-42c4-b8a5-d60f9b31df98 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:37.794611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7f26bf77-5727-4a3a-b0e6-ce067829817d req-7a8875c2-fba8-42c4-b8a5-d60f9b31df98 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:37.811236 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7f26bf77-5727-4a3a-b0e6-ce067829817d req-7a8875c2-fba8-42c4-b8a5-d60f9b31df98 service nova] Creating event network-changed:638a4ae8-01e3-451c-a150-d82086ac0210 for instance 416d9a93-9707-4295-8591-5aeb60914333 on n-h1-849796-1 Jul 18 03:22:37.817189 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7f26bf77-5727-4a3a-b0e6-ce067829817d req-7a8875c2-fba8-42c4-b8a5-d60f9b31df98 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050168 Jul 18 03:22:37.818175 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3442/6951] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:37.822525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:22:37.929977 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4706c8b8-a6c5-4fc0-96fa-a08b175cfa47 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 204 len: 0 microversion: 2.1 time: 0.165198 Jul 18 03:22:37.930676 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3510/6952] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:37 2022] DELETE /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:22:37.939881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:37.941043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:37.949368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:37.949368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:37.950564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:37.950564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:38.144716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:38.162335 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dfafaafa-c25d-4966-a248-9b9f390e0b8e tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1577 microversion: 2.1 time: 0.226259 Jul 18 03:22:38.164456 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3443/6953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:37 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:22:39.188144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:39.189065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:39.200526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:39.201022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:39.203074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:39.203074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:39.369931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:39.379187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad16ee54-80d5-4e6e-99e9-219991e1e4c1 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1577 microversion: 2.1 time: 0.198709 Jul 18 03:22:39.379697 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3511/6954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:39 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:40.197885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-ae34c8d6-d1f3-432d-819d-152ab5b62a1d req-c2d498e0-f264-432b-9a2b-8d87e4bd8299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416d9a93-9707-4295-8591-5aeb60914333", "name": "network-vif-deleted", "tag": "638a4ae8-01e3-451c-a150-d82086ac0210"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:22:40.207863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ae34c8d6-d1f3-432d-819d-152ab5b62a1d req-c2d498e0-f264-432b-9a2b-8d87e4bd8299 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:40.208611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-ae34c8d6-d1f3-432d-819d-152ab5b62a1d req-c2d498e0-f264-432b-9a2b-8d87e4bd8299 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:40.222370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-ae34c8d6-d1f3-432d-819d-152ab5b62a1d req-c2d498e0-f264-432b-9a2b-8d87e4bd8299 service nova] Creating event network-vif-deleted:638a4ae8-01e3-451c-a150-d82086ac0210 for instance 416d9a93-9707-4295-8591-5aeb60914333 on n-h1-849796-1 Jul 18 03:22:40.230579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-ae34c8d6-d1f3-432d-819d-152ab5b62a1d req-c2d498e0-f264-432b-9a2b-8d87e4bd8299 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Jul 18 03:22:40.231218 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3444/6955] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:22:40.397413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:40.398192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:40.405819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:40.406176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:40.406973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:40.407408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:40.482646 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:40.492455 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76be9a7d-57f8-48a2-a8bb-2881b3b7c607 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1225 microversion: 2.1 time: 0.099172 Jul 18 03:22:40.493514 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3512/6956] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:40 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:41.191117 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:22:41.191388 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:22:41.202939 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:22:41.203584 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:22:41.513522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:41.514267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:41.522252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:41.522732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:41.523540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:41.523987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:41.598337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:41.607466 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-906cc71b-3b5f-4b69-b699-f0e3eea0c51f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1225 microversion: 2.1 time: 0.099366 Jul 18 03:22:41.608116 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3445/6957] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:41 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:41.741967 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:22:41.742368 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:22:42.627608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:42.628278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:42.636698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:42.637217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:42.638024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:42.638475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:42.714560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:42.723243 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad935c3c-dc12-4e9b-bcf7-1acf918d0e93 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1225 microversion: 2.1 time: 0.099890 Jul 18 03:22:42.723988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3513/6958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:42 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:43.739924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:43.740564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:43.749053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:43.749524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:43.750337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:43.751094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:43.821816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:43.829782 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28d0df34-b408-4aab-8166-4bcf6344c43a tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1225 microversion: 2.1 time: 0.093875 Jul 18 03:22:43.830376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3446/6959] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:43 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:44.848295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:44.848821 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:44.856560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:44.857067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:44.857866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:44.858313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:44.893438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:44.893947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:44.894515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lazy-loading 'fault' on Instance uuid 416d9a93-9707-4295-8591-5aeb60914333 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:22:44.942933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21150b21d9704d189d8932ca8e3a640d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc364d31d5094fcaa5cd3eb4d7b11f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:22:44.952707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c264c6b-f842-4ef8-a998-96dab3fae5c4 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 200 len: 1230 microversion: 2.1 time: 0.108896 Jul 18 03:22:44.953363 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3514/6960] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:44 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:22:45.970536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:45.971228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: 416d9a93-9707-4295-8591-5aeb60914333] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:45.979691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:45.980164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:45.980991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:45.981445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:46.000210 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 HTTP/1.1 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '416d9a93-9707-4295-8591-5aeb60914333'} Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.001969 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance 416d9a93-9707-4295-8591-5aeb60914333 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3238f119-2308-4342-8e5a-d063c0023803 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333" status: 404 len: 111 microversion: 2.1 time: 0.036847 Jul 18 03:22:46.006600 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3447/6961] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:45 2022] GET /compute/v2.1/servers/416d9a93-9707-4295-8591-5aeb60914333 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:46.501492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:46.502401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:46.512912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:46.513394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:46.514180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:46.514625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:46.529310 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e HTTP/1.1 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'dface792-c21c-497c-9888-62b7fb990a6e'} Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:46.531031 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95f2fc31-1d43-40a4-8ea7-b1ea7e810c4f tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 404 len: 111 microversion: 2.1 time: 0.038228 Jul 18 03:22:46.537705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3515/6962] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:22:46 2022] DELETE /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:46.544111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:46.544745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] [instance: dface792-c21c-497c-9888-62b7fb990a6e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:22:46.551304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:46.551865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:46.552690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:22:46.553172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:22:46.568684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] HTTP exception thrown: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Request method failure captured: Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e HTTP/1.1 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1M-EmfIxwyHEG34Xneknlt_-I_CCg33YOrunF9CE5a8oaWKBy2w8yzJKviB6XJFsWObl6BOah0duPQLd99iHBJegfOYlXnqAaiWKtCKXoIaCHRVc5rIYuyW-eAAnkWnrqEeYzrCjoqP4KYV2WFpXfUKR0okjc0ujoqHuGOiqALIJyX0 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dc364d31d5094fcaa5cd3eb4d7b11f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dc364d31d5094fcaa5cd3eb4d7b11f00 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1739888341 Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 21150b21d9704d189d8932ca8e3a640d Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestVolumeBootPattern-1739888341-project Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'dface792-c21c-497c-9888-62b7fb990a6e'} Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:22:46.570571 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Returning 404 to user: Instance dface792-c21c-497c-9888-62b7fb990a6e could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d83f257-72de-4b6d-a5e3-c119422ea465 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e" status: 404 len: 111 microversion: 2.1 time: 0.034006 Jul 18 03:22:46.577622 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3448/6963] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:22:46 2022] GET /compute/v2.1/servers/dface792-c21c-497c-9888-62b7fb990a6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:22:50.055215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5d1801a-c259-4150-ae9b-d660504eff32 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] Calling method '.version_select at 0x7fab0473a0d0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:22:50.081669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5d1801a-c259-4150-ae9b-d660504eff32 tempest-TestVolumeBootPattern-1739888341 tempest-TestVolumeBootPattern-1739888341-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-928969416" status: 202 len: 0 microversion: 2.1 time: 0.030319 Jul 18 03:22:50.082441 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3516/6964] 10.222.0.67 () {58 vars in 1259 bytes} [Mon Jul 18 03:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-928969416 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:10.750074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:10.750909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:10.877682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1868251537", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:10.928442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] validate_networks() for None {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:23:11.211278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:23:11.211859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:23:11.212404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:23:11.212881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:23:11.213400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:23:11.222674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:11.223134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:11.223950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:11.224399 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:11.242101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Getting quotas for project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:11.247354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Getting quotas for user 3dae043ea7e24f00aa89168633e48d1a and project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:11.260472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:23:11.262971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:23:11.308949 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ac29b5fd-90bc-4937-8efe-3c363b4c2567 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563755 Jul 18 03:23:11.309646 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3449/6965] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:23:11.321779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b5fae31c-6ae8-40a7-b883-c3a06aa0c324 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:11.322428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b5fae31c-6ae8-40a7-b883-c3a06aa0c324 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:11.330071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:11.330869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:11.388898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b5fae31c-6ae8-40a7-b883-c3a06aa0c324 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:11.395783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b5fae31c-6ae8-40a7-b883-c3a06aa0c324 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1222 microversion: 2.1 time: 0.079436 Jul 18 03:23:11.396371 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3517/6966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:11 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:12.416050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:12.416738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:12.423710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:12.424473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:12.425343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:12.425809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:12.535808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:12.544636 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d6ded44e-0cee-45f6-a540-1ac074a49c88 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1280 microversion: 2.1 time: 0.134169 Jul 18 03:23:12.545528 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3450/6967] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:12 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:13.563967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:13.564895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:13.572507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:13.572991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:13.573787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:13.574230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:13.721220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:13.730210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9caa01de-e74e-4465-9b2f-d0a0374c4f20 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.171091 Jul 18 03:23:13.730815 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3518/6968] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:13 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:13.832769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dea6012f-63e9-4b60-960e-1550bd82ed1a req-22337ba4-e1e9-4304-af3a-01a32c949f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd05c02-43f1-49d8-a83c-f4ab08686116", "tag": "7d5f1bbe-1340-4659-86e9-022dcf260414"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:13.858924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dea6012f-63e9-4b60-960e-1550bd82ed1a req-22337ba4-e1e9-4304-af3a-01a32c949f18 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:13.859394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dea6012f-63e9-4b60-960e-1550bd82ed1a req-22337ba4-e1e9-4304-af3a-01a32c949f18 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:13.872131 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dea6012f-63e9-4b60-960e-1550bd82ed1a req-22337ba4-e1e9-4304-af3a-01a32c949f18 service nova] Creating event network-changed:7d5f1bbe-1340-4659-86e9-022dcf260414 for instance edd05c02-43f1-49d8-a83c-f4ab08686116 on n-h1-849796-1 Jul 18 03:23:13.877822 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dea6012f-63e9-4b60-960e-1550bd82ed1a req-22337ba4-e1e9-4304-af3a-01a32c949f18 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058393 Jul 18 03:23:13.878850 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3451/6969] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:14.748163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:14.748805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:14.755876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:14.756332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:14.757175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:14.758343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:14.894677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:14.903453 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-39487b25-d936-45b0-ba24-ebfd5f1d170f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.159377 Jul 18 03:23:14.904046 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3519/6970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:14 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:15.921650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:15.922373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:15.930203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:15.930671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:15.931468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:15.931925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:16.076653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:16.084209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-729c1c9a-e5ba-4e2e-8bd3-ee13610fcc4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.167142 Jul 18 03:23:16.084777 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3452/6971] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:15 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:17.104424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:17.105520 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:17.112865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:17.113345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:17.114159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:17.114600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:17.254239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:17.263969 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64e1e54a-0840-400b-bf44-5fb7952e6f68 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.165369 Jul 18 03:23:17.264746 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3520/6972] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:17 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:18.281569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:18.282198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:18.289468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:18.289935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:18.290734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:18.291192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:18.424877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:18.433603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-24eee5b2-738b-4eed-8ae3-42763eff954e tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.155934 Jul 18 03:23:18.434189 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3453/6973] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:18 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:19.450930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:19.451674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:19.459277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:19.459737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:19.460756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:19.461239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:19.606820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:19.614430 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-beb05a1a-2a34-4b3c-89fc-009b0fdd08e7 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.167771 Jul 18 03:23:19.615021 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3521/6974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:19 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:20.633252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:20.634101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:20.640943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:20.641428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:20.642221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:20.642673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:20.775000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:20.783177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15a469ec-cf6e-4ff9-ac17-9e4d3d105cce tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.154432 Jul 18 03:23:20.783778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3454/6975] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:20 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:20.994822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-580458f6-5243-4a5b-ba00-363a65132dff req-b888919c-745f-44cb-a319-dfc7ee7d2aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd05c02-43f1-49d8-a83c-f4ab08686116", "name": "network-vif-plugged", "status": "completed", "tag": "7d5f1bbe-1340-4659-86e9-022dcf260414"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:21.003290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-580458f6-5243-4a5b-ba00-363a65132dff req-b888919c-745f-44cb-a319-dfc7ee7d2aaf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:21.003742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-580458f6-5243-4a5b-ba00-363a65132dff req-b888919c-745f-44cb-a319-dfc7ee7d2aaf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:21.015275 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-580458f6-5243-4a5b-ba00-363a65132dff req-b888919c-745f-44cb-a319-dfc7ee7d2aaf service nova] Creating event network-vif-plugged:7d5f1bbe-1340-4659-86e9-022dcf260414 for instance edd05c02-43f1-49d8-a83c-f4ab08686116 on n-h1-849796-1 Jul 18 03:23:21.020591 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-580458f6-5243-4a5b-ba00-363a65132dff req-b888919c-745f-44cb-a319-dfc7ee7d2aaf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097575 Jul 18 03:23:21.021299 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3522/6976] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:21.801079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:21.801711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:21.803702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:21.804550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:21.811722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:21.812193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:21.813032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:21.813493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:21.958312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:21.967520 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b54ec2b0-679c-4b0d-b07e-c68e873e0bbb tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1322 microversion: 2.1 time: 0.170303 Jul 18 03:23:21.968135 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3455/6977] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:21 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:22.982273 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:22.987617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:22.988321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:22.995092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:22.995548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:22.996329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:22.996779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.135885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:23.143517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5c416227-5505-41fb-a4f0-8e2ff5989f4b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1472 microversion: 2.1 time: 0.162302 Jul 18 03:23:23.144091 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3523/6978] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:22 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:23.209329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0f4fa5d9-b3f8-44cc-9c8a-c8507dbb5c4f tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '.version_select at 0x7faaf74393a0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.276981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0f4fa5d9-b3f8-44cc-9c8a-c8507dbb5c4f tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/c3b41c7731b648e68228cb244e459141" status: 200 len: 371 microversion: 2.1 time: 0.118046 Jul 18 03:23:23.277592 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3456/6979] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 03:23:23 2022] GET /compute/v2.1/os-quota-sets/c3b41c7731b648e68228cb244e459141 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:23.287892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da31daa0-e938-47a9-8db7-9285f2718a20 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-454864772", "id": 649217595, "os-flavor-access:is_public": "True"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:23.290175 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:23:23.290175 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 03:23:23.305427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da31daa0-e938-47a9-8db7-9285f2718a20 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021167 Jul 18 03:23:23.306163 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3524/6980] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:23 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:23.316733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "649217595"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:23.317740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:23.324397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.324857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.325654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.326101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.412261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '009adb75464a42e6823c51539861509b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b41c7731b648e68228cb244e459141', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:23.419245 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-454864772 {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:23:23.425554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.426012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.426813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.427263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.447745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Getting quotas for project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:23.453084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Getting quotas for user 3dae043ea7e24f00aa89168633e48d1a and project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:23.467505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] ram quota exceeded for c3b41c7731b648e68228cb244e459141, tried to resize instance. Jul 18 03:23:23.468062 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Request method failure captured: Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action HTTP/1.1 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 38 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NIePNKrk7xp77KbKw3BGffw5cmiITZawaOA9vw6P_0lvQAGfpYX0sL6pHzL2Lo9RfTkd6I-wHStkwE03_9Bn8tKfLbYktynW7d2dHMAcNfp3Ac3xTuGE1k5jk-nc2tlkO4ThcmNEu4Fd0JKATgPyTE__2Ro3ISfusBUAEqyed3oXyA Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: c3b41c7731b648e68228cb244e459141 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Role: admin,reader,member Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: admin,reader,member Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c3b41c7731b648e68228cb244e459141"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c3b41c7731b648e68228cb244e459141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c3b41c7731b648e68228cb244e459141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c3b41c7731b648e68228cb244e459141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: c3b41c7731b648e68228cb244e459141 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1598892414-project-admin Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 009adb75464a42e6823c51539861509b Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1598892414-project-admin Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: {"resize": {"flavorRef": "649217595"}} Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'edd05c02-43f1-49d8-a83c-f4ab08686116', 'body': {'resize': {'flavorRef': '649217595'}}} Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.477157 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7432d0e3-4350-4bb7-9693-dfaa328250ee tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action" status: 403 len: 118 microversion: 2.1 time: 0.166111 Jul 18 03:23:23.482349 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3457/6981] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:23:23 2022] POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action => generated 118 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:23:23.488228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3014924f-642f-4410-8589-a07b3ad37304 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.489022 n-d-849796-1 devstack@n-api.service[119439]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:23:23.489022 n-d-849796-1 devstack@n-api.service[119439]: warnings.warn(msg) Jul 18 03:23:23.506932 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3014924f-642f-4410-8589-a07b3ad37304 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/649217595" status: 202 len: 0 microversion: 2.1 time: 0.022440 Jul 18 03:23:23.508232 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3525/6982] 10.222.0.67 () {58 vars in 1157 bytes} [Mon Jul 18 03:23:23 2022] DELETE /compute/v2.1/flavors/649217595 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:23.516478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e538915f-e776-4cc2-9a32-b82a14756c4e tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.536353 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e538915f-e776-4cc2-9a32-b82a14756c4e tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023616 Jul 18 03:23:23.536973 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3458/6983] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 03:23:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:23.555534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71a67979-2251-439a-a894-4a4ba4173e0f tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '.version_select at 0x7fab04547b80>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.624832 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71a67979-2251-439a-a894-4a4ba4173e0f tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/c3b41c7731b648e68228cb244e459141" status: 200 len: 371 microversion: 2.1 time: 0.073761 Jul 18 03:23:23.625453 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3526/6984] 10.222.0.67 () {58 vars in 1241 bytes} [Mon Jul 18 03:23:23 2022] GET /compute/v2.1/os-quota-sets/c3b41c7731b648e68228cb244e459141 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:23.636281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22c984a8-7330-42c3-bba2-2657dfa80092 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-841907426", "id": 1289873355, "os-flavor-access:is_public": "True"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:23.637827 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:23:23.637827 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 03:23:23.652544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22c984a8-7330-42c3-bba2-2657dfa80092 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020637 Jul 18 03:23:23.653338 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3459/6985] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:23 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:23.664332 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1289873355"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:23.665435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:23.671701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.672159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.672949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.673480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.759550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '009adb75464a42e6823c51539861509b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b41c7731b648e68228cb244e459141', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:23.766961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-841907426 {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:23:23.774091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.774548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.775348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.775787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.799107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Getting quotas for project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:23.805112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Getting quotas for user 3dae043ea7e24f00aa89168633e48d1a and project 57c54fa0d216440cbf868c946468292a. Resources: {'cores', 'ram'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:23.821280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.compute.api [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] cores quota exceeded for c3b41c7731b648e68228cb244e459141, tried to resize instance. Jul 18 03:23:23.821822 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Request method failure captured: Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action HTTP/1.1 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 39 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NIePNKrk7xp77KbKw3BGffw5cmiITZawaOA9vw6P_0lvQAGfpYX0sL6pHzL2Lo9RfTkd6I-wHStkwE03_9Bn8tKfLbYktynW7d2dHMAcNfp3Ac3xTuGE1k5jk-nc2tlkO4ThcmNEu4Fd0JKATgPyTE__2Ro3ISfusBUAEqyed3oXyA Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: c3b41c7731b648e68228cb244e459141 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Role: admin,reader,member Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: admin,reader,member Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c3b41c7731b648e68228cb244e459141"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c3b41c7731b648e68228cb244e459141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c3b41c7731b648e68228cb244e459141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c3b41c7731b648e68228cb244e459141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: c3b41c7731b648e68228cb244e459141 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1598892414 Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersAdminNegativeTestJSON-1598892414-project-admin Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 009adb75464a42e6823c51539861509b Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1598892414-project-admin Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: {"resize": {"flavorRef": "1289873355"}} Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'edd05c02-43f1-49d8-a83c-f4ab08686116', 'body': {'resize': {'flavorRef': '1289873355'}}} Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.825114 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aacc085f-d8db-4fcc-b584-856a1eef6fd1 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action" status: 403 len: 113 microversion: 2.1 time: 0.166564 Jul 18 03:23:23.828959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3527/6986] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:23:23 2022] POST /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:23:23.836906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95868529-5de3-4262-84db-b85157278b51 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.837702 n-d-849796-1 devstack@n-api.service[119440]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 03:23:23.837702 n-d-849796-1 devstack@n-api.service[119440]: warnings.warn(msg) Jul 18 03:23:23.855128 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95868529-5de3-4262-84db-b85157278b51 tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1289873355" status: 202 len: 0 microversion: 2.1 time: 0.021788 Jul 18 03:23:23.855782 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3460/6987] 10.222.0.67 () {58 vars in 1160 bytes} [Mon Jul 18 03:23:23 2022] DELETE /compute/v2.1/flavors/1289873355 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:23.863862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1b9e8a4-d222-48c4-9218-18636edb6b4e tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.883530 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1b9e8a4-d222-48c4-9218-18636edb6b4e tempest-ServersAdminNegativeTestJSON-1598892414 tempest-ServersAdminNegativeTestJSON-1598892414-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023365 Jul 18 03:23:23.884100 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3528/6988] 10.222.0.67 () {58 vars in 1145 bytes} [Mon Jul 18 03:23:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:23.901437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:23.901866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:23.907883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.908349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.909176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:23.909638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:23.935285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:23:24.013896 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd59d31e-e191-4bb7-83d5-3377ab6f90c5 tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "DELETE /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 204 len: 0 microversion: 2.1 time: 0.116734 Jul 18 03:23:24.014694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3461/6989] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:23:23 2022] DELETE /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:23:24.023957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:24.025280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:24.032578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:24.033149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:24.033953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:24.034424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:24.419689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:24.427373 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0d23be5-8270-4308-966c-cc60d59b3f5b tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1478 microversion: 2.1 time: 0.408198 Jul 18 03:23:24.428408 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3529/6990] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:24 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:25.449659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:25.450370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:25.457331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:25.457787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:25.458565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:25.459011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:25.693416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae043ea7e24f00aa89168633e48d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c54fa0d216440cbf868c946468292a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:25.701920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4256f73-5672-4f79-99f1-36feae7a249d tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 200 len: 1478 microversion: 2.1 time: 0.256410 Jul 18 03:23:25.702509 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3462/6991] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:25 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 1478 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:25.975794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-62b6a3a6-8c9b-439f-9254-4658ff77d6c0 req-0b85c7d1-e6f9-49c1-b66f-adc9b1ff258e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd05c02-43f1-49d8-a83c-f4ab08686116", "name": "network-vif-deleted", "tag": "7d5f1bbe-1340-4659-86e9-022dcf260414"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:25.985832 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62b6a3a6-8c9b-439f-9254-4658ff77d6c0 req-0b85c7d1-e6f9-49c1-b66f-adc9b1ff258e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:25.986290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62b6a3a6-8c9b-439f-9254-4658ff77d6c0 req-0b85c7d1-e6f9-49c1-b66f-adc9b1ff258e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:25.999091 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-62b6a3a6-8c9b-439f-9254-4658ff77d6c0 req-0b85c7d1-e6f9-49c1-b66f-adc9b1ff258e service nova] Creating event network-vif-deleted:7d5f1bbe-1340-4659-86e9-022dcf260414 for instance edd05c02-43f1-49d8-a83c-f4ab08686116 on n-h1-849796-1 Jul 18 03:23:26.004517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-62b6a3a6-8c9b-439f-9254-4658ff77d6c0 req-0b85c7d1-e6f9-49c1-b66f-adc9b1ff258e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Jul 18 03:23:26.005154 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3530/6992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:23:26.718434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:26.719060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] [instance: edd05c02-43f1-49d8-a83c-f4ab08686116] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:26.726302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:26.726758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:26.727537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:26.727983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:26.744947 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] HTTP exception thrown: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Request method failure captured: Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 HTTP/1.1 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NIdvTENOByDH6NajpFRr3YaAk-IllQQXxVmJFC9hU0ySEPAd4um47nYQqs79RDiXtudu0uD9rpDM8yEXWxMMcusQfloBwSlMOAUSSw0it1z2Bjnd7RNQFdKr5mho34tTwuf67iDQ-oWpD83z330dY895TgOOibFNQb75FMtzC5P99M Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 57c54fa0d216440cbf868c946468292a Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1621257456 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/57c54fa0d216440cbf868c946468292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_57c54fa0d216440cbf868c946468292a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/57c54fa0d216440cbf868c946468292a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/57c54fa0d216440cbf868c946468292a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1621257456 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 57c54fa0d216440cbf868c946468292a Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1621257456 Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersAdminNegativeTestJSON-1621257456-project Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 3dae043ea7e24f00aa89168633e48d1a Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1621257456-project Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'edd05c02-43f1-49d8-a83c-f4ab08686116'} Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:26.748226 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] Returning 404 to user: Instance edd05c02-43f1-49d8-a83c-f4ab08686116 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:23:26.752222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-717f93da-963b-4669-8122-50a167a4e68f tempest-ServersAdminNegativeTestJSON-1621257456 tempest-ServersAdminNegativeTestJSON-1621257456-project] 10.222.0.67 "GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116" status: 404 len: 111 microversion: 2.1 time: 0.035169 Jul 18 03:23:26.753513 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3463/6993] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:26 2022] GET /compute/v2.1/servers/edd05c02-43f1-49d8-a83c-f4ab08686116 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:23:33.410403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-281004501", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "aa676b73-a14c-49f3-985d-19c2b68fc1a6"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:33.470214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] validate_networks() for [('aa676b73-a14c-49f3-985d-19c2b68fc1a6', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:23:33.614396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:33.785705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:33.993206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:23:33.993803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:23:33.994328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:23:33.994766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:23:33.995193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:23:34.005095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.005571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.006399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:34.007451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:34.026173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Getting quotas for project 83bf9bf9a90e40128131944434838a65. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:23:34.032428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Getting quotas for user bda51d44765e49a3b0ce230d2c9dce03 and project 83bf9bf9a90e40128131944434838a65. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:23:34.046972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:23:34.049527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:23:34.107474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b3ecedb-41dd-4fe6-b0f3-0340e71e8524 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862056 Jul 18 03:23:34.108431 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3531/6994] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:23:34.119117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-186b8b54-d81c-47c4-9bd6-4fa2e026cf24 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:34.119754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-186b8b54-d81c-47c4-9bd6-4fa2e026cf24 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:34.123501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:34.124414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:34.188312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-186b8b54-d81c-47c4-9bd6-4fa2e026cf24 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:34.197036 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-186b8b54-d81c-47c4-9bd6-4fa2e026cf24 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1214 microversion: 2.1 time: 0.082446 Jul 18 03:23:34.198061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3464/6995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:34 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:35.214914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:35.216760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:35.225131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:35.226852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:35.227904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:35.228513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:35.305469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:35.314670 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40897899-cc5a-4ada-8d43-03711721c8c6 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1272 microversion: 2.1 time: 0.103788 Jul 18 03:23:35.315287 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3532/6996] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:35 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:36.334240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:36.337181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:36.706284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-62916696-b51b-4b16-a09a-6b0b440068cd req-d7b218aa-2c41-4304-afdb-7b0835cd4715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:36.726268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62916696-b51b-4b16-a09a-6b0b440068cd req-d7b218aa-2c41-4304-afdb-7b0835cd4715 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:36.727023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-62916696-b51b-4b16-a09a-6b0b440068cd req-d7b218aa-2c41-4304-afdb-7b0835cd4715 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:36.766838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-62916696-b51b-4b16-a09a-6b0b440068cd req-d7b218aa-2c41-4304-afdb-7b0835cd4715 service nova] Creating event network-changed:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h1-849796-1 Jul 18 03:23:36.789140 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-62916696-b51b-4b16-a09a-6b0b440068cd req-d7b218aa-2c41-4304-afdb-7b0835cd4715 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092191 Jul 18 03:23:36.791049 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3533/6997] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:23:36.817658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:36.820333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:36.821143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:36.822043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:36.822525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:37.081619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:37.092008 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9eb5a3b-c523-4d0f-9e72-9e26cfcb163f tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.762229 Jul 18 03:23:37.092622 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3465/6998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:36 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:38.111216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:38.111915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:38.119420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.119871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.120652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:38.121127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:38.270727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:38.278850 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-748636df-845a-4dd1-8415-fa619b85687b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.171941 Jul 18 03:23:38.279447 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3534/6999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:38 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:39.297315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:39.297872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:39.305720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:39.306196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:39.307003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:39.307466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:39.545198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:39.553645 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5fa9716-72dc-4635-ad3f-8ded90473944 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.260383 Jul 18 03:23:39.555114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3466/7000] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:39 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:40.571019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:40.571571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:40.578970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:40.579427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:40.580235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:40.580688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:40.714200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:40.721807 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f14ca5da-f688-458e-9751-5a74c863610c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.155067 Jul 18 03:23:40.722641 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3535/7001] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:40 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:41.739902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:41.740529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:41.743994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:41.750174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:41.750649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:41.751487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:41.751933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:41.894576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:41.903603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb073439-9c46-45c5-9916-4424a1ce380a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.167696 Jul 18 03:23:41.904194 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3467/7002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:41 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:42.921215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:42.921984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:42.924971 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:42.931517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:42.932097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:42.933009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:42.933542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:42.938451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=76 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:43.013925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a4c2b7c8-7b38-4684-9090-97c0bb65ae6a req-f9471884-299b-494b-9c72-8d706a1ef316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "name": "network-vif-plugged", "status": "completed", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:43.022944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a4c2b7c8-7b38-4684-9090-97c0bb65ae6a req-f9471884-299b-494b-9c72-8d706a1ef316 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:43.024325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a4c2b7c8-7b38-4684-9090-97c0bb65ae6a req-f9471884-299b-494b-9c72-8d706a1ef316 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:43.037138 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a4c2b7c8-7b38-4684-9090-97c0bb65ae6a req-f9471884-299b-494b-9c72-8d706a1ef316 service nova] Creating event network-vif-plugged:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h1-849796-1 Jul 18 03:23:43.044168 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a4c2b7c8-7b38-4684-9090-97c0bb65ae6a req-f9471884-299b-494b-9c72-8d706a1ef316 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Jul 18 03:23:43.045163 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3468/7003] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:23:43.101014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:43.109687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78254ef0-7d59-480b-9f32-dade90e86c5c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.192525 Jul 18 03:23:43.119933 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3536/7004] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:42 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:44.130061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:44.130800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:44.138157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:44.138630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:44.139545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:44.140012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:44.192996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:44.293065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:44.301320 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-988bf06e-15c1-4448-8d4e-c3dee9f79b16 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1314 microversion: 2.1 time: 0.177565 Jul 18 03:23:44.301917 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3469/7005] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:44 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:45.318935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:45.319813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:45.323275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:45.323965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:23:45.330501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.330970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.331778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.332245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.477304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:45.485667 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1247750-6de3-4a10-8201-bef33042dede tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1501 microversion: 2.1 time: 0.170616 Jul 18 03:23:45.486267 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3537/7006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:45 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:45.503181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:23:45.504199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:45.511750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.512213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.513018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.513470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.542461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:45.548712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Old instance type m1.heat2, new instance type m1.heat {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:23:45.556651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:23:45.557152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:23:45.557652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:23:45.558084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:23:45.558517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:23:45.627044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3cd93f16-ef8e-4bc7-b38b-6bd1e9e88c07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "POST /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84/action" status: 202 len: 0 microversion: 2.1 time: 0.127795 Jul 18 03:23:45.627687 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3470/7007] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:23:45 2022] POST /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:23:45.636001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:45.636616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:45.642737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.643196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.643990 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:45.644438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:45.785505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:45.793587 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78a1928a-4758-4711-aefa-427709279275 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1510 microversion: 2.1 time: 0.161532 Jul 18 03:23:45.794103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3538/7008] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:45 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:46.812983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:46.813530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:46.820778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:46.821279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:46.822118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:46.822585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:46.968491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:46.977509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1577f622-2ccb-4890-97c5-02cc289c34df tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1510 microversion: 2.1 time: 0.170012 Jul 18 03:23:46.978133 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3471/7009] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:46 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:23:47.995608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:47.996203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:48.003428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:48.003884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:48.004664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:48.005138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:48.146888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:48.154622 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e1bcc16-33e1-4832-b338-bfe4678188b2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.163069 Jul 18 03:23:48.155385 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3539/7010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:47 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:49.172001 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:49.172626 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:49.179817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:49.180344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:49.181158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:49.181611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:49.322523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:49.330569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57db3941-22a4-488a-a0fa-33eeb5797edd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.162445 Jul 18 03:23:49.331293 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3472/7011] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:49 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:50.349015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:50.349626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:50.357319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:50.357767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:50.358542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:50.358982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:50.499387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:50.507046 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c540aa4d-2d89-4b79-9561-9067f80e21db tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.162230 Jul 18 03:23:50.508206 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3540/7012] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:50 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:51.526769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:51.527295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:51.534435 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:51.534907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:51.535711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:51.536174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:51.672513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:51.680752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9ef672a-997c-4e4c-a526-40cd9632392c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.159194 Jul 18 03:23:51.681355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3473/7013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:51 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:52.697869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:52.698416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:52.704789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:52.705281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:52.706054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:52.706501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:52.838907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:52.847164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2b3449a4-7618-482d-9fd3-9f4413c4f40b tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.153787 Jul 18 03:23:52.848006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3541/7014] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:52 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:53.864687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:53.865333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:53.873048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:53.873597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:53.874401 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:53.874857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:54.016774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:54.024518 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-52a99ab8-ce66-44fb-8c15-849f45b7aca2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.163853 Jul 18 03:23:54.025145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3474/7015] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:53 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:55.043262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:55.043889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:55.051611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:55.052075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:55.052893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:55.053377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:55.189615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:55.198210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6aed9b4e-b3cc-48d0-88a6-935aa4630e5e tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.160024 Jul 18 03:23:55.198819 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3542/7016] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:55 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:56.215483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:56.216098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:56.223733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:56.224204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:56.225057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:56.225523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:56.364419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:56.373001 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aad08196-27f8-4a62-a8f8-f6ce23f5b746 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.161422 Jul 18 03:23:56.373591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3475/7017] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:56 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:57.390809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:57.391450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:57.398794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:57.399548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:57.400463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:57.400940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:57.544491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:57.552251 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5daae19-fae9-47ce-8beb-31b73a2cb5b5 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.165550 Jul 18 03:23:57.552838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3543/7018] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:57 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:58.571421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:58.572028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:58.579793 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:58.580871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:58.581859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:58.582351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:58.725127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:58.733311 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ca5786e-bc91-4839-bd71-6fd64e788df0 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.166434 Jul 18 03:23:58.733911 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3476/7019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:58 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:23:59.751110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:23:59.751834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:23:59.759552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:59.760021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:59.760819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:23:59.761293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:23:59.912677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:23:59.921299 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4b09447-22d1-450f-940a-ff15907b3c70 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.174085 Jul 18 03:23:59.922003 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3544/7020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:23:59 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:00.938764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:00.939396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:00.948292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:00.948769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:00.949625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:00.950091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:01.095475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:01.103631 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3cc3239b-d537-4743-9926-db522679fd54 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.168793 Jul 18 03:24:01.104324 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3477/7021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:00 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:02.121708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:02.122328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:02.129280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:02.129739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:02.130513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:02.131050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:02.265632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:02.273674 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13f1b0de-c9aa-415a-8d12-32076619b107 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.156591 Jul 18 03:24:02.274460 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3545/7022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:02 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:03.290874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:03.291498 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:03.298523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:03.298988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:03.299786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:03.300246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:03.447311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:03.455267 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a858534f-ae6c-4c02-b6c2-7465aa37238a tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.168550 Jul 18 03:24:03.455856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3478/7023] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:03 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:04.473624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:04.474242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:04.482196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:04.482661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:04.483446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:04.483899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:04.621881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:04.629552 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7f6fc144-131f-4081-b9dc-cb6dd3b68d23 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.160274 Jul 18 03:24:04.630130 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3546/7024] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:04 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:05.648884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:05.650054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:05.658480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:05.658948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:05.659752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:05.660204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:05.794360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:05.802134 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15031b5c-61b0-4bcd-9f41-288b31e02d2d tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.158751 Jul 18 03:24:05.802719 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3479/7025] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:05 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:06.820245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:06.820864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:06.829564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.830010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.830952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:06.831451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:06.975884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:06.984114 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22d113be-ce8e-4819-a0e5-5539546ed10c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.167826 Jul 18 03:24:06.984707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3547/7026] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:06 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:08.003077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:08.003694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:08.012031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:08.012492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:08.013325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:08.013782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:08.016575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:08.156199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:08.163926 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2dc29212-d526-4d98-b996-8ac4bb2bd399 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.164797 Jul 18 03:24:08.164508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3480/7027] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:07 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:09.183427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:09.184032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:09.191535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:09.191992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:09.192777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:09.193259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:09.332611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:09.342989 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c7512e58-1aa2-4442-a68b-dc9acfff7d19 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.163902 Jul 18 03:24:09.343587 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3548/7028] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:09 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:10.360376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:10.361457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:10.368754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:10.369265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:10.370072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:10.370530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:10.511545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:10.519598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e816c3ca-44ca-4eef-a0db-cebe2a2ecd13 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.163229 Jul 18 03:24:10.520114 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3481/7029] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:10 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:11.538582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:11.539230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:11.547422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:11.547885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:11.548682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:11.549176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:11.689274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:11.697160 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e88c71bf-796b-4939-b023-ff3307088465 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.163253 Jul 18 03:24:11.697779 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3549/7030] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:11 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:12.714738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:12.715409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:12.718174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=34 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:12.725165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.725663 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.726497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:12.726979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:12.870232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:12.880043 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68aa8ad0-79a2-47ff-ad95-7ec94b748ecd tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.169172 Jul 18 03:24:12.880944 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3482/7031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:12 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:13.898759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:13.899480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:13.902276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:13.907759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:13.908214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:13.909036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:13.909485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:13.912346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=84 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:14.053670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:14.061432 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-034a60fe-41d0-4fef-a147-c3e1efc27c73 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1515 microversion: 2.1 time: 0.166630 Jul 18 03:24:14.062032 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3550/7032] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:13 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:15.078934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:15.079871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:15.089275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.089764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.090592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.091052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.242690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:15.251868 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-860ba893-03ff-4bfa-bbe9-6fed1d368d96 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1514 microversion: 2.1 time: 0.176727 Jul 18 03:24:15.262613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3483/7033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:15 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:15.344485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "name": "network-vif-unplugged", "status": "completed", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:15.354886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:15.355368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:15.367442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] Creating event network-vif-unplugged:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h2-849796-1 Jul 18 03:24:15.373944 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] Instance 9642c556-541f-4148-95db-16c7bde7ca84 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:24:15.386450 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a070fba9-006a-46c5-b110-95769fe6e522 req-86941512-1913-4bb0-8f70-c2004224da2c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049106 Jul 18 03:24:15.387082 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3551/7034] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:16.270648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:16.271319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:16.279415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:16.279909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:16.280717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:16.281206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:16.423782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:16.432248 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bbae5df9-03b6-4f5f-9350-1c1330ed6c74 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1514 microversion: 2.1 time: 0.165507 Jul 18 03:24:16.432901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3484/7035] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:16 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:17.405079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:17.413683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:17.414141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:17.433598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] Creating event network-changed:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h2-849796-1 Jul 18 03:24:17.439232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] Instance 9642c556-541f-4148-95db-16c7bde7ca84 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:24:17.450582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:17.451151 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-e3d00e74-3694-4911-a3c2-826595c7b250 req-0c3888ef-ec75-4c95-8d57-0c883942613e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051400 Jul 18 03:24:17.451236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:17.451325 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3552/7036] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:17.459072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:17.459544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:17.460594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:17.461075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:17.680811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:17.692070 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fa57c0aa-eedf-4dfb-81de-179d15a2f6ae tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1512 microversion: 2.1 time: 0.245975 Jul 18 03:24:17.692693 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3485/7037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:17 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:18.711665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:18.713277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:18.719598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.720061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.720854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:18.721334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:18.860685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:18.868230 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c2e6564-1970-4feb-aee8-470ba505d2fc tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1512 microversion: 2.1 time: 0.161763 Jul 18 03:24:18.869615 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3553/7038] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:18 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:19.889120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:19.889714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:19.898171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:19.898651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:19.899471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:19.900015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:20.047132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:20.055252 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-87e917b5-429d-4017-ae7b-18a7f54d8e07 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1512 microversion: 2.1 time: 0.172403 Jul 18 03:24:20.056678 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3486/7039] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:19 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:21.075819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:21.076572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:21.085387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:21.085858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:21.088222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:21.088222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:21.234337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:21.242126 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1350ae2b-932e-433c-bf9d-210f3177ffb9 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1509 microversion: 2.1 time: 0.172730 Jul 18 03:24:21.242722 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3554/7040] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:21 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:21.262970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:21.264172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:21.272482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:21.272982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:21.273815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:21.274480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:21.304747 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:24:21.374195 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Found an unconfirmed migration during delete, id: 16, status: finished Jul 18 03:24:22.824119 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-62e902e9-8021-46f6-8961-0591b1259147 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 204 len: 0 microversion: 2.1 time: 1.566259 Jul 18 03:24:22.825690 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3487/7041] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:24:21 2022] DELETE /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 0 bytes in 1569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:24:22.835869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:22.836531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:22.844314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:22.845156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:22.845956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:22.846554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:22.994113 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:23.002103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-94ef59f7-3d7b-43a1-b529-7db78af75e6c tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1501 microversion: 2.1 time: 0.172023 Jul 18 03:24:23.002705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3555/7042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:22 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:23.021208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a4acce00-9de4-4a9b-8a1c-c0d0a3b2eeb3 req-6756da9c-4abf-4484-b464-1a53aa258504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "name": "network-vif-plugged", "status": "completed", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:23.030600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a4acce00-9de4-4a9b-8a1c-c0d0a3b2eeb3 req-6756da9c-4abf-4484-b464-1a53aa258504 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:23.031129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a4acce00-9de4-4a9b-8a1c-c0d0a3b2eeb3 req-6756da9c-4abf-4484-b464-1a53aa258504 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:23.047185 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a4acce00-9de4-4a9b-8a1c-c0d0a3b2eeb3 req-6756da9c-4abf-4484-b464-1a53aa258504 service nova] Creating event network-vif-plugged:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h2-849796-1 Jul 18 03:24:23.052299 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a4acce00-9de4-4a9b-8a1c-c0d0a3b2eeb3 req-6756da9c-4abf-4484-b464-1a53aa258504 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035124 Jul 18 03:24:23.052974 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3488/7043] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:24.020445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:24.021098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:24.029058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:24.029521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:24.030324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:24.030781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:24.188269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda51d44765e49a3b0ce230d2c9dce03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf9bf9a90e40128131944434838a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:24.196295 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-183711df-84b8-4854-8aa1-cbea2efe5d93 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 200 len: 1501 microversion: 2.1 time: 0.179998 Jul 18 03:24:24.197515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3556/7044] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:24 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:24.934476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a3ee9248-2b8a-4c7e-a901-38b7669e4b57 req-ffc2d238-26ba-4512-aa5c-f87a184dee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9642c556-541f-4148-95db-16c7bde7ca84", "name": "network-vif-deleted", "tag": "338e49d5-3351-4e36-9a14-23a8d9e04637"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:24.945324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a3ee9248-2b8a-4c7e-a901-38b7669e4b57 req-ffc2d238-26ba-4512-aa5c-f87a184dee47 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:24.946582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a3ee9248-2b8a-4c7e-a901-38b7669e4b57 req-ffc2d238-26ba-4512-aa5c-f87a184dee47 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:24.960777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a3ee9248-2b8a-4c7e-a901-38b7669e4b57 req-ffc2d238-26ba-4512-aa5c-f87a184dee47 service nova] Creating event network-vif-deleted:338e49d5-3351-4e36-9a14-23a8d9e04637 for instance 9642c556-541f-4148-95db-16c7bde7ca84 on n-h2-849796-1 Jul 18 03:24:24.967777 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a3ee9248-2b8a-4c7e-a901-38b7669e4b57 req-ffc2d238-26ba-4512-aa5c-f87a184dee47 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040769 Jul 18 03:24:24.968391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3489/7045] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:25.221262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:25.223865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:25.236012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.236875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.238342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.239184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.268815 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] HTTP exception thrown: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Request method failure captured: Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 HTTP/1.1 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NI1NXTlDV-S1iZ_7i_tZE4URO0-Y3pK3Pwsp7sxmRLyn3l3MzfvGgqN6qgN_E1FLERO4Nn72DexzUStJiWmreVHkTA3gr4Ki-xwRTY0cCEBA8k1TCrPtqizQ75B9D4olwaOepyNf_WLrxeo3EVJ1RILc7ibrcUl9TKcx9Xa7JSWe94 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_83bf9bf9a90e40128131944434838a65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/83bf9bf9a90e40128131944434838a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: bda51d44765e49a3b0ce230d2c9dce03 Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9642c556-541f-4148-95db-16c7bde7ca84'} Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.272321 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Returning 404 to user: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:24:25.276910 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1892123a-4beb-4728-a6ca-024b6de8c6c7 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 404 len: 111 microversion: 2.1 time: 0.063710 Jul 18 03:24:25.277472 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3557/7046] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:25 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:24:25.299576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:25.300350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:25.311455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.312236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.313827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.314411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.329453 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] HTTP exception thrown: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Request method failure captured: Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 HTTP/1.1 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NI1NXTlDV-S1iZ_7i_tZE4URO0-Y3pK3Pwsp7sxmRLyn3l3MzfvGgqN6qgN_E1FLERO4Nn72DexzUStJiWmreVHkTA3gr4Ki-xwRTY0cCEBA8k1TCrPtqizQ75B9D4olwaOepyNf_WLrxeo3EVJ1RILc7ibrcUl9TKcx9Xa7JSWe94 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_83bf9bf9a90e40128131944434838a65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/83bf9bf9a90e40128131944434838a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: bda51d44765e49a3b0ce230d2c9dce03 Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '9642c556-541f-4148-95db-16c7bde7ca84'} Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:24:25.331228 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Returning 404 to user: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-77ed88bb-1c46-4f25-b338-755f9fc041ca tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 404 len: 111 microversion: 2.1 time: 0.040420 Jul 18 03:24:25.336354 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3490/7047] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:24:25 2022] DELETE /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:24:25.342649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:25.343206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] [instance: 9642c556-541f-4148-95db-16c7bde7ca84] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:25.349788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.350249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.351045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:25.351496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:25.368729 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] HTTP exception thrown: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Request method failure captured: Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 HTTP/1.1 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NI1NXTlDV-S1iZ_7i_tZE4URO0-Y3pK3Pwsp7sxmRLyn3l3MzfvGgqN6qgN_E1FLERO4Nn72DexzUStJiWmreVHkTA3gr4Ki-xwRTY0cCEBA8k1TCrPtqizQ75B9D4olwaOepyNf_WLrxeo3EVJ1RILc7ibrcUl9TKcx9Xa7JSWe94 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_83bf9bf9a90e40128131944434838a65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/83bf9bf9a90e40128131944434838a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/83bf9bf9a90e40128131944434838a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 83bf9bf9a90e40128131944434838a65 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-DeleteServersTestJSON-840653774 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: bda51d44765e49a3b0ce230d2c9dce03 Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-DeleteServersTestJSON-840653774-project Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '9642c556-541f-4148-95db-16c7bde7ca84'} Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:24:25.370366 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] Returning 404 to user: Instance 9642c556-541f-4148-95db-16c7bde7ca84 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9fcc49a9-c83f-47b0-b432-af994314eed2 tempest-DeleteServersTestJSON-840653774 tempest-DeleteServersTestJSON-840653774-project] 10.222.0.67 "GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84" status: 404 len: 111 microversion: 2.1 time: 0.033310 Jul 18 03:24:25.377418 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3558/7048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:25 2022] GET /compute/v2.1/servers/9642c556-541f-4148-95db-16c7bde7ca84 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:24:35.732727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:35.733572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:35.874488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1563525554", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "988b77a5-ab81-4b96-9780-48f2babeded3"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:35.938098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] validate_networks() for [('988b77a5-ab81-4b96-9780-48f2babeded3', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:24:36.484069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:24:36.484519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:24:36.485182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:24:36.485587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:24:36.485921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:24:36.496445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:36.496893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:36.497785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:36.498239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:36.525563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for project 515bfa3119e04f228354fe59da38bf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:24:36.536632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for user 9be5f11657894ade809949d767888e38 and project 515bfa3119e04f228354fe59da38bf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:24:36.560177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:24:36.562805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:24:36.628073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-021c1e60-bbf7-469c-9f1c-906383cb86c2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902267 Jul 18 03:24:36.629106 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3491/7049] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:24:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:24:36.650374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-44fca8e3-2156-4194-86d0-55887adea5c6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:36.651158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-44fca8e3-2156-4194-86d0-55887adea5c6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:36.661847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=17 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:36.663077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=41 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:37.166049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-44fca8e3-2156-4194-86d0-55887adea5c6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:37.174750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-44fca8e3-2156-4194-86d0-55887adea5c6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1218 microversion: 2.1 time: 0.535225 Jul 18 03:24:37.176143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3559/7050] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:36 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1218 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:38.201450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:38.202759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:38.212299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:38.213070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:38.214339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:38.215036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:38.329260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:38.343466 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d13f682a-ba0f-4ffe-9786-5e3b52a2dbc2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1276 microversion: 2.1 time: 0.148100 Jul 18 03:24:38.344099 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3492/7051] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:38 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:39.367672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:39.370755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:39.386768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:39.388272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:39.390142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:39.391417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:39.753679 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:39.764315 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b8b41d6b-44b3-44ff-8864-9f53b2af9bb9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.405662 Jul 18 03:24:39.774421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3560/7052] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:39 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:40.000869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-bf0a18c0-4ded-43ca-9404-2a63cbcf31c5 req-a421f438-5648-4ba4-a2b7-4a900aff46d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:40.043906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bf0a18c0-4ded-43ca-9404-2a63cbcf31c5 req-a421f438-5648-4ba4-a2b7-4a900aff46d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:40.057532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-bf0a18c0-4ded-43ca-9404-2a63cbcf31c5 req-a421f438-5648-4ba4-a2b7-4a900aff46d2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:40.083632 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-bf0a18c0-4ded-43ca-9404-2a63cbcf31c5 req-a421f438-5648-4ba4-a2b7-4a900aff46d2 service nova] Creating event network-changed:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h2-849796-1 Jul 18 03:24:40.090224 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-bf0a18c0-4ded-43ca-9404-2a63cbcf31c5 req-a421f438-5648-4ba4-a2b7-4a900aff46d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102259 Jul 18 03:24:40.090867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3493/7053] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:40.791243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:40.791865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:40.800438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:40.801190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:40.802116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:40.802669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:41.004195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:41.013009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7beafb20-37e5-4a68-8734-2e02847ecf91 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.225714 Jul 18 03:24:41.013649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3561/7054] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:40 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:42.035133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:42.035791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:42.042836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:42.043303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:42.044114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:42.044573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:42.194979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:42.207705 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97adc71a-1a23-4ecd-b6ca-243b2b2ebe52 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.177785 Jul 18 03:24:42.208334 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3494/7055] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:42 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:43.228865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:43.230151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:43.244190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:43.245244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:43.246481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:43.247393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:43.643231 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:43.654732 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e3dfb5e-f24b-4f3b-9c6f-81e661db7978 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.432556 Jul 18 03:24:43.668973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3562/7056] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:43 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:44.682070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:44.682759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:44.692729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:44.693541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:44.695538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:44.696807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:44.847264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:44.859538 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d214b63-502e-469b-bcf5-2ab38667f057 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.181857 Jul 18 03:24:44.860594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3495/7057] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:44 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:45.100421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f2eb8e9a-036f-4af1-9221-53ae618686d9 req-10652ac1-dd6a-415a-b1ef-ee064066a245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "name": "network-vif-plugged", "status": "completed", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:45.110295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f2eb8e9a-036f-4af1-9221-53ae618686d9 req-10652ac1-dd6a-415a-b1ef-ee064066a245 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:45.110755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f2eb8e9a-036f-4af1-9221-53ae618686d9 req-10652ac1-dd6a-415a-b1ef-ee064066a245 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:45.124520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f2eb8e9a-036f-4af1-9221-53ae618686d9 req-10652ac1-dd6a-415a-b1ef-ee064066a245 service nova] Creating event network-vif-plugged:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h2-849796-1 Jul 18 03:24:45.131675 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f2eb8e9a-036f-4af1-9221-53ae618686d9 req-10652ac1-dd6a-415a-b1ef-ee064066a245 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Jul 18 03:24:45.132505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3563/7058] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:24:45.881385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:45.882814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:45.894594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:45.895326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:45.896711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:45.897303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:46.048938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:46.056855 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cb0ec9ab-c3bd-48ac-8bc0-30c805954926 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1318 microversion: 2.1 time: 0.182587 Jul 18 03:24:46.057486 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3496/7059] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:45 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:47.077070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:47.077789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.084275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.084738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.085609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.086080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.174337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:47.238013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:47.246481 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10af0afd-2f24-4349-9688-de675d4d4ffa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1509 microversion: 2.1 time: 0.175500 Jul 18 03:24:47.247185 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3564/7060] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:47 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:47.269134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:47.269599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.271324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:47.272043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:24:47.280428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.280843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.281952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.282388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.429466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:47.443515 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-18ca9d58-8d1e-464b-b853-4e65b81da7ff tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1509 microversion: 2.1 time: 0.178619 Jul 18 03:24:47.444493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3497/7061] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:47 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:47.461963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:47.463238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.469444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.469908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.470708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.471150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.553360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01743660-c220-47b4-9e52-8fd6caca6310 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "PUT /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1081 microversion: 2.1 time: 0.095234 Jul 18 03:24:47.554025 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3565/7062] 10.222.0.67 () {60 vars in 1255 bytes} [Mon Jul 18 03:24:47 2022] PUT /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1081 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:47.569193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:47.569827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.576890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.577463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.578268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.578724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.731806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:47.740073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8c043029-4a56-4d6c-9f9e-e0dacbd34910 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1507 microversion: 2.1 time: 0.174761 Jul 18 03:24:47.740696 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3498/7063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:47 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:47.765570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:47.766253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.775445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.775935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.776810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.777321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.929230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:47.939219 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07bafc1a-7858-46c8-b5ab-062b17f55e78 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1507 microversion: 2.1 time: 0.180623 Jul 18 03:24:47.939863 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3566/7064] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:47 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:47.957502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:24:47.958598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:47.965991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.966461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:47.967277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:47.967730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:48.001438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:48.008010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Old instance type m1.heat2, new instance type m1.heat {{(pid=119440) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:24:48.015487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:24:48.016029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:24:48.016698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:24:48.017186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:24:48.017632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:24:48.096790 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-73287cbf-7766-4746-a867-083332fb36e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43/action" status: 202 len: 0 microversion: 2.1 time: 0.143471 Jul 18 03:24:48.098138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3499/7065] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:24:47 2022] POST /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:24:48.107543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:48.108262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:48.115852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:48.116316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:48.117151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:48.117604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:48.306759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:48.319089 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a499780-f9f6-47fe-8be4-4901e0cf0a35 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1518 microversion: 2.1 time: 0.215372 Jul 18 03:24:48.320081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3567/7066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:48 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:49.344151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:49.344887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:49.351903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:49.352404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:49.353266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:49.353732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:49.536123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:49.547933 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a14a8e2-dbc2-4abb-be57-810c75028d4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1518 microversion: 2.1 time: 0.210308 Jul 18 03:24:49.548629 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3500/7067] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:49 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:50.566406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:50.566975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:50.575610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:50.576069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:50.576864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:50.577328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:50.830347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:50.840652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8737c3ff-bda4-4985-ad74-98443d2d59aa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.278161 Jul 18 03:24:50.841295 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3568/7068] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:50 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:51.860331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:51.861137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:51.869960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:51.870445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:51.871277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:51.871743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:52.019464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:52.027482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-50196945-a1ac-4b21-9606-06516b200b41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.171887 Jul 18 03:24:52.028071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3501/7069] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:51 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:53.048869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:53.049565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:53.056736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:53.057398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:53.058195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:53.058638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:53.205871 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:53.216483 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f037f5b9-f5fe-4b49-a049-f312e178014d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.172249 Jul 18 03:24:53.217174 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3569/7070] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:53 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:54.242900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:54.243712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:54.251461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:54.251939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:54.252758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:54.253252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:54.417873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:54.425658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c1b7994-3f91-4697-b13e-f61f4293fe9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.186682 Jul 18 03:24:54.426258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3502/7071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:54 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:55.443604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:55.444225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:55.452084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:55.452560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:55.453555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:55.454344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:55.609430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:55.617105 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ea614e4-876e-4340-bbf9-6764ba746903 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.177360 Jul 18 03:24:55.617686 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3570/7072] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:55 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:56.635909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:56.636541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:56.643880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:56.644349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:56.645226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:56.645686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:56.792850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:56.801187 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c7c2213-9846-4fbf-a30c-ab5cbcb2b8cf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.169728 Jul 18 03:24:56.801875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3503/7073] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:56 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:24:57.819779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:57.820391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:57.828709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:57.829191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:57.829987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:57.830430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:57.979179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:57.987196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-92a1221a-57a2-4ace-b614-7b3ddb685d6b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.171431 Jul 18 03:24:57.987804 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3571/7074] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:57 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:24:59.005716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:24:59.006352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:24:59.015545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:59.016024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:59.016846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:24:59.017328 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:24:59.192459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:24:59.201501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-becac7c9-3547-4578-8ab0-6dea846f2983 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.199712 Jul 18 03:24:59.202108 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3504/7075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:24:59 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:00.222358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:00.223297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:00.230383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:00.230834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:00.231602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:00.232042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:00.377593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:00.386474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce2a9aa2-6308-4435-b8a1-76cba8642b25 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.167939 Jul 18 03:25:00.387073 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3572/7076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:00 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:01.404246 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:01.404867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:01.411896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:01.412360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:01.413181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:01.413632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:01.551877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:01.559962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5e410468-4b04-4bc1-8e9d-9455d8f8fb04 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.160245 Jul 18 03:25:01.560716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3505/7077] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:01 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:02.577453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:02.577974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:02.584872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:02.585359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:02.586136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:02.586583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:02.724480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:02.732945 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb9a2960-7a19-47f7-a508-f4fde8bbf43b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.159661 Jul 18 03:25:02.733537 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3573/7078] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:02 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:03.750787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:03.751427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:03.758896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:03.759367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:03.761052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:03.761849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:03.915289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:03.925394 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1e74d615-264a-4ace-b069-8eb7c24efbcf tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.178484 Jul 18 03:25:03.925996 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3506/7079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:03 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:04.942738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:04.943352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:04.951414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:04.951898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:04.952680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:04.953176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:05.090883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:05.099139 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74d01ff7-b1dc-49f4-9dc2-81ae39dd03f4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.160270 Jul 18 03:25:05.100000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3574/7080] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:04 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:06.117541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:06.118202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:06.122030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:06.127785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:06.128258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:06.129091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:06.129562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:06.133456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:06.274580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:06.283309 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7aaded25-ca1f-4376-8f0f-bff22fe7eb85 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.169772 Jul 18 03:25:06.283907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3507/7081] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:06 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:07.301312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:07.301936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:07.304629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=35 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:07.311003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:07.311468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:07.312259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:07.312713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:07.315554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:07.453415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:07.461203 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cddb0fa2-5a99-4caa-9aff-23cfd5cbf62c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.163837 Jul 18 03:25:07.461813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3575/7082] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:07 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:08.480274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:08.481041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:08.488052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:08.488523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:08.489360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:08.489837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:08.629671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:08.637550 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51395bad-e7cd-4a3b-af0d-c194eae36bcb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.162043 Jul 18 03:25:08.638163 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3508/7083] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:08 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:09.655807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:09.656810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:09.663744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:09.664197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:09.664987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:09.665432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:09.801657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:09.809674 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5dc31c26-974a-4707-9795-c66c8bb7c72d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.157937 Jul 18 03:25:09.810264 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3576/7084] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:09 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:10.827767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:10.828402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:10.836370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:10.836948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:10.837859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:10.838974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:10.984955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:10.996519 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f8a49dc9-66aa-4ed7-a8a6-ed0530d6b322 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.172899 Jul 18 03:25:10.997138 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3509/7085] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:10 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:12.014007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:12.014613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:12.021806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:12.022267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:12.023095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:12.023547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:12.160078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:12.169062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-998c80e2-0a4c-4e7b-8277-61abbc0183d6 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.159525 Jul 18 03:25:12.169658 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3577/7086] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:12 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:13.185822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:13.186449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:13.193416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.193878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.194690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:13.195145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:13.333031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:13.342150 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5bfa31b7-75c0-4e6a-9096-929c5b21f1c0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.160730 Jul 18 03:25:13.342739 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3510/7087] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:13 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:14.360408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:14.361049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:14.368061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:14.368512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:14.369928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:14.370373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:14.508277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:14.516771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7154c26-ff9b-4fea-8b8a-4f207dc2d2d5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.160362 Jul 18 03:25:14.517414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3578/7088] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:14 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:15.535146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:15.535734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:15.544083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:15.544562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:15.545400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:15.545866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:15.692795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:15.701235 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca13c73f-2a3b-450d-ad58-6d861719bbe5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.170211 Jul 18 03:25:15.701835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3511/7089] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:15 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:16.720547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:16.721242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:16.729492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:16.729988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:16.732173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:16.734176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:16.876133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:16.883772 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4445a31a-6dfe-48c0-b45b-4a96d7aa13d0 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1523 microversion: 2.1 time: 0.167183 Jul 18 03:25:16.884356 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3579/7090] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:16 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:17.585970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "name": "network-vif-unplugged", "status": "completed", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:17.595842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:17.596306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:17.609382 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] Creating event network-vif-unplugged:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h1-849796-1 Jul 18 03:25:17.615176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] Instance d2862458-af63-40c2-a501-297ffe4dde43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:25:17.627702 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9573d684-cbb0-4cac-a01c-192913759abd req-e3896563-0a40-447b-b827-92e6b1d0a8be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045609 Jul 18 03:25:17.628323 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3512/7091] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:17.902991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:17.903620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:17.913457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:17.913951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:17.914956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:17.915489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:18.071393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:18.081374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc5de8a4-15e2-4ff2-aeca-9b9ddf68c29b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1522 microversion: 2.1 time: 0.183075 Jul 18 03:25:18.081981 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3580/7092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:17 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:19.101257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:19.101980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:19.108484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:19.108981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:19.109790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:19.110249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:19.249805 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:19.257862 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a516116-81f4-434c-9c33-9ed20514a4ee tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1520 microversion: 2.1 time: 0.162450 Jul 18 03:25:19.258473 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3513/7093] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:19 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:19.645531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:19.655818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:19.656274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:19.670049 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] Creating event network-changed:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h1-849796-1 Jul 18 03:25:19.676198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] Instance d2862458-af63-40c2-a501-297ffe4dde43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:25:19.688624 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8abde7b5-245d-487c-b0be-9a8f1b2ccc0c req-c85a01b5-4942-4063-84ee-23945dc79c9e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046865 Jul 18 03:25:19.689395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3581/7094] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:20.277115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:20.277810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:20.285127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:20.285605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:20.286414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:20.286880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:20.431235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:20.439752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0f20bae-0ad9-41b3-9b02-b93ba16fcd7d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1520 microversion: 2.1 time: 0.167728 Jul 18 03:25:20.440364 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3514/7095] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:20 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:21.459073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:21.459776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:21.466608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.467062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.467842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.468284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.619161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:21.627293 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a4ab304-38f5-4156-906c-7ab5dee52423 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1517 microversion: 2.1 time: 0.173465 Jul 18 03:25:21.627878 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3582/7096] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:21 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:21.644871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:21.645691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:21.653485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.653958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.654754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.655213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.719258 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2730103e-6c51-43c4-a43f-0458d7bb3c87 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43/action" status: 204 len: 0 microversion: 2.1 time: 0.078199 Jul 18 03:25:21.719918 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3515/7097] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:25:21 2022] POST /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:25:21.728501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:21.729154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:21.735324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.735780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.736587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:21.737069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:21.937546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:21.945899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5398d78b-c40b-4534-be01-96fa6f793e5c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1517 microversion: 2.1 time: 0.221333 Jul 18 03:25:21.946754 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3583/7098] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:21 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:22.966203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:22.967038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:22.973833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:22.974308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:22.975113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:22.975574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:23.114075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:23.122608 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9934fdb2-5f4e-47e8-a7bf-5ac318db74fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1509 microversion: 2.1 time: 0.162680 Jul 18 03:25:23.123204 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3516/7099] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:22 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:23.139435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:23.140060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:23.147184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:23.147638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:23.148441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:23.148888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:23.289451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:23.298827 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3fae24eb-e21f-4684-a2be-197b6fd3c2af tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1509 microversion: 2.1 time: 0.163594 Jul 18 03:25:23.299415 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3584/7100] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:23 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:23.319112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fea7030-2878-483c-9954-d0343cc1bd0f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'create', calling method: .version_select at 0x7faaf7317160>, body: {"keypair": {"name": "tempest-keypair-1128121262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIe4yyqi7u7d8FOqKAXDMFpH+ia0xwAIfACfjHQdpjryIPXoFBo55oPkiSPbpWvcbSUvWeglBikkDqsDWEYbOUTVmjM6yQhaCzPzTMcrCsk1KoFJ6kJBziskm1tzHK52g=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:23.334185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1fea7030-2878-483c-9954-d0343cc1bd0f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for project 515bfa3119e04f228354fe59da38bf5d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:25:23.340526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-1fea7030-2878-483c-9954-d0343cc1bd0f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for user 9be5f11657894ade809949d767888e38 and project 515bfa3119e04f228354fe59da38bf5d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:25:23.368399 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fea7030-2878-483c-9954-d0343cc1bd0f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053133 Jul 18 03:25:23.368939 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3517/7101] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:25:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:23.573167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-80d35c88-ed8b-4573-9b7f-ecb3804fcb3f req-a77b8afb-62bb-40e3-91f8-21db4209cee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "name": "network-vif-plugged", "status": "completed", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:23.582289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80d35c88-ed8b-4573-9b7f-ecb3804fcb3f req-a77b8afb-62bb-40e3-91f8-21db4209cee7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:23.582984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-80d35c88-ed8b-4573-9b7f-ecb3804fcb3f req-a77b8afb-62bb-40e3-91f8-21db4209cee7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:23.595962 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-80d35c88-ed8b-4573-9b7f-ecb3804fcb3f req-a77b8afb-62bb-40e3-91f8-21db4209cee7 service nova] Creating event network-vif-plugged:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h1-849796-1 Jul 18 03:25:23.601811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-80d35c88-ed8b-4573-9b7f-ecb3804fcb3f req-a77b8afb-62bb-40e3-91f8-21db4209cee7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Jul 18 03:25:23.602799 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3585/7102] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:25:24.609921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:24.610564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:24.618099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:24.618573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:24.619378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:24.619844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:24.754322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:24.763323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-baa46054-7cd4-401e-a1fd-348e6ce1607e tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 200 len: 1509 microversion: 2.1 time: 0.158947 Jul 18 03:25:24.763909 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3518/7103] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:24 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:24.780947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:24.781547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:24.787868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:24.788317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:24.789111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:24.789554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:24.818503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:25:24.895165 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-17ed7464-e524-4b3e-bfcd-5ab5eb5f9e50 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 204 len: 0 microversion: 2.1 time: 0.119143 Jul 18 03:25:24.895910 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3586/7104] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:25:24 2022] DELETE /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:25:24.949959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1850716487", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "988b77a5-ab81-4b96-9780-48f2babeded3"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:25.002269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] validate_networks() for [('988b77a5-ab81-4b96-9780-48f2babeded3', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:25:25.374966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:25:25.375411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:25:25.375889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:25:25.376314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:25:25.376736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:25:25.386486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:25.386945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:25.388483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:25.388961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:25.405388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for project 515bfa3119e04f228354fe59da38bf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:25:25.410672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Getting quotas for user 9be5f11657894ade809949d767888e38 and project 515bfa3119e04f228354fe59da38bf5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:25:25.423025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:25:25.425658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:25:25.471626 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95342111-d5d6-4ea6-b93b-a757888dbdeb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526078 Jul 18 03:25:25.472415 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3519/7105] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:25:25.483833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b3f4895-8919-4313-bf18-8e9176987629 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:25.484547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b3f4895-8919-4313-bf18-8e9176987629 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:25.541083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b3f4895-8919-4313-bf18-8e9176987629 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:25.548932 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b3f4895-8919-4313-bf18-8e9176987629 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1218 microversion: 2.1 time: 0.069975 Jul 18 03:25:25.549530 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3587/7106] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:25 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:26.567197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:26.567959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:26.578873 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:26.579345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:26.580164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:26.580879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:26.709882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:26.718379 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81afc870-fa66-48fc-8ca5-ed127375dd03 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1278 microversion: 2.1 time: 0.156089 Jul 18 03:25:26.718983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3520/7107] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:26 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:25:27.647858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-18d0ca6a-8c10-4654-bfb4-8805e419ffe5 req-67aabdad-e35c-4db2-a9a0-08f88736c532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2862458-af63-40c2-a501-297ffe4dde43", "name": "network-vif-deleted", "tag": "cce6ae16-642b-4bca-834b-70fd25d10ce4"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:27.667434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-18d0ca6a-8c10-4654-bfb4-8805e419ffe5 req-67aabdad-e35c-4db2-a9a0-08f88736c532 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:27.667953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-18d0ca6a-8c10-4654-bfb4-8805e419ffe5 req-67aabdad-e35c-4db2-a9a0-08f88736c532 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:27.685639 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-18d0ca6a-8c10-4654-bfb4-8805e419ffe5 req-67aabdad-e35c-4db2-a9a0-08f88736c532 service nova] Creating event network-vif-deleted:cce6ae16-642b-4bca-834b-70fd25d10ce4 for instance d2862458-af63-40c2-a501-297ffe4dde43 on n-h1-849796-1 Jul 18 03:25:27.692288 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-18d0ca6a-8c10-4654-bfb4-8805e419ffe5 req-67aabdad-e35c-4db2-a9a0-08f88736c532 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049987 Jul 18 03:25:27.693736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3588/7108] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:25:27.737013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:27.738412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:27.766374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:27.766853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:27.767679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:27.768146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:27.856369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:27.864805 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01eb428d-3233-4653-98bf-ef5b093957db tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1276 microversion: 2.1 time: 0.132185 Jul 18 03:25:27.866108 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3521/7109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:27 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:28.884858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:28.886277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:28.893899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:28.894567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:28.895591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:28.896025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:29.061585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:29.069429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2bb14389-5499-48d7-9f30-f10a05fcf78a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.189190 Jul 18 03:25:29.070185 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3589/7110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:28 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:29.711477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f908c0b9-ddfd-406e-a879-bbafee45b209 req-f43292b5-042a-491d-93a9-cd6246a3949e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:29.721778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f908c0b9-ddfd-406e-a879-bbafee45b209 req-f43292b5-042a-491d-93a9-cd6246a3949e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:29.722237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f908c0b9-ddfd-406e-a879-bbafee45b209 req-f43292b5-042a-491d-93a9-cd6246a3949e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:29.734482 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f908c0b9-ddfd-406e-a879-bbafee45b209 req-f43292b5-042a-491d-93a9-cd6246a3949e service nova] Creating event network-changed:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h1-849796-1 Jul 18 03:25:29.739858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f908c0b9-ddfd-406e-a879-bbafee45b209 req-f43292b5-042a-491d-93a9-cd6246a3949e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Jul 18 03:25:29.740480 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3522/7111] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:30.088060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:30.088686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:30.097816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:30.098548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:30.099384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:30.099863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:30.237902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:30.245741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45610ff5-80bb-4f61-987f-fbb79558302a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.161957 Jul 18 03:25:30.246333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3590/7112] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:30 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:31.265080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:31.266137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:31.272513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:31.273005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:31.273802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:31.274263 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:31.583622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:31.592255 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a2f633c0-d2a8-40e7-9d0c-7ce77d0788fd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.333161 Jul 18 03:25:31.602060 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3523/7113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:31 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:32.611064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:32.611662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:32.619112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:32.619829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:32.620776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:32.621269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:32.832866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:32.846076 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7495ae9-30f8-4938-ae97-38ba2ead6cce tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.238736 Jul 18 03:25:32.847018 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3591/7114] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:32 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:33.656213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4c17dc7d-5e5e-4bf1-b343-0b1cf229702f req-558de87f-258f-4992-b7e1-e6248d2f5777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "name": "network-vif-plugged", "status": "completed", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:33.673062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c17dc7d-5e5e-4bf1-b343-0b1cf229702f req-558de87f-258f-4992-b7e1-e6248d2f5777 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.673695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4c17dc7d-5e5e-4bf1-b343-0b1cf229702f req-558de87f-258f-4992-b7e1-e6248d2f5777 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.690123 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4c17dc7d-5e5e-4bf1-b343-0b1cf229702f req-558de87f-258f-4992-b7e1-e6248d2f5777 service nova] Creating event network-vif-plugged:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h1-849796-1 Jul 18 03:25:33.697779 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4c17dc7d-5e5e-4bf1-b343-0b1cf229702f req-558de87f-258f-4992-b7e1-e6248d2f5777 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049763 Jul 18 03:25:33.698829 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3524/7115] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:25:33.867352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:33.869455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:33.882758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.883552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:33.885051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:33.885931 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:34.039922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:34.042351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:34.049748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a33e3fe-9e66-4756-ab2a-b5e7cd3ce108 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.187283 Jul 18 03:25:34.050349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3592/7116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:33 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:25:35.068841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:35.069698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:35.076849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:35.077327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:35.078109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:35.078561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:35.223053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:35.227008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:35.232078 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3f2f66cc-712f-4441-b68d-bd0a763d12e4 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1318 microversion: 2.1 time: 0.168949 Jul 18 03:25:35.232699 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3525/7117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:35 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:36.251029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:36.251562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:36.254668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:36.261302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.261771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.263764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.264361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.400895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:36.409169 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1388ae37-bb76-4324-b002-efb301b79dfb tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1508 microversion: 2.1 time: 0.163282 Jul 18 03:25:36.409757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3593/7118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:36 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:36.427397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:36.428031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:36.429871 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:36.430545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:36.432260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:36.441833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.442310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.443139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.443583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.574582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:36.582512 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7132403-4cf2-43c2-a242-697789031176 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1508 microversion: 2.1 time: 0.159810 Jul 18 03:25:36.583104 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3526/7119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:36 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:36.599251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:25:36.600242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:36.606877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.607324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.608278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.608715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.681828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:36.688718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:25:36.695410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:25:36.695840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:25:36.696314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:25:36.696729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:25:36.697165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:25:36.808286 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-966e55e5-3cd0-43c3-bd8d-31b6596492f7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3/action" status: 202 len: 0 microversion: 2.1 time: 0.213207 Jul 18 03:25:36.808830 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3594/7120] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:25:36 2022] POST /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:25:36.817257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:36.817903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:36.824351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.824811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.825708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:36.826167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:36.999084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:37.006833 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0552ae6-2b59-4988-8775-4142a784cecd tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1515 microversion: 2.1 time: 0.193596 Jul 18 03:25:37.007439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3527/7121] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:36 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:38.027116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:38.027746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:38.030326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:25:38.036673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:38.037153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:38.037950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:38.038383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:38.524954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:38.533547 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-13174717-1ccc-44b4-a671-7b1de9eeec38 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1515 microversion: 2.1 time: 0.511426 Jul 18 03:25:38.534208 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3595/7122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:38 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:39.552693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:39.553265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:39.560950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:39.561423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:39.562224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:39.562679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:39.696021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:39.703977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b02f5cf9-c1a1-400b-b049-6203b24d2074 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.155355 Jul 18 03:25:39.704553 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3528/7123] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:39 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:40.721838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:40.722445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:40.730004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:40.730455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:40.731222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:40.731662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:40.868813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:40.877523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2450f059-c794-4748-9b39-169ee11dd045 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.159639 Jul 18 03:25:40.878138 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3596/7124] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:40 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:41.895350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:41.895983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:41.903154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:41.903623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:41.904430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:41.904889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:42.043842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:42.051621 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d548a90b-8f32-4aaa-9a8f-30dfffb3fe4f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.160967 Jul 18 03:25:42.052198 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3529/7125] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:41 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:43.069448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:43.070140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:43.076972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:43.077425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:43.078811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:43.079456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:43.216271 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:43.224409 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93ff5c55-a643-435e-ad98-f15368c58710 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.158941 Jul 18 03:25:43.225008 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3597/7126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:43 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:25:44.241782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:44.242422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:44.249452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:44.249931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:44.251463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:44.251892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:44.390439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:44.398864 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e5981f2-c559-40a6-a82c-1b9e5f1df7c8 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.160894 Jul 18 03:25:44.399530 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3530/7127] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:44 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:45.417215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:45.417819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:45.425274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:45.425725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:45.426490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:45.426929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:45.564228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:45.572193 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e954e7c-2461-4433-b086-0986d10e5f41 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.158899 Jul 18 03:25:45.572779 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3598/7128] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:45 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:46.589727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:46.590293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:46.598238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:46.598955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:46.599749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:46.600208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:46.733516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:46.741863 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2eed482c-bd1e-4b2e-b811-04974b9dcc20 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.156158 Jul 18 03:25:46.742445 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3531/7129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:46 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:47.760088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:47.760727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:47.767919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:47.768375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:47.769189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:47.769643 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:47.905364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:47.914126 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e2e4327-15cf-4a8e-923b-bf20263ca25c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.157982 Jul 18 03:25:47.914720 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3599/7130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:47 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:48.931360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:48.931984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:48.939334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:48.939732 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:48.940517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:48.940990 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:49.083666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:49.092039 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-155bf961-9152-4045-8455-5bddf1423239 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.164640 Jul 18 03:25:49.093125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3532/7131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:48 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:50.111323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:50.111949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:50.119146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:50.119606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:50.120400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:50.120841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:50.252151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:50.260046 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-141c458b-c678-4308-a6bb-304e22210d63 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.153388 Jul 18 03:25:50.260643 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3600/7132] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:50 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:25:51.278237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:51.278907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:51.286487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:51.286961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:51.287760 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:51.288218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:51.423238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:51.431607 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-156fa57f-d256-4561-838d-13caf74601d9 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.157336 Jul 18 03:25:51.432195 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3533/7133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:51 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:52.449034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:52.449655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:52.456634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:52.457126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:52.457909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:52.458353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:52.594392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:52.602266 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4da334bf-79dc-45fc-abc1-9ffbb3b1bdfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.157533 Jul 18 03:25:52.602848 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3601/7134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:52 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:53.620212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:53.620761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:53.627826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:53.628299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:53.629130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:53.629610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:53.764179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:53.772309 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-060a1c45-b878-4ba2-b119-7c7c9a398732 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.156482 Jul 18 03:25:53.772901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3534/7135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:53 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:54.789667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:54.790288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:54.797726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:54.798267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:54.799095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:54.799720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:54.933176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:54.941914 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fed702c1-de65-4a03-89d6-42d7dc69fbb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.156207 Jul 18 03:25:54.942496 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3602/7136] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:54 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:55.959158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:55.959817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:55.966835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:55.967291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:55.968075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:55.968524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:56.100710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:56.108305 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ec1405d-2a1c-453c-ac9c-b81bb3e724b1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.153124 Jul 18 03:25:56.108889 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3535/7137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:55 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:57.124965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:57.126556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:57.136244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:57.136696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:57.137550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:57.138015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:57.273465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:57.281292 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-98516853-d668-470b-84d6-57fca8cacb8d tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.160252 Jul 18 03:25:57.281857 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3603/7138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:57 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:58.299241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:58.299935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:58.307325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:58.307797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:58.308605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:58.309746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:58.448337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:58.456858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a45c4a16-eec2-4f89-b841-ca384f293ec1 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.161967 Jul 18 03:25:58.457613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3536/7139] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:58 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:25:59.475508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:25:59.476126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:25:59.485312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:59.485720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:59.486565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:25:59.487020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:25:59.625429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:25:59.633028 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b468a84-79f2-4181-b93f-d7cf2a9f337c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.162264 Jul 18 03:25:59.633603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3604/7140] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:25:59 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:00.651075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:00.651750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:00.658950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:00.659432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:00.660250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:00.660719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:00.836956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:00.849135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c3107e8-df9f-4ef7-aa43-b18562b349a2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.201294 Jul 18 03:26:00.850145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3537/7141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:00 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:01.759574 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:26:01.760171 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:26:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:26:01.868087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:01.868714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:01.876510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:01.876915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:01.877717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:01.878160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:02.008665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:02.016690 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fcf603cb-6417-4c9e-84d2-e6fa76b459d7 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.152409 Jul 18 03:26:02.017241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3605/7142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:01 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:03.034912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:03.035506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:03.042508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:03.042981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:03.043782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:03.044279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:03.180844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:03.189061 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-51396064-64ff-44f2-9939-2c830de57609 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.158720 Jul 18 03:26:03.189646 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3538/7143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:03 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:04.207341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:04.207959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:04.215557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:04.216019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:04.216805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:04.217291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:04.353706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:04.362077 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7d189945-1744-41e6-b988-de8d2f374624 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.159691 Jul 18 03:26:04.362674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3606/7144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:04 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:05.379551 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:05.380182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:05.387151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:05.387622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:05.388414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:05.388872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:05.563576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:05.571580 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85d2bcb5-88f9-4281-88f9-3b618336896a tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1520 microversion: 2.1 time: 0.196009 Jul 18 03:26:05.572163 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3539/7145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:05 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:06.227137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "name": "network-vif-unplugged", "status": "completed", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:06.235526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:06.236255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:06.249659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] Creating event network-vif-unplugged:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h2-849796-1 Jul 18 03:26:06.265581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:26:06.278240 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d60c2241-6abe-4150-881a-ab900e6214e3 req-4f48b695-1afb-4d6d-9519-5775eec262ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.187528 Jul 18 03:26:06.278915 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3607/7146] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:26:06.589770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:06.590341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:06.593173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=28 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:06.599090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:06.599557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:06.600360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:06.600827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:06.603617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=85 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:06.742326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:06.750080 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f7f8517e-d34f-48ad-b4b2-4842b5170dfa tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1519 microversion: 2.1 time: 0.164356 Jul 18 03:26:06.750666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3540/7147] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:06 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:07.770728 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:07.771473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:07.777939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:07.778408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:07.779192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:07.779642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:07.783711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:07.915589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:07.924594 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5354b347-83d6-4795-8434-913516873601 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1517 microversion: 2.1 time: 0.159136 Jul 18 03:26:07.925275 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3608/7148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:07 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:08.308339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:08.318030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:08.318497 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:08.330908 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] Creating event network-changed:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h2-849796-1 Jul 18 03:26:08.336710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:26:08.349796 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-42ac6297-6313-4e82-8cf2-b22082ea64e0 req-c07df796-e008-4d7f-9efb-e9f419e4beec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045243 Jul 18 03:26:08.350403 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3541/7149] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:26:08.942690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:08.943324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:08.945977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:08.951394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:08.951846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:08.952619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:08.953083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:09.096672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:09.106571 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ade03e7b-6fcb-47be-869f-36cf3c2d0a9c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1517 microversion: 2.1 time: 0.168292 Jul 18 03:26:09.107186 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3609/7150] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:08 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:10.126302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:10.127289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:10.133725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:10.134195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:10.134982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:10.135434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:10.276288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:10.284587 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28ebdd35-7151-4d2d-942a-f730a7d22c8b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1517 microversion: 2.1 time: 0.163444 Jul 18 03:26:10.285190 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3542/7151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:10 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:11.302452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:11.303081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:11.310163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.310629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.311406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.311857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.446700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:11.454367 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6366f28b-f9d4-4d45-bc64-48257ee5632c tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1514 microversion: 2.1 time: 0.156519 Jul 18 03:26:11.455516 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3610/7152] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:11 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:11.471819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:11.472213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:11.479078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.479554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.480361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.480823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.545658 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef45a717-7033-4af0-9a57-51435750a5b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "POST /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3/action" status: 204 len: 0 microversion: 2.1 time: 0.077914 Jul 18 03:26:11.546339 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3543/7153] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:26:11 2022] POST /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:26:11.555737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:11.556344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:11.563353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.563979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.565883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:11.566419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:11.707827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:11.715627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf477b3a-6bac-4905-ae2d-c83b88b54fb2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1514 microversion: 2.1 time: 0.164463 Jul 18 03:26:11.716225 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3611/7154] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:11 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:12.734820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:12.735548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:12.743707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:12.744176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:12.745022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:12.745486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:12.885960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:12.894132 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fd6d687a-4f50-495b-92c7-377da0d8a88f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1506 microversion: 2.1 time: 0.164008 Jul 18 03:26:12.894732 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3544/7155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:12 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:12.911174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:12.911793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:12.918892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:12.919349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:12.920150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:12.920592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.053335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:13.062160 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-858d94fc-af9a-486a-b1ff-4947631994b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1506 microversion: 2.1 time: 0.155641 Jul 18 03:26:13.062759 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3612/7156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:12 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:13.078671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:13.079372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:13.086798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.087295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.088091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.088548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.226192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:13.234044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4ab834c-8c8f-4d62-ab1c-78acb3f8c801 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1506 microversion: 2.1 time: 0.159345 Jul 18 03:26:13.234629 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3545/7157] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:13 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:13.251100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:13.251689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:13.258630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.259086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.259870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.260322 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.285988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:26:13.368627 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-436cd7d6-11c2-4267-b33f-2cfab3df0882 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "DELETE /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 204 len: 0 microversion: 2.1 time: 0.121058 Jul 18 03:26:13.369727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3613/7158] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:26:13 2022] DELETE /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:26:13.388533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:13.389309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:13.395675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.396145 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.396981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.397443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.425105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:26:13.473183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.compute.api [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Instance is already in deleting state, ignoring this request Jul 18 03:26:13.474091 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7f56d89-103f-43de-9e25-325ac8e3998b tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "DELETE /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 204 len: 0 microversion: 2.1 time: 0.089342 Jul 18 03:26:13.474866 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3546/7159] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:26:13 2022] DELETE /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:26:13.483390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:13.484351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:13.491711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.492165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.493006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.493449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.495926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-1b8cff10-a4cd-4aec-86c4-837f6843ee27 req-5eacb88d-2551-4cd1-b444-5115c21dfb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "name": "network-vif-plugged", "status": "completed", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:13.505712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1b8cff10-a4cd-4aec-86c4-837f6843ee27 req-5eacb88d-2551-4cd1-b444-5115c21dfb12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:13.506799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-1b8cff10-a4cd-4aec-86c4-837f6843ee27 req-5eacb88d-2551-4cd1-b444-5115c21dfb12 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:13.519561 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-1b8cff10-a4cd-4aec-86c4-837f6843ee27 req-5eacb88d-2551-4cd1-b444-5115c21dfb12 service nova] Creating event network-vif-plugged:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h2-849796-1 Jul 18 03:26:13.525181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-1b8cff10-a4cd-4aec-86c4-837f6843ee27 req-5eacb88d-2551-4cd1-b444-5115c21dfb12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Jul 18 03:26:13.526411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3547/7160] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:26:13.638477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:13.646255 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-37fe9e61-4a15-455d-b432-fd5975184d5f tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1512 microversion: 2.1 time: 0.167225 Jul 18 03:26:13.646847 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3614/7161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:13 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:14.664719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:14.666028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:14.672581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:14.673091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:14.674571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:14.675038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:14.809955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be5f11657894ade809949d767888e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515bfa3119e04f228354fe59da38bf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:14.818418 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf45d3fb-62a8-4f60-87f7-d8466fb150b2 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 200 len: 1512 microversion: 2.1 time: 0.158904 Jul 18 03:26:14.818999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3548/7162] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:14 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:15.532803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-be011505-bc18-477a-a163-393f08f5079d req-d86aab76-bb81-4e51-a4ed-b1a54a7c01fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28bf3a15-0a35-4c36-8492-96c6d48acee3", "name": "network-vif-deleted", "tag": "2e313d01-ecdc-4c99-b1b8-d155ca46ff98"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:15.550095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-be011505-bc18-477a-a163-393f08f5079d req-d86aab76-bb81-4e51-a4ed-b1a54a7c01fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:15.550563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-be011505-bc18-477a-a163-393f08f5079d req-d86aab76-bb81-4e51-a4ed-b1a54a7c01fc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:15.565386 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-be011505-bc18-477a-a163-393f08f5079d req-d86aab76-bb81-4e51-a4ed-b1a54a7c01fc service nova] Creating event network-vif-deleted:2e313d01-ecdc-4c99-b1b8-d155ca46ff98 for instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 on n-h2-849796-1 Jul 18 03:26:15.570902 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-be011505-bc18-477a-a163-393f08f5079d req-d86aab76-bb81-4e51-a4ed-b1a54a7c01fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043519 Jul 18 03:26:15.571721 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3615/7163] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:26:15.835823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:15.836489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: 28bf3a15-0a35-4c36-8492-96c6d48acee3] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:15.844132 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:15.844636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:15.845508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:15.846153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:15.860057 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] HTTP exception thrown: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Request method failure captured: Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 HTTP/1.1 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NJz8sHtnVGHjtaw-nnc9pyMoYzZKugk1ExHMfV051ztHe1_bPVYwYp6IX1MT7RrhbH86Ot_H4MCj-4yycnwJpyxOBoE_emrugIXZ4kasvlPaBYom8RkxG1nexdfBA-vsXH9IHHVu8xp0x1H10w5Tl9NX078EWZyE-lIy9bFBZ95Fsc Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 9be5f11657894ade809949d767888e38 Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '28bf3a15-0a35-4c36-8492-96c6d48acee3'} Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:15.861780 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Returning 404 to user: Instance 28bf3a15-0a35-4c36-8492-96c6d48acee3 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de1ef5a7-a4df-4879-add9-59524ffc3543 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3" status: 404 len: 111 microversion: 2.1 time: 0.031518 Jul 18 03:26:15.866411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3549/7164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:15 2022] GET /compute/v2.1/servers/28bf3a15-0a35-4c36-8492-96c6d48acee3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:26:15.872684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8482f3b-55c3-481b-86fe-bd78eed78ef5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '.version_select at 0x7fab045551f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:15.895653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8482f3b-55c3-481b-86fe-bd78eed78ef5 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128121262" status: 202 len: 0 microversion: 2.1 time: 0.027177 Jul 18 03:26:15.896246 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3616/7165] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 03:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128121262 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:26:16.506388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:16.506900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:16.513009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:16.513476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:16.514296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:16.514751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:16.530793 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] HTTP exception thrown: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Request method failure captured: Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 HTTP/1.1 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NJz8sHtnVGHjtaw-nnc9pyMoYzZKugk1ExHMfV051ztHe1_bPVYwYp6IX1MT7RrhbH86Ot_H4MCj-4yycnwJpyxOBoE_emrugIXZ4kasvlPaBYom8RkxG1nexdfBA-vsXH9IHHVu8xp0x1H10w5Tl9NX078EWZyE-lIy9bFBZ95Fsc Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 9be5f11657894ade809949d767888e38 Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd2862458-af63-40c2-a501-297ffe4dde43'} Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:26:16.532389 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Returning 404 to user: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2078c71e-d8ea-4254-bddb-66c05dfa5a94 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 404 len: 111 microversion: 2.1 time: 0.032264 Jul 18 03:26:16.536799 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3550/7166] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:26:16 2022] DELETE /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:26:16.543548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:16.544293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] [instance: d2862458-af63-40c2-a501-297ffe4dde43] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:16.554353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:16.554813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:16.555596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:16.556049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:16.570191 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] HTTP exception thrown: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Request method failure captured: Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 HTTP/1.1 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NJz8sHtnVGHjtaw-nnc9pyMoYzZKugk1ExHMfV051ztHe1_bPVYwYp6IX1MT7RrhbH86Ot_H4MCj-4yycnwJpyxOBoE_emrugIXZ4kasvlPaBYom8RkxG1nexdfBA-vsXH9IHHVu8xp0x1H10w5Tl9NX078EWZyE-lIy9bFBZ95Fsc Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/515bfa3119e04f228354fe59da38bf5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 515bfa3119e04f228354fe59da38bf5d Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1789663575 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 9be5f11657894ade809949d767888e38 Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerDiskConfigTestJSON-1789663575-project Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd2862458-af63-40c2-a501-297ffe4dde43'} Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:26:16.571859 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] Returning 404 to user: Instance d2862458-af63-40c2-a501-297ffe4dde43 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e98af8c7-e28d-41fd-a147-cc64eeaf0637 tempest-ServerDiskConfigTestJSON-1789663575 tempest-ServerDiskConfigTestJSON-1789663575-project] 10.222.0.67 "GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43" status: 404 len: 111 microversion: 2.1 time: 0.034267 Jul 18 03:26:16.576474 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3617/7167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:16 2022] GET /compute/v2.1/servers/d2862458-af63-40c2-a501-297ffe4dde43 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:26:25.519134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fbd41b9-9d76-4686-9229-7643dbd84465 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: .version_select at 0x7faaf738da60>, body: {"keypair": {"name": "tempest-keypair-1045846927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXNRRxDmKhtE48k/bSJajLK1mqV9+GIZQ5KoNPIAuHDEuBQoUlPnhgTmdalCzuyek+ZrQbFa6A/bSpT5Q5ozqIPEQx+XJRsj/MSU/8JhIcBnSSnl+TsLJDG7bapAQz01g=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:25.536105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5fbd41b9-9d76-4686-9229-7643dbd84465 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:26:25.541546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-5fbd41b9-9d76-4686-9229-7643dbd84465 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:26:25.569363 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fbd41b9-9d76-4686-9229-7643dbd84465 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174341 Jul 18 03:26:25.570339 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3551/7168] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:26:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:26:26.890199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-943335314", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09acb3a2-5135-4d04-ab0b-340fd4081a9b"}], "security_groups": [{"name": "tempest-securitygroup--302046339"}], "key_name": "tempest-keypair-1045846927", "user_data": "}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:26.898827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:26.899660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:27.005244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] validate_networks() for [('09acb3a2-5135-4d04-ab0b-340fd4081a9b', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:26:27.433250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:26:27.433950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:26:27.434706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:26:27.435293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:26:27.435648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:26:27.449965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:27.450428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:27.451310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:27.451886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:27.473092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:26:27.479226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:26:27.512190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:26:27.514954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:26:27.575734 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7095a03-7890-43df-96d2-2456fdb2cdfe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.690956 Jul 18 03:26:27.577541 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3618/7169] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:26:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:26:27.587118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:27.599060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bd53ac8d-b860-421e-956d-d598f6e2ac83 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:27.599708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bd53ac8d-b860-421e-956d-d598f6e2ac83 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:27.686235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bd53ac8d-b860-421e-956d-d598f6e2ac83 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:27.694054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bd53ac8d-b860-421e-956d-d598f6e2ac83 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1238 microversion: 2.1 time: 0.110141 Jul 18 03:26:27.705439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3552/7170] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:27 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:28.713100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:28.713868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:28.721514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:28.722081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:28.722891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:28.723345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:28.798079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:28.807199 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95903670-6ea7-4344-84c8-e0efe3e6ef9a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1290 microversion: 2.1 time: 0.098896 Jul 18 03:26:28.808114 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3619/7171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:28 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:29.825565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:29.826203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:29.835427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:29.835902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:29.836914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:29.837422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:29.997124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:30.007437 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0db07ce8-16ef-433d-8b67-4a3f9c7b539c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.185742 Jul 18 03:26:30.008067 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3553/7172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:29 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:30.433252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5e6fd2a5-df28-4bd3-a546-6cfe51fe8a1f req-d0200dc7-cf44-4d38-9259-b8d0c9a35a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:30.444165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5e6fd2a5-df28-4bd3-a546-6cfe51fe8a1f req-d0200dc7-cf44-4d38-9259-b8d0c9a35a49 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:30.444544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5e6fd2a5-df28-4bd3-a546-6cfe51fe8a1f req-d0200dc7-cf44-4d38-9259-b8d0c9a35a49 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:30.461665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5e6fd2a5-df28-4bd3-a546-6cfe51fe8a1f req-d0200dc7-cf44-4d38-9259-b8d0c9a35a49 service nova] Creating event network-changed:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h2-849796-1 Jul 18 03:26:30.467288 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5e6fd2a5-df28-4bd3-a546-6cfe51fe8a1f req-d0200dc7-cf44-4d38-9259-b8d0c9a35a49 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037798 Jul 18 03:26:30.468525 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3620/7173] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:26:31.024597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:31.025262 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:31.032506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:31.033250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:31.034154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:31.034617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:31.182212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:31.192413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1354c789-da58-4b9c-8cf7-bac87a3931ec tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.170827 Jul 18 03:26:31.192413 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3554/7174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:31 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:32.210042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:32.210829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:32.217187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:32.217649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:32.218427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:32.218879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:32.367641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:32.375206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12abbd7f-3e9d-4d16-bc34-e69707c399e4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.170964 Jul 18 03:26:32.375793 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3621/7175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:32 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:33.394923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:33.396096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:33.405847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:33.406314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:33.407469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:33.408472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:33.561952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:33.570684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1a76ed8d-e499-4ec9-ad27-863dac71e6e5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.182257 Jul 18 03:26:33.571295 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3555/7176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:33 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:34.588604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:34.589290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:34.596473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:34.596939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:34.597731 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:34.598175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:34.730601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:34.738629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4513d4c-bee7-468d-9539-2e7aa188b8ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.153954 Jul 18 03:26:34.739209 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3622/7177] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:34 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:35.636359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0fd908bc-03c3-466b-a140-85921230322a req-911385f2-b31b-4622-be8a-0cb7e495bd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "name": "network-vif-plugged", "status": "completed", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:35.645810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0fd908bc-03c3-466b-a140-85921230322a req-911385f2-b31b-4622-be8a-0cb7e495bd57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:35.646281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0fd908bc-03c3-466b-a140-85921230322a req-911385f2-b31b-4622-be8a-0cb7e495bd57 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:35.658292 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0fd908bc-03c3-466b-a140-85921230322a req-911385f2-b31b-4622-be8a-0cb7e495bd57 service nova] Creating event network-vif-plugged:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h2-849796-1 Jul 18 03:26:35.663976 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0fd908bc-03c3-466b-a140-85921230322a req-911385f2-b31b-4622-be8a-0cb7e495bd57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031266 Jul 18 03:26:35.664594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3556/7178] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:26:35.756488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:35.757253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:35.764382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:35.764945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:35.765757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:35.766200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:35.941672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:35.949136 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09bcf32d-41d2-4945-954f-23545e1d2af2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.197137 Jul 18 03:26:35.949715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3623/7179] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:35 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:26:36.967516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:36.968241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:36.970276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:36.977064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:36.977537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:36.978340 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:36.978804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:37.116000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:37.123600 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ba896c2-4a61-4a70-ae05-31b0aaf670d5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1363 microversion: 2.1 time: 0.161274 Jul 18 03:26:37.124183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3557/7180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:36 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:38.140914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:38.141450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:38.144827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:38.145518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:38.151470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:38.151922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:38.152697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:38.153290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:38.291060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:26:38.298672 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bfce4899-86cb-40e7-a866-339f0bf9debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1550 microversion: 2.1 time: 0.161802 Jul 18 03:26:38.299254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3624/7181] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:26:38 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:26:38.315910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:26:38.316601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:26:38.318537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:26:38.325084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:38.325555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:38.326352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:38.326810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:38.407493 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b33b55f-ce13-4cff-bdf5-9c04b94ca6d4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095941 Jul 18 03:26:38.408111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3558/7182] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:26:38 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:26:39.362933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-08ee550e-7e8b-4a3d-b2e8-2bd0e6597f53 req-9fb8b7c6-f300-416a-9a14-1e35a7ec0013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:26:39.371903 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-08ee550e-7e8b-4a3d-b2e8-2bd0e6597f53 req-9fb8b7c6-f300-416a-9a14-1e35a7ec0013 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:26:39.372345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-08ee550e-7e8b-4a3d-b2e8-2bd0e6597f53 req-9fb8b7c6-f300-416a-9a14-1e35a7ec0013 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:26:39.384142 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-08ee550e-7e8b-4a3d-b2e8-2bd0e6597f53 req-9fb8b7c6-f300-416a-9a14-1e35a7ec0013 service nova] Creating event network-changed:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h2-849796-1 Jul 18 03:26:39.389442 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-08ee550e-7e8b-4a3d-b2e8-2bd0e6597f53 req-9fb8b7c6-f300-416a-9a14-1e35a7ec0013 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030553 Jul 18 03:26:39.390232 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3625/7183] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:27:41.202992 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:27:41.203614 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:28:09.381741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:09.382568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=30 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:09.387225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:09.387853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:09.394790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.396054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.396886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.397368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.541280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:09.548898 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3428997f-20a0-4e8e-ac21-30753e142d47 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.170320 Jul 18 03:28:09.549504 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3559/7184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:09 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:09.565278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:09.566130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=36 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:09.571680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:09.572385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:09.579782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.580282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.581095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.581544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.715584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:09.723241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87d5f6e9-ff19-4af8-8346-ac8da12f28f0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.161296 Jul 18 03:28:09.723881 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3626/7185] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:09 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:09.739823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:09.740376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:09.746436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.746906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.747686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.748137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.885430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:09.893124 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f36cf9d-0efd-4a89-9aae-cea401641484 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.157320 Jul 18 03:28:09.893707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3560/7186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:09 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:09.909350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:09.910319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:09.916506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.916989 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.917758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:09.918196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:09.946751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:09.952641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:28:09.958854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:28:09.959276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:28:09.959757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:28:09.960165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:28:09.960574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:28:10.023570 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-52e032de-33a2-4bb6-a4b2-dec13bd27cc8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/action" status: 202 len: 0 microversion: 2.1 time: 0.118114 Jul 18 03:28:10.024208 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3627/7187] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:28:09 2022] POST /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:28:10.032361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:10.033096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:10.039618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:10.040084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:10.041258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:10.041713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:10.210822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:10.218765 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f597ae21-4451-46e9-880d-ec01e815e293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1678 microversion: 2.1 time: 0.190246 Jul 18 03:28:10.219375 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3561/7188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:10 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:11.237631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:11.238518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:11.247244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:11.247727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:11.248548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:11.249081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:11.479172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:11.487517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7460caf2-5c32-450e-994f-928bf75cd6e6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1678 microversion: 2.1 time: 0.254134 Jul 18 03:28:11.488180 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3628/7189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:11 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:12.506555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:12.507183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:12.514274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:12.514745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:12.515548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:12.516011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:12.654752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:12.662864 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d16606ea-aadb-41fe-b41e-5a6941e967d6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.160940 Jul 18 03:28:12.663445 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3562/7190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:12 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:13.680882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:13.681524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:13.688540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:13.689033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:13.689822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:13.690286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:13.821555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:13.829083 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-129e84a3-dd45-45e7-8e93-e1970f58598d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.153140 Jul 18 03:28:13.829656 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3629/7191] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:13 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:14.846301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:14.846927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:14.854574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:14.855043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:14.855842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:14.856302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:14.989978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:14.998485 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d04e1e54-8da5-4024-aef1-f865c69ba0b6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.156209 Jul 18 03:28:14.999077 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3563/7192] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:14 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:16.016752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:16.017425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:16.025325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:16.025790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:16.026590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:16.027045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:16.166479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:16.174101 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6dca5b9c-e671-4923-bc0f-62fce3ac04ad tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.161459 Jul 18 03:28:16.174684 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3630/7193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:16 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:17.192093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:17.192759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:17.200853 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:17.201378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:17.202317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:17.202656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:17.340458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:17.348112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-05057166-0a2c-4f69-a770-dada8b9a2fed tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.160009 Jul 18 03:28:17.348687 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3564/7194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:17 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:18.366755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:18.367368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:18.374349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:18.374812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:18.375592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:18.376042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:18.509612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:18.525198 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-529d1980-4a04-412b-a07d-b41cd6f2f8a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.162653 Jul 18 03:28:18.525690 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3631/7195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:18 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:19.543620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:19.544265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:19.554734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:19.555209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:19.556019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:19.556481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:19.693433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:19.701274 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d323ce1-8455-40cd-b5f6-37d8d112275a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.163153 Jul 18 03:28:19.701853 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3565/7196] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:19 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:20.719715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:20.720385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:20.728895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:20.729380 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:20.730162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:20.730610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:20.872046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:20.879620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07197a12-f7fb-4479-aee8-5b8dc2b26d81 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.164051 Jul 18 03:28:20.880201 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3632/7197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:20 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:21.897889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:21.898544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:21.905641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:21.906116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:21.906917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:21.907379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:22.044802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:22.052438 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6057f31d-3f5a-4294-8840-8a89d786ead0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.158670 Jul 18 03:28:22.053619 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3566/7198] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:21 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:23.070880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:23.071481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:23.077756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:23.078203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:23.078967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:23.079408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:23.210517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:23.218085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1f6a43d-fe86-4dc8-99c4-f38236cee65e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.151499 Jul 18 03:28:23.218656 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3633/7199] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:23 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:24.236142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:24.236770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:24.244165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:24.244638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:24.245466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:24.245929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:24.385995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:24.393853 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1dab9fa9-e9a9-4caa-93d9-86a126b562a1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1683 microversion: 2.1 time: 0.162051 Jul 18 03:28:24.394446 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3567/7200] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:24 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:25.024016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "name": "network-vif-unplugged", "status": "completed", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:25.033375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:25.033834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:25.048461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] Creating event network-vif-unplugged:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h1-849796-1 Jul 18 03:28:25.055064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:28:25.067163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-367df8c4-ef8a-42cf-aa00-307eef128046 req-3a2c05cf-e0c7-4e8d-93ad-42c060bdaf73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126283 Jul 18 03:28:25.068985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3634/7201] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:25.412006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:25.413432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:25.420599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:25.421110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:25.422598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:25.423076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:25.684030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:25.691678 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bba9f8ae-f602-4c61-b697-aa402e259ea7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1682 microversion: 2.1 time: 0.283822 Jul 18 03:28:25.692267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3568/7202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:25 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:26.710880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:26.711623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:26.717970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:26.718471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:26.719261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:26.719710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:26.857713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:26.865653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f6e8cc66-f669-43dd-89fb-e03c426849bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1680 microversion: 2.1 time: 0.160320 Jul 18 03:28:26.866527 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3635/7203] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:26 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:27.083742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:27.093344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:27.093795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:27.106738 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] Creating event network-changed:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h1-849796-1 Jul 18 03:28:27.112050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:28:27.123635 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-80ddb48a-4d88-4ffd-96e0-3a40dba0f6e3 req-a7552451-1986-407f-aef6-99e01b3a5a58 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043596 Jul 18 03:28:27.124301 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3569/7204] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:27.883677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:27.884289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:27.891246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:27.891700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:27.892485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:27.892927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:28.029002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:28.037851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1bf76d25-ee42-4ce1-bb83-a8162d4142c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1680 microversion: 2.1 time: 0.157701 Jul 18 03:28:28.038464 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3636/7205] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:27 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:29.057647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:29.058461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:29.065874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:29.066612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:29.067552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:29.068231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:29.591536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:29.599542 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8449d668-1e95-442f-b469-d8a0d783e9ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1680 microversion: 2.1 time: 0.547545 Jul 18 03:28:29.600254 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3570/7206] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:29 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1680 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:30.617750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:30.618291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:30.625592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.626053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.626837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.627286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.770946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:30.779551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e0c38bf-6973-4e2a-bed6-2c305520d1d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1677 microversion: 2.1 time: 0.165864 Jul 18 03:28:30.780165 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3637/7207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:30 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:30.797000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:30.797580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:30.805674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.806244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.807115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.807647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.870454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "name": "network-vif-plugged", "status": "completed", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:30.875479 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-514a404e-f157-4355-8632-b4aec175b640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/action" status: 204 len: 0 microversion: 2.1 time: 0.082419 Jul 18 03:28:30.879981 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3571/7208] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:28:30 2022] POST /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:28:30.880136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.880136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.886920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:30.887660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:30.893685 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] Creating event network-vif-plugged:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h1-849796-1 Jul 18 03:28:30.894438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.894920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.895910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:30.896413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:30.900466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:28:30.912890 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8d6a1b85-0108-44a7-b9e5-8e0658eb5407 req-7b5755fe-b86a-4811-b7df-29c325b89d82 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107747 Jul 18 03:28:30.913523 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3638/7209] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:28:31.044050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:31.051922 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21456b5a-b3d8-4d79-ab9c-94a08a856f48 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1677 microversion: 2.1 time: 0.170121 Jul 18 03:28:31.052553 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3572/7210] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:30 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:28:32.070873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:32.071514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:32.077919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.078374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.079154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.079608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.226951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:32.234709 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dd7763c-a61c-4a94-a022-a76a1bb78021 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.169604 Jul 18 03:28:32.235297 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3639/7211] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:32 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:28:32.251363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:32.252843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:32.260229 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.260950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.261921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.262378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.409813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:32.418813 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-816a443c-03fe-42cd-b5b9-a82c813384f6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.171356 Jul 18 03:28:32.419419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3573/7212] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:32 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:32.435671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:32.436292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:32.442415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.442874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.444265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.444713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.581926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:32.590577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c8f13704-2acb-4225-a1b9-05c89763de12 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1669 microversion: 2.1 time: 0.158840 Jul 18 03:28:32.591197 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3640/7213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:32 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:32.607464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:32.607945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:32.614028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.614493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.615296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.615753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.640535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:28:32.643355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:32.720457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-69f92670-c75d-4002-baf6-cd21e70993fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 204 len: 0 microversion: 2.1 time: 0.116585 Jul 18 03:28:32.721076 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3574/7214] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:28:32 2022] DELETE /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:28:32.729858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:32.730558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:32.736863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.737346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.738124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:32.738563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:32.869694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:32.873421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:32.878431 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-288d8d02-a1d4-4228-835d-f6147d840156 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1675 microversion: 2.1 time: 0.152558 Jul 18 03:28:32.879019 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3641/7215] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:32 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:33.899654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:33.900959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:33.908096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:33.908566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:33.909405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:33.909898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:34.053798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:34.062266 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11f5d793-4e9a-4d92-b074-3ec1b233cfb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1675 microversion: 2.1 time: 0.168018 Jul 18 03:28:34.062885 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3575/7216] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:33 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:35.011408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-06ef1e09-5493-4ca7-83e1-ff81f12e2298 req-26e805f2-614a-4156-93e9-ccdf9b6a564c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea008c56-0047-4f4d-8ee6-acbb5f2d9faf", "name": "network-vif-deleted", "tag": "ad1f0827-afc3-4725-bfc4-a4f53699572e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:35.021350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-06ef1e09-5493-4ca7-83e1-ff81f12e2298 req-26e805f2-614a-4156-93e9-ccdf9b6a564c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:35.022491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-06ef1e09-5493-4ca7-83e1-ff81f12e2298 req-26e805f2-614a-4156-93e9-ccdf9b6a564c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:35.035798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-06ef1e09-5493-4ca7-83e1-ff81f12e2298 req-26e805f2-614a-4156-93e9-ccdf9b6a564c service nova] Creating event network-vif-deleted:ad1f0827-afc3-4725-bfc4-a4f53699572e for instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf on n-h1-849796-1 Jul 18 03:28:35.041758 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-06ef1e09-5493-4ca7-83e1-ff81f12e2298 req-26e805f2-614a-4156-93e9-ccdf9b6a564c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Jul 18 03:28:35.042575 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3642/7217] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:35.079802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:35.080457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:35.088499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:35.089346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:35.090358 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:35.091013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:35.136840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:35.137592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:35.138079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lazy-loading 'fault' on Instance uuid ea008c56-0047-4f4d-8ee6-acbb5f2d9faf {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:28:35.193654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:35.202662 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72fa96e7-0ae0-448e-bcbb-02a17783f280 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 200 len: 1328 microversion: 2.1 time: 0.126814 Jul 18 03:28:35.203790 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3576/7218] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:35 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:36.222802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:36.223491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:36.230215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.230668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.231432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.231872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.245386 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf HTTP/1.1 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ea008c56-0047-4f4d-8ee6-acbb5f2d9faf'} Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:28:36.247022 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0dda1375-acae-4ba9-a498-65936f4991b8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 404 len: 111 microversion: 2.1 time: 0.030822 Jul 18 03:28:36.252866 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3643/7219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:36 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:28:36.263617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:36.264240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:36.271892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.272688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.273168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.273620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.287446 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf HTTP/1.1 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ea008c56-0047-4f4d-8ee6-acbb5f2d9faf'} Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:28:36.289170 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a8c3353d-2e7b-42f0-a037-788695cab1c8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 404 len: 111 microversion: 2.1 time: 0.030956 Jul 18 03:28:36.293099 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3577/7220] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:36 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:28:36.341125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1697832399", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "09acb3a2-5135-4d04-ab0b-340fd4081a9b"}], "security_groups": [{"name": "tempest-securitygroup--302046339"}], "key_name": "tempest-keypair-1045846927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:36.453126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] validate_networks() for [('09acb3a2-5135-4d04-ab0b-340fd4081a9b', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:28:36.903369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:28:36.903805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:28:36.904343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:28:36.904763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:28:36.905206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:28:36.914334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.914789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.915602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:36.916047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:36.932866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:28:36.938415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:28:36.954632 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:28:36.956963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:28:37.003499 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed80a5aa-a7b2-44e7-a71b-9938133e3096 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.666358 Jul 18 03:28:37.004171 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3644/7221] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:28:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:28:37.015334 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10ed2805-c234-4bae-8ddc-21ef92edacd0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:37.015966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10ed2805-c234-4bae-8ddc-21ef92edacd0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:37.070082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10ed2805-c234-4bae-8ddc-21ef92edacd0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:37.076956 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10ed2805-c234-4bae-8ddc-21ef92edacd0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1239 microversion: 2.1 time: 0.065489 Jul 18 03:28:37.077542 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3578/7222] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:37 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:38.096735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:38.097400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:38.105512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:38.105981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:38.106777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:38.107228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:38.172005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:38.180269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74f123e8-39ce-46ed-85c3-833890e5479a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1297 microversion: 2.1 time: 0.088455 Jul 18 03:28:38.189698 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3645/7223] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:38 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:39.200264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:39.201021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:39.210713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:39.211190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:39.212046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:39.212505 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:39.416767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-3243bb0b-ffb4-4516-abfb-0eb088e4ceb7 req-2d11fc41-c514-4ba3-81b5-9bf80ea1c73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:39.440509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3243bb0b-ffb4-4516-abfb-0eb088e4ceb7 req-2d11fc41-c514-4ba3-81b5-9bf80ea1c73c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:39.441441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-3243bb0b-ffb4-4516-abfb-0eb088e4ceb7 req-2d11fc41-c514-4ba3-81b5-9bf80ea1c73c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:39.441823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:39.455344 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-17b92160-a62a-45ee-9865-9a8c490b3e5b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.259329 Jul 18 03:28:39.455952 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3579/7224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:39 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:39.458976 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-3243bb0b-ffb4-4516-abfb-0eb088e4ceb7 req-2d11fc41-c514-4ba3-81b5-9bf80ea1c73c service nova] Creating event network-changed:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h1-849796-1 Jul 18 03:28:39.464480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-3243bb0b-ffb4-4516-abfb-0eb088e4ceb7 req-2d11fc41-c514-4ba3-81b5-9bf80ea1c73c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051447 Jul 18 03:28:39.466204 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3646/7225] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:40.473789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:40.475199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:40.478321 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:40.483895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:40.484365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:40.485201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:40.485665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:40.621957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:40.629514 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19506a36-c0c4-492f-85ef-fb1b13bb59b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.159698 Jul 18 03:28:40.630097 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3580/7226] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:40 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:41.650404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:41.651108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:41.653083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:41.658811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:41.659546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:41.660336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:41.660781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:41.796085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:41.804650 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0fd14c8-67b4-40ef-a6e8-0d9f2499796c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.160076 Jul 18 03:28:41.805195 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3647/7227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:41 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:28:42.822471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:42.823135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:42.830337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:42.830800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:42.831589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:42.832037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:42.981660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:42.992835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94384e91-22af-4cf7-bb1a-d646cde44d03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.174478 Jul 18 03:28:42.993477 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3581/7228] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:42 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:44.010951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:44.011594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:44.018902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:44.019363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:44.020150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:44.020608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:44.158360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:44.166520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d909a72-279d-4ab5-9f1f-e48ed513a77e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.159931 Jul 18 03:28:44.167230 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3648/7229] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:44 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:44.848053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-df97771d-cb21-4e2b-bc77-3dfdd7ec0e3d req-075fae14-6749-49cf-8568-0568a266f245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "name": "network-vif-plugged", "status": "completed", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:44.858653 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-df97771d-cb21-4e2b-bc77-3dfdd7ec0e3d req-075fae14-6749-49cf-8568-0568a266f245 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:44.859127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-df97771d-cb21-4e2b-bc77-3dfdd7ec0e3d req-075fae14-6749-49cf-8568-0568a266f245 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:44.871719 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-df97771d-cb21-4e2b-bc77-3dfdd7ec0e3d req-075fae14-6749-49cf-8568-0568a266f245 service nova] Creating event network-vif-plugged:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h1-849796-1 Jul 18 03:28:44.877083 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-df97771d-cb21-4e2b-bc77-3dfdd7ec0e3d req-075fae14-6749-49cf-8568-0568a266f245 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032737 Jul 18 03:28:44.877702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3582/7230] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:45.185169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:45.185785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:45.192866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:45.193374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:45.194732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:45.195173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:45.327877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:45.336279 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e1d3ed2-d131-4dd4-b906-3350ec93aa68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.155083 Jul 18 03:28:45.336869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3649/7231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:45 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:46.356390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:46.357163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:46.363474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:46.363937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:46.364726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:46.365276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:46.504093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:46.513098 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2b884425-4da2-4452-ab79-b489bcf38457 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1364 microversion: 2.1 time: 0.162739 Jul 18 03:28:46.513767 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3583/7232] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:46 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:47.530359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:47.530947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:47.533676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:47.534526 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:47.541352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:47.541804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:47.542581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:47.543022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:47.679412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:28:47.687018 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-896dae86-33e3-4298-ab58-bcc91c9de182 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1551 microversion: 2.1 time: 0.160627 Jul 18 03:28:47.687604 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3650/7233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:28:47 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:28:47.702474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:28:47.708849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:28:47.709583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:28:47.716843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:47.717360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:47.718162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:47.718622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:47.798324 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-055c6622-507e-4b8c-ac3c-4fc1547b5445 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097078 Jul 18 03:28:47.798927 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3584/7234] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:28:47 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:28:48.805429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-eba49b0e-a834-4a4b-bd34-264d56f2182b req-e81af27d-c9c6-4eae-a298-dc4d580a843f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:28:48.814882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-eba49b0e-a834-4a4b-bd34-264d56f2182b req-e81af27d-c9c6-4eae-a298-dc4d580a843f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:28:48.815048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-eba49b0e-a834-4a4b-bd34-264d56f2182b req-e81af27d-c9c6-4eae-a298-dc4d580a843f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:28:48.827284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-eba49b0e-a834-4a4b-bd34-264d56f2182b req-e81af27d-c9c6-4eae-a298-dc4d580a843f service nova] Creating event network-changed:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h1-849796-1 Jul 18 03:28:48.836073 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-eba49b0e-a834-4a4b-bd34-264d56f2182b req-e81af27d-c9c6-4eae-a298-dc4d580a843f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Jul 18 03:28:48.837053 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3651/7235] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:29:21.217590 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:29:21.218151 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:29:21.769820 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:29:21.770512 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:30:00.866472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=9 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:00.867922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:00.873041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3b424d8d-9c81-4109-af0b-d47a35303b3d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:00.881307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b424d8d-9c81-4109-af0b-d47a35303b3d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:00.881768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3b424d8d-9c81-4109-af0b-d47a35303b3d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:00.907862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3b424d8d-9c81-4109-af0b-d47a35303b3d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:30:00.955615 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3b424d8d-9c81-4109-af0b-d47a35303b3d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action" status: 202 len: 0 microversion: 2.1 time: 0.091500 Jul 18 03:30:00.956774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3585/7236] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:00 2022] POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:30:00.965355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=9 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:00.966589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=40 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:00.971528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:00.972244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:00.980783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:00.981264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:00.982067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:00.982579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:01.145906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:01.155118 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c4279ddb-b54c-4575-843c-ec5e58c03e6e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.192741 Jul 18 03:30:01.155865 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3652/7237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:00 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:02.173868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:02.174587 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:02.182122 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:02.182584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:02.183414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:02.183863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:02.326872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:02.334417 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3af9f954-1041-419a-98bb-b44d3635ec04 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.164856 Jul 18 03:30:02.334987 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3586/7238] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:02 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:03.356968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:03.357886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:03.367208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:03.368025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:03.369215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:03.370392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:03.516967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:03.525449 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf04f3c5-cd92-423c-aaeb-40320ef377f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.177001 Jul 18 03:30:03.526055 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3653/7239] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:03 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:04.543204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:04.543796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:04.550942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:04.551403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:04.552227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:04.552677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:04.697882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:04.705645 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-25ec92ab-a862-4e58-ba41-aac24f521148 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.166587 Jul 18 03:30:04.706221 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3587/7240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:04 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:05.723505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:05.724133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:05.732613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:05.733104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:05.733911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:05.734361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:06.210118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:06.218947 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-539224a9-45aa-4ff4-ae2c-7c9931995c7d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.499552 Jul 18 03:30:06.219556 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3654/7241] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:05 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:07.237882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:07.238514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:07.245914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:07.246388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:07.247187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:07.247647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:07.386820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:07.394429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1040b4ed-76e3-449d-b8d7-452ee2aca3fe tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.160740 Jul 18 03:30:07.395024 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3588/7242] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:07 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:08.413606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:08.414239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:08.421253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:08.421717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:08.422498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:08.422950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:08.558846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:08.566460 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a261036c-5b60-48e3-a377-52139f1b1e53 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.156765 Jul 18 03:30:08.567037 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3655/7243] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:08 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:09.584576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:09.585150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:09.592699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:09.593195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:09.593975 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:09.594427 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:09.730131 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:09.738260 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1c0337b3-fde8-42e5-a9a8-87705c149f03 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.157701 Jul 18 03:30:09.738798 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3589/7244] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:09 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:10.756094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:10.756859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:10.765018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.765481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.766280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:10.766723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:10.911490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:10.919348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d4c28afc-f477-4e79-bb18-b27cf09fa05c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.167435 Jul 18 03:30:10.919950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3656/7245] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:10 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:11.937149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:11.937679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:11.943791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:11.944276 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:11.945088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:11.945542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.082035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:12.090971 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a2c1d42-c8b0-45f7-bfe8-b432c6263c2b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1657 microversion: 2.1 time: 0.158805 Jul 18 03:30:12.091576 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3590/7246] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:11 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:12.108180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:12.109251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:12.116634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.117124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.117915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.118362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.149745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:12.157083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:30:12.164089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:30:12.164517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:30:12.165029 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:30:12.165447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:30:12.165864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:30:12.247445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cce780ce-052c-42f1-8ad7-94cea4a3372d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action" status: 202 len: 0 microversion: 2.1 time: 0.143349 Jul 18 03:30:12.248105 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3657/7247] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:12 2022] POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:30:12.262039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:12.262039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:12.265608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.266079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.266879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:12.267330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:12.452449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:12.460188 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ae0a4c2-31b2-4e6c-b85e-1715d562dfd2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.207460 Jul 18 03:30:12.460778 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3591/7248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:12 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:30:13.479843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:13.480727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:13.487126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:13.487588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:13.488372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:13.488846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:13.629625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:13.638104 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34e75aa7-6fc1-4b37-bd4f-6c5e97e37c61 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.163450 Jul 18 03:30:13.638692 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3658/7249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:13 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:14.655433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:14.656062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:14.663097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:14.663565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:14.664360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:14.664815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:14.800176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:14.808633 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-122001fa-ad27-445a-a408-d30e201a5ec6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.157281 Jul 18 03:30:14.809251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3592/7250] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:14 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:15.826957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:15.827574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:15.834636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:15.835094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:15.835877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:15.836324 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:15.977584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:15.986405 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5397c75a-0613-4e95-804e-6139931ba313 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.164158 Jul 18 03:30:15.987012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3659/7251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:15 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:17.007338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:17.007970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:17.015958 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:17.016425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:17.017259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:17.017721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:17.164020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:17.173742 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b0bb0c0a-40e4-4ee9-83e4-c529f62773c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.170275 Jul 18 03:30:17.174365 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3593/7252] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:17 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:18.191761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:18.192444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:18.199685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:18.200148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:18.200952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:18.201408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:18.348476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:18.358202 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26574b3d-79bd-4454-90fb-880bd4e467c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1680 microversion: 2.1 time: 0.170393 Jul 18 03:30:18.358805 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3660/7253] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:18 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:19.376557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:19.377211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:19.384197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:19.384665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:19.386061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:19.386753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:19.531594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:19.539349 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-002bca0a-d415-4001-96c8-7297127f5d70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1685 microversion: 2.1 time: 0.166800 Jul 18 03:30:19.539929 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3594/7254] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:19 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:20.560494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:20.561608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:20.569595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:20.570080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:20.570877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:20.571326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:20.784972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:20.794258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e81780c-20e6-4ed6-a0f5-2c964fbdb3ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1684 microversion: 2.1 time: 0.240334 Jul 18 03:30:20.794970 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3661/7255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:20 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:21.106541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "name": "network-vif-unplugged", "status": "completed", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:21.115924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:21.116407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:21.132109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] Creating event network-vif-unplugged:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h2-849796-1 Jul 18 03:30:21.138691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] Instance 81029320-56f6-4a1d-945e-8724c834f29c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:30:21.150152 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-69ab2037-966e-4bcf-8403-b95afc908ad9 req-74ace296-eb08-4353-bc84-f9db8aa19e67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047853 Jul 18 03:30:21.151901 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3595/7256] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:21.812499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:21.813090 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:21.819803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:21.820267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:21.821088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:21.821542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:22.055730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:22.064134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f0712ba-9f6c-4307-a00e-55dd0cb69560 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1684 microversion: 2.1 time: 0.255848 Jul 18 03:30:22.064727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3662/7257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:21 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1684 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:30:23.085500 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:23.086277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:23.093798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:23.094255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:23.095065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:23.095527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:23.167828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:23.180546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:23.181375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:23.202212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] Creating event network-changed:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h2-849796-1 Jul 18 03:30:23.208249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] Instance 81029320-56f6-4a1d-945e-8724c834f29c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:30:23.221385 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-23a6ef0f-2b56-4839-b720-7062a7d29eae req-5e54c4c6-ce2b-42b2-93d0-d11a3764b706 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057880 Jul 18 03:30:23.222669 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3663/7258] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:30:23.256361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:23.264479 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-28f7a6e3-8c93-4ff4-923c-61e7d1ed2288 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1682 microversion: 2.1 time: 0.184708 Jul 18 03:30:23.264838 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3596/7259] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:23 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:24.283630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:24.284347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:24.290858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:24.291316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:24.292170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:24.292735 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:24.434894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:24.442690 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bb877d0f-4f87-452c-b4c3-a607378b5f3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1682 microversion: 2.1 time: 0.164279 Jul 18 03:30:24.443273 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3664/7260] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:24 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:25.464633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:25.465948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:25.478875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.479609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.481223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.481691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.671323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:25.679375 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be8c3a90-7a01-44e3-8ce4-386626fd3aa4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1678 microversion: 2.1 time: 0.222476 Jul 18 03:30:25.679978 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3597/7261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:25 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:25.703046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:25.704095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:25.716894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.717740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.719154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.719963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.826434 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ceda973-acd4-444e-92d2-d5f65b2088bd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action" status: 204 len: 0 microversion: 2.1 time: 0.131593 Jul 18 03:30:25.827593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3665/7262] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:25 2022] POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:30:25.837367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:25.838022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:25.845876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.846378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:25.847059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:25.847521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:26.098923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:26.109194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3462bfae-e0a1-42c7-8725-c5a967f933ea tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1678 microversion: 2.1 time: 0.275822 Jul 18 03:30:26.109871 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3598/7263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:25 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:27.129236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:27.129968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:27.137907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.138363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.139136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.139576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.156793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:27.342690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:27.351276 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-531959fb-e3d9-4b8c-9d33-dc7f8919e2de tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1657 microversion: 2.1 time: 0.227442 Jul 18 03:30:27.353386 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3666/7264] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:27 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1657 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:27.374280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:27.374915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:27.382736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.383209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.384021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.384469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.552902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:27.562549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-98b155ba-5538-44b4-8bc5-aea1da74f4a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1657 microversion: 2.1 time: 0.192873 Jul 18 03:30:27.563164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3599/7265] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:27 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1657 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:27.579565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c00d9f6-35cc-42a0-a669-6b8797b6f895 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:27.586291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c00d9f6-35cc-42a0-a669-6b8797b6f895 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.586756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c00d9f6-35cc-42a0-a669-6b8797b6f895 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.613405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c00d9f6-35cc-42a0-a669-6b8797b6f895 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Going to try to start instance {{(pid=119439) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:30:27.661322 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c00d9f6-35cc-42a0-a669-6b8797b6f895 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action" status: 202 len: 0 microversion: 2.1 time: 0.085627 Jul 18 03:30:27.661952 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3667/7266] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:30:27 2022] POST /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:30:27.678333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:27.679443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:27.692955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.693598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.695061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:27.695606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:27.847345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:27.851560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:27.857598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-20e52a33-620d-49f0-ba21-bb139bed05ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1666 microversion: 2.1 time: 0.186921 Jul 18 03:30:27.858449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3600/7267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:27 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:28.877572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:28.878270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:28.884879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:28.885354 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:28.886673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:28.887114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:28.965373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f12abde6-4f55-44f7-b6d1-05eff012982e req-3544738a-b2b4-4563-9621-1766e228f0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "name": "network-vif-plugged", "status": "completed", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:28.983194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f12abde6-4f55-44f7-b6d1-05eff012982e req-3544738a-b2b4-4563-9621-1766e228f0a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:28.983951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f12abde6-4f55-44f7-b6d1-05eff012982e req-3544738a-b2b4-4563-9621-1766e228f0a0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:28.998073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f12abde6-4f55-44f7-b6d1-05eff012982e req-3544738a-b2b4-4563-9621-1766e228f0a0 service nova] Creating event network-vif-plugged:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h2-849796-1 Jul 18 03:30:29.004370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f12abde6-4f55-44f7-b6d1-05eff012982e req-3544738a-b2b4-4563-9621-1766e228f0a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043560 Jul 18 03:30:29.005319 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3601/7268] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:29.070012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:29.078355 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0e05e71f-f508-4521-ba49-dd944bff3830 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1666 microversion: 2.1 time: 0.206024 Jul 18 03:30:29.078939 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3668/7269] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:28 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:30:30.097444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:30.098159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:30.105492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.105957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.106749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.107206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.239875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:30.248014 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c5ad0a92-be51-4150-aa8d-626c4a42e630 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1670 microversion: 2.1 time: 0.155744 Jul 18 03:30:30.248613 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3602/7270] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:30 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:30.265274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:30.265787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:30.272777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.273275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.274059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.274505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.300757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:30:30.378743 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ddcb120-5cef-45a5-9dd7-eb19f7bd923b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 204 len: 0 microversion: 2.1 time: 0.116854 Jul 18 03:30:30.379505 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3669/7271] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:30:30 2022] DELETE /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:30:30.387857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:30.388494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:30.394700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.395175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.395967 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:30.396430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:30.536949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:30.545492 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eac7124a-0f8d-4de6-ba8f-352aeac7898b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1676 microversion: 2.1 time: 0.161514 Jul 18 03:30:30.546083 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3603/7272] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:30 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:31.564705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:31.565457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:31.568268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:31.574765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:31.575218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:31.576017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:31.576463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:31.715885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:31.723652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-621c46ab-5c6a-485f-93b9-8d66a6ba4f2e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1676 microversion: 2.1 time: 0.163839 Jul 18 03:30:31.724241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3670/7273] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:31 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:32.741755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:32.742516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:32.746141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=39 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:32.752914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:32.753419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:32.754235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:32.754692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:32.874191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-25333bbd-501f-42e3-bf39-431cc19821be req-d1c8e780-9be5-495c-ae27-2d4ad590c577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81029320-56f6-4a1d-945e-8724c834f29c", "name": "network-vif-deleted", "tag": "cb1d7162-24f5-494c-af94-fe5e4ec8c7d3"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:32.884591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:32.886335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25333bbd-501f-42e3-bf39-431cc19821be req-d1c8e780-9be5-495c-ae27-2d4ad590c577 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:32.886796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25333bbd-501f-42e3-bf39-431cc19821be req-d1c8e780-9be5-495c-ae27-2d4ad590c577 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:32.893859 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c48097b3-c013-486b-aa35-eb75bef8426f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 200 len: 1609 microversion: 2.1 time: 0.156208 Jul 18 03:30:32.905542 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3604/7274] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:32 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 1609 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:32.906557 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-25333bbd-501f-42e3-bf39-431cc19821be req-d1c8e780-9be5-495c-ae27-2d4ad590c577 service nova] Creating event network-vif-deleted:cb1d7162-24f5-494c-af94-fe5e4ec8c7d3 for instance 81029320-56f6-4a1d-945e-8724c834f29c on n-h2-849796-1 Jul 18 03:30:32.914436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-25333bbd-501f-42e3-bf39-431cc19821be req-d1c8e780-9be5-495c-ae27-2d4ad590c577 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044105 Jul 18 03:30:32.915067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3671/7275] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:30:33.911840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:33.912479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:33.920134 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:33.920597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:33.921422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:33.921886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:33.937463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c HTTP/1.1 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '81029320-56f6-4a1d-945e-8724c834f29c'} Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:30:33.939168 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d2be6d2-1c45-4424-8d9b-7ce70c2e3eb5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 404 len: 111 microversion: 2.1 time: 0.032820 Jul 18 03:30:33.947253 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3605/7276] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:33 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:30:33.959197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:33.959986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:33.967705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:33.968513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:33.970014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:33.970625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:33.987539 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c HTTP/1.1 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '81029320-56f6-4a1d-945e-8724c834f29c'} Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:30:33.989877 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:30:33.994258 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1caee2c3-250c-4826-926d-9ad770adef6f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 404 len: 111 microversion: 2.1 time: 0.036521 Jul 18 03:30:34.000120 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3672/7277] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:33 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:30:34.040696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-982632695", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "09acb3a2-5135-4d04-ab0b-340fd4081a9b"}], "security_groups": [{"name": "tempest-securitygroup--302046339"}], "key_name": "tempest-keypair-1045846927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:34.152792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] validate_networks() for [('09acb3a2-5135-4d04-ab0b-340fd4081a9b', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:30:34.587141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:30:34.587580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:30:34.588092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:30:34.589040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:30:34.589479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:30:34.598305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:34.598766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:34.599596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:34.600310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:34.617439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:30:34.622842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:30:34.634923 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:30:34.637344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:30:34.684752 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1e78d45-6392-4d7b-a5a7-0fbaada31c31 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.647799 Jul 18 03:30:34.685443 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3606/7278] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:30:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:30:34.695466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cfbbadde-93e6-44ff-ac28-7cd00001a6ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:34.696085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cfbbadde-93e6-44ff-ac28-7cd00001a6ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:34.810629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cfbbadde-93e6-44ff-ac28-7cd00001a6ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:34.817813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cfbbadde-93e6-44ff-ac28-7cd00001a6ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1238 microversion: 2.1 time: 0.126166 Jul 18 03:30:34.818476 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3673/7279] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:34 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:35.836843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:35.837538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:35.846089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:35.846555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:35.847364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:35.847819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:35.927654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:35.935828 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a3eced78-b723-46af-af1e-f10be4f39631 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1296 microversion: 2.1 time: 0.103753 Jul 18 03:30:35.936546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3607/7280] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:35 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:36.955106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:36.955882 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:36.965794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:36.966257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:36.967059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:36.967507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:37.122588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:37.130663 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c38ef35-14e4-463b-bda2-6e62c09d4726 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.179546 Jul 18 03:30:37.131265 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3674/7281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:36 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:37.367251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9599c095-01d0-4195-a289-f49625983d7b req-e9e99ed8-1b80-4471-ba91-dcc64229dab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:37.382083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9599c095-01d0-4195-a289-f49625983d7b req-e9e99ed8-1b80-4471-ba91-dcc64229dab5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:37.382553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9599c095-01d0-4195-a289-f49625983d7b req-e9e99ed8-1b80-4471-ba91-dcc64229dab5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:37.402329 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9599c095-01d0-4195-a289-f49625983d7b req-e9e99ed8-1b80-4471-ba91-dcc64229dab5 service nova] Creating event network-changed:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:30:37.408803 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9599c095-01d0-4195-a289-f49625983d7b req-e9e99ed8-1b80-4471-ba91-dcc64229dab5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045344 Jul 18 03:30:37.409468 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3608/7282] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:38.149074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:38.149699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:38.157812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:38.158270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:38.159054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:38.159502 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:38.295025 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:38.302748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f7c3c24b-5bb0-4a22-9c4d-e81f08c03c90 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.157699 Jul 18 03:30:38.303552 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3675/7283] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:38 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:39.322151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:39.323448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:39.330886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:39.331355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:39.332152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:39.332617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:39.476072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:39.488864 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2ac4f2fd-0a75-4507-859c-ce54a5b8c78a tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.171025 Jul 18 03:30:39.489495 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3609/7284] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:39 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:40.516764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:40.517406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:40.524696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:40.525196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:40.526058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:40.526789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:40.663879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:40.671770 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4497372b-0bbb-4a77-b6bc-d684b15a43b5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.158969 Jul 18 03:30:40.672354 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3676/7285] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:40 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:41.689842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:41.690480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:41.697590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:41.698299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:41.699259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:41.699725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:41.836065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:41.843723 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97a0365b-2d7d-493e-827f-658fba35933e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.157972 Jul 18 03:30:41.844302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3610/7286] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:41 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:42.860814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:42.861494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:42.868938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:42.869403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:42.870685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:42.871209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.008450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:43.017218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd7709ef-dbbf-4665-8f07-da24d906e1c4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.160205 Jul 18 03:30:43.017816 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3677/7287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:42 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:43.395143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3ab159fa-08f2-4a1a-b998-23f06089ab88 req-cc23f9cd-0038-4351-8f2e-75a047f2b198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-plugged", "status": "completed", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:43.404306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3ab159fa-08f2-4a1a-b998-23f06089ab88 req-cc23f9cd-0038-4351-8f2e-75a047f2b198 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:43.404798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3ab159fa-08f2-4a1a-b998-23f06089ab88 req-cc23f9cd-0038-4351-8f2e-75a047f2b198 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:43.420761 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3ab159fa-08f2-4a1a-b998-23f06089ab88 req-cc23f9cd-0038-4351-8f2e-75a047f2b198 service nova] Creating event network-vif-plugged:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:30:43.425901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3ab159fa-08f2-4a1a-b998-23f06089ab88 req-cc23f9cd-0038-4351-8f2e-75a047f2b198 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034694 Jul 18 03:30:43.426538 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3611/7288] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:44.035787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:44.036416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:44.044331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:44.044786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:44.045613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:44.046065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:44.189293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:44.197290 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8399578f-3fee-4eb0-910b-b4778caaf8f1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1363 microversion: 2.1 time: 0.165377 Jul 18 03:30:44.197946 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3678/7289] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:44 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:45.212960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:45.214235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:45.218546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:45.219255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:45.226699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:45.227160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:45.227939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:45.228390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:45.359637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:30:45.367297 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8cfe4d69-fe8f-47e6-a105-cf6fdc39debf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1550 microversion: 2.1 time: 0.156151 Jul 18 03:30:45.368074 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3612/7290] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:30:45 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:30:45.384584 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:30:45.385193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:30:45.387285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:30:45.393353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:45.393809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:45.394574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:45.395010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:45.476188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b25f791e-d88c-49c0-a700-8900b1e0bd06 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095380 Jul 18 03:30:45.477323 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3679/7291] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:30:45 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:30:46.455730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5f1e3ad3-8af4-483f-921e-62dbc2d4a391 req-dc6bf6f5-6bed-4905-bafd-06ef726f726b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:30:46.465706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5f1e3ad3-8af4-483f-921e-62dbc2d4a391 req-dc6bf6f5-6bed-4905-bafd-06ef726f726b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:30:46.466169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5f1e3ad3-8af4-483f-921e-62dbc2d4a391 req-dc6bf6f5-6bed-4905-bafd-06ef726f726b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:30:46.477650 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5f1e3ad3-8af4-483f-921e-62dbc2d4a391 req-dc6bf6f5-6bed-4905-bafd-06ef726f726b service nova] Creating event network-changed:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:30:46.483889 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5f1e3ad3-8af4-483f-921e-62dbc2d4a391 req-dc6bf6f5-6bed-4905-bafd-06ef726f726b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Jul 18 03:30:46.484571 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3613/7292] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:01.732818 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=21 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:01.733697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:01.790876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:01.791936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:01.799171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.799634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:01.800427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.800876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:01.831515 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:01.837886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:32:01.845346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:32:01.845777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:32:01.846397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:32:01.846826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:32:01.847258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:32:01.925616 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d349d4c0-31f4-4ac3-9542-eed8bde59634 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/action" status: 202 len: 0 microversion: 2.1 time: 0.195705 Jul 18 03:32:01.926149 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3680/7293] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:32:01 2022] POST /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:32:01.934377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:01.935304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=54 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:01.940711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:01.941484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:01.949801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.950387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:01.951270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:01.952722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:02.124517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:02.132135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-868608ea-9619-47af-91cd-ced6019aba89 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1678 microversion: 2.1 time: 0.201518 Jul 18 03:32:02.132713 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3614/7294] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:01 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:03.151692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:03.152555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:03.160013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:03.160470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:03.161455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:03.161744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:03.323781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:03.332707 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-15f50b12-68e0-47be-99ce-09a3ccecf3b9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1678 microversion: 2.1 time: 0.185840 Jul 18 03:32:03.333355 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3681/7295] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:03 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:04.351580 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:04.352208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:04.359841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:04.360311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:04.361151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:04.361615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:04.497687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:04.506901 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e1af3359-0621-4c01-b3c4-20909b8a5028 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.159548 Jul 18 03:32:04.507514 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3615/7296] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:04 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:05.525352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:05.525906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:05.533726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:05.534188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:05.534985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:05.535436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:05.680507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:05.689293 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-31fdcfd7-081a-4462-aaaf-7a5239fe674f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.168020 Jul 18 03:32:05.689880 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3682/7297] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:05 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:06.706826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:06.707452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:06.714825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:06.715299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:06.716140 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:06.716604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:06.854898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:06.865663 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-134ee6ae-a46e-4947-bde0-0c1391a3860c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.162647 Jul 18 03:32:06.866397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3616/7298] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:06 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:07.883746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:07.884368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:07.891890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:07.892350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:07.893160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:07.893616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:08.027957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:08.035774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9447bba-0e5b-45f2-95e3-6d5fc2a30285 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.155985 Jul 18 03:32:08.036357 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3683/7299] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:07 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:09.054622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:09.055249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:09.063585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:09.064065 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:09.064884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:09.065372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:09.516060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:09.524182 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d8004313-fe7c-455d-b0b4-31451bb485a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.473898 Jul 18 03:32:09.524797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3617/7300] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:09 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:10.542905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:10.543984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:10.552640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:10.553201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:10.554010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:10.554471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:10.693886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:10.703325 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-af7abacf-647f-4a53-8a09-4829965a0b54 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.164204 Jul 18 03:32:10.703942 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3684/7301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:10 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:11.721480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:11.722109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:11.729537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.730011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.730820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:11.731285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:11.875715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:11.883782 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fdb98a3-ff8d-4499-a48e-05a1f03c5407 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.166930 Jul 18 03:32:11.884391 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3618/7302] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:11 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:12.902170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:12.902742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:12.910571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:12.911034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:12.911839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:12.912285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:13.089460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:13.097802 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d400a41d-6921-431b-b766-2a3ff73f9ddf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.199579 Jul 18 03:32:13.098412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3685/7303] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:12 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:14.115915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:14.116586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:14.124456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:14.124977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:14.125816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:14.126304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:14.266952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:14.274635 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-912d1fe5-3132-4a01-8b6e-3ef31e18699e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.162746 Jul 18 03:32:14.275212 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3619/7304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:14 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:15.292972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:15.293595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:15.300805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:15.301309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:15.302092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:15.302545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:15.439913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:15.447507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac037292-6069-43af-a35f-50abc6218fa2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.158539 Jul 18 03:32:15.448087 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3686/7305] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:15 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:16.466244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:16.466901 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:16.474526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:16.474987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:16.476079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:16.476531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:16.612189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:16.619989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2c6a95ae-b910-4520-877a-3ddce9328fd1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.157717 Jul 18 03:32:16.620574 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3620/7306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:16 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:17.637533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:17.638177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:17.645512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:17.645976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:17.646758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:17.647210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:17.782152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:17.789725 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9df0749f-0ab1-477a-80bf-9d9f316c3226 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.156254 Jul 18 03:32:17.790308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3687/7307] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:17 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:18.807843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:18.808472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:18.816161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:18.816631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:18.817460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:18.817920 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:18.948782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:18.956427 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-681d4862-1c8b-47fc-9db3-153376e66974 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.152572 Jul 18 03:32:18.957017 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3621/7308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:18 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:19.974037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:19.974653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:19.981859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:19.982325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:19.983688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:19.984131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:20.118829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:20.127070 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12cfd15d-9b04-40b0-b216-5744a38cacb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1683 microversion: 2.1 time: 0.156942 Jul 18 03:32:20.127645 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3688/7309] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:19 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:21.147058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:21.148769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:21.156756 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:21.157258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:21.158075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:21.158539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:21.309946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:21.319203 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2a2f3c2-23d0-4b84-badb-2af8dc574ea6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1682 microversion: 2.1 time: 0.179226 Jul 18 03:32:21.319725 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3622/7310] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:21 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:21.745524 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-unplugged", "status": "completed", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:21.754633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:21.755263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:21.769301 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] Creating event network-vif-unplugged:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h2-849796-1 Jul 18 03:32:21.775715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:32:21.792599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-40f2497a-14e2-44c4-a960-68d9e4aab733 req-29b23a84-464d-4613-9750-5cd84ca199d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112249 Jul 18 03:32:21.793823 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3689/7311] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:32:22.337251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:22.337888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:22.345635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:22.346100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:22.346905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:22.347362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:22.496502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:22.504508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0785df02-217f-4d29-8345-2c97aa6a9aaa tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1682 microversion: 2.1 time: 0.171283 Jul 18 03:32:22.514232 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3623/7312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:22 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:23.523841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:23.524604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:23.531490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:23.531945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:23.532738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:23.533224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:23.934243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:23.943125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:23.943566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:23.959715 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] Creating event network-changed:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h2-849796-1 Jul 18 03:32:23.966943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:32:23.980038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-015b3e4c-2d7f-44b8-8405-a29e61cbae8b req-890a3b05-dd2d-4c98-92cb-e97393742ac3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049686 Jul 18 03:32:23.980652 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3624/7313] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:32:24.007998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:24.016598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e94d0619-183e-48b5-996f-21170b2ab1a6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1680 microversion: 2.1 time: 0.498178 Jul 18 03:32:24.017229 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3690/7314] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:23 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1680 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:25.036529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:25.037258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:25.043586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:25.044043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:25.044824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:25.045310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:25.182008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:25.190423 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-23bc5e67-e406-4b40-aed2-1a001687ea34 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1680 microversion: 2.1 time: 0.159876 Jul 18 03:32:25.190943 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3625/7315] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:25 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:26.207974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:26.208608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:26.216485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.216970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.218280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.218729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.354576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:26.363833 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00897be3-8d70-46fd-80a4-22f7c4e8d2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1677 microversion: 2.1 time: 0.159793 Jul 18 03:32:26.364231 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3691/7316] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:26 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:26.381040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:26.381593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:26.388478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.388971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.390357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.391005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.428802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.429298 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.430130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.430585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.450935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:32:26.456754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:32:26.563971 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-74776d02-1b1f-4f1b-8469-40f2ec93dfee tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/action" status: 202 len: 0 microversion: 2.1 time: 0.186743 Jul 18 03:32:26.564591 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3626/7317] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:32:26 2022] POST /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:32:26.573253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:26.573873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:26.581054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.581564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.582432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:26.582811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:26.785510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:26.793221 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc26617c-3907-4c1d-92e2-8d80c54a101b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.223954 Jul 18 03:32:26.793803 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3692/7318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:26 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:27.813241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:27.813867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:27.820243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:27.820710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:27.821524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:27.821977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:27.956484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:27.960238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:27.965467 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7bba010f-64dc-4ae4-a0e1-99416b1e5ee1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.157660 Jul 18 03:32:27.966071 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3627/7319] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:27 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:28.984835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:28.985514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:28.992490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:28.992974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:28.993773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:28.994224 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:29.139687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:29.147345 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-03b92713-d622-4462-ae26-8a69c4c3c90d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.167154 Jul 18 03:32:29.147935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3693/7320] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:28 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:29.443792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-plugged", "status": "completed", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:29.468690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:29.469509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:29.483261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] Creating event network-vif-plugged:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:32:29.489483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:32:29.501914 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-11060959-8433-4529-97c8-426b0e0ccee2 req-7b92439a-a42e-4936-82da-fc34af39251b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064713 Jul 18 03:32:29.502612 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3628/7321] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:30.022831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-unplugged", "status": "completed", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:30.033397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:30.033891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:30.046094 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] Creating event network-vif-unplugged:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:32:30.052021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:32:30.064566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a5626f8c-e0e1-4a66-adfa-9a0d50e91aeb req-309dc3de-17ea-4b1a-9137-f62dd72f47b4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045596 Jul 18 03:32:30.065397 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3694/7322] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:30.166091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:30.166819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:30.174166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:30.174638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:30.175513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:30.175902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:30.393492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:30.401145 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a52468ee-0fcf-4391-afab-66ac56c81db1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.239305 Jul 18 03:32:30.401748 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3629/7323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:30 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:31.419767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:31.420378 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:31.426870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:31.427331 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:31.428101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:31.428542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:31.565856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:31.569456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:31.574364 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-677b5146-1f68-40eb-aa73-38a33aed11a0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.159839 Jul 18 03:32:31.574946 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3695/7324] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:31 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:32.078819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:32.083197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:32.089897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:32.090360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:32.102986 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] Creating event network-changed:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:32:32.109712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:32:32.120457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-dd6b6bdf-65ea-45d9-8057-4434ea4a67e9 req-b78f82e8-c7c5-42e5-8dac-f2bc4fe369f1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045623 Jul 18 03:32:32.121263 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3630/7325] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:32.591511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:32.592848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:32.596370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=37 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:32.604124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:32.604578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:32.605400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:32.605841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:32.767583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:32.775232 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bc86c65c-511f-463c-8581-13a4a8d59640 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.187541 Jul 18 03:32:32.775810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3696/7326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:32 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:33.793125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:33.793841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:33.801715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:33.802169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:33.803040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:33.803911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:33.990861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:34.000371 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53ee8ce4-6986-464b-ae69-5e1ac5ad4835 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1676 microversion: 2.1 time: 0.211317 Jul 18 03:32:34.001947 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3631/7327] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:33 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:35.018663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:35.019278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:35.026727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.027180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.027955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.028399 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.174573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:35.182134 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ecb2ee58-579b-4af7-bdcd-727d83b189dc tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1669 microversion: 2.1 time: 0.167798 Jul 18 03:32:35.182716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3697/7328] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:35 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:35.200128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:35.200810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:35.208060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.208531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.209354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.209817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.345803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:35.353709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3357bf11-30d1-43c1-9a3c-c7f6fb43cb68 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1669 microversion: 2.1 time: 0.157599 Jul 18 03:32:35.354290 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3632/7329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:35 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:35.370087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:35.370698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:35.377447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.377910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.378692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.379143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.512226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:35.520791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79188bd4-2173-43b9-9c99-bdd22d3bc293 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1669 microversion: 2.1 time: 0.154541 Jul 18 03:32:35.521421 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3698/7330] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:35 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:35.537818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:35.538344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:35.545423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.545885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.546724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.547182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.573207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:32:35.652868 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4d19b0b-e697-4cb2-90b4-e9ad946aa2c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 204 len: 0 microversion: 2.1 time: 0.118734 Jul 18 03:32:35.653774 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3633/7331] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:32:35 2022] DELETE /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:32:35.662747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:35.663384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:35.669461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.669912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.671180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:35.671620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:35.807647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:35.815400 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eb962e45-fd3b-4f6c-ab54-352f2f93acb6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1675 microversion: 2.1 time: 0.156587 Jul 18 03:32:35.815975 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3699/7332] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:35 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:36.073947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0f7aad8e-ce4f-40b9-b06f-816cb18299c8 req-53843076-d44b-4410-871f-3d74b58ff291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-plugged", "status": "completed", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:36.082850 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0f7aad8e-ce4f-40b9-b06f-816cb18299c8 req-53843076-d44b-4410-871f-3d74b58ff291 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:36.083528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0f7aad8e-ce4f-40b9-b06f-816cb18299c8 req-53843076-d44b-4410-871f-3d74b58ff291 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:36.096634 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0f7aad8e-ce4f-40b9-b06f-816cb18299c8 req-53843076-d44b-4410-871f-3d74b58ff291 service nova] Creating event network-vif-plugged:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:32:36.101851 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0f7aad8e-ce4f-40b9-b06f-816cb18299c8 req-53843076-d44b-4410-871f-3d74b58ff291 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032127 Jul 18 03:32:36.102652 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3634/7333] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:36.839295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:36.839902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:36.847118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:36.847572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:36.848348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:36.848789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:36.984802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:36.992702 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e41bd534-4ab5-4598-97c1-71acf6fbe247 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1675 microversion: 2.1 time: 0.157384 Jul 18 03:32:36.993341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3700/7334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:36 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:32:37.976676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-38329d2f-6321-4aaf-9cbd-1edcff0fb5c7 req-cb535645-b3bf-4987-a133-0f31961e9087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d598a-a55b-4173-9b85-ceb601fb42cb", "name": "network-vif-deleted", "tag": "d4749489-57ae-4dc6-b9d7-d6e0a6696dce"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:37.984339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:37.991601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38329d2f-6321-4aaf-9cbd-1edcff0fb5c7 req-cb535645-b3bf-4987-a133-0f31961e9087 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:37.992204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-38329d2f-6321-4aaf-9cbd-1edcff0fb5c7 req-cb535645-b3bf-4987-a133-0f31961e9087 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:38.004993 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-38329d2f-6321-4aaf-9cbd-1edcff0fb5c7 req-cb535645-b3bf-4987-a133-0f31961e9087 service nova] Creating event network-vif-deleted:d4749489-57ae-4dc6-b9d7-d6e0a6696dce for instance ac1d598a-a55b-4173-9b85-ceb601fb42cb on n-h1-849796-1 Jul 18 03:32:38.010597 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-38329d2f-6321-4aaf-9cbd-1edcff0fb5c7 req-cb535645-b3bf-4987-a133-0f31961e9087 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039023 Jul 18 03:32:38.011581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3635/7335] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:38.018647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:38.020705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:38.034270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:38.034840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:38.035726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:38.036254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:38.106135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:38.122547 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84a039f6-43d6-4df0-b4e0-53cd64f38bb4 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 200 len: 1323 microversion: 2.1 time: 0.114811 Jul 18 03:32:38.123152 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3701/7336] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:38 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:39.141721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:39.142449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:39.149754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.150225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.151031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.151492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.165021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb HTTP/1.1 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ac1d598a-a55b-4173-9b85-ceb601fb42cb'} Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:32:39.166685 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0950377-9013-4645-b8c9-bfb870d541e2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 404 len: 111 microversion: 2.1 time: 0.032123 Jul 18 03:32:39.172247 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3636/7337] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:39 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:32:39.187786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:39.188411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:39.195625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.196056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.196872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.197358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.210959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb HTTP/1.1 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ac1d598a-a55b-4173-9b85-ceb601fb42cb'} Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:32:39.212647 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0874011-5a13-4790-858f-2aa0b7866822 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 404 len: 111 microversion: 2.1 time: 0.031001 Jul 18 03:32:39.217352 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3702/7338] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:39 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:32:39.267514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-976767902", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "09acb3a2-5135-4d04-ab0b-340fd4081a9b"}], "security_groups": [{"name": "tempest-securitygroup--302046339"}], "key_name": "tempest-keypair-1045846927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:39.371996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] validate_networks() for [('09acb3a2-5135-4d04-ab0b-340fd4081a9b', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:32:39.756366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:32:39.756811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:32:39.757331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:32:39.757764 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:32:39.758202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:32:39.770862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.771726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.773323 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:39.773989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:39.791195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:32:39.796741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:32:39.809257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:32:39.811516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:32:39.858263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-efe19ac7-70ab-45d6-97b8-ce23d1192419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.596705 Jul 18 03:32:39.859002 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3637/7339] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:32:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:32:39.869544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-446ea1a8-8acf-44f1-bae1-5fa993c5eb51 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:39.870166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-446ea1a8-8acf-44f1-bae1-5fa993c5eb51 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:39.931015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-446ea1a8-8acf-44f1-bae1-5fa993c5eb51 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:39.938872 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-446ea1a8-8acf-44f1-bae1-5fa993c5eb51 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1238 microversion: 2.1 time: 0.073080 Jul 18 03:32:39.939612 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3703/7340] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:39 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:40.957728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:40.958367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:40.965370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:40.965832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:40.966619 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:40.967072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:41.054536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:41.063791 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c968c2f2-f593-4168-8a2e-88388a462797 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1296 microversion: 2.1 time: 0.111770 Jul 18 03:32:41.064597 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3638/7341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:40 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:41.226654 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:32:41.226923 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:32:41.778428 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:32:41.778951 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:32:42.083577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:42.084201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:42.094727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:42.095491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:42.096351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:42.096866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:42.238856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:42.246595 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27405173-dcf6-49ed-a586-38c247d357db tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.166883 Jul 18 03:32:42.247175 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3704/7342] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:42 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:42.606575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-fa9ba523-0c1f-4bf2-9872-c6d5eb6ee2df req-ce82665f-c1b3-4353-95fb-d9f12b2644f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:42.628779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fa9ba523-0c1f-4bf2-9872-c6d5eb6ee2df req-ce82665f-c1b3-4353-95fb-d9f12b2644f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:42.629264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-fa9ba523-0c1f-4bf2-9872-c6d5eb6ee2df req-ce82665f-c1b3-4353-95fb-d9f12b2644f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:42.641720 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-fa9ba523-0c1f-4bf2-9872-c6d5eb6ee2df req-ce82665f-c1b3-4353-95fb-d9f12b2644f4 service nova] Creating event network-changed:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:32:42.649998 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-fa9ba523-0c1f-4bf2-9872-c6d5eb6ee2df req-ce82665f-c1b3-4353-95fb-d9f12b2644f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054309 Jul 18 03:32:42.650879 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3639/7343] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:43.263705 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:43.264313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:43.272535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:43.273035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:43.273817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:43.274264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:43.407978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:43.415481 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-416d1e16-68f2-48b7-8ade-52e03182d138 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.155695 Jul 18 03:32:43.416053 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3705/7344] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:43 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:44.433547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:44.434273 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:44.441836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:44.442307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:44.443124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:44.443585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:44.585651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:44.594716 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ef71cc5e-ca09-41c4-97ad-95333f1272c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.165462 Jul 18 03:32:44.595302 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3640/7345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:44 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:45.612300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:45.613073 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:45.620274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:45.620732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:45.621530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:45.621977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:45.764006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:45.772158 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e122ab60-770e-4acc-aa28-bb7ccd421dbf tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.164439 Jul 18 03:32:45.772748 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3706/7346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:45 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:46.789992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:46.790622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:46.798601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:46.799069 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:46.799879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:46.800348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:46.942637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:46.950562 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-723330c6-c2b0-45d7-8ccd-9416d85a2c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.164574 Jul 18 03:32:46.951145 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3641/7347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:46 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:47.968050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:47.968785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:47.975934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:47.976401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:47.977233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:47.977682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:48.114097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:48.122953 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a452545-d087-4497-95a5-f999902347b7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.158770 Jul 18 03:32:48.123553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3707/7348] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:47 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:48.123969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cd877d67-23b0-484d-b30e-b915d0111369 req-1b79feaa-5e94-4928-8e30-1a97306784e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "name": "network-vif-plugged", "status": "completed", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:48.136201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cd877d67-23b0-484d-b30e-b915d0111369 req-1b79feaa-5e94-4928-8e30-1a97306784e1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:48.136978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cd877d67-23b0-484d-b30e-b915d0111369 req-1b79feaa-5e94-4928-8e30-1a97306784e1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:48.149412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cd877d67-23b0-484d-b30e-b915d0111369 req-1b79feaa-5e94-4928-8e30-1a97306784e1 service nova] Creating event network-vif-plugged:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:32:48.154780 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cd877d67-23b0-484d-b30e-b915d0111369 req-1b79feaa-5e94-4928-8e30-1a97306784e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035620 Jul 18 03:32:48.155581 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3642/7349] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:32:49.142190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:49.142713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:49.150558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:49.151087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:49.151896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:49.152345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:49.299101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:49.307394 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-190f0766-62ca-45df-88ae-c3268fe81cfb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1363 microversion: 2.1 time: 0.169695 Jul 18 03:32:49.308184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3708/7350] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:49 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:50.326629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:50.327337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:50.330320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:50.331171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:50.337603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:50.338077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:50.338912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:50.339371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:50.478852 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:32:50.486663 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f7800704-3745-4760-8fb3-9bf1dd37d3e3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1549 microversion: 2.1 time: 0.164325 Jul 18 03:32:50.487246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3643/7351] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:32:50 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:32:50.503838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:32:50.504372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:32:50.506302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:32:50.512527 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:50.513020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:50.513817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:50.514267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:50.594651 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4fd9e625-356b-4bfa-9e41-b192d6a8d9a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095091 Jul 18 03:32:50.595254 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3709/7352] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Jul 18 03:32:50 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:32:51.558600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-717729a8-71bb-414b-b74d-d3ab151d82ba req-49038e08-a3d9-461f-987a-44a8a05b8a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:32:51.568063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-717729a8-71bb-414b-b74d-d3ab151d82ba req-49038e08-a3d9-461f-987a-44a8a05b8a38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:32:51.568518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-717729a8-71bb-414b-b74d-d3ab151d82ba req-49038e08-a3d9-461f-987a-44a8a05b8a38 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:32:51.580680 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-717729a8-71bb-414b-b74d-d3ab151d82ba req-49038e08-a3d9-461f-987a-44a8a05b8a38 service nova] Creating event network-changed:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:32:51.585938 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-717729a8-71bb-414b-b74d-d3ab151d82ba req-49038e08-a3d9-461f-987a-44a8a05b8a38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030892 Jul 18 03:32:51.586773 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3644/7353] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:34:04.929954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:04.930792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=72 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:04.935167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:04.935793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:04.943065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:04.943529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:04.944658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:04.944781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:05.083533 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:05.091139 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ad6bedc6-085a-4209-992a-6b2485857618 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1668 microversion: 2.1 time: 0.163690 Jul 18 03:34:05.091726 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3710/7354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:04 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:05.108504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:05.109319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:05.115061 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd16429f-656c-4f70-a70e-e1cc9e30c01d"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:05.116242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:05.125002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:05.125465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:05.126255 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:05.126695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:05.373558 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-192ab386-b20f-46d8-8e32-495671198d62 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268071 Jul 18 03:34:05.374230 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3645/7355] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:34:05 2022] POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:34:17.099890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:17.101532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:17.104311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:17.105006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:17.111496 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:17.111963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:17.112781 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:17.113268 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:17.198800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:17.205486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:34:17.212672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:34:17.213120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:34:17.213596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:34:17.214004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:34:17.214420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:34:17.280178 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8bd5ed8c-da18-47f1-aa6f-214745dbfbb8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/action" status: 202 len: 0 microversion: 2.1 time: 0.184280 Jul 18 03:34:17.280797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3711/7356] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:34:17 2022] POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:34:17.287272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:17.288391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:17.292346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:17.293341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:17.300795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:17.301289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:17.302113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:17.302546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:17.472984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:17.482054 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-710a4938-d34b-493a-9a0a-ec3aee3f8f27 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.196621 Jul 18 03:34:17.482669 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3646/7357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:17 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:18.501314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:18.501926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:18.509170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:18.509622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:18.510508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:18.510851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:18.642778 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:18.654837 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce344c17-a154-4bb3-b5d2-3cb2faa8111c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.157917 Jul 18 03:34:18.656185 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3712/7358] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:18 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:19.672511 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:19.673173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:19.680678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:19.681172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:19.681966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:19.682430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:19.812796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:19.822413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-81388d51-2b89-49b0-a6c1-e93a19518a3b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.153888 Jul 18 03:34:19.823010 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3647/7359] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:19 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:20.839901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:20.840519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:20.847504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:20.847967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:20.848852 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:20.849329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:20.986318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:20.995331 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09953e45-a97c-48b3-ae07-04824a06fd33 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.159461 Jul 18 03:34:20.995928 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3713/7360] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:20 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:22.013302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:22.013862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:22.020846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:22.021357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:22.023133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:22.023699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:22.166642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:22.175137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41836752-4f9f-4bbc-9798-70796159bdd9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.165863 Jul 18 03:34:22.175738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3648/7361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:22 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:23.194221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:23.195516 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:23.201752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:23.202208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:23.202998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:23.203444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:23.346762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:23.355485 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d68ef2e4-d050-4015-8aef-4abf328c1c5d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1723 microversion: 2.1 time: 0.165592 Jul 18 03:34:23.356067 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3714/7362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:23 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:34:24.372286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:24.372914 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:24.379461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:24.379946 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:24.380724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:24.381773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:24.518180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:24.527981 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-adce9bd1-4276-4fe4-94f7-f32182be5db5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.159734 Jul 18 03:34:24.528580 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3649/7363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:24 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:25.548805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:25.549729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:25.561102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:25.561567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:25.562409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:25.562917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:25.702432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:25.711159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cf570ffe-fbf7-451f-8a66-7855ff123e1b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.167778 Jul 18 03:34:25.711731 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3715/7364] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:25 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:26.728960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:26.729629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:26.736710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:26.737217 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:26.738021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:26.738481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:26.870168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:26.878435 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7436f56e-195c-4f07-92ce-3b9dc39b3a5c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.153883 Jul 18 03:34:26.879061 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3650/7365] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:26 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:27.896030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:27.896574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:27.904167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:27.904628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:27.905461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:27.905909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:28.039816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:28.048207 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4e84d8b-9918-4ad0-a4ef-bbe63229e3ac tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.156214 Jul 18 03:34:28.048787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3716/7366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:27 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:29.067028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:29.067661 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:29.074940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:29.075412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:29.076215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:29.076676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:29.214977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:29.223082 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8eb7667b-08c9-46cd-8db0-36d379044ac2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.160128 Jul 18 03:34:29.223671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3651/7367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:29 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:34:30.241733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:30.242510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:30.249831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:30.250287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:30.251080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:30.251529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:30.386329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:30.394533 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9e2b0211-d7cc-4ca8-9460-dce26c76718b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.157525 Jul 18 03:34:30.395106 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3717/7368] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:30 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:31.412989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:31.413819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:31.420692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:31.421191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:31.421992 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:31.422454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:31.557843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:31.565948 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9771b031-3477-4d56-8131-7dc62627b079 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.157730 Jul 18 03:34:31.566539 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3652/7369] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:31 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:32.582622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:32.583203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:32.590167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:32.590617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:32.591389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:32.591831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:32.723304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:32.732205 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-278e7a23-e683-4cc2-833b-7ca343238807 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.153620 Jul 18 03:34:32.732788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3718/7370] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:32 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:33.750784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:33.751412 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:33.758542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:33.759009 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:33.759806 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:33.760259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:33.900509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:33.908802 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-27f89e70-4b2a-4062-af8d-fa7c9d84f5c1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.162170 Jul 18 03:34:33.909422 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3653/7371] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:33 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:34.927175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:34.927717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:34.935251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:34.935707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:34.936521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:34.936994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:35.074858 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:35.083057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f6ee8f64-af32-4bc5-ace7-cd3c62e96c50 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.159935 Jul 18 03:34:35.083640 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3719/7372] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:34 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:36.102045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:36.102647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:36.109635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:36.110105 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:36.110891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:36.111343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:36.244503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:36.252766 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-87e1f8d1-dce3-4f17-bf16-a0232932b419 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.155567 Jul 18 03:34:36.253381 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3654/7373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:36 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:37.270185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:37.270812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:37.278507 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:37.278965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:37.279747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:37.280194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:37.411371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:37.419584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76cae0d2-0bc2-4abc-b86a-e75a3df6c107 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.153392 Jul 18 03:34:37.420167 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3720/7374] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:37 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:38.436740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:38.437400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:38.444457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:38.444952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:38.445743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:38.446201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:38.580182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:38.590741 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97d102bb-76e0-479f-a8e2-6ec4a98ac455 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.157675 Jul 18 03:34:38.591791 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3655/7375] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:38 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:39.610198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:39.610754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:39.618513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:39.618961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:39.619733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:39.620171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:39.754473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:39.762769 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-856dd530-4c21-41e6-9ef0-420cd088b52d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.156658 Jul 18 03:34:39.763359 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3721/7376] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:39 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:40.780948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:40.781562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:40.788731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:40.789227 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:40.790011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:40.790463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:40.930422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:40.939826 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7f092ee7-50bd-49f9-abd9-c1e28c313676 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.162830 Jul 18 03:34:40.940449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3656/7377] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:40 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:41.957595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:41.958219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:41.965323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:41.965786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:41.966570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:41.967024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:42.104654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:42.112731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd8d3d86-c69b-408c-93ca-272884d0be1f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.159174 Jul 18 03:34:42.113361 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3722/7378] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:41 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:43.129904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:43.130565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:43.138330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:43.138798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:43.139594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:43.140048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:43.272117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:43.280208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-12296008-6e62-4142-8f83-3e5173927d25 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.154384 Jul 18 03:34:43.280786 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3657/7379] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:43 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:44.299179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:44.299790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:44.307070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:44.307522 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:44.308290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:44.308730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:44.442045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:44.451046 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-950f25f1-34ff-4bb5-acd3-449cc922bd10 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.155751 Jul 18 03:34:44.451638 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3723/7380] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:44 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:45.469955 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:45.470573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:45.478550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:45.479010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:45.479811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:45.480264 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:45.626719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:45.635618 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-944b148c-a2c7-461a-9f63-3acbda9ff6ca tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.169336 Jul 18 03:34:45.636596 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3658/7381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:45 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:46.654598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:46.655133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:46.662335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:46.662803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:46.663598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:46.664047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:46.800696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:46.809773 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90401af6-56c3-4e20-9fd1-2f6ded52fd55 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1728 microversion: 2.1 time: 0.160361 Jul 18 03:34:46.810855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3724/7382] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:46 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:47.828172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:47.828809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:47.831495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=27 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:47.836767 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:47.837292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:47.838735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:47.839292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:47.842185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=79 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:47.977414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:47.987044 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6aa2263b-620b-44fe-b0da-ff6f48b6dbeb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1727 microversion: 2.1 time: 0.162838 Jul 18 03:34:47.987649 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3659/7383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:47 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:48.020624 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "name": "network-vif-unplugged", "status": "completed", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:48.025170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=33 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:48.033014 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:48.033478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:48.036265 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:34:48.051218 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] Creating event network-vif-unplugged:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h2-849796-1 Jul 18 03:34:48.059054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] Instance 2f685da4-803b-4713-a13d-4170d0bf0aec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:34:48.064167 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] [e29c7292-4931-4bfb-82c4-7db25680c04c] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:34:49.005566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:49.006797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:49.014682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:49.015160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:49.015976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:49.016440 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:49.073592 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] [e29c7292-4931-4bfb-82c4-7db25680c04c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 53238. Jul 18 03:34:49.083141 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d2222408-110b-4db2-bcc4-0f6fb43b7009 req-042aa439-eaaf-4adc-b3c1-7a0223987459 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.066000 Jul 18 03:34:49.084309 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3725/7384] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:34:49.171059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:49.194200 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d2228aed-79a1-48f7-a449-d845f2d3fab2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1727 microversion: 2.1 time: 0.192516 Jul 18 03:34:49.195193 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3660/7385] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:49 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:34:50.214498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:50.215198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:50.221590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:50.222041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:50.222826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:50.223262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:50.366383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:50.375400 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9d349353-c947-45b3-951e-5a3b6dead628 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.166826 Jul 18 03:34:50.375988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3726/7386] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:50 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:51.104627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:34:51.114062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.114527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.127824 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] Creating event network-changed:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h2-849796-1 Jul 18 03:34:51.133410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] Instance 2f685da4-803b-4713-a13d-4170d0bf0aec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:34:51.145827 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0e07687e-1188-424f-ba30-9464b08e19d6 req-f83d152b-f8dd-4ecf-b73d-ab9ca5fb5ea4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046245 Jul 18 03:34:51.146440 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3661/7387] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:34:51.394451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:51.395814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:51.403665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.404488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.405561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:51.406227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:51.648768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:51.660100 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a08157fc-7656-4065-9d7e-13c55731e62b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.268979 Jul 18 03:34:51.661705 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3727/7388] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:51 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:52.680654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:52.681409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:52.688277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:52.688752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:52.690112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:52.690438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:52.829748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:52.838687 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e058024-5bf4-42e7-843a-3a230d399f79 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.162644 Jul 18 03:34:52.839396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3662/7389] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:52 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:53.857161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:53.857811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:53.864787 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:53.865275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:53.866064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:53.866518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:54.009076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:54.017521 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0da960e-a4f8-49b9-b5e9-34b18c03cb6b tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.165263 Jul 18 03:34:54.018119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3728/7390] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:53 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:55.035902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:55.036525 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:55.043613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:55.044075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:55.044857 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:55.045337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:55.183046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:55.191310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4eaefb2a-3641-4f99-8ebd-18c0fa334b84 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.159347 Jul 18 03:34:55.191888 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3663/7391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:55 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:56.209079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:56.209616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:56.217633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:56.218095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:56.218911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:56.219356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:56.357717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:56.365750 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-21d48814-0c58-4447-9542-5097bf52de88 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.160753 Jul 18 03:34:56.366331 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3729/7392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:56 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:57.383430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:57.383960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:57.391554 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:57.392018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:57.392811 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:57.393300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:57.535509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:57.544282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ef40424-e2e4-49fe-8107-cf49d5ea2ef6 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.164931 Jul 18 03:34:57.544880 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3664/7393] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:57 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:58.562445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:58.562991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:58.570005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:58.570461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:58.571235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:58.571698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:58.705505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:58.714383 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-625a9961-a927-45b2-b5f8-55cfdce6ab58 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.155938 Jul 18 03:34:58.714961 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3730/7394] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:58 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:34:59.732894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:34:59.733570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:34:59.740548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:59.741046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:59.741836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:34:59.742291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:34:59.880076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:34:59.889590 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2a5fc74-b6b1-43c8-b679-3e30e68707d3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.161269 Jul 18 03:34:59.890193 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3665/7395] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:34:59 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:00.907725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:00.908416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:00.915593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:00.916466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:00.917562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:00.918095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:01.059910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:01.068451 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-888b385b-b474-4931-b925-7c9f8c800a70 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.164874 Jul 18 03:35:01.069083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3731/7396] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:00 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:02.086744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:02.087303 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:02.094442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:02.094915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:02.095710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:02.096171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:02.231904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:02.240127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6c443fa-9422-4635-b338-28c615017829 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1725 microversion: 2.1 time: 0.157465 Jul 18 03:35:02.240713 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3666/7397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:02 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:03.260782 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:03.261573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:03.269277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.269737 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.270530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.270979 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.447738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:03.456172 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bdaf605e-e54e-4f23-9ba2-910f7d91d5a9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1722 microversion: 2.1 time: 0.201966 Jul 18 03:35:03.456765 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3732/7398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:03 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:03.475939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:03.476784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:03.484301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.484780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.485618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.486079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.527239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.527719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.528568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.528945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.550293 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:35:03.555753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Getting quotas for user 8cf1ce901b1b4ff4a6baed824246daff and project 6ac8d47ba84a4303b63c31f835028b5d. Resources: {'cores', 'ram'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:35:03.665375 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60bb7eff-9b6c-4389-94a9-a1d7a07fc4fb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/action" status: 202 len: 0 microversion: 2.1 time: 0.193308 Jul 18 03:35:03.666548 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3667/7399] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:35:03 2022] POST /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:35:03.674601 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:03.675521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:03.684089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.684555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:03.685410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:03.685847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:04.003102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:04.012578 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3513f8b1-4be7-41cf-a106-4021b75703c9 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.341616 Jul 18 03:35:04.020603 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3733/7400] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:03 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:05.031547 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:05.032272 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:05.039753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:05.040224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:05.042228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:05.042696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:05.176902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:05.186120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee6a2818-4484-4a0a-9684-4be69298a2c3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.159719 Jul 18 03:35:05.186717 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3668/7401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:05 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:06.205378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:06.206067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:06.210422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "name": "network-vif-plugged", "status": "completed", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:06.213454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:06.213915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:06.214714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:06.215165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:06.227734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:06.228320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:06.241813 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] Creating event network-vif-plugged:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h2-849796-1 Jul 18 03:35:06.248253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] Instance 2f685da4-803b-4713-a13d-4170d0bf0aec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:35:06.261492 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-1aac4023-2b3d-4585-b2bc-621a5834d5d8 req-f0808d8b-6053-4985-bd57-4ffac3dc2df0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113912 Jul 18 03:35:06.262259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3734/7402] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:06.364906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:06.373964 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1fbd90e-f662-4278-ab75-b523a383a924 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.172641 Jul 18 03:35:06.374546 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3669/7403] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:06 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:07.393212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:07.393970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:07.400403 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:07.401160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:07.401943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:07.402389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:07.541750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:07.549986 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dba6876-8d7d-4556-b6bd-1e2eb185e265 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.161900 Jul 18 03:35:07.550593 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3735/7404] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:07 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:08.568076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:08.568862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:08.577792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:08.578275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:08.579407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:08.579844 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:08.741062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:08.749960 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-490e4aea-884d-4ea0-bc73-f44ca9b205c2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.185907 Jul 18 03:35:08.750556 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3670/7405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:08 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:09.767644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:09.768260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:09.775796 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:09.776036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:09.776827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:09.777307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:09.921598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:09.929787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a79ae71a-0167-41d2-8a7e-b80c5611e312 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.166126 Jul 18 03:35:09.930387 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3736/7406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:09 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:10.356667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "name": "network-vif-unplugged", "status": "completed", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:10.375430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:10.375997 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:10.390906 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] Creating event network-vif-unplugged:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:35:10.398791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] Instance 2f685da4-803b-4713-a13d-4170d0bf0aec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:35:10.411619 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-25afec4f-e714-4753-be63-3610d85b458f req-32ec7e79-e3a2-4500-9ab4-16d1a7bcbd80 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125521 Jul 18 03:35:10.412684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3671/7407] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:35:10.949189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:10.949802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:10.957047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:10.957499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:10.958589 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:10.959043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:11.101102 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:11.109626 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7417cc37-b602-4116-80f7-44377a4f7a21 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.165766 Jul 18 03:35:11.110216 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3737/7408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:10 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:12.128402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:12.129074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:12.136564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:12.137135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:12.137957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:12.138425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:12.287067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:12.296145 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ca942d0e-1ee4-4e33-ba4b-969b5071f758 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.172995 Jul 18 03:35:12.297241 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3672/7409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:12 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:12.434809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:12.444049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:12.444505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:12.456884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] Creating event network-changed:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:35:12.463463 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] Instance 2f685da4-803b-4713-a13d-4170d0bf0aec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:35:12.474386 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-79c56ca6-cd64-401a-8bec-4fff34e2661d req-ec4f74f9-9c68-49c0-aeab-fe8ce6899ae9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044354 Jul 18 03:35:12.475007 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3738/7410] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:13.314631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:13.315168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:13.322256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:13.322729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:13.323532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:13.323996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:13.339211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:13.465746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:13.473856 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-09d3cc8d-fdec-40d0-871b-70cea2fe4918 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.163327 Jul 18 03:35:13.474438 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3673/7411] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:13 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:14.494951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:14.495659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:14.502264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:14.502790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:14.503583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:14.504026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:14.662426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:14.671949 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60373cb2-99f6-49fa-9d97-48521c9f1e99 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.182834 Jul 18 03:35:14.672710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3739/7412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:14 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:15.690137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:15.690684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:15.692568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:15.699063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:15.699466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:15.700267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:15.700728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:15.834524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:15.844120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ab9c1639-04ef-4053-b7f6-22584543672d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.158065 Jul 18 03:35:15.844725 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3674/7413] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:15 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:16.863593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:16.864208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:16.871676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:16.872133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:16.872935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:16.873393 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:17.007744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:17.016050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2072e4e5-94b1-4123-87bb-f3f65072f7a8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.156420 Jul 18 03:35:17.016613 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3740/7414] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:16 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:35:18.033071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:18.033615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:18.036437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:18.043581 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:18.044053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:18.044883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:18.045373 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:18.186675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:18.194906 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b9cb9cec-d015-4621-92d5-36cbec44408f tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.165937 Jul 18 03:35:18.195489 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3675/7415] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:18 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:19.212957 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:19.213581 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:19.216862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=32 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:19.222673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:19.223131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:19.223916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:19.224361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:19.229390 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=90 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:19.364575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:19.373925 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-48d14ff5-22d6-4c5e-bf99-7add7d7bd305 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.164865 Jul 18 03:35:19.374519 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3741/7416] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:19 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:20.390717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:20.391385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:20.398468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:20.398939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:20.400384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:20.401034 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:20.543491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:20.551998 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-01e0a897-ea85-403c-90e6-1aecbcd68bfd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.165238 Jul 18 03:35:20.552607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3676/7417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:20 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:21.569834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:21.570391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:21.576961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:21.577415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:21.578201 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:21.578647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:21.715242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:21.723358 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b63d235f-140c-44f3-b736-91e2e4ee681d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.157857 Jul 18 03:35:21.723944 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3742/7418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:21 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:22.741411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:22.742043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:22.748305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:22.748777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:22.749604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:22.750064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:22.886968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:22.895090 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7eea8d9f-bb07-414c-a87b-f261c03983a5 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.158023 Jul 18 03:35:22.895674 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3677/7419] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:22 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:23.912913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:23.913549 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:23.920991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:23.921459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:23.922233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:23.922676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:24.053067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:24.061869 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c55704c-629d-41f2-a003-e658377a27f7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1721 microversion: 2.1 time: 0.152898 Jul 18 03:35:24.062456 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3743/7420] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:23 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:25.080040 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:25.080680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:25.087678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.088150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.089345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.089754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.223453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:25.231902 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-210bac44-5bfd-4c4e-820e-bbf1dbdc9608 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1714 microversion: 2.1 time: 0.155844 Jul 18 03:35:25.232486 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3678/7421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:25 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:25.249575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:25.250204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:25.257611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.258084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.258863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.259314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.400344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:25.408574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-483868d3-21fc-47f1-b1be-df164b28de1c tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1714 microversion: 2.1 time: 0.163562 Jul 18 03:35:25.409083 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3744/7422] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:25 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:25.425286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:25.425906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:25.431973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.433072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.433845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.434291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.564404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:25.572419 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-979456f4-cd5d-424a-84d0-181cf019b6bb tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1714 microversion: 2.1 time: 0.151096 Jul 18 03:35:25.573016 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3679/7423] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:25 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:25.588552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:25.589199 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:25.595634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.595945 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.596724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.597207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.626389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:35:25.704247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-73a51153-2614-4a89-8d72-d5cc78efb8d2 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 204 len: 0 microversion: 2.1 time: 0.119252 Jul 18 03:35:25.705174 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3745/7424] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:25 2022] DELETE /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:35:25.713776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:25.714668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:25.720859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.721382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.722179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:25.722657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:25.858317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:25.866487 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9aec298e-fc07-4c88-9753-b1653f3df2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1720 microversion: 2.1 time: 0.156861 Jul 18 03:35:25.867068 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3680/7425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:25 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:26.884868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:26.887975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:26.895009 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:26.895474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:26.896292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:26.896703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:27.036037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:27.045142 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f14f4397-24f1-4039-acbc-16ff04e27003 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1720 microversion: 2.1 time: 0.165102 Jul 18 03:35:27.045737 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3746/7426] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:26 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:28.062406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:28.063051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:28.069926 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:28.070417 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:28.071205 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:28.071656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:28.172014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:28.184854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b655ea11-2b89-4ee5-a30b-dd53f67ba2e8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1653 microversion: 2.1 time: 0.126214 Jul 18 03:35:28.185517 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3681/7427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:28 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1653 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:28.404022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b60b3e50-727c-41ea-b04d-0a80640b5ede req-ca03f3b6-214c-4bf1-a0c4-b64836a8a161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f685da4-803b-4713-a13d-4170d0bf0aec", "name": "network-vif-deleted", "tag": "aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:28.417508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b60b3e50-727c-41ea-b04d-0a80640b5ede req-ca03f3b6-214c-4bf1-a0c4-b64836a8a161 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:28.418207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b60b3e50-727c-41ea-b04d-0a80640b5ede req-ca03f3b6-214c-4bf1-a0c4-b64836a8a161 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:28.430793 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b60b3e50-727c-41ea-b04d-0a80640b5ede req-ca03f3b6-214c-4bf1-a0c4-b64836a8a161 service nova] Creating event network-vif-deleted:aa60f6ca-40b4-444c-a0a1-fcd3bcc448f7 for instance 2f685da4-803b-4713-a13d-4170d0bf0aec on n-h1-849796-1 Jul 18 03:35:28.437620 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b60b3e50-727c-41ea-b04d-0a80640b5ede req-ca03f3b6-214c-4bf1-a0c4-b64836a8a161 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 Jul 18 03:35:28.438238 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3747/7428] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:29.202827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:29.204271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:29.211631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:29.212098 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:29.212943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:29.213734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:29.286265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:29.298033 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5140527e-02cc-42b4-9979-9e3c596bae82 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1369 microversion: 2.1 time: 0.099510 Jul 18 03:35:29.298990 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3682/7429] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:29 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:30.316336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:30.317081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:30.325059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:30.325528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:30.326320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:30.326773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:30.396475 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:30.405411 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ef7d1920-7609-4055-b11c-225f3ac849a7 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1369 microversion: 2.1 time: 0.093263 Jul 18 03:35:30.406012 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3748/7430] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:30 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:31.423370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:31.423988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:31.431084 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:31.431549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:31.433133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:31.433956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:31.498656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:31.507265 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b98b62b4-3833-4ff8-990f-9fc69c70e0d1 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1369 microversion: 2.1 time: 0.087763 Jul 18 03:35:31.507875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3683/7431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:31 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:32.524911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:32.525563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:32.533883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:32.534375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:32.535198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:32.535647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:32.605659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf1ce901b1b4ff4a6baed824246daff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac8d47ba84a4303b63c31f835028b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:32.613817 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7a0a7e3c-e2a3-43fb-9e2d-459d233a0a26 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 200 len: 1369 microversion: 2.1 time: 0.092834 Jul 18 03:35:32.614404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3749/7432] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:32 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:33.631329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:33.631887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:33.639099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:33.639564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:33.640360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:33.640816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:33.658178 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec HTTP/1.1 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2f685da4-803b-4713-a13d-4170d0bf0aec'} Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:33.659869 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-085499b9-55bb-404d-a8d9-5ca373cde1ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 404 len: 111 microversion: 2.1 time: 0.034070 Jul 18 03:35:33.664214 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3684/7433] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:33 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:33.721017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:33.722018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:33.729621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:33.730210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:33.731050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:33.731495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:33.744609 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-volume_attachments HTTP/1.1 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': '2f685da4-803b-4713-a13d-4170d0bf0aec'} Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:33.746430 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-745563f5-d357-4cc2-b8cf-dbf5a10ae393 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031715 Jul 18 03:35:33.750997 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3750/7434] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:35:33 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.066094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.066507 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.074610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.075087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.075915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.076385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.091208 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec HTTP/1.1 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '2f685da4-803b-4713-a13d-4170d0bf0aec'} Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.092798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-691c25c8-fe87-4e08-b44c-3d46fad967d8 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 404 len: 111 microversion: 2.1 time: 0.032651 Jul 18 03:35:37.097518 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3685/7435] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:37 2022] DELETE /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.103141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.104362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 2f685da4-803b-4713-a13d-4170d0bf0aec] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.111514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.111985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.112725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.113196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.128201 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec HTTP/1.1 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2f685da4-803b-4713-a13d-4170d0bf0aec'} Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.129814 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 2f685da4-803b-4713-a13d-4170d0bf0aec could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ba51d1c-9852-4c4e-9c4c-64d2459cc7ae tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec" status: 404 len: 111 microversion: 2.1 time: 0.032317 Jul 18 03:35:37.134236 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3751/7436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:37 2022] GET /compute/v2.1/servers/2f685da4-803b-4713-a13d-4170d0bf0aec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.140179 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.140721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.147202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.147669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.148478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.148999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.164373 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb HTTP/1.1 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ac1d598a-a55b-4173-9b85-ceb601fb42cb'} Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.166087 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad9e48b7-3350-4307-8d0f-4873b76a25ab tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 404 len: 111 microversion: 2.1 time: 0.032109 Jul 18 03:35:37.170912 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3686/7437] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:37 2022] DELETE /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.177474 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.178076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ac1d598a-a55b-4173-9b85-ceb601fb42cb] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.185299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.185849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.186721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.187256 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.202327 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb HTTP/1.1 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ac1d598a-a55b-4173-9b85-ceb601fb42cb'} Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.204015 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ac1d598a-a55b-4173-9b85-ceb601fb42cb could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed037409-a8e3-4048-96e2-e0fff573627e tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb" status: 404 len: 111 microversion: 2.1 time: 0.032215 Jul 18 03:35:37.208598 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3752/7438] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:37 2022] GET /compute/v2.1/servers/ac1d598a-a55b-4173-9b85-ceb601fb42cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.215024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.215623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.223892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.224452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.225351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.225879 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.241550 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c HTTP/1.1 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '81029320-56f6-4a1d-945e-8724c834f29c'} Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.243236 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2926af09-159a-4ea1-a78f-a8fff96f96fd tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 404 len: 111 microversion: 2.1 time: 0.035579 Jul 18 03:35:37.248999 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3687/7439] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:37 2022] DELETE /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.256383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.257202 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: 81029320-56f6-4a1d-945e-8724c834f29c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.263965 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.264431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.265372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.265688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.282649 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c HTTP/1.1 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '81029320-56f6-4a1d-945e-8724c834f29c'} Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.284212 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance 81029320-56f6-4a1d-945e-8724c834f29c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7bd96f69-3002-4d81-8668-30bf9c70a51d tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c" status: 404 len: 111 microversion: 2.1 time: 0.033332 Jul 18 03:35:37.288157 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3753/7440] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:37 2022] GET /compute/v2.1/servers/81029320-56f6-4a1d-945e-8724c834f29c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.295999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.296463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.302801 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.303278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.304077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.304541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.320979 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf HTTP/1.1 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ea008c56-0047-4f4d-8ee6-acbb5f2d9faf'} Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.322631 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ce1b2d94-2998-4ad1-b20d-289cfe8d9149 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 404 len: 111 microversion: 2.1 time: 0.033932 Jul 18 03:35:37.329021 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3688/7441] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:35:37 2022] DELETE /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.333777 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.334396 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] [instance: ea008c56-0047-4f4d-8ee6-acbb5f2d9faf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:37.340691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.341190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.341973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:37.342426 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:37.357323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] HTTP exception thrown: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Request method failure captured: Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf HTTP/1.1 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NLhMY5012OGc74DxMZJc0YdUkDAc7eUE0vq7erQ3fFC9DvmuK0IYB68e1sEeRHsji3qvWr9dRIMq2mtK3fnhl3V17If0xMgJqmcE3T3_QdYNJ9ucy-Lewaq_Q3ffbznjZJZVNmw8B2RkTKtPawl69n0sqh3kDiVKBZ4XpmWDUthXIM Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6ac8d47ba84a4303b63c31f835028b5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6ac8d47ba84a4303b63c31f835028b5d Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServerActionsTestJSON-1612943512 Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 8cf1ce901b1b4ff4a6baed824246daff Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServerActionsTestJSON-1612943512-project Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ea008c56-0047-4f4d-8ee6-acbb5f2d9faf'} Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:35:37.358889 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Returning 404 to user: Instance ea008c56-0047-4f4d-8ee6-acbb5f2d9faf could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f6a8ccfd-a9c0-48b3-ab3c-b8a9d80c33a3 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf" status: 404 len: 111 microversion: 2.1 time: 0.030514 Jul 18 03:35:37.362811 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3754/7442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:37 2022] GET /compute/v2.1/servers/ea008c56-0047-4f4d-8ee6-acbb5f2d9faf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:35:37.369947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2916e65b-40fa-48fb-af01-f513fcb822c0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] Calling method '.version_select at 0x7fab048215e0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:37.394204 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2916e65b-40fa-48fb-af01-f513fcb822c0 tempest-ServerActionsTestJSON-1612943512 tempest-ServerActionsTestJSON-1612943512-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045846927" status: 202 len: 0 microversion: 2.1 time: 0.028744 Jul 18 03:35:37.394914 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3689/7443] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Jul 18 03:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045846927 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:35:47.055012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1693533788", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "87031e81-3142-4796-9da2-27392e6ce644"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:47.321578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] validate_networks() for [('87031e81-3142-4796-9da2-27392e6ce644', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:35:47.347960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:47.754397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:35:47.754828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:35:47.755304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:35:47.755720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:35:47.756137 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:35:47.766397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:47.766876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:47.767704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:47.768162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:47.790582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Getting quotas for project d709d830683b44348c9a6ad07f0b7c8d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:35:47.799830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Getting quotas for user cf4916cce748426a89f3590c1fb09e73 and project d709d830683b44348c9a6ad07f0b7c8d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:35:47.818255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:35:47.820595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:35:47.875294 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7ea439ed-4153-4e02-a432-76b125185b70 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985234 Jul 18 03:35:47.882016 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3755/7444] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:35:47.884171 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=73 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:47.885147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:47.889439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9adeb5d3-702a-44ff-93c2-8f0826ef2b49 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:47.890158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9adeb5d3-702a-44ff-93c2-8f0826ef2b49 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:48.071724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9adeb5d3-702a-44ff-93c2-8f0826ef2b49 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:48.080077 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9adeb5d3-702a-44ff-93c2-8f0826ef2b49 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1217 microversion: 2.1 time: 0.197677 Jul 18 03:35:48.088775 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3690/7445] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:47 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:49.098620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:49.099814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:49.108346 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:49.109098 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:49.110037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:49.110722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:49.176440 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:49.185360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6b667e2f-4d74-4e59-8a07-650b4bcf512d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1275 microversion: 2.1 time: 0.090606 Jul 18 03:35:49.188085 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3756/7446] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:49 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:50.204687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:50.205538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:50.217038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:50.217038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:50.217900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:50.218295 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:50.473627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:50.483249 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-41b3c124-66e7-4cd0-bf49-608cfaa2dd46 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.282600 Jul 18 03:35:50.484016 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3691/7447] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:50 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:50.891830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-0cf041a3-fcd8-4e2b-91cf-40f2be953499 req-31c6666a-abae-432d-bf9c-540709b6f15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d53995cd-19c8-4c5c-bd64-82e917242482", "tag": "bb30c924-8fa8-4960-b713-dc54fb49bbfb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:50.909261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:50.918634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0cf041a3-fcd8-4e2b-91cf-40f2be953499 req-31c6666a-abae-432d-bf9c-540709b6f15e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:50.919413 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-0cf041a3-fcd8-4e2b-91cf-40f2be953499 req-31c6666a-abae-432d-bf9c-540709b6f15e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:50.935679 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-0cf041a3-fcd8-4e2b-91cf-40f2be953499 req-31c6666a-abae-432d-bf9c-540709b6f15e service nova] Creating event network-changed:bb30c924-8fa8-4960-b713-dc54fb49bbfb for instance d53995cd-19c8-4c5c-bd64-82e917242482 on n-h1-849796-1 Jul 18 03:35:50.941101 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-0cf041a3-fcd8-4e2b-91cf-40f2be953499 req-31c6666a-abae-432d-bf9c-540709b6f15e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055832 Jul 18 03:35:50.942040 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3757/7448] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:51.500510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:51.501058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:51.508253 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:51.508721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:51.509542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:51.510598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:51.646228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:51.654153 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-72609708-ab31-478b-aa32-1d9de019a6e1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.157706 Jul 18 03:35:51.654771 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3692/7449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:51 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:52.671696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:52.672312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:52.679412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:52.679870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:52.680651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:52.681131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:52.816784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:52.825130 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8cbc28a4-2350-424c-9051-36b63a83c901 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.158274 Jul 18 03:35:52.825713 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3758/7450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:52 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:53.843109 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:53.843929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:53.850729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:53.851094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:53.852199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:53.852659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:54.293601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:54.301567 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-93900c74-0368-4b76-a288-309381b8a1cb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.462629 Jul 18 03:35:54.302294 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3693/7451] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:53 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:55.320468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:55.321125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:55.330383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.330856 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.331655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:55.332186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:55.475491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:55.484235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1eb66121-6d09-46e8-9f50-02bdcfdced3d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.167899 Jul 18 03:35:55.484840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3759/7452] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:55 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:56.502237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:56.503037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:56.511350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:56.511827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:56.512644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:56.513177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:56.671494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:56.679421 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-be0b442a-8e7b-454f-803c-e40f94d70775 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.181149 Jul 18 03:35:56.680023 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3694/7453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:56 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:57.050436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a3ee8513-096e-4183-98e4-35853b3d2262 req-0e85dc5e-758a-4dee-9817-2126f804700c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53995cd-19c8-4c5c-bd64-82e917242482", "name": "network-vif-plugged", "status": "completed", "tag": "bb30c924-8fa8-4960-b713-dc54fb49bbfb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:57.062600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3ee8513-096e-4183-98e4-35853b3d2262 req-0e85dc5e-758a-4dee-9817-2126f804700c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:57.063895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a3ee8513-096e-4183-98e4-35853b3d2262 req-0e85dc5e-758a-4dee-9817-2126f804700c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:57.077480 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a3ee8513-096e-4183-98e4-35853b3d2262 req-0e85dc5e-758a-4dee-9817-2126f804700c service nova] Creating event network-vif-plugged:bb30c924-8fa8-4960-b713-dc54fb49bbfb for instance d53995cd-19c8-4c5c-bd64-82e917242482 on n-h1-849796-1 Jul 18 03:35:57.083543 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a3ee8513-096e-4183-98e4-35853b3d2262 req-0e85dc5e-758a-4dee-9817-2126f804700c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036273 Jul 18 03:35:57.083543 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3760/7454] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:35:57.698745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:57.699409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:57.706875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:57.707342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:57.708152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:57.708608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:57.856947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:57.865588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e2ea3f2-0838-4c64-929f-6ea35e178151 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1317 microversion: 2.1 time: 0.170969 Jul 18 03:35:57.866190 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3695/7455] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:57 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:58.883506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:58.884109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:58.886163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:58.886921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:58.894547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.895007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:58.895798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:58.896246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:59.031375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:59.039062 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-06aa6024-9bec-445a-8ebb-021f9c1dbef2 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.159929 Jul 18 03:35:59.039647 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3761/7456] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:58 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:35:59.094503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-512636838", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "87031e81-3142-4796-9da2-27392e6ce644"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:35:59.101106 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:35:59.147560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] validate_networks() for [('87031e81-3142-4796-9da2-27392e6ce644', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:35:59.574610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:35:59.575052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:35:59.575538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:35:59.575961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:35:59.576386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:35:59.586110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:59.586571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:59.587536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:35:59.588019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:35:59.607465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Getting quotas for project d709d830683b44348c9a6ad07f0b7c8d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:35:59.613455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Getting quotas for user cf4916cce748426a89f3590c1fb09e73 and project d709d830683b44348c9a6ad07f0b7c8d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:35:59.629003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:35:59.631348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:35:59.683181 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a8e38c3-4afb-4ee6-a2c1-afa74bdc4801 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587614 Jul 18 03:35:59.684079 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3696/7457] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:35:59.695487 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4b9c2aec-da5f-4fd6-a52e-f089a36520ff tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:35:59.696223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4b9c2aec-da5f-4fd6-a52e-f089a36520ff tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:35:59.755826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4b9c2aec-da5f-4fd6-a52e-f089a36520ff tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:35:59.764403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4b9c2aec-da5f-4fd6-a52e-f089a36520ff tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1216 microversion: 2.1 time: 0.073609 Jul 18 03:35:59.766000 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3762/7458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:35:59 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:00.783913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:00.784553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:00.792181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:00.792714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:00.793603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:00.794083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:00.875601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:00.884900 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6cb3fc35-7c18-43de-b596-bf2ad19d5c48 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1276 microversion: 2.1 time: 0.105874 Jul 18 03:36:00.886143 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3697/7459] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:00 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:36:01.788125 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:36:01.788631 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:36:01.905663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:01.907247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:01.918726 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:01.919917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:01.920801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:01.922303 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:02.150670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:02.159701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12a82f67-8b67-476e-b1c4-86675cc1452f tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.260466 Jul 18 03:36:02.160314 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3763/7460] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:01 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:02.564600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-539fd549-c400-4bef-8261-8638b424ded0 req-4d6f2999-ede0-45c6-870e-095044171383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c55277-c5a7-4dec-b7ed-13eb1ae7dad9", "tag": "519419e8-9d0f-4d03-8510-9418814d2711"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:02.582639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-539fd549-c400-4bef-8261-8638b424ded0 req-4d6f2999-ede0-45c6-870e-095044171383 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:02.584038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-539fd549-c400-4bef-8261-8638b424ded0 req-4d6f2999-ede0-45c6-870e-095044171383 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:02.603978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-539fd549-c400-4bef-8261-8638b424ded0 req-4d6f2999-ede0-45c6-870e-095044171383 service nova] Creating event network-changed:519419e8-9d0f-4d03-8510-9418814d2711 for instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 on n-h2-849796-1 Jul 18 03:36:02.611295 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-539fd549-c400-4bef-8261-8638b424ded0 req-4d6f2999-ede0-45c6-870e-095044171383 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053914 Jul 18 03:36:02.612399 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3698/7461] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:03.179103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:03.179665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:03.187870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:03.188321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:03.189162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:03.189608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:03.451592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:03.460198 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-663f7e7b-cecb-409d-9869-2d02e7112c44 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.285950 Jul 18 03:36:03.460793 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3764/7462] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:03 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:04.480421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:04.481183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:04.487615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:04.488086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:04.488883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:04.489369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:04.624976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:04.632599 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f44adab4-f143-4240-9d3d-780d08258ce7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.158469 Jul 18 03:36:04.633219 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3699/7463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:04 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:05.650381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:05.651583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:05.659252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:05.659712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:05.660540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:05.661017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:05.805253 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:05.814317 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a4efcd30-81bd-4395-b228-81502a631f64 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.167901 Jul 18 03:36:05.814919 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3765/7464] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:05 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:06.833522 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:06.834156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:06.842055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:06.842531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:06.843344 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:06.843810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:07.000018 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:07.008249 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9c128d63-ac63-479e-a50c-2ec288fbd207 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.178629 Jul 18 03:36:07.013702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3700/7465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:06 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:08.026367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:08.027270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:08.034954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:08.035410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:08.036220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:08.036661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:08.187910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:08.195714 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6714edaa-a103-45cb-882a-b1476318c9eb tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.173819 Jul 18 03:36:08.196309 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3766/7466] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:08 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:36:08.437670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e5d94d7d-ab17-469d-bc0d-05ebe296df41 req-f1372910-0ebb-4239-b6db-d8f56ed85622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c55277-c5a7-4dec-b7ed-13eb1ae7dad9", "name": "network-vif-plugged", "status": "completed", "tag": "519419e8-9d0f-4d03-8510-9418814d2711"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:08.450092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e5d94d7d-ab17-469d-bc0d-05ebe296df41 req-f1372910-0ebb-4239-b6db-d8f56ed85622 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:08.451259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e5d94d7d-ab17-469d-bc0d-05ebe296df41 req-f1372910-0ebb-4239-b6db-d8f56ed85622 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:08.465871 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e5d94d7d-ab17-469d-bc0d-05ebe296df41 req-f1372910-0ebb-4239-b6db-d8f56ed85622 service nova] Creating event network-vif-plugged:519419e8-9d0f-4d03-8510-9418814d2711 for instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 on n-h2-849796-1 Jul 18 03:36:08.471521 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e5d94d7d-ab17-469d-bc0d-05ebe296df41 req-f1372910-0ebb-4239-b6db-d8f56ed85622 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037599 Jul 18 03:36:08.472425 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3701/7467] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:09.216885 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:09.217641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:09.225755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:09.228262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:09.230297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:09.230949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:09.438837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:09.449586 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a8fa43ce-180e-4a36-b4dc-4b105193901c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1316 microversion: 2.1 time: 0.240118 Jul 18 03:36:09.451547 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3767/7468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:09 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:10.465725 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:10.466584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:10.470953 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:10.471684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:10.479682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.480330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:10.481181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.481644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:10.643060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:10.651966 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a230bc2-5b76-407d-9c55-208399190057 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1505 microversion: 2.1 time: 0.187456 Jul 18 03:36:10.652643 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3702/7469] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:10 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:10.670195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:10.670806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:10.672659 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:10.679185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.679650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:10.680462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.680915 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:10.714772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:36:10.806774 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5a1c00ce-3de1-45cf-b042-14dcd37669b6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "DELETE /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 204 len: 0 microversion: 2.1 time: 0.141295 Jul 18 03:36:10.808278 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3768/7470] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:36:10 2022] DELETE /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:36:10.816865 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:10.817544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:10.825508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.825974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:10.826804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:10.827269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:11.010797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:11.019020 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec6934da-c974-48e1-8f10-5c724fef7fd5 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1511 microversion: 2.1 time: 0.206170 Jul 18 03:36:11.019621 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3703/7471] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:10 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:12.044129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:12.044834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:12.052546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:12.053110 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:12.054015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:12.054551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:12.205553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:12.215876 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2db62d19-4929-468f-9311-050a52108789 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1511 microversion: 2.1 time: 0.176579 Jul 18 03:36:12.216509 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3769/7472] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:12 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:13.239924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:13.240846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:13.278487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:13.288800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:13.291394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:13.292424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:13.387067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:13.397785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c353b2b2-bae2-4757-888c-59eb954a0781 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 200 len: 1469 microversion: 2.1 time: 0.166344 Jul 18 03:36:13.401465 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3704/7473] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:13 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:13.439682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7cbfc560-9caf-49be-a5b4-0ba2d3be4c6e req-9e6024e6-0533-4100-8e34-d881116d1cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c55277-c5a7-4dec-b7ed-13eb1ae7dad9", "name": "network-vif-deleted", "tag": "519419e8-9d0f-4d03-8510-9418814d2711"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:13.481317 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7cbfc560-9caf-49be-a5b4-0ba2d3be4c6e req-9e6024e6-0533-4100-8e34-d881116d1cd5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:13.486472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7cbfc560-9caf-49be-a5b4-0ba2d3be4c6e req-9e6024e6-0533-4100-8e34-d881116d1cd5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:13.512240 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7cbfc560-9caf-49be-a5b4-0ba2d3be4c6e req-9e6024e6-0533-4100-8e34-d881116d1cd5 service nova] Creating event network-vif-deleted:519419e8-9d0f-4d03-8510-9418814d2711 for instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 on n-h2-849796-1 Jul 18 03:36:13.523326 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7cbfc560-9caf-49be-a5b4-0ba2d3be4c6e req-9e6024e6-0533-4100-8e34-d881116d1cd5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087973 Jul 18 03:36:13.530907 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3770/7474] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:14.428322 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:14.428889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.436634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.437160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.437999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.438463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.454632 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 HTTP/1.1 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '49c55277-c5a7-4dec-b7ed-13eb1ae7dad9'} Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:14.456460 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 404 to user: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-45dfb73b-eb41-48da-8e94-392353fe1e3e tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 404 len: 111 microversion: 2.1 time: 0.033927 Jul 18 03:36:14.465557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3705/7475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:14 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:14.470838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:14.471570 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.478947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.479709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.480599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.481092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.627816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:14.635874 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-16988a9b-0307-4bde-afb5-bb543ec06a0b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.170726 Jul 18 03:36:14.636467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3771/7476] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:14 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:14.653292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:14.654300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 57355445-08f8-4130-874a-c5622a629e1b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.659945 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/57355445-08f8-4130-874a-c5622a629e1b/action HTTP/1.1 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 32 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: {"resize": {"flavorRef": "452"}} Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '57355445-08f8-4130-874a-c5622a629e1b', 'body': {'resize': {'flavorRef': '452'}}} Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:36:14.661623 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 404 to user: Instance 57355445-08f8-4130-874a-c5622a629e1b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-558c9345-0f97-4f6e-a945-dd8d83eff344 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "POST /compute/v2.1/servers/57355445-08f8-4130-874a-c5622a629e1b/action" status: 404 len: 111 microversion: 2.1 time: 0.014571 Jul 18 03:36:14.666215 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3706/7477] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:36:14 2022] POST /compute/v2.1/servers/57355445-08f8-4130-874a-c5622a629e1b/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:14.673061 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:14.673685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.680436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.680816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.681721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.682175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.825972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:14.833799 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd49b85a-7e60-43e0-98fd-e3888fd7722c tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.164780 Jul 18 03:36:14.834423 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3772/7478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:14 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:14.852426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:14.853101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:14.860978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.861446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:14.862238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:14.862689 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.001634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.010834 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de731440-cc50-4299-83a0-77abfd14ab95 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.162035 Jul 18 03:36:15.011842 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3707/7479] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:14 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:15.032350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ef7d95bb-5011-400a-b768-cba77b041d84"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:15.034300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.046325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.047165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.048585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.049447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.079325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:15.090221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.096669 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: request: POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action HTTP/1.1 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 65 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: {"resize": {"flavorRef": "ef7d95bb-5011-400a-b768-cba77b041d84"}} Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: exception: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd53995cd-19c8-4c5c-bd64-82e917242482', 'body': {'resize': {'flavorRef': 'ef7d95bb-5011-400a-b768-cba77b041d84'}}} Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 03:36:15.098701 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 400 to user: Flavor ef7d95bb-5011-400a-b768-cba77b041d84 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd317169-9ccf-42fc-afd3-823cd35f30ad tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action" status: 400 len: 107 microversion: 2.1 time: 0.075569 Jul 18 03:36:15.105428 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3773/7480] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:36:15 2022] POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action => generated 107 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:36:15.110286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.110931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.117379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.117845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.118648 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.119094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.265868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.274261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2eb18143-d81b-4e5e-8476-4632aa0ea019 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.168100 Jul 18 03:36:15.274907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3708/7481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:15.293805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.294956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.302869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.303462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.304364 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.304911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.458958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.467817 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12a5a8e2-d849-497d-bae3-b516fae26f9b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.179945 Jul 18 03:36:15.468417 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3774/7482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:15.485240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1622293e-a1b0-400a-a63e-b42d1fad5d4d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1622293e-a1b0-400a-a63e-b42d1fad5d4d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: request: POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action HTTP/1.1 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 29 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: {"resize": {"flavorRef": ""}} Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'd53995cd-19c8-4c5c-bd64-82e917242482', 'body': {'resize': {'flavorRef': ''}}} Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise error Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi '' Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.487590 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1622293e-a1b0-400a-a63e-b42d1fad5d4d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1622293e-a1b0-400a-a63e-b42d1fad5d4d tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action" status: 400 len: 113 microversion: 2.1 time: 0.008056 Jul 18 03:36:15.492164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3709/7483] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:36:15 2022] POST /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 03:36:15.498802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.499498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.506404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.507457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.507661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.508108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.674433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:15.683267 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23ede384-8732-42ba-a73b-cb0430a408d1 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1507 microversion: 2.1 time: 0.188011 Jul 18 03:36:15.683955 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3775/7484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:36:15.705995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.706586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.715108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.715568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.716405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.716861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.732232 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 HTTP/1.1 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '49c55277-c5a7-4dec-b7ed-13eb1ae7dad9'} Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:36:15.733919 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 404 to user: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-408a4c0e-bc1b-497c-8fc6-ea5179b46c40 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "DELETE /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 404 len: 111 microversion: 2.1 time: 0.034342 Jul 18 03:36:15.738414 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3710/7485] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:36:15 2022] DELETE /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:15.747176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.747839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.754592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.755059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.755870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.756330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.772810 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 HTTP/1.1 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '49c55277-c5a7-4dec-b7ed-13eb1ae7dad9'} Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:15.774449 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 404 to user: Instance 49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce45a6e7-e2ab-48f8-9661-d9a11d693bb7 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9" status: 404 len: 111 microversion: 2.1 time: 0.034855 Jul 18 03:36:15.782485 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3776/7486] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/49c55277-c5a7-4dec-b7ed-13eb1ae7dad9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:15.787251 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.787776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.796028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.796028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.796320 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.796752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.828030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:36:15.866127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:15.921644 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4bd04afd-dc9e-428c-996d-52a3a92f4ac6 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 204 len: 0 microversion: 2.1 time: 0.139545 Jul 18 03:36:15.922867 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3711/7487] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:36:15 2022] DELETE /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:36:15.932823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:15.934344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:15.940909 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.941414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:15.942229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:15.942683 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:16.094557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:16.103181 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fcf6f0b9-fa3f-45e4-8741-1e8dd9d07a85 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1513 microversion: 2.1 time: 0.175677 Jul 18 03:36:16.104357 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3777/7488] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:15 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:17.122604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:17.123327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:17.130416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:17.130882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:17.131678 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:17.132165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:17.274941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:17.282651 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-77fc7555-54a0-43c4-8723-0b0cecbea987 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1513 microversion: 2.1 time: 0.164954 Jul 18 03:36:17.283238 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3712/7489] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:17 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:17.924050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-39a152a9-0396-4222-95f4-21cf339ab59b req-da9404d0-9d06-4162-a4e5-cb1e608c6c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53995cd-19c8-4c5c-bd64-82e917242482", "name": "network-vif-deleted", "tag": "bb30c924-8fa8-4960-b713-dc54fb49bbfb"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:17.933614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-39a152a9-0396-4222-95f4-21cf339ab59b req-da9404d0-9d06-4162-a4e5-cb1e608c6c54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:17.934105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-39a152a9-0396-4222-95f4-21cf339ab59b req-da9404d0-9d06-4162-a4e5-cb1e608c6c54 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:17.947162 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-39a152a9-0396-4222-95f4-21cf339ab59b req-da9404d0-9d06-4162-a4e5-cb1e608c6c54 service nova] Creating event network-vif-deleted:bb30c924-8fa8-4960-b713-dc54fb49bbfb for instance d53995cd-19c8-4c5c-bd64-82e917242482 on n-h1-849796-1 Jul 18 03:36:17.953506 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-39a152a9-0396-4222-95f4-21cf339ab59b req-da9404d0-9d06-4162-a4e5-cb1e608c6c54 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Jul 18 03:36:17.954677 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3778/7490] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:36:18.300993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:18.301665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:18.304548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:18.313704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:18.314687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:18.315521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:18.316260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:18.352359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:18.352834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:18.353372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lazy-loading 'fault' on Instance uuid d53995cd-19c8-4c5c-bd64-82e917242482 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:36:18.397632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4916cce748426a89f3590c1fb09e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd709d830683b44348c9a6ad07f0b7c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:18.405977 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8922b8ab-627a-41e0-9d61-eadc5fe8e90b tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 200 len: 1307 microversion: 2.1 time: 0.109383 Jul 18 03:36:18.406707 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3713/7491] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:18 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:19.425406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:19.426114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] [instance: d53995cd-19c8-4c5c-bd64-82e917242482] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:19.432618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:19.433115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:19.433900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:19.434350 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:19.448002 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] HTTP exception thrown: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Request method failure captured: Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 HTTP/1.1 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NUSQeVBCPQQuAZVXoKlCR4_LLpgl2hxq0v9iYHypC-x_vqg6QUco7KjPhaKqpGsTcbUH1-hmSg4N_KCY1nE4fZ6Tq0LTNlvQMcFHPYldGMS0w0TRr39LuK0PWA68COk7GnIyMrj_GK--Rj37Fv3WOlGqF3t57yu34FqqHhguqESuto Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d709d830683b44348c9a6ad07f0b7c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: d709d830683b44348c9a6ad07f0b7c8d Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1389620103 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: cf4916cce748426a89f3590c1fb09e73 Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-ServersNegativeTestJSON-1389620103-project Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd53995cd-19c8-4c5c-bd64-82e917242482'} Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:36:19.449767 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] Returning 404 to user: Instance d53995cd-19c8-4c5c-bd64-82e917242482 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e3f61838-1a1c-4349-a839-a61c1cda5888 tempest-ServersNegativeTestJSON-1389620103 tempest-ServersNegativeTestJSON-1389620103-project] 10.222.0.67 "GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482" status: 404 len: 111 microversion: 2.1 time: 0.031218 Jul 18 03:36:19.454912 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3779/7492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:19 2022] GET /compute/v2.1/servers/d53995cd-19c8-4c5c-bd64-82e917242482 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:36:52.682178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:52.682949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:52.862973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e684ad41-7409-49c1-aeff-00e0f043ff6f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: .version_select at 0x7faaf72b5310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1127616952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMz4MK2CE+bvoMatXVYcYR+skz7hAkXxZ8yvJsHL00R/EDc32Mg8jW7VG4gE56vvspLr5gg+X1rYMTU/ZvhCtjoUO+U5iPOZHG8NoSL535dvxjJVR8EgOWgCrC977j55Bg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:52.877533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e684ad41-7409-49c1-aeff-00e0f043ff6f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:36:52.883528 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-e684ad41-7409-49c1-aeff-00e0f043ff6f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for user 85121753d7ff42eb8310883df8c850c9 and project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:36:52.911976 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e684ad41-7409-49c1-aeff-00e0f043ff6f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.235025 Jul 18 03:36:52.918844 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3714/7493] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:36:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:52.968519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1800777572", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1127616952", "networks": [{"uuid": "465fbdfb-68a1-4b67-87aa-01309f510a75"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:52.975831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:52.976490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=24 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:36:53.026513 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] validate_networks() for [('465fbdfb-68a1-4b67-87aa-01309f510a75', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:36:53.409949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:36:53.410434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:36:53.410920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:36:53.411342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:36:53.411763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:36:53.421934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:53.422391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:53.423210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:53.423657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:53.442257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:36:53.448013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for user 85121753d7ff42eb8310883df8c850c9 and project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:36:53.460506 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:36:53.462867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:36:53.511517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b2b90243-5eb4-4eec-a6b1-b2589a388bb4 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547817 Jul 18 03:36:53.512440 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3780/7494] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:36:53.522782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a9ecccd-d5f2-40e2-954e-ab9008404559 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:53.523419 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a9ecccd-d5f2-40e2-954e-ab9008404559 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:53.578462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a9ecccd-d5f2-40e2-954e-ab9008404559 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:53.585457 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a9ecccd-d5f2-40e2-954e-ab9008404559 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1263 microversion: 2.1 time: 0.066694 Jul 18 03:36:53.586180 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3715/7495] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:53 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:54.605204 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:54.607151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:54.614258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:54.614849 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:54.615703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:54.616349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:54.689642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:54.697946 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3c3a68cf-6d3e-4969-817f-5b3ff47266a6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1333 microversion: 2.1 time: 0.098248 Jul 18 03:36:54.698857 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3781/7496] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:54 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:55.715540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:55.716169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:55.726585 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:55.728744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:55.729860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:55.730468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:56.007128 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:56.015800 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b3c206a-03ff-4390-8edd-a64148efc965 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.304306 Jul 18 03:36:56.017122 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3716/7497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:55 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:56.148896 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-5a60f601-6113-451b-a216-3246322c39d5 req-c8f56e8a-866f-4f10-b0aa-7dbc0a883be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb540ce-e45f-4120-8503-0f81fcb1113e", "tag": "b0c1f6aa-5f85-473c-9e76-09d9a221a884"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:36:56.190242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5a60f601-6113-451b-a216-3246322c39d5 req-c8f56e8a-866f-4f10-b0aa-7dbc0a883be6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:56.193983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-5a60f601-6113-451b-a216-3246322c39d5 req-c8f56e8a-866f-4f10-b0aa-7dbc0a883be6 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:56.212449 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-5a60f601-6113-451b-a216-3246322c39d5 req-c8f56e8a-866f-4f10-b0aa-7dbc0a883be6 service nova] Creating event network-changed:b0c1f6aa-5f85-473c-9e76-09d9a221a884 for instance ccb540ce-e45f-4120-8503-0f81fcb1113e on n-h1-849796-1 Jul 18 03:36:56.222004 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-5a60f601-6113-451b-a216-3246322c39d5 req-c8f56e8a-866f-4f10-b0aa-7dbc0a883be6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078775 Jul 18 03:36:56.223281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3782/7498] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:36:57.033942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:57.034575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:57.042150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:57.042612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:57.043397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:57.043862 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:57.174228 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:57.182990 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-39297c31-1e2c-43d0-92ea-878a53b2b75f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.152876 Jul 18 03:36:57.183569 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3717/7499] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:57 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:36:58.201678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:58.202306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:58.208751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:58.209252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:58.210069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:58.210517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:58.345770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:58.353504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1094e008-f85e-4266-864d-d5bac3f55c75 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.157521 Jul 18 03:36:58.354075 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3783/7500] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:58 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:36:59.370800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:36:59.371434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:36:59.378347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:59.378810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:59.379593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:36:59.380047 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:36:59.514212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:36:59.521978 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a09ad42f-507c-4f1f-8740-0e708bb31bc1 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.155354 Jul 18 03:36:59.522578 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3718/7501] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:36:59 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:00.539843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:00.540450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:00.548733 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:00.549221 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:00.550012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:00.550464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:00.687181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:00.695422 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2cd881aa-7a6a-4e9f-b5c5-6762f747d5e7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.159585 Jul 18 03:37:00.696092 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3784/7502] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:00 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:01.712147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:01.712831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:01.720113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:01.720700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:01.721634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:01.722236 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:01.865310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:01.872785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3eec59f7-476e-4a90-abd4-3f9af7022552 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.165011 Jul 18 03:37:01.873400 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3719/7503] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:01 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:02.889982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:02.890595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:02.898693 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:02.899141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:02.899913 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:02.900352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:03.044627 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:03.052805 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-126c4893-487a-4716-ba66-76ac98cfa38a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.167247 Jul 18 03:37:03.053420 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3785/7504] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:02 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:03.491146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-48fd066c-7979-43e6-834f-61f8e78b99ef req-8160ae53-17c7-4c47-a83d-48a991d842d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb540ce-e45f-4120-8503-0f81fcb1113e", "name": "network-vif-plugged", "status": "completed", "tag": "b0c1f6aa-5f85-473c-9e76-09d9a221a884"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:03.510335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-48fd066c-7979-43e6-834f-61f8e78b99ef req-8160ae53-17c7-4c47-a83d-48a991d842d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:03.511178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-48fd066c-7979-43e6-834f-61f8e78b99ef req-8160ae53-17c7-4c47-a83d-48a991d842d9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:03.533579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-48fd066c-7979-43e6-834f-61f8e78b99ef req-8160ae53-17c7-4c47-a83d-48a991d842d9 service nova] Creating event network-vif-plugged:b0c1f6aa-5f85-473c-9e76-09d9a221a884 for instance ccb540ce-e45f-4120-8503-0f81fcb1113e on n-h1-849796-1 Jul 18 03:37:03.540239 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-48fd066c-7979-43e6-834f-61f8e78b99ef req-8160ae53-17c7-4c47-a83d-48a991d842d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059402 Jul 18 03:37:03.541183 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3720/7505] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:04.073020 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:04.073649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:04.076153 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:04.076865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:04.083539 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:04.083995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:04.084773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:04.085251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:04.233315 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:04.241927 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0508c233-96b3-4953-aca5-4c7808d03e99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1363 microversion: 2.1 time: 0.172669 Jul 18 03:37:04.242716 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3786/7506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:04 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:05.257392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:05.263642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:05.264363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:05.271052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:05.271514 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:05.272301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:05.272751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:05.413679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:05.421354 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa1494f3-118e-4d98-9657-d33185e54b99 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1555 microversion: 2.1 time: 0.164965 Jul 18 03:37:05.421910 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3721/7507] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:05 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:05.437884 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:05.438505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:05.445461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:05.445919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:05.446697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:05.447141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:05.582906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:05.591604 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1a865b2a-d68f-4a42-8e23-65c89dd2adcb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1555 microversion: 2.1 time: 0.157572 Jul 18 03:37:05.592269 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3787/7508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:05 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:07.220083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35976747-4535-41ae-9df0-e0ecfa044e31"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:07.221214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:07.228544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:07.229038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:07.229837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:07.231042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:07.470493 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-861005ab-7bed-4f41-8fdd-e15da684cebe tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254670 Jul 18 03:37:07.471144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3722/7509] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:37:07 2022] POST /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:19.213081 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:19.213622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:19.217052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:19.217713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=40 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:19.223486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:19.223934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:19.224714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:19.225179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:19.313023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lazy-loading 'services' on Instance uuid ccb540ce-e45f-4120-8503-0f81fcb1113e {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:37:19.385517 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5cdb09fb-dc6c-49bc-9c10-8f8cb0f2027c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments/35976747-4535-41ae-9df0-e0ecfa044e31" status: 202 len: 0 microversion: 2.1 time: 0.176221 Jul 18 03:37:19.386278 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3788/7510] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:37:19 2022] DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments/35976747-4535-41ae-9df0-e0ecfa044e31 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:37:19.392966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:19.393774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:19.398311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:19.399410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:19.409352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:19.409832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:19.410639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:19.411126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:19.445025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-26aca802-f125-433e-95a8-0d31df18024d tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054020 Jul 18 03:37:19.445607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3723/7511] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:19 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:20.460097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:20.461148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:20.468066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:20.468523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:20.469504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:20.469960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:20.505315 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e0ac1a50-a695-4a5b-a5d6-c75e8cc23af2 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Jul 18 03:37:20.505917 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3789/7512] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:20 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:21.518279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:21.519268 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:21.526727 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:21.527182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:21.528256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:21.528778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:21.560817 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a7f8748-ca70-4bd0-bf97-7497106e9b25 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Jul 18 03:37:21.561683 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3724/7513] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:21 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:22.571936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:22.572900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:22.580143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:22.580597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:22.581409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:22.581854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:22.616481 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-36a970fb-d15f-45da-bd7b-dd5e10d2646b tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048298 Jul 18 03:37:22.617024 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3790/7514] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:22 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:23.628636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:23.629539 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:23.636180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:23.636697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:23.637586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:23.638041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:23.668727 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-92872d53-b57a-4174-b112-7a0f8d4bbadb tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Jul 18 03:37:23.669583 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3725/7515] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:23 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:24.680523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:24.681428 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:24.689187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:24.689650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:24.690457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:24.690907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:24.720545 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6fff32f8-e1f2-4b27-986e-f14a83ab018c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044154 Jul 18 03:37:24.721138 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3791/7516] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:24 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:37:24.732014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:24.732518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:24.739750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:24.740234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:24.741028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:24.741484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:24.817193 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] HTTP exception thrown: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e is not attached to volume 35976747-4535-41ae-9df0-e0ecfa044e31 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Request method failure captured: Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments/35976747-4535-41ae-9df0-e0ecfa044e31 HTTP/1.1 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NVPX2MGnE1mwkQInn9gfuKPDzv1-8GURs7XwI_8RLgKFBEJZTJFuO8OvWNYLd1x_qpSqKutYYEnKFh9g-a1rDJPbWNMkU7dUoGyNRmWN_Kq6LuQS65CNBwfHQVfsnplIooAA4QjbUtxABlDwIMxZfwCrI0oO9NS5oCHCMcOr7sCmoU Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 85121753d7ff42eb8310883df8c850c9 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e is not attached to volume 35976747-4535-41ae-9df0-e0ecfa044e31 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'ccb540ce-e45f-4120-8503-0f81fcb1113e', 'id': '35976747-4535-41ae-9df0-e0ecfa044e31'} Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35976747-4535-41ae-9df0-e0ecfa044e31. Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e is not attached to volume 35976747-4535-41ae-9df0-e0ecfa044e31 Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:37:24.828903 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e is not attached to volume 35976747-4535-41ae-9df0-e0ecfa044e31 Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Returning 404 to user: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e is not attached to volume 35976747-4535-41ae-9df0-e0ecfa044e31 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c74431f-a5b1-4e3d-b2cf-5a95cdf773c8 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments/35976747-4535-41ae-9df0-e0ecfa044e31" status: 404 len: 154 microversion: 2.1 time: 0.103577 Jul 18 03:37:24.833798 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3726/7517] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:37:24 2022] DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e/os-volume_attachments/35976747-4535-41ae-9df0-e0ecfa044e31 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:37:28.164314 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:28.164973 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:28.172109 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:28.172571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:28.173416 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:28.173887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:28.200118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:37:28.286787 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c058000d-c6f3-4845-99ab-20be7ed1c85a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 204 len: 0 microversion: 2.1 time: 0.126028 Jul 18 03:37:28.288143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3792/7518] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:37:28 2022] DELETE /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:37:28.297607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:28.298243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:28.310307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:28.310808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:28.311734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:28.312096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:28.451039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:28.459069 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-092ee29b-a49d-431e-9475-a845581f00c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1561 microversion: 2.1 time: 0.166444 Jul 18 03:37:28.459676 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3727/7519] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:28 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:29.479422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:29.480218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:29.488611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:29.489106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:29.489890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:29.490371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:29.628049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:29.635967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a71c58ef-9ea4-4e3e-bdf6-dd3585990338 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1561 microversion: 2.1 time: 0.161553 Jul 18 03:37:29.636539 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3793/7520] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:29 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:30.655313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:30.656684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:30.665810 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:30.666286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:30.667214 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:30.667549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:30.678047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b2b2615f-7649-4bfd-a1a4-dbd1a2100fc5 req-2eca4735-cdbe-4882-9cfa-f4b04ef9f161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb540ce-e45f-4120-8503-0f81fcb1113e", "name": "network-vif-deleted", "tag": "b0c1f6aa-5f85-473c-9e76-09d9a221a884"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:30.691280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b2b2615f-7649-4bfd-a1a4-dbd1a2100fc5 req-2eca4735-cdbe-4882-9cfa-f4b04ef9f161 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:30.691738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b2b2615f-7649-4bfd-a1a4-dbd1a2100fc5 req-2eca4735-cdbe-4882-9cfa-f4b04ef9f161 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:30.704691 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b2b2615f-7649-4bfd-a1a4-dbd1a2100fc5 req-2eca4735-cdbe-4882-9cfa-f4b04ef9f161 service nova] Creating event network-vif-deleted:b0c1f6aa-5f85-473c-9e76-09d9a221a884 for instance ccb540ce-e45f-4120-8503-0f81fcb1113e on n-h1-849796-1 Jul 18 03:37:30.710966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b2b2615f-7649-4bfd-a1a4-dbd1a2100fc5 req-2eca4735-cdbe-4882-9cfa-f4b04ef9f161 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036349 Jul 18 03:37:30.712132 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3794/7521] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:37:30.764013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:30.773603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-302bd040-bfe7-4ceb-bd0d-f40baa013902 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 200 len: 1519 microversion: 2.1 time: 0.123427 Jul 18 03:37:30.774690 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3728/7522] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:30 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 1519 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:37:31.794017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:31.794740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ccb540ce-e45f-4120-8503-0f81fcb1113e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:31.802325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:31.802788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:31.803587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:31.804034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:31.819459 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] HTTP exception thrown: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Request method failure captured: Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e HTTP/1.1 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NVPX2MGnE1mwkQInn9gfuKPDzv1-8GURs7XwI_8RLgKFBEJZTJFuO8OvWNYLd1x_qpSqKutYYEnKFh9g-a1rDJPbWNMkU7dUoGyNRmWN_Kq6LuQS65CNBwfHQVfsnplIooAA4QjbUtxABlDwIMxZfwCrI0oO9NS5oCHCMcOr7sCmoU Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 85121753d7ff42eb8310883df8c850c9 Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ccb540ce-e45f-4120-8503-0f81fcb1113e'} Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:37:31.821188 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Returning 404 to user: Instance ccb540ce-e45f-4120-8503-0f81fcb1113e could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c81bc7ed-1e85-4e11-9c21-22bea403a0f6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e" status: 404 len: 111 microversion: 2.1 time: 0.034096 Jul 18 03:37:31.826676 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3795/7523] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:31 2022] GET /compute/v2.1/servers/ccb540ce-e45f-4120-8503-0f81fcb1113e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 03:37:31.833225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a726522a-fdd3-48e2-8320-d87343e18a46 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '.version_select at 0x7fab048181f0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:31.864102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a726522a-fdd3-48e2-8320-d87343e18a46 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1127616952" status: 202 len: 0 microversion: 2.1 time: 0.034812 Jul 18 03:37:31.864751 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3729/7524] 10.222.0.67 () {58 vars in 1277 bytes} [Mon Jul 18 03:37:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1127616952 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:37:31.885504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f394a31e-443a-4d49-86ca-7b4b756020e3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: .version_select at 0x7fab05b0c3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1508472755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4299IgmBuhdHjIZQYO93C2VjBrQO8ZEaqhHNdWswXmJ7vytKP4tzsyQz17OGu2GFkdyCfZTmoYtM/MMUNQCPysWV7g0Qnv8BahiiNqhyYMOFMDFcNOprRk5COrDln/+g=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:31.901531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f394a31e-443a-4d49-86ca-7b4b756020e3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:37:31.908538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-f394a31e-443a-4d49-86ca-7b4b756020e3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for user 85121753d7ff42eb8310883df8c850c9 and project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:37:31.939566 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f394a31e-443a-4d49-86ca-7b4b756020e3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058216 Jul 18 03:37:31.940183 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3796/7525] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:37:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:37:31.993378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1334139292", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1508472755", "networks": [{"uuid": "465fbdfb-68a1-4b67-87aa-01309f510a75"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:32.051075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] validate_networks() for [('465fbdfb-68a1-4b67-87aa-01309f510a75', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:37:32.456319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:37:32.456752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:37:32.457286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:37:32.457718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:37:32.458153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:37:32.467931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:32.468406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:32.469278 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:32.469742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:32.487789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:37:32.493623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Getting quotas for user 85121753d7ff42eb8310883df8c850c9 and project b9aa1297cf654afe9c3aa242995ab01d. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:37:32.507724 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:37:32.510102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:37:32.559932 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b193dd4d-9e33-4e00-851f-6797190946ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569599 Jul 18 03:37:32.561481 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3730/7526] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:37:32.572214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-95d7a21b-6707-4357-b788-fb1e754cc439 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:32.573019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-95d7a21b-6707-4357-b788-fb1e754cc439 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:32.637794 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-95d7a21b-6707-4357-b788-fb1e754cc439 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:32.645300 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-95d7a21b-6707-4357-b788-fb1e754cc439 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1263 microversion: 2.1 time: 0.077935 Jul 18 03:37:32.645974 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3797/7527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:32 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:33.665083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:33.665885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:33.673973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:33.674375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:33.675182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:33.675647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:33.752341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:33.767073 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc2cc6c0-4968-47c1-9d8c-a97225a9dd21 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1315 microversion: 2.1 time: 0.104952 Jul 18 03:37:33.777095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3731/7528] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:33 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:34.785148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:34.785773 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:34.794783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:34.795243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:34.796050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:34.796529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:34.941838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:34.951582 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b451364-7c70-43b1-98a3-e8ecf4fba5d6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.170467 Jul 18 03:37:34.952490 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3798/7529] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:34 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:35.455795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-a26ee5d9-0d89-45c4-8702-2d028d0d7481 req-d4dde5fc-e640-4eb2-adc3-156c09aabfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2983c3-8a0e-4748-b59e-731cf0010a0d", "tag": "597571fb-0f17-44c1-a8e4-33b8e0c9afe2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:35.469824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a26ee5d9-0d89-45c4-8702-2d028d0d7481 req-d4dde5fc-e640-4eb2-adc3-156c09aabfb9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:35.470912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-a26ee5d9-0d89-45c4-8702-2d028d0d7481 req-d4dde5fc-e640-4eb2-adc3-156c09aabfb9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:35.486765 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-a26ee5d9-0d89-45c4-8702-2d028d0d7481 req-d4dde5fc-e640-4eb2-adc3-156c09aabfb9 service nova] Creating event network-changed:597571fb-0f17-44c1-a8e4-33b8e0c9afe2 for instance ed2983c3-8a0e-4748-b59e-731cf0010a0d on n-h1-849796-1 Jul 18 03:37:35.492141 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-a26ee5d9-0d89-45c4-8702-2d028d0d7481 req-d4dde5fc-e640-4eb2-adc3-156c09aabfb9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043919 Jul 18 03:37:35.493095 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3732/7530] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:35.970422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:35.971108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:35.978450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:35.978912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:35.979690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:35.980152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:36.114105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:36.122149 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-68da15af-3ceb-4b1e-b76c-f6fb54da9405 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.155721 Jul 18 03:37:36.122727 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3799/7531] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:35 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:37.140370 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:37.141121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:37.148610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:37.149119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:37.149935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:37.150400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:37.297141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:37.305363 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9df9e73-03a0-47e7-92fb-d9496e1447e6 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.169475 Jul 18 03:37:37.305982 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3733/7532] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:37 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:38.326095 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:38.326675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:38.332905 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:38.333398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:38.334266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:38.334681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:38.478799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:38.486751 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b2ba472e-d530-4f4b-9f2a-a0214418d230 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.167458 Jul 18 03:37:38.487343 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3800/7533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:38 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:39.503999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:39.504622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:39.511673 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:39.512777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:39.513766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:39.514937 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:39.665143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:39.673247 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1137869c-14a1-4b7b-8306-b09392c64ca7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.173069 Jul 18 03:37:39.673842 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3734/7534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:39 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:40.690822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:40.691358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:40.698680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:40.699142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:40.700206 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:40.700653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:40.838155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:40.846829 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-925b87cf-fb93-4f5f-95f6-008869669075 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.160007 Jul 18 03:37:40.847420 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3801/7535] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:40 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:41.551740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c5891a3c-e380-4eb1-a37e-5fd229d97166 req-36a38164-9f7e-476f-9203-93216d1fe6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2983c3-8a0e-4748-b59e-731cf0010a0d", "name": "network-vif-plugged", "status": "completed", "tag": "597571fb-0f17-44c1-a8e4-33b8e0c9afe2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:41.561601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c5891a3c-e380-4eb1-a37e-5fd229d97166 req-36a38164-9f7e-476f-9203-93216d1fe6db service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:41.562059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c5891a3c-e380-4eb1-a37e-5fd229d97166 req-36a38164-9f7e-476f-9203-93216d1fe6db service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:41.577569 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c5891a3c-e380-4eb1-a37e-5fd229d97166 req-36a38164-9f7e-476f-9203-93216d1fe6db service nova] Creating event network-vif-plugged:597571fb-0f17-44c1-a8e4-33b8e0c9afe2 for instance ed2983c3-8a0e-4748-b59e-731cf0010a0d on n-h1-849796-1 Jul 18 03:37:41.582869 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c5891a3c-e380-4eb1-a37e-5fd229d97166 req-36a38164-9f7e-476f-9203-93216d1fe6db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Jul 18 03:37:41.583527 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3735/7536] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:41.865468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:41.866244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:41.875423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:41.875874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:41.876686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:41.877175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:42.032692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:42.040599 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4ca814e5-86d7-4e73-a52f-ac319c1dca97 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1363 microversion: 2.1 time: 0.179373 Jul 18 03:37:42.041239 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3802/7537] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:41 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:43.055311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:43.056259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:43.062537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:43.063254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:43.071081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.071544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.072332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.072792 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.217484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:43.225323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-533c7451-a818-459d-acbd-10bfb16f54c5 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1555 microversion: 2.1 time: 0.171006 Jul 18 03:37:43.225927 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3736/7538] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:43 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:43.243607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:43.244259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:43.246892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:43.254167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.254647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.255617 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:43.256097 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:43.390425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:37:43.398080 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4266b75c-7d69-40a7-8f03-9b8391065592 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1555 microversion: 2.1 time: 0.158426 Jul 18 03:37:43.398667 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3803/7539] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:37:43 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:37:44.872982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdef2f17-3769-4aeb-9f5b-8a69941c12ae"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:37:44.874120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:44.881206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:44.881679 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:44.882481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:44.882949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:45.132404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9636f262-303a-4151-9482-7e10b79578ed tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "POST /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263847 Jul 18 03:37:45.133045 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3737/7540] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:37:44 2022] POST /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:55.845067 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:55.845623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:55.847993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:55.848713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:55.855786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:55.855786 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:55.857071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:55.857604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:55.940717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lazy-loading 'services' on Instance uuid ed2983c3-8a0e-4748-b59e-731cf0010a0d {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:37:56.015523 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6187e645-26ee-4290-9b7e-1a8eaf546a33 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments/fdef2f17-3769-4aeb-9f5b-8a69941c12ae" status: 202 len: 0 microversion: 2.1 time: 0.174601 Jul 18 03:37:56.016241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3804/7541] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:37:55 2022] DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments/fdef2f17-3769-4aeb-9f5b-8a69941c12ae => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:37:56.025436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:56.026469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:56.029929 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:56.030624 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:37:56.039325 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:56.039817 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:56.040738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:56.041364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:56.076576 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ae1fd64-4a49-4944-bdf8-b4c8ce52c75e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055500 Jul 18 03:37:56.077490 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3738/7542] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:56 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:57.089379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:57.091086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:57.097672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:57.098133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:57.098910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:57.099376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:57.129763 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2946c727-19c3-48a4-a862-6f7aec9ffa16 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Jul 18 03:37:57.130345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3805/7543] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:57 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:58.142680 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:58.143556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:58.151434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:58.151909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:58.152733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:58.153219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:58.186473 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-441e0cac-7c4f-4bb9-a8be-13329b778264 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Jul 18 03:37:58.187094 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3739/7544] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:58 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:37:59.198521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:37:59.199558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:37:59.206628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:59.207086 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:59.207864 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:37:59.208299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:37:59.239133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0a9435a-55c6-451b-aa2f-77c063abf105 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Jul 18 03:37:59.239594 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3806/7545] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:37:59 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:00.251651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:00.252636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:00.260897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:00.262031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:00.262881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:00.265281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:00.295970 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a856314-a48b-47e4-abb0-125237dcccf7 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048468 Jul 18 03:38:00.296547 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3740/7546] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:38:00 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:01.309605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:01.310676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:01.317804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:01.318264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:01.319054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:01.319504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:01.350417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-143495e0-39c1-4ccf-b7f0-0274747e2100 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045714 Jul 18 03:38:01.350991 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3807/7547] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:38:01 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:38:01.361589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:01.362137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:01.368995 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:01.369485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:01.370256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:01.370716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:01.453743 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] HTTP exception thrown: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d is not attached to volume fdef2f17-3769-4aeb-9f5b-8a69941c12ae Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Request method failure captured: Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments/fdef2f17-3769-4aeb-9f5b-8a69941c12ae HTTP/1.1 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NVPX2MGnE1mwkQInn9gfuKPDzv1-8GURs7XwI_8RLgKFBEJZTJFuO8OvWNYLd1x_qpSqKutYYEnKFh9g-a1rDJPbWNMkU7dUoGyNRmWN_Kq6LuQS65CNBwfHQVfsnplIooAA4QjbUtxABlDwIMxZfwCrI0oO9NS5oCHCMcOr7sCmoU Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 85121753d7ff42eb8310883df8c850c9 Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d is not attached to volume fdef2f17-3769-4aeb-9f5b-8a69941c12ae Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'ed2983c3-8a0e-4748-b59e-731cf0010a0d', 'id': 'fdef2f17-3769-4aeb-9f5b-8a69941c12ae'} Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fdef2f17-3769-4aeb-9f5b-8a69941c12ae. Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d is not attached to volume fdef2f17-3769-4aeb-9f5b-8a69941c12ae Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:01.455378 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d is not attached to volume fdef2f17-3769-4aeb-9f5b-8a69941c12ae Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Returning 404 to user: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d is not attached to volume fdef2f17-3769-4aeb-9f5b-8a69941c12ae {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f5bfc5bf-be90-4f90-89a7-446be50ad662 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments/fdef2f17-3769-4aeb-9f5b-8a69941c12ae" status: 404 len: 154 microversion: 2.1 time: 0.099290 Jul 18 03:38:01.460038 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3741/7548] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:38:01 2022] DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d/os-volume_attachments/fdef2f17-3769-4aeb-9f5b-8a69941c12ae => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:38:04.831876 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:04.832503 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:04.840358 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:04.840817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:04.841645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:04.842099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:04.872290 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:38:04.955335 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b93848d2-86ce-48f9-982d-161fb88638c3 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 204 len: 0 microversion: 2.1 time: 0.128184 Jul 18 03:38:04.955935 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3808/7549] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:38:04 2022] DELETE /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:38:04.964751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:04.965476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:04.973657 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:04.974123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:04.974945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:04.975395 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:05.118573 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:05.126932 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82169902-54fe-4c13-8589-13afc569f40c tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1561 microversion: 2.1 time: 0.166597 Jul 18 03:38:05.127510 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3742/7550] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:04 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:06.145604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:06.146232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:06.153422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:06.153886 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:06.154674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:06.155120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:06.287761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:06.295902 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5d096e2f-0921-44c1-868f-aef05e16121e tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1561 microversion: 2.1 time: 0.154737 Jul 18 03:38:06.296492 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3809/7551] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:06 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:07.275875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-4525e94d-36e5-4e1a-89cc-db7d4a1a80d0 req-bd220036-a403-4bd4-83ac-a4756b72e1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2983c3-8a0e-4748-b59e-731cf0010a0d", "name": "network-vif-deleted", "tag": "597571fb-0f17-44c1-a8e4-33b8e0c9afe2"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:07.288778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4525e94d-36e5-4e1a-89cc-db7d4a1a80d0 req-bd220036-a403-4bd4-83ac-a4756b72e1f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:07.289606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-4525e94d-36e5-4e1a-89cc-db7d4a1a80d0 req-bd220036-a403-4bd4-83ac-a4756b72e1f8 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:07.305338 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-4525e94d-36e5-4e1a-89cc-db7d4a1a80d0 req-bd220036-a403-4bd4-83ac-a4756b72e1f8 service nova] Creating event network-vif-deleted:597571fb-0f17-44c1-a8e4-33b8e0c9afe2 for instance ed2983c3-8a0e-4748-b59e-731cf0010a0d on n-h1-849796-1 Jul 18 03:38:07.313606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:07.314191 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-4525e94d-36e5-4e1a-89cc-db7d4a1a80d0 req-bd220036-a403-4bd4-83ac-a4756b72e1f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041556 Jul 18 03:38:07.314805 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3743/7552] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:07.317469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:07.326242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:07.326734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:07.327662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:07.328177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:07.401596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85121753d7ff42eb8310883df8c850c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa1297cf654afe9c3aa242995ab01d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:07.415808 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9ad5b3e-99d9-471c-8961-98b98fae115a tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 200 len: 1348 microversion: 2.1 time: 0.102307 Jul 18 03:38:07.416525 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3810/7553] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:07 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:08.436235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:08.437005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] [instance: ed2983c3-8a0e-4748-b59e-731cf0010a0d] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:08.443351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:08.443757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:08.444543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:08.445027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:08.458610 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] HTTP exception thrown: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Request method failure captured: Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d HTTP/1.1 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NVPX2MGnE1mwkQInn9gfuKPDzv1-8GURs7XwI_8RLgKFBEJZTJFuO8OvWNYLd1x_qpSqKutYYEnKFh9g-a1rDJPbWNMkU7dUoGyNRmWN_Kq6LuQS65CNBwfHQVfsnplIooAA4QjbUtxABlDwIMxZfwCrI0oO9NS5oCHCMcOr7sCmoU Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b9aa1297cf654afe9c3aa242995ab01d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b9aa1297cf654afe9c3aa242995ab01d Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-896918414 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 85121753d7ff42eb8310883df8c850c9 Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestEncryptedCinderVolumes-896918414-project Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': 'ed2983c3-8a0e-4748-b59e-731cf0010a0d'} Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:38:08.460271 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Returning 404 to user: Instance ed2983c3-8a0e-4748-b59e-731cf0010a0d could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75247b7b-f5e1-4d9e-92a4-f94fb1f8b671 tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jul 18 03:38:08.466369 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3744/7554] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:08 2022] GET /compute/v2.1/servers/ed2983c3-8a0e-4748-b59e-731cf0010a0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:38:08.471024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3205260b-ca13-4f82-a6a6-87350af0847f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] Calling method '.version_select at 0x7fab056945e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:08.490116 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3205260b-ca13-4f82-a6a6-87350af0847f tempest-TestEncryptedCinderVolumes-896918414 tempest-TestEncryptedCinderVolumes-896918414-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1508472755" status: 202 len: 0 microversion: 2.1 time: 0.022838 Jul 18 03:38:08.490706 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3811/7555] 10.222.0.67 () {58 vars in 1277 bytes} [Mon Jul 18 03:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1508472755 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:38:36.902703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6201e7d6-e8a5-4f2f-86e1-ad339eef0167 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: .version_select at 0x7fab04818b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-766170603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNDBJCNRD6YgVrCT/ft5x6bIZ3st0sfRIy+Iu0+LEk1bvRquWqhQDogYN5mYvI0FZ+L8KVBavzlJWYtfcJU6KAQwENN2MydUvL9NswSVy+o1qxc1yGV9cCjiBo4NJvdA=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:36.907568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=14 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:36.908292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=34 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:36.921660 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6201e7d6-e8a5-4f2f-86e1-ad339eef0167 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:38:36.927389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6201e7d6-e8a5-4f2f-86e1-ad339eef0167 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for user d802b9cf1d6f498f84d675e2124698d3 and project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:38:36.956103 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6201e7d6-e8a5-4f2f-86e1-ad339eef0167 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058428 Jul 18 03:38:36.956722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3745/7556] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:38:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:38:37.024452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:37.025310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:37.031442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1840358550", "imageRef": "3def4c1b-349b-4b5d-afc9-43500e2571ca", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-766170603", "networks": [{"uuid": "b3a7a584-ed4e-492f-88f7-a9af9deab7fa"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:37.094041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] validate_networks() for [('b3a7a584-ed4e-492f-88f7-a9af9deab7fa', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:38:37.569334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:38:37.569772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:38:37.570262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:38:37.570687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:38:37.571115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:38:37.582367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:37.582831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:37.583740 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:37.584132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:37.610717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:38:37.617340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for user d802b9cf1d6f498f84d675e2124698d3 and project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:38:37.633104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:38:37.635578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3def4c1b-349b-4b5d-afc9-43500e2571ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:38:37.689228 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2dc58c80-9672-4962-9fc8-a05c41f80a0f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666611 Jul 18 03:38:37.690503 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3812/7557] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 03:38:37.703496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b04a47d4-622d-408f-a3d7-5ea8f0501674 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:37.704487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b04a47d4-622d-408f-a3d7-5ea8f0501674 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:37.770888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b04a47d4-622d-408f-a3d7-5ea8f0501674 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:37.781140 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b04a47d4-622d-408f-a3d7-5ea8f0501674 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1258 microversion: 2.1 time: 0.084209 Jul 18 03:38:37.785738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3746/7558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:37 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:38:38.806471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:38.807078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:38.817409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:38.818897 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:38.820906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:38.821892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:38.937801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:38.951087 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8e171361-4cc6-48b5-ac68-2d7e8ada27e1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1318 microversion: 2.1 time: 0.151439 Jul 18 03:38:38.952181 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3813/7559] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:38 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:39.975446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:39.976333 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:39.998146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:39.998780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:39.999846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:40.000576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:40.215250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:40.232025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c2b02303-8bbd-46fb-aa10-27c817a0d23e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.264488 Jul 18 03:38:40.232638 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3747/7560] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:39 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:41.252586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:41.254048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:41.262339 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:41.263134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:41.264018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:41.264544 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:41.441816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:41.458653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fd43f05e-719c-427f-98de-332dd1861dc2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.209780 Jul 18 03:38:41.459877 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3814/7561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:41 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:38:42.482761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:42.483462 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:42.490692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:42.491148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:42.491939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:42.492423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:42.667136 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:42.687611 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eeade1cf-4bf4-4282-95c9-30ad254f16e9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.209659 Jul 18 03:38:42.699311 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3748/7562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:42 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:43.704937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:43.705553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:43.712629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:43.713121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:43.714576 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:43.715023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:43.873132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:43.881066 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26c7e18b-9f5c-4ea5-8b36-e29532ede52d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.180072 Jul 18 03:38:43.881856 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3815/7563] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:43 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:44.899553 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:44.900316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:44.908645 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:44.909157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:44.909978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:44.910446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:45.068858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:45.079442 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0e2c5bca-8cd0-4582-b7bf-ffcfc48d1304 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.184522 Jul 18 03:38:45.081379 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3749/7564] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:44 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:46.096954 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:46.097548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:46.105798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:46.106365 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:46.107248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:46.107789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:46.248130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:46.256278 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2995ccda-e613-440e-833e-cc1506bd9947 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.163320 Jul 18 03:38:46.256864 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3816/7565] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:46 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:47.273380 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:47.274016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:47.282639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:47.283130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:47.283917 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:47.284383 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:47.426050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:47.434339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7d78c59b-2000-475a-ab9b-d0988e6231ea tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.164828 Jul 18 03:38:47.435087 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3750/7566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:47 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:48.452124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:48.452765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:48.455443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:48.456220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:48.462470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:48.462928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:48.463704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:48.464827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:48.601604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:48.609429 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9b1f9e3e-87e4-4937-bc12-fd274ff9fc21 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.161881 Jul 18 03:38:48.610006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3817/7567] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:48 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:49.626469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:49.627216 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:49.629425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:38:49.636277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:49.636750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:49.637571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:49.638027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:49.772743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:49.781718 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-abd2cd3b-eb9e-4182-900f-cc1b856829d8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.159176 Jul 18 03:38:49.782343 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3751/7568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:49 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:50.799578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:50.800211 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:50.807325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:50.808650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:50.809917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:50.810372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:50.946820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:50.955436 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5ebb0f42-aad0-4b4c-92d2-187ffe47caec tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.159945 Jul 18 03:38:50.956092 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3818/7569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:50 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:51.679617 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-c06f5148-7f87-45df-9bd1-7d1c5bd5dc4e req-6f0e493e-b8e9-4a3f-b852-c568242806b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:51.695418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c06f5148-7f87-45df-9bd1-7d1c5bd5dc4e req-6f0e493e-b8e9-4a3f-b852-c568242806b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.695890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-c06f5148-7f87-45df-9bd1-7d1c5bd5dc4e req-6f0e493e-b8e9-4a3f-b852-c568242806b7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.715555 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-c06f5148-7f87-45df-9bd1-7d1c5bd5dc4e req-6f0e493e-b8e9-4a3f-b852-c568242806b7 service nova] Creating event network-changed:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:38:51.722403 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-c06f5148-7f87-45df-9bd1-7d1c5bd5dc4e req-6f0e493e-b8e9-4a3f-b852-c568242806b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047683 Jul 18 03:38:51.723397 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3752/7570] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:38:51.972372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:51.973049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:51.979839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.980294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:51.981187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:51.981648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:52.121795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:52.129635 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fa542db6-c488-4f47-afa0-e8403edfa07c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.161261 Jul 18 03:38:52.130241 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3819/7571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:51 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:53.149393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:53.150184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:53.157267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:53.157739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:53.158537 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:53.158991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:53.301509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:53.310078 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0c37401d-73ea-47aa-8b26-4364ad8580f2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.165901 Jul 18 03:38:53.310679 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3753/7572] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:53 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:54.328741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:54.329685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:54.338013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:54.338433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:54.339263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:54.339734 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:54.493143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:54.506418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-23daf100-9d57-4b36-a50a-4fae5fb5aa55 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.181783 Jul 18 03:38:54.507520 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3820/7573] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:54 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:55.524102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:55.524646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:55.531911 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:55.532382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:55.533209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:55.533667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:55.662520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:55.670525 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bed8d13a-c274-41c4-9d6f-30509d1e686d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.150456 Jul 18 03:38:55.671112 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3754/7574] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:55 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:56.686892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:56.687514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:56.694934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:56.695400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:56.696186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:56.696636 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:56.829892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:56.837427 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e61fc8e-9e77-4c5c-8133-4d76c50e51fe tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.154423 Jul 18 03:38:56.838014 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3821/7575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:56 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:57.855684 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:57.856311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:57.863285 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:57.863780 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:57.864578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:57.865060 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:57.953003 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ded7f940-37f4-451d-957a-72dd3b3f6575 req-68cb9edb-f9c9-41fa-ae0c-3efc3d3d5ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "name": "network-vif-plugged", "status": "completed", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:38:57.963232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ded7f940-37f4-451d-957a-72dd3b3f6575 req-68cb9edb-f9c9-41fa-ae0c-3efc3d3d5ced service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:57.963797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ded7f940-37f4-451d-957a-72dd3b3f6575 req-68cb9edb-f9c9-41fa-ae0c-3efc3d3d5ced service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:57.976454 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ded7f940-37f4-451d-957a-72dd3b3f6575 req-68cb9edb-f9c9-41fa-ae0c-3efc3d3d5ced service nova] Creating event network-vif-plugged:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:38:57.982783 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ded7f940-37f4-451d-957a-72dd3b3f6575 req-68cb9edb-f9c9-41fa-ae0c-3efc3d3d5ced service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Jul 18 03:38:57.983953 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3822/7576] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:38:58.009651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:58.019426 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-75b09872-71aa-4477-8c3e-9663bef3563d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.168097 Jul 18 03:38:58.020508 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3755/7577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:57 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:38:59.039168 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:38:59.039879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:38:59.047337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:59.047801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:59.048587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:38:59.049063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:38:59.512344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:38:59.521025 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-96eca391-a067-4826-adb8-0818f8fbf3ab tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1358 microversion: 2.1 time: 0.487358 Jul 18 03:38:59.521809 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3823/7578] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:38:59 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:00.539256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:00.539800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:00.547779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.548252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.549090 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.549549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.696516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:00.705013 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-297ee2de-ab3b-4999-b9eb-cb6618e6d9d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1545 microversion: 2.1 time: 0.169784 Jul 18 03:39:00.705596 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3756/7579] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:00 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1545 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:00.721806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:00.722420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:00.729757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.730797 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.731569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.732010 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.860328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:00.868244 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c79270ff-e091-4bef-9f3d-fe29ca61d5fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1545 microversion: 2.1 time: 0.150327 Jul 18 03:39:00.868829 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3824/7580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:00 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1545 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:00.884367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:00.887921 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:00.888700 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Searching by: {'deleted': False, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 03:39:00.894240 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.894707 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.895527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.895982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.921570 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 03:39:00.948412 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3d97ebc0-abb0-479b-9b23-af4d189bd4f5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068098 Jul 18 03:39:00.949128 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3757/7581] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 03:39:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:39:00.967500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:00.968159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:00.974283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.974739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:00.975509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:00.975949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:01.121169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:01.129254 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0b0cba21-4c4b-40d1-9a57-f60afa104bf5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1545 microversion: 2.1 time: 0.172928 Jul 18 03:39:01.129834 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3825/7582] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:00 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1545 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:02.668644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "221c78ab-af4e-435a-b4bd-aab7284ace71"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:02.669781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:02.676671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:02.677185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:02.677978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:02.678436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:02.920104 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-064a2c9f-a1ab-4cfd-9cfb-800917e1589e tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255316 Jul 18 03:39:02.920860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3758/7583] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:39:02 2022] POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:39:16.987929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:16.988548 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:16.991543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:16.992407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=76 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:16.999293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:16.999756 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:17.000546 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:17.001033 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:17.137363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:17.145508 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3da11680-526f-4eb6-a276-01ebd20d4ef9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1591 microversion: 2.1 time: 0.161433 Jul 18 03:39:17.146103 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3826/7584] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:16 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1591 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:18.858837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:18.859968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:18.860606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:39:19.041479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-3401b141-cadf-4233-a3b3-d50872eb5bb6 req-f52e2344-7f44-448c-9fd6-8963517bba70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:19.051016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3401b141-cadf-4233-a3b3-d50872eb5bb6 req-f52e2344-7f44-448c-9fd6-8963517bba70 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:19.051757 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-3401b141-cadf-4233-a3b3-d50872eb5bb6 req-f52e2344-7f44-448c-9fd6-8963517bba70 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:19.064089 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-3401b141-cadf-4233-a3b3-d50872eb5bb6 req-f52e2344-7f44-448c-9fd6-8963517bba70 service nova] Creating event network-changed:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:39:19.069312 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-3401b141-cadf-4233-a3b3-d50872eb5bb6 req-f52e2344-7f44-448c-9fd6-8963517bba70 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212341 Jul 18 03:39:19.070205 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3759/7585] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:39:19.951325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-499099482"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:19.952190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:19.959702 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:19.960184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:19.961066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:19.961608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:20.095792 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.network.security_group_api [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Adding security group 747efc2f-78e6-4db1-9255-753cce6917dc to port a01738da-f216-41aa-bae6-472e9003ba19 Jul 18 03:39:20.463215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-acd6dd19-6b6a-4f3f-a945-f245006648c7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action" status: 202 len: 0 microversion: 2.1 time: 0.515995 Jul 18 03:39:20.465632 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3827/7586] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:39:19 2022] POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:39:20.475433 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:39:20.476175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:39:20.485654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:20.491768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:20.493073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:20.493730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:20.668123 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:39:20.676606 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-19608d60-0b96-4449-92be-95ef2d221377 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1756 microversion: 2.1 time: 0.206796 Jul 18 03:39:20.677940 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3760/7587] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:39:20 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:39:21.085446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ff55fe5a-7319-4a47-a265-6fbcd2fad4de req-f60c8085-1463-4343-a727-1cabb65529ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:39:21.096115 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ff55fe5a-7319-4a47-a265-6fbcd2fad4de req-f60c8085-1463-4343-a727-1cabb65529ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:39:21.097316 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ff55fe5a-7319-4a47-a265-6fbcd2fad4de req-f60c8085-1463-4343-a727-1cabb65529ed service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:39:21.110200 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ff55fe5a-7319-4a47-a265-6fbcd2fad4de req-f60c8085-1463-4343-a727-1cabb65529ed service nova] Creating event network-changed:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:39:21.116023 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ff55fe5a-7319-4a47-a265-6fbcd2fad4de req-f60c8085-1463-4343-a727-1cabb65529ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035334 Jul 18 03:39:21.117006 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3828/7588] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:41:01.239944 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:01.240627 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:01.802575 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:01.803412 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:01.925618 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:41:01.925837 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:41:42.183748 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:41:42.185015 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:41:42.185546 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:42.186312 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:42.191252 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:41:42.192218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:42.199784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:42.200335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:42.201170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:42.201638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:42.284011 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5bcc9311-7d94-4923-9e36-28264192d656 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action" status: 202 len: 0 microversion: 2.1 time: 0.102063 Jul 18 03:41:42.284677 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3761/7589] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:41:42 2022] POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:41:42.291596 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:41:42.293137 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:41:42.293987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:42.294722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:41:42.299078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:42.299789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:42.308079 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:42.309348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:42.310534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:42.311363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:42.536333 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:42.546545 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b9cb1900-0bbd-43b3-8402-df218cb15e9a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1758 microversion: 2.1 time: 0.256845 Jul 18 03:41:42.547363 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3829/7590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:42 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1758 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:41:43.566129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:41:43.566848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:41:43.575092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:43.575558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:43.576354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:41:43.576832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:41:43.594881 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 54544. Jul 18 03:41:43.595610 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 54542. Jul 18 03:41:43.794067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:41:43.802253 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-db4beee6-65f8-4cfa-8111-1eb5868a0518 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1756 microversion: 2.1 time: 0.241745 Jul 18 03:41:43.802864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3762/7591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:41:43 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:42:41.223637 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:42:41.224446 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:42:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:43:27.975793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:27.976595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:27.989479 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 54586. Jul 18 03:43:27.990253 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 54588. Jul 18 03:43:28.036650 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-499099482"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:28.037232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:28.043400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:28.043867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:28.044700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:28.045177 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:28.175957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.network.security_group_api [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Removing security group 747efc2f-78e6-4db1-9255-753cce6917dc from port a01738da-f216-41aa-bae6-472e9003ba19 Jul 18 03:43:28.535629 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-45507937-52e7-4d35-bcce-df7c37bcf9fd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action" status: 202 len: 0 microversion: 2.1 time: 0.563736 Jul 18 03:43:28.537503 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3830/7592] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:43:27 2022] POST /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:43:28.548361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-11ba8a45-fb7c-4a06-ab22-a589b565f5b9 req-3b2bac6a-da53-4785-a9db-4925d87560a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:28.552332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:28.552984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:28.559213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-11ba8a45-fb7c-4a06-ab22-a589b565f5b9 req-3b2bac6a-da53-4785-a9db-4925d87560a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:28.559687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-11ba8a45-fb7c-4a06-ab22-a589b565f5b9 req-3b2bac6a-da53-4785-a9db-4925d87560a3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:28.574854 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-11ba8a45-fb7c-4a06-ab22-a589b565f5b9 req-3b2bac6a-da53-4785-a9db-4925d87560a3 service nova] Creating event network-changed:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:43:28.583488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-11ba8a45-fb7c-4a06-ab22-a589b565f5b9 req-3b2bac6a-da53-4785-a9db-4925d87560a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040689 Jul 18 03:43:28.584756 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3763/7593] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:29.816727 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:29.817279 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:29.823449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:29.823917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:29.824708 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:29.825203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:29.910606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lazy-loading 'services' on Instance uuid d836adca-80ce-45a4-beb2-1bf4c1e96264 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:43:29.993437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3a348832-01ce-46a8-bf8d-9aa3c8b1d309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments/221c78ab-af4e-435a-b4bd-aab7284ace71" status: 202 len: 0 microversion: 2.1 time: 0.182038 Jul 18 03:43:29.997436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3831/7594] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:43:29 2022] DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments/221c78ab-af4e-435a-b4bd-aab7284ace71 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:43:30.004469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:30.006286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:30.014135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:30.014761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:30.015682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:30.016208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:30.065015 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4132514b-c3dc-440e-861a-cfc3a901e30d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065891 Jul 18 03:43:30.065607 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3764/7595] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:29 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:30.613319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-a94cb3b8-f495-4104-b809-068096140df1 req-c4f93df1-a23f-4739-b0f9-6a814c9469de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:30.622768 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a94cb3b8-f495-4104-b809-068096140df1 req-c4f93df1-a23f-4739-b0f9-6a814c9469de service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:30.623476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-a94cb3b8-f495-4104-b809-068096140df1 req-c4f93df1-a23f-4739-b0f9-6a814c9469de service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:30.636967 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-a94cb3b8-f495-4104-b809-068096140df1 req-c4f93df1-a23f-4739-b0f9-6a814c9469de service nova] Creating event network-changed:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:43:30.642981 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-a94cb3b8-f495-4104-b809-068096140df1 req-c4f93df1-a23f-4739-b0f9-6a814c9469de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033891 Jul 18 03:43:30.643855 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3832/7596] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:31.079548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:31.081439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:31.091445 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:31.092667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:31.093591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:31.094804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:31.131866 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0718b1b7-475a-4b1d-8892-5206f92b8495 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058726 Jul 18 03:43:31.132995 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3765/7597] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:31 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:32.145397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:32.146580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:32.153402 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:32.153865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:32.154754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:32.155129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:32.190661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4aeacbe-de1a-4d74-b845-9fa8d1db6309 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050600 Jul 18 03:43:32.191252 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3833/7598] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:32 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:33.202833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:33.203778 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:33.210900 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:33.211365 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:33.212149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:33.212592 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:33.243520 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e59881fc-cb89-454f-be1c-efaa463cd222 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Jul 18 03:43:33.243988 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3766/7599] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:33 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:34.255986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:34.256744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:34.265455 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:34.265921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:34.266738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:34.267191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:34.299379 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c25420d6-9251-417e-bfb0-0ff196d2cd29 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047868 Jul 18 03:43:34.299963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3834/7600] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:34 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:35.312991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:35.313950 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:35.320979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:35.321456 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:35.322249 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:35.322708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:35.360277 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d196135d-546e-46f3-8611-51af24d727b9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052428 Jul 18 03:43:35.360854 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3767/7601] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:43:35 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 03:43:35.370815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:35.371348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:35.379388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:35.379848 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:35.380633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:35.381118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:35.458506 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] HTTP exception thrown: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 is not attached to volume 221c78ab-af4e-435a-b4bd-aab7284ace71 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Request method failure captured: Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: request: DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments/221c78ab-af4e-435a-b4bd-aab7284ace71 HTTP/1.1 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NWtmPfEoJQmiRWRSMe5CUbhF4Hdr3kAIJ9FXsBNz9TgKJe6mBPo5vaTsApxgXTf_VMS5ExWkZmKVfYr7ldl3Gm6sHi2xYoRKNtPB83e53SynBd5YgXiE9yycfzI4iTOhzsYVkRWnT_zVVN6wyxgQVveqEkU-BjrJCy6tCp6TWsdurg Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d802b9cf1d6f498f84d675e2124698d3 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 is not attached to volume 221c78ab-af4e-435a-b4bd-aab7284ace71 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'server_id': 'd836adca-80ce-45a4-beb2-1bf4c1e96264', 'id': '221c78ab-af4e-435a-b4bd-aab7284ace71'} Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 221c78ab-af4e-435a-b4bd-aab7284ace71. Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 is not attached to volume 221c78ab-af4e-435a-b4bd-aab7284ace71 Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:43:35.460471 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 is not attached to volume 221c78ab-af4e-435a-b4bd-aab7284ace71 Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Returning 404 to user: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 is not attached to volume 221c78ab-af4e-435a-b4bd-aab7284ace71 {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3dc97086-a40b-4875-9132-46c0b602d14b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments/221c78ab-af4e-435a-b4bd-aab7284ace71" status: 404 len: 154 microversion: 2.1 time: 0.095233 Jul 18 03:43:35.464834 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3835/7602] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:43:35 2022] DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264/os-volume_attachments/221c78ab-af4e-435a-b4bd-aab7284ace71 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:43:38.715130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:38.715662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:38.723820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:38.724288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:38.725133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:38.725595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:38.751971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:43:38.836112 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ceacf3e6-e875-43a4-9fd9-b1188d47c574 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 204 len: 0 microversion: 2.1 time: 0.124701 Jul 18 03:43:38.837082 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3768/7603] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:43:38 2022] DELETE /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 03:43:38.845612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:38.846936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:38.855510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:38.855970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:38.857738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:38.857738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:38.995255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:39.004507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-670aa496-3f4c-49ad-83c7-3de851b75f02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1551 microversion: 2.1 time: 0.163419 Jul 18 03:43:39.005116 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3836/7604] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:38 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:40.023071 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:40.023798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:40.031331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:40.031802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:40.032600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:40.033094 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:40.481601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:40.490718 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5fe90940-4d8c-4a1c-821f-a3a68448098c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1551 microversion: 2.1 time: 0.471999 Jul 18 03:43:40.491329 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3769/7605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:40 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1551 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:41.191047 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-7493d26b-668c-467e-a9fd-eb541e814f2e req-6a6b87fa-87b5-498a-a351-8cdfd0f40cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d836adca-80ce-45a4-beb2-1bf4c1e96264", "name": "network-vif-deleted", "tag": "a01738da-f216-41aa-bae6-472e9003ba19"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:41.199959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7493d26b-668c-467e-a9fd-eb541e814f2e req-6a6b87fa-87b5-498a-a351-8cdfd0f40cd3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:41.200451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-7493d26b-668c-467e-a9fd-eb541e814f2e req-6a6b87fa-87b5-498a-a351-8cdfd0f40cd3 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:41.214085 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-7493d26b-668c-467e-a9fd-eb541e814f2e req-6a6b87fa-87b5-498a-a351-8cdfd0f40cd3 service nova] Creating event network-vif-deleted:a01738da-f216-41aa-bae6-472e9003ba19 for instance d836adca-80ce-45a4-beb2-1bf4c1e96264 on n-h1-849796-1 Jul 18 03:43:41.220048 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-7493d26b-668c-467e-a9fd-eb541e814f2e req-6a6b87fa-87b5-498a-a351-8cdfd0f40cd3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094045 Jul 18 03:43:41.220840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3837/7606] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:41.507774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:41.508407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:41.516654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:41.517170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:41.518198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:41.518819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:41.558204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:41.558655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:41.559120 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lazy-loading 'fault' on Instance uuid d836adca-80ce-45a4-beb2-1bf4c1e96264 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:43:41.605676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:41.612937 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5634a1df-9281-46f3-b00e-85889f44d14d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 200 len: 1348 microversion: 2.1 time: 0.109131 Jul 18 03:43:41.613530 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3770/7607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:41 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:43:42.632649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:42.633388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: d836adca-80ce-45a4-beb2-1bf4c1e96264] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:42.640785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:42.641342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:42.642162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:42.642613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:42.656836 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] HTTP exception thrown: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Request method failure captured: Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 HTTP/1.1 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NWtmPfEoJQmiRWRSMe5CUbhF4Hdr3kAIJ9FXsBNz9TgKJe6mBPo5vaTsApxgXTf_VMS5ExWkZmKVfYr7ldl3Gm6sHi2xYoRKNtPB83e53SynBd5YgXiE9yycfzI4iTOhzsYVkRWnT_zVVN6wyxgQVveqEkU-BjrJCy6tCp6TWsdurg Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d802b9cf1d6f498f84d675e2124698d3 Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'd836adca-80ce-45a4-beb2-1bf4c1e96264'} Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:43:42.658504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Returning 404 to user: Instance d836adca-80ce-45a4-beb2-1bf4c1e96264 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dc45aec2-0ff8-40fd-b9b8-1f916a0fcdd6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264" status: 404 len: 111 microversion: 2.1 time: 0.032455 Jul 18 03:43:42.663302 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3838/7608] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:42 2022] GET /compute/v2.1/servers/d836adca-80ce-45a4-beb2-1bf4c1e96264 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:43:42.668791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4ef934f4-c81e-4883-9ea8-b7f78d7a0423 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '.version_select at 0x7fab04765310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:42.693131 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4ef934f4-c81e-4883-9ea8-b7f78d7a0423 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-766170603" status: 202 len: 0 microversion: 2.1 time: 0.028121 Jul 18 03:43:42.693724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3771/7609] 10.222.0.67 () {58 vars in 1268 bytes} [Mon Jul 18 03:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-766170603 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:43:51.733697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2d9866b5-6848-4c77-8262-e087cdd5b1b7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: .version_select at 0x7fab05bf91f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1983156301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpanjjsMXBDw6dIAbqVIVy8owX9soDT1JpI0LxjxdcqU13HSmdLRDx+Hhen+0hXkTeIXQZvWXW2liMvDkjc68GGAoYYLNtlesU1D5nj3sjT89OA45FxLj0M1KU73ch+Bg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:51.749963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2d9866b5-6848-4c77-8262-e087cdd5b1b7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:43:51.755026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2d9866b5-6848-4c77-8262-e087cdd5b1b7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for user d802b9cf1d6f498f84d675e2124698d3 and project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:43:51.782245 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2d9866b5-6848-4c77-8262-e087cdd5b1b7 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052691 Jul 18 03:43:51.782859 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3839/7610] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:43:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:43:51.828974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:51.833189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2041355481", "imageRef": "5ee23a51-6e92-4c71-94d1-cfd61acda58a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1983156301", "networks": [{"uuid": "b3a7a584-ed4e-492f-88f7-a9af9deab7fa"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:43:51.885649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] validate_networks() for [('b3a7a584-ed4e-492f-88f7-a9af9deab7fa', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:43:52.327755 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:43:52.328197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:43:52.328687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:43:52.329152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:43:52.329579 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:43:52.338652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:52.339113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:52.339933 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:52.340391 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:52.358889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:43:52.364165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Getting quotas for user d802b9cf1d6f498f84d675e2124698d3 and project 6f6ddd6f40eb42438df1d59a5703c2c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:43:52.377545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:43:52.379796 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee23a51-6e92-4c71-94d1-cfd61acda58a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:43:52.426218 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aac5d5b2-0b4b-4641-ab25-ef1849f6a0bd tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599225 Jul 18 03:43:52.426875 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3772/7611] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:43:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:43:52.436960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-db844734-cc01-488a-927c-ffc51f566e95 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:52.437577 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-db844734-cc01-488a-927c-ffc51f566e95 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:52.500008 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-db844734-cc01-488a-927c-ffc51f566e95 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:52.506880 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-db844734-cc01-488a-927c-ffc51f566e95 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1259 microversion: 2.1 time: 0.073915 Jul 18 03:43:52.507456 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3840/7612] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:52 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:53.525017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:53.526183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:53.536799 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:53.537299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:53.538100 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:53.538555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:53.614723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:53.623035 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-387543ac-38e0-488a-8777-49d9a91ca00d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1317 microversion: 2.1 time: 0.103103 Jul 18 03:43:53.628294 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3773/7613] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:53 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:54.645012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:54.645755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:54.647755 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:54.656148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:54.656898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:54.657718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:54.658159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:54.799972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:54.808103 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eda78677-d952-4fca-8b73-f2f4f9cc3b9b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.166931 Jul 18 03:43:54.808782 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3841/7614] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:54 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:55.825453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:55.826777 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:55.835372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:55.835936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:55.836847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:55.837408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:55.990996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:55.999736 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-97093903-56bc-4195-b432-858589777047 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.177918 Jul 18 03:43:56.000652 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3774/7615] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:55 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:57.017880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:57.018493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:57.025984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:57.026536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:57.027404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:57.027918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:57.168940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:57.178740 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-32830300-b47d-444f-9da1-1aee24b402d4 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.165392 Jul 18 03:43:57.179358 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3842/7616] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:57 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:58.196181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:58.196749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:58.204097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:58.204576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:58.205418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:58.205912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:58.369158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:58.377655 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4c27d5ad-97c4-421a-881e-f5af8c8db0fc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.185805 Jul 18 03:43:58.378478 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3775/7617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:58 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:43:59.396862 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:43:59.397743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:43:59.400247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:43:59.406827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:59.407267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:59.408160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:43:59.408680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:43:59.561374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:43:59.569438 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fc8c1250-79a4-4e7e-b134-d90817694980 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.177117 Jul 18 03:43:59.570035 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3843/7618] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:43:59 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:00.589655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:00.590124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:00.593603 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:00.598640 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:00.599112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:00.599910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:00.600361 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:00.790824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:00.797468 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-06497d40-7b23-486d-a660-939e6dc8e366 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.211774 Jul 18 03:44:00.798090 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3776/7619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:00 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:01.815051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:01.815725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:01.822872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:01.823329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:01.824106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:01.824553 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:01.971825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:01.979395 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-07ccf98c-c132-4e33-9023-d3b38b3a181d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.168490 Jul 18 03:44:01.980232 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3844/7620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:01 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:44:02.997195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:02.997836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:03.000535 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:03.001271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:03.007051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:03.007517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:03.008304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:03.008758 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:03.149913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:03.158137 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b1659c00-4349-4df0-b6a4-beb033224bbf tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.165043 Jul 18 03:44:03.158722 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3777/7621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:02 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:04.175600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:04.176198 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:04.178127 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:04.184753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:04.185347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:04.186139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:04.186658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:04.322788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:04.333739 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f3bbfef-97d5-46da-96c1-30b7a9114e88 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.161921 Jul 18 03:44:04.333739 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3845/7622] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:04 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:05.350948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:05.351779 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:05.359959 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:05.360429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:05.361311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:05.361774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:05.551647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c29da64c-0972-42d5-8702-2ddccf2a9b64 req-a342607f-99ff-4256-83f1-2a356f85e7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:05.562762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c29da64c-0972-42d5-8702-2ddccf2a9b64 req-a342607f-99ff-4256-83f1-2a356f85e7c4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:05.563223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c29da64c-0972-42d5-8702-2ddccf2a9b64 req-a342607f-99ff-4256-83f1-2a356f85e7c4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:05.575952 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c29da64c-0972-42d5-8702-2ddccf2a9b64 req-a342607f-99ff-4256-83f1-2a356f85e7c4 service nova] Creating event network-changed:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:44:05.582397 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c29da64c-0972-42d5-8702-2ddccf2a9b64 req-a342607f-99ff-4256-83f1-2a356f85e7c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036122 Jul 18 03:44:05.583755 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3846/7623] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:44:05.604770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:05.614361 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-22ebbcb6-f237-4e4a-899b-8eaf7f182e50 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.267577 Jul 18 03:44:05.615144 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3778/7624] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:05 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:06.632830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:06.633511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:06.639857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:06.640334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:06.641237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:06.641690 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:06.771890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:06.780269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5409b18a-3e0c-484c-8cdd-9af65fdb2a46 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.152574 Jul 18 03:44:06.781430 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3847/7625] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:06 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:07.799070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:07.799695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:07.806730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:07.807203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:07.808059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:07.808520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:07.946947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:07.954603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-350206f0-3f8a-49ba-8f15-62ad003eba02 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.160040 Jul 18 03:44:07.955186 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3779/7626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:07 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:08.972573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:08.973207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:08.980468 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:08.980956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:08.981751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:08.982203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:09.119940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:09.128253 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-66b937da-0c89-4027-a247-0fdccf1f5b71 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.159937 Jul 18 03:44:09.128835 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3848/7627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:08 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:10.145560 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:10.146235 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:10.153466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:10.153932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:10.154741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:10.155208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:10.305998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:10.314242 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2343066a-4a60-44f9-83db-8f9dbd825e6b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.172688 Jul 18 03:44:10.314835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3780/7628] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:10 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:11.333934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:11.334678 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:11.342352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:11.343698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:11.344686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:11.345240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:11.488409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:11.495957 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d22e9f6-7345-4233-9b24-499ca04772b8 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.166276 Jul 18 03:44:11.497128 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3849/7629] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:11 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:11.509405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-470992d6-6e70-44f5-8179-4a45d8c85723 req-a023a76a-ad1c-40ac-b880-fc2618d9772a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "name": "network-vif-plugged", "status": "completed", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:11.519646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-470992d6-6e70-44f5-8179-4a45d8c85723 req-a023a76a-ad1c-40ac-b880-fc2618d9772a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:11.520224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-470992d6-6e70-44f5-8179-4a45d8c85723 req-a023a76a-ad1c-40ac-b880-fc2618d9772a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:11.535920 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-470992d6-6e70-44f5-8179-4a45d8c85723 req-a023a76a-ad1c-40ac-b880-fc2618d9772a service nova] Creating event network-vif-plugged:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:44:11.542049 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-470992d6-6e70-44f5-8179-4a45d8c85723 req-a023a76a-ad1c-40ac-b880-fc2618d9772a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102631 Jul 18 03:44:11.542687 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3781/7630] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:44:12.514094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:12.515035 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:12.522389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:12.522874 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:12.523670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:12.524120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:12.657536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:12.664995 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b4c53e3e-d04f-49dc-b3fe-967bec124c62 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1359 microversion: 2.1 time: 0.155030 Jul 18 03:44:12.665565 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3850/7631] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:12 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:13.684487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:13.685157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:13.691835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:13.692304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:13.693206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:13.693733 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:13.824571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:13.832994 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-812fce1b-e8a6-4b89-99a5-a7b5add4290c tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1546 microversion: 2.1 time: 0.153106 Jul 18 03:44:13.833580 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3782/7632] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:13 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:13.849351 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:13.849962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:13.857091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:13.857541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:13.858309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:13.859529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:13.996710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:14.004786 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cdfed9d0-24c2-46f5-a009-b9e590de6015 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1546 microversion: 2.1 time: 0.159301 Jul 18 03:44:14.005376 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3851/7633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:13 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:14.021394 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:14.024676 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:14.025474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Searching by: {'deleted': False, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7'} {{(pid=119440) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 03:44:14.030908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:14.031360 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:14.032170 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:14.032620 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:14.056274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.multi_cell_list [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 03:44:14.084821 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-59e1ca8a-9a99-4ea2-a0d2-1d7be23d83a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067227 Jul 18 03:44:14.085460 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3783/7634] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Jul 18 03:44:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:44:14.096442 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:14.097094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:14.103212 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:14.103674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:14.104450 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:14.104898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:14.237389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:14.245268 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bdc71db3-381c-4e83-805c-e537ff34e9e0 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1546 microversion: 2.1 time: 0.153254 Jul 18 03:44:14.245856 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3852/7635] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:14 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:15.767667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8380d38-6f16-4b06-82b2-d5bb40ad6292"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:15.768774 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:15.776097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:15.776575 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:15.777409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:15.777867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:16.020148 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa5cb503-670a-452d-a192-1617ea7b2b9f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256471 Jul 18 03:44:16.020855 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3784/7636] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Jul 18 03:44:15 2022] POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:44:21.935881 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:44:21.936603 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:44:27.814376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:27.814996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:27.817840 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=19 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:27.818689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=68 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:27.824907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:27.825508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:27.826492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:27.827382 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:27.966889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:27.975182 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64dcb020-782e-48e6-8c4a-b3fd2b32a96b tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1592 microversion: 2.1 time: 0.164707 Jul 18 03:44:27.975818 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3853/7637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:27 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1592 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:29.993940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:29.997903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=17 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:29.998746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:44:30.068738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-84bf7c65-4bb0-4b0b-ae85-87365de32ed0 req-f37f649a-4a5e-46e4-8d1a-0f1240e0f444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:30.081610 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-84bf7c65-4bb0-4b0b-ae85-87365de32ed0 req-f37f649a-4a5e-46e4-8d1a-0f1240e0f444 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:30.082863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-84bf7c65-4bb0-4b0b-ae85-87365de32ed0 req-f37f649a-4a5e-46e4-8d1a-0f1240e0f444 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:30.095500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-84bf7c65-4bb0-4b0b-ae85-87365de32ed0 req-f37f649a-4a5e-46e4-8d1a-0f1240e0f444 service nova] Creating event network-changed:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:44:30.102735 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-84bf7c65-4bb0-4b0b-ae85-87365de32ed0 req-f37f649a-4a5e-46e4-8d1a-0f1240e0f444 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109864 Jul 18 03:44:30.104080 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3785/7638] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:44:31.375823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1728252659"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:31.376535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:31.383242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:31.383701 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:31.384477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:31.384940 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:31.519154 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.network.security_group_api [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Adding security group 4f70a292-c89d-49f5-9cd8-9a83ba48e432 to port 0a778cdf-d2a8-44f3-8401-28c359e2334c Jul 18 03:44:31.881418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25c1974c-b0e7-4171-b32b-4626d75aa364 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action" status: 202 len: 0 microversion: 2.1 time: 0.510108 Jul 18 03:44:31.882037 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3854/7639] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:44:31 2022] POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:44:31.894869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:44:31.895605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:44:31.906561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:31.907872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:31.909111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:31.909614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:32.068384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:44:32.084913 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7fea1033-59a2-4abd-9adc-47cab842273d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1758 microversion: 2.1 time: 0.198227 Jul 18 03:44:32.085557 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3786/7640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:44:31 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:44:32.118976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ec7ca74a-c144-4ae4-94d0-90909762841f req-cf46d2e2-8d24-45ec-babf-cbe935ad841b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:44:32.128476 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ec7ca74a-c144-4ae4-94d0-90909762841f req-cf46d2e2-8d24-45ec-babf-cbe935ad841b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:44:32.128955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ec7ca74a-c144-4ae4-94d0-90909762841f req-cf46d2e2-8d24-45ec-babf-cbe935ad841b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:44:32.141314 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ec7ca74a-c144-4ae4-94d0-90909762841f req-cf46d2e2-8d24-45ec-babf-cbe935ad841b service nova] Creating event network-changed:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:44:32.146659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ec7ca74a-c144-4ae4-94d0-90909762841f req-cf46d2e2-8d24-45ec-babf-cbe935ad841b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031272 Jul 18 03:44:32.147205 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3855/7641] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:45:29.532531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:45:29.533529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:29.535798 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:29.536479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:29.542938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:29.543405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:29.544191 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:29.544647 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:29.618627 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-633266d8-6d86-45ba-9177-b2e70da3a7a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action" status: 202 len: 0 microversion: 2.1 time: 0.090830 Jul 18 03:45:29.619239 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3787/7642] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:45:29 2022] POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:45:29.626415 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:29.627159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:45:29.631943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:29.632661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:29.639868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:29.640318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:29.641138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:29.641574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:29.795118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:29.803695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64d3e23b-b3de-483f-bf9b-23713b247536 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1750 microversion: 2.1 time: 0.180023 Jul 18 03:45:29.804467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3856/7643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:29 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:30.822861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:30.823574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:30.829904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:30.830372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:30.831159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:30.831612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:30.987994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:30.996838 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-427fd1dd-2a63-46e4-9185-5b1b39a11251 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.179121 Jul 18 03:45:30.997477 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3788/7644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:30 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:32.015125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:32.015828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:32.022841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:32.023295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:32.024064 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:32.024532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:32.171568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:32.180798 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2ff1dc8a-c427-40d4-a8e1-4e91717d56c6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.169632 Jul 18 03:45:32.181412 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3857/7645] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:32 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:33.200066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:33.200720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:33.207945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:33.208409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:33.209306 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:33.209759 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:33.364608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:33.372719 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b45832b5-384b-4f1c-9a4b-3f9a062f501f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.176790 Jul 18 03:45:33.373330 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3789/7646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:33 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:34.390107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:34.390664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:34.398591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:34.399043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:34.399824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:34.400269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:34.549551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:34.558334 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6a8ad019-9a5f-467d-9fcf-7f585900bab6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.172206 Jul 18 03:45:34.558985 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3858/7647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:34 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:35.576208 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:35.576754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:35.583787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:35.584267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:35.585058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:35.585509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:35.733649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:35.742404 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-315c8875-1912-4523-b4b3-618260918540 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.170261 Jul 18 03:45:35.742983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3790/7648] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:35 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:36.760105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:36.760723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:36.767732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:36.768193 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:36.769002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:36.770011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:36.916823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:36.925186 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22af3fd4-44bb-407b-b27a-25774547597a tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.168961 Jul 18 03:45:36.925770 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3859/7649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:36 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:37.942683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:37.943409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:37.951077 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:37.951607 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:37.952404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:37.952864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:38.096646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:38.105433 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e71fc67-a7ed-4039-b527-d7b2d6097052 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.166731 Jul 18 03:45:38.106407 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3791/7650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:37 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:39.122789 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:39.123401 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:39.130356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:39.130763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:39.131535 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:39.131976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:39.278492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:39.286705 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1b5d2c2-2c6b-4a07-88d2-e9c73c841327 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.167687 Jul 18 03:45:39.287398 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3860/7651] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:39 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:40.304468 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:40.305139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:40.312192 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:40.312656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:40.313540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:40.313996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:40.462455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:40.470483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-85a90e54-b9ad-44bd-99f6-4ad546f50fdc tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1755 microversion: 2.1 time: 0.170265 Jul 18 03:45:40.471057 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3792/7652] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:40 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:45:41.488002 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:45:41.488642 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:45:41.496392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:41.496839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:41.497712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:45:41.498149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:45:41.648684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:45:41.656853 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74c82e8b-c6e5-4b9a-a2e5-449c905efcf1 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1758 microversion: 2.1 time: 0.172771 Jul 18 03:45:41.657462 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3861/7653] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:45:41 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:01.251880 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:46:01.252487 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:46:01.813868 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:46:01.814434 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:46:44.919918 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:46:44.921031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:44.921807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:44.926210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1728252659"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:44.926763 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:44.935101 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:44.935569 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:44.936356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:44.936813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:45.151488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.network.security_group_api [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Removing security group 4f70a292-c89d-49f5-9cd8-9a83ba48e432 from port 0a778cdf-d2a8-44f3-8401-28c359e2334c Jul 18 03:46:45.502025 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ee63f553-f65d-46e3-ae28-8a17b70493a2 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action" status: 202 len: 0 microversion: 2.1 time: 0.583741 Jul 18 03:46:45.505851 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3793/7654] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:46:44 2022] POST /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:46:45.512824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-fbdb6a57-c087-43bb-8e7d-ca736a74bd0f req-57591939-9a54-4fa1-b128-42407d1416c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:45.525124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:45.526059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=36 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:46:45.534822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fbdb6a57-c087-43bb-8e7d-ca736a74bd0f req-57591939-9a54-4fa1-b128-42407d1416c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:45.535398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-fbdb6a57-c087-43bb-8e7d-ca736a74bd0f req-57591939-9a54-4fa1-b128-42407d1416c1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:45.551589 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-fbdb6a57-c087-43bb-8e7d-ca736a74bd0f req-57591939-9a54-4fa1-b128-42407d1416c1 service nova] Creating event network-changed:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:46:45.558686 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-fbdb6a57-c087-43bb-8e7d-ca736a74bd0f req-57591939-9a54-4fa1-b128-42407d1416c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052010 Jul 18 03:46:45.560134 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3862/7655] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:46.905754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:46.906274 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:46.916244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:46.916716 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:46.917691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:46.918152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:46.935226 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 55022. Jul 18 03:46:47.011768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lazy-loading 'services' on Instance uuid ffc56342-c40e-43ee-9170-cc48286c6daa {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:46:47.095709 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d1c55a1b-6b7e-4d98-ad8e-49d2c6a24c15 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments/a8380d38-6f16-4b06-82b2-d5bb40ad6292" status: 202 len: 0 microversion: 2.1 time: 0.193984 Jul 18 03:46:47.096584 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3794/7656] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:46:46 2022] DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments/a8380d38-6f16-4b06-82b2-d5bb40ad6292 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:46:47.108167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:47.109237 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:47.118504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:47.118887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:47.119894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:47.120327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:47.160772 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f012c993-d9ed-4da7-939f-dcc1295e6bf6 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059673 Jul 18 03:46:47.161401 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3863/7657] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:47 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:46:47.579884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-02a99bcb-dd68-4bc7-953f-a1617b33bbbc req-c2591a0c-e3c2-4c1f-a53d-3921f0770884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:47.589687 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-02a99bcb-dd68-4bc7-953f-a1617b33bbbc req-c2591a0c-e3c2-4c1f-a53d-3921f0770884 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:47.590144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-02a99bcb-dd68-4bc7-953f-a1617b33bbbc req-c2591a0c-e3c2-4c1f-a53d-3921f0770884 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:47.602339 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-02a99bcb-dd68-4bc7-953f-a1617b33bbbc req-c2591a0c-e3c2-4c1f-a53d-3921f0770884 service nova] Creating event network-changed:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:46:47.607893 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-02a99bcb-dd68-4bc7-953f-a1617b33bbbc req-c2591a0c-e3c2-4c1f-a53d-3921f0770884 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Jul 18 03:46:47.608544 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3795/7658] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:48.172963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:48.173883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:48.180950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:48.181421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:48.182222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:48.182667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:48.216584 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93c472ae-ae15-4033-a176-2c542b1a2e4d tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Jul 18 03:46:48.218736 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3864/7659] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:48 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:46:49.230422 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:49.231750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:49.238515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:49.238987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:49.239834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:49.240296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:49.278183 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-71bbd2ea-3843-455b-a894-58ad8309321f tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053878 Jul 18 03:46:49.278800 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3796/7660] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:49 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:50.290083 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:50.291013 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:50.298001 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:50.298460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:50.299238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:50.299674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:50.331042 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ce67cd22-8f10-4ba6-ab6f-42f5f7640153 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Jul 18 03:46:50.331620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3865/7661] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:50 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:51.343476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:51.344474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:51.351578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:51.352559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:51.353388 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:51.353839 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:51.385066 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b5752752-660e-4592-9ed4-906e3dcea8f9 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Jul 18 03:46:51.385663 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3797/7662] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:51 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:46:52.397264 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:52.398282 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:52.406117 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:52.406580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:52.407360 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:52.407811 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:52.436399 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1713294e-dab0-4af2-bb2d-128c21526810 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043253 Jul 18 03:46:52.436987 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3866/7663] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Jul 18 03:46:52 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 03:46:52.447281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:52.447882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:52.455390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:52.455882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:52.456692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:52.457168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:52.535872 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] HTTP exception thrown: Instance ffc56342-c40e-43ee-9170-cc48286c6daa is not attached to volume a8380d38-6f16-4b06-82b2-d5bb40ad6292 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Request method failure captured: Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: request: DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments/a8380d38-6f16-4b06-82b2-d5bb40ad6292 HTTP/1.1 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NWtmPfEoJQmiRWRSMe5CUbhF4Hdr3kAIJ9FXsBNz9TgKJe6mBPo5vaTsApxgXTf_VMS5ExWkZmKVfYr7ldl3Gm6sHi2xYoRKNtPB83e53SynBd5YgXiE9yycfzI4iTOhzsYVkRWnT_zVVN6wyxgQVveqEkU-BjrJCy6tCp6TWsdurg Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: d802b9cf1d6f498f84d675e2124698d3 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance ffc56342-c40e-43ee-9170-cc48286c6daa is not attached to volume a8380d38-6f16-4b06-82b2-d5bb40ad6292 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'server_id': 'ffc56342-c40e-43ee-9170-cc48286c6daa', 'id': 'a8380d38-6f16-4b06-82b2-d5bb40ad6292'} Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a8380d38-6f16-4b06-82b2-d5bb40ad6292. Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc56342-c40e-43ee-9170-cc48286c6daa is not attached to volume a8380d38-6f16-4b06-82b2-d5bb40ad6292 Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:46:52.537533 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc56342-c40e-43ee-9170-cc48286c6daa is not attached to volume a8380d38-6f16-4b06-82b2-d5bb40ad6292 Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Returning 404 to user: Instance ffc56342-c40e-43ee-9170-cc48286c6daa is not attached to volume a8380d38-6f16-4b06-82b2-d5bb40ad6292 {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-984904f7-f707-4775-94a6-58ce8e559d16 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments/a8380d38-6f16-4b06-82b2-d5bb40ad6292" status: 404 len: 154 microversion: 2.1 time: 0.096152 Jul 18 03:46:52.543666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3798/7664] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Jul 18 03:46:52 2022] DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa/os-volume_attachments/a8380d38-6f16-4b06-82b2-d5bb40ad6292 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:46:55.788662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:55.789985 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:55.797411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:55.797875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:55.798671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:55.799148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:55.825259 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:46:55.907687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58dd2619-1588-4dfc-b2f8-42ceaa868b65 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 204 len: 0 microversion: 2.1 time: 0.122564 Jul 18 03:46:55.908392 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3867/7665] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:46:55 2022] DELETE /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:46:55.918846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:55.919493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:55.927890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:55.928368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:55.929204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:55.929670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:56.074180 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:56.082032 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c52029dd-cd01-4be8-9081-d4aebee9e4c5 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1552 microversion: 2.1 time: 0.168846 Jul 18 03:46:56.082609 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3799/7666] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:55 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:57.100149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:57.100878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:57.109209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:57.109665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:57.110434 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:57.110873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:57.305916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:57.313726 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-355951c5-847b-4361-9ce7-94a3df394eef tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1552 microversion: 2.1 time: 0.217797 Jul 18 03:46:57.314284 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3868/7667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:57 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:58.331221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:58.332542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:58.340565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:58.341741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:58.342654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:58.343153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:58.354154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c290f3ad-284e-473c-b1d6-52c7a748b4d3 req-045671af-63a1-4972-a57a-7442253e4e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc56342-c40e-43ee-9170-cc48286c6daa", "name": "network-vif-deleted", "tag": "0a778cdf-d2a8-44f3-8401-28c359e2334c"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:46:58.362652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c290f3ad-284e-473c-b1d6-52c7a748b4d3 req-045671af-63a1-4972-a57a-7442253e4e03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:58.363104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c290f3ad-284e-473c-b1d6-52c7a748b4d3 req-045671af-63a1-4972-a57a-7442253e4e03 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:58.375437 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c290f3ad-284e-473c-b1d6-52c7a748b4d3 req-045671af-63a1-4972-a57a-7442253e4e03 service nova] Creating event network-vif-deleted:0a778cdf-d2a8-44f3-8401-28c359e2334c for instance ffc56342-c40e-43ee-9170-cc48286c6daa on n-h1-849796-1 Jul 18 03:46:58.380703 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c290f3ad-284e-473c-b1d6-52c7a748b4d3 req-045671af-63a1-4972-a57a-7442253e4e03 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030620 Jul 18 03:46:58.381413 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3869/7668] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:46:58.421085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802b9cf1d6f498f84d675e2124698d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6ddd6f40eb42438df1d59a5703c2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:46:58.428861 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48e9e723-18a9-4dbe-aae8-66c298866964 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 200 len: 1510 microversion: 2.1 time: 0.101565 Jul 18 03:46:58.429492 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3800/7669] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:58 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:46:59.450178 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:59.450917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] [instance: ffc56342-c40e-43ee-9170-cc48286c6daa] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:46:59.457218 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:59.457677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:59.458446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:46:59.458887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:46:59.472241 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] HTTP exception thrown: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Request method failure captured: Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa HTTP/1.1 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1NWtmPfEoJQmiRWRSMe5CUbhF4Hdr3kAIJ9FXsBNz9TgKJe6mBPo5vaTsApxgXTf_VMS5ExWkZmKVfYr7ldl3Gm6sHi2xYoRKNtPB83e53SynBd5YgXiE9yycfzI4iTOhzsYVkRWnT_zVVN6wyxgQVveqEkU-BjrJCy6tCp6TWsdurg Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6f6ddd6f40eb42438df1d59a5703c2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 6f6ddd6f40eb42438df1d59a5703c2c7 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755652118 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: d802b9cf1d6f498f84d675e2124698d3 Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestMinimumBasicScenario-755652118-project Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'ffc56342-c40e-43ee-9170-cc48286c6daa'} Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:46:59.473892 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Returning 404 to user: Instance ffc56342-c40e-43ee-9170-cc48286c6daa could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-77be0e16-b8cb-407f-936e-6db103a09858 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa" status: 404 len: 111 microversion: 2.1 time: 0.030564 Jul 18 03:46:59.479226 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3870/7670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:46:59 2022] GET /compute/v2.1/servers/ffc56342-c40e-43ee-9170-cc48286c6daa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:46:59.485184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b7d3482c-9378-404a-9fe2-edb165fac799 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] Calling method '.version_select at 0x7fab045ce8b0>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:46:59.509729 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b7d3482c-9378-404a-9fe2-edb165fac799 tempest-TestMinimumBasicScenario-755652118 tempest-TestMinimumBasicScenario-755652118-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1983156301" status: 202 len: 0 microversion: 2.1 time: 0.028696 Jul 18 03:46:59.510355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3801/7671] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Jul 18 03:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1983156301 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:47:09.206130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-01ea9bca-4fa3-4994-97b7-70e1d7076e6d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: .version_select at 0x7fab044ca5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-717251805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEit2ID/blqwBQmdaaYg9LCpNSSzoi8iYgmSY4JwYZRakDhf9WJhms6HwSGGTUNC3XhcNos2cDRw8wVYOytSBwwSTp/n9mtAWWTPD1MIgaIaM81JPYuIWd38nyKJP/F/qg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:47:09.221863 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01ea9bca-4fa3-4994-97b7-70e1d7076e6d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:47:09.227591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-01ea9bca-4fa3-4994-97b7-70e1d7076e6d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:47:09.257551 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-01ea9bca-4fa3-4994-97b7-70e1d7076e6d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.236637 Jul 18 03:47:09.262562 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3871/7672] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:47:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:47:14.855045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:14.855897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:14.860714 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-463197747", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ef31034e-0104-4986-8bd3-8df67d9f7c97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-717251805", "security_groups": [{"name": "tempest-secgroup-smoke-1025049703"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:47:15.003013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] validate_networks() for [('ef31034e-0104-4986-8bd3-8df67d9f7c97', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:47:15.442947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:47:15.443385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:47:15.443880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:47:15.444309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:47:15.444740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:47:15.463042 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:15.463513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:15.464339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:15.464797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:15.488574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:47:15.495206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:47:15.510703 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:47:15.513254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:47:15.576129 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53d18236-641d-4869-86d6-cf2f94cd0598 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722636 Jul 18 03:47:15.577803 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3802/7673] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:47:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:47:15.591808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-84524f93-5032-4c6a-8651-5d2bae3758e0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:15.593668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-84524f93-5032-4c6a-8651-5d2bae3758e0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:15.603121 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:15.670448 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-84524f93-5032-4c6a-8651-5d2bae3758e0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:15.679687 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-84524f93-5032-4c6a-8651-5d2bae3758e0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1265 microversion: 2.1 time: 0.095129 Jul 18 03:47:15.690188 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3872/7674] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:15 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:16.701904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:16.703261 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:16.714932 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:16.715686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:16.716877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:16.718919 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:16.801031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:16.812820 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6a00c500-05b4-4d08-9ca9-4d329364dcc3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1317 microversion: 2.1 time: 0.114789 Jul 18 03:47:16.816509 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3803/7675] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:16 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:17.832473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:17.833136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:17.840552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:17.848196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:17.848950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:17.859251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:17.859998 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:18.009565 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:18.017864 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5fcdbcc3-a388-4daf-a50e-1a16cbc9b0b7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.189920 Jul 18 03:47:18.018479 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3873/7676] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:17 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:18.781915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5d7d1292-3a28-4043-a177-01ee6139baa9 req-1e2ba441-a110-4a01-9c30-70eb8077a501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cf6150-6315-4550-b87b-2d6af3e4633c", "tag": "7dfcde93-0579-404b-9a73-84ed25ac4440"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:47:18.794130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d7d1292-3a28-4043-a177-01ee6139baa9 req-1e2ba441-a110-4a01-9c30-70eb8077a501 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:18.795583 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5d7d1292-3a28-4043-a177-01ee6139baa9 req-1e2ba441-a110-4a01-9c30-70eb8077a501 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:18.816785 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5d7d1292-3a28-4043-a177-01ee6139baa9 req-1e2ba441-a110-4a01-9c30-70eb8077a501 service nova] Creating event network-changed:7dfcde93-0579-404b-9a73-84ed25ac4440 for instance e8cf6150-6315-4550-b87b-2d6af3e4633c on n-h1-849796-1 Jul 18 03:47:18.823413 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5d7d1292-3a28-4043-a177-01ee6139baa9 req-1e2ba441-a110-4a01-9c30-70eb8077a501 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045006 Jul 18 03:47:18.824628 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3804/7677] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:47:19.035893 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:19.036445 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:19.044912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:19.045408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:19.046196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:19.046637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:19.577248 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:19.584959 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f1f90813-f284-4792-915e-79d555d9c585 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.553035 Jul 18 03:47:19.586058 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3874/7678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:19 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:20.605161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:20.605890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:20.612516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:20.613002 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:20.613824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:20.614269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:20.755518 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:20.763688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-86ce346c-6058-49ae-b1c6-93323df316d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.164816 Jul 18 03:47:20.764275 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3805/7679] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:20 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:21.781452 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:21.782104 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:21.790616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:21.791087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:21.791883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:21.792340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:21.929334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:21.937283 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-203f5592-fc6b-4aa5-9520-901d1c3801cc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.159653 Jul 18 03:47:21.937969 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3875/7680] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:21 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:22.955329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:22.955986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:22.964550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:22.965054 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:22.966075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:22.966531 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:23.109310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:23.118370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9cbc9bd2-f57c-4f9d-b7d9-6568f78140ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.166811 Jul 18 03:47:23.118966 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3806/7681] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:22 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:24.139311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:24.139939 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:24.147419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:24.147970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:24.149798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:24.150608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:24.289718 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:24.297235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-64a8051a-fb1f-49d6-99d4-778e23d392f1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.165408 Jul 18 03:47:24.297810 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3876/7682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:24 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:24.546830 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8b4d8713-cce8-41ad-ac5a-4ac12a2fbf79 req-b6d02cda-ccc0-46da-a5d2-ebc5a981b10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cf6150-6315-4550-b87b-2d6af3e4633c", "name": "network-vif-plugged", "status": "completed", "tag": "7dfcde93-0579-404b-9a73-84ed25ac4440"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:47:24.556314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8b4d8713-cce8-41ad-ac5a-4ac12a2fbf79 req-b6d02cda-ccc0-46da-a5d2-ebc5a981b10e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:24.556781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8b4d8713-cce8-41ad-ac5a-4ac12a2fbf79 req-b6d02cda-ccc0-46da-a5d2-ebc5a981b10e service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:24.568398 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8b4d8713-cce8-41ad-ac5a-4ac12a2fbf79 req-b6d02cda-ccc0-46da-a5d2-ebc5a981b10e service nova] Creating event network-vif-plugged:7dfcde93-0579-404b-9a73-84ed25ac4440 for instance e8cf6150-6315-4550-b87b-2d6af3e4633c on n-h1-849796-1 Jul 18 03:47:24.573693 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8b4d8713-cce8-41ad-ac5a-4ac12a2fbf79 req-b6d02cda-ccc0-46da-a5d2-ebc5a981b10e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Jul 18 03:47:24.574344 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3807/7683] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:47:25.315958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:25.316575 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:25.324567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:25.325074 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:25.325861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:25.326312 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:25.461775 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:25.469196 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cd7d9056-2153-4bb0-9991-976636f0c12a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1391 microversion: 2.1 time: 0.157106 Jul 18 03:47:25.469773 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3877/7684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:25 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:26.483615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:26.484413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:26.489849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:26.490571 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:26.497889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:26.498368 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:26.499165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:26.499628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:26.643877 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:26.652474 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-247b64cf-c1d8-48cc-bf5e-178e10dad404 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1562 microversion: 2.1 time: 0.169796 Jul 18 03:47:26.653125 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3808/7685] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:26 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:26.669114 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:26.669764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:26.671700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:47:26.678089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:26.678551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:26.679925 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:26.680391 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:26.812754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:26.820912 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bff6a500-053c-4053-8566-dfb3f4ae5078 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1562 microversion: 2.1 time: 0.155693 Jul 18 03:47:26.821558 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3878/7686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:26 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:28.457618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:47:28.458248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:47:28.463552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-88a877be-482c-45d5-80ac-413709f954c4 req-192b410b-ff76-4fe2-92de-ed4bdc60eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cf6150-6315-4550-b87b-2d6af3e4633c", "tag": "7dfcde93-0579-404b-9a73-84ed25ac4440"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:47:28.474885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:28.475122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-88a877be-482c-45d5-80ac-413709f954c4 req-192b410b-ff76-4fe2-92de-ed4bdc60eab9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:28.475351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:28.475644 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-88a877be-482c-45d5-80ac-413709f954c4 req-192b410b-ff76-4fe2-92de-ed4bdc60eab9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:28.476606 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:47:28.477400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:47:28.492188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-88a877be-482c-45d5-80ac-413709f954c4 req-192b410b-ff76-4fe2-92de-ed4bdc60eab9 service nova] Creating event network-changed:7dfcde93-0579-404b-9a73-84ed25ac4440 for instance e8cf6150-6315-4550-b87b-2d6af3e4633c on n-h1-849796-1 Jul 18 03:47:28.499204 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-88a877be-482c-45d5-80ac-413709f954c4 req-192b410b-ff76-4fe2-92de-ed4bdc60eab9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038398 Jul 18 03:47:28.500084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3879/7687] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:47:28.718006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:47:28.726483 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b29896d5-f9b6-49ca-a1a6-08df1ff78f7b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1562 microversion: 2.1 time: 0.272740 Jul 18 03:47:28.727101 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3809/7688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:47:28 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:47:41.946252 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:47:41.946915 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:48:02.047517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=13 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:02.048288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:02.054208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:02.055918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:02.063457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:02.063921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:02.065195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:02.065195 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:02.122363 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-11f93b0c-6419-4fb6-acf1-6074ac663000 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action" status: 200 len: 24571 microversion: 2.1 time: 0.076940 Jul 18 03:48:02.122996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3880/7689] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:48:02 2022] POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:48:32.556019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:32.557046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:32.561960 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:32.562524 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:32.571154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.571625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.572442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.572897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.645120 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-159a527b-63ce-40e4-ad67-0219d4f9306c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action" status: 202 len: 0 microversion: 2.1 time: 0.090802 Jul 18 03:48:32.645797 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3810/7690] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:48:32 2022] POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:48:32.656815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:32.657933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:32.660798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:32.661738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:32.669610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.670084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.670920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:32.671622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:32.824494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:32.835592 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-46d28374-5506-4e10-a4ad-bb5017add1be tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1685 microversion: 2.1 time: 0.183851 Jul 18 03:48:32.836564 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3881/7691] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:32 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:33.858144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:33.858907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:33.865287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:33.865872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:33.866736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:33.867186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:34.020144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:34.028565 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c7ee2030-8948-46d6-9897-564c498d8cb9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1665 microversion: 2.1 time: 0.175924 Jul 18 03:48:34.029267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3811/7692] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:33 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1665 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:35.129964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:35.130815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:35.138857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.139319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.140158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.140603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.193244 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-22bb44ec-9747-4bc4-be2a-de2fbf5eb997 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action" status: 200 len: 32645 microversion: 2.1 time: 0.067209 Jul 18 03:48:35.193963 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3882/7693] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:48:35 2022] POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action => generated 32645 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:48:35.205353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:35.205915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:35.213883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.214353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.215163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.215622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.291772 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-35f3af0e-77f1-4154-a19a-8fc2aaff247f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action" status: 202 len: 0 microversion: 2.1 time: 0.090199 Jul 18 03:48:35.292439 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3812/7694] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:48:35 2022] POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:48:35.301547 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:35.302308 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:35.310967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.311427 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.312371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:35.312730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:35.461982 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:35.474206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6af5334c-396d-40ca-8c20-585e328ec5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1672 microversion: 2.1 time: 0.176969 Jul 18 03:48:35.480404 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3883/7695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:35 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:36.495483 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:36.496211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:36.503761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:36.504232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:36.505062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:36.505534 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:36.648563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:36.658631 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-886bd467-4ce2-4ffa-8da9-38020fcf9840 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1680 microversion: 2.1 time: 0.168256 Jul 18 03:48:36.659267 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3813/7696] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:36 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:36.766771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:36.767626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:36.776220 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:36.776687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:36.777559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:36.778012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:36.839473 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e25d0c4-0a59-43b9-8c5c-562afd3c71c5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action" status: 200 len: 36098 microversion: 2.1 time: 0.076510 Jul 18 03:48:36.840143 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3884/7697] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:48:36 2022] POST /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c/action => generated 36098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:48:37.953198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:37.954016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:37.961761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:37.962589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:37.963655 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:37.964146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:37.965656 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-36bf1185-0b76-446f-b555-fd1c151f993f req-1a0958e1-5dec-4e1b-8c9c-8a243394e67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cf6150-6315-4550-b87b-2d6af3e4633c", "tag": "7dfcde93-0579-404b-9a73-84ed25ac4440"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:37.978301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-36bf1185-0b76-446f-b555-fd1c151f993f req-1a0958e1-5dec-4e1b-8c9c-8a243394e67c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:37.978952 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-36bf1185-0b76-446f-b555-fd1c151f993f req-1a0958e1-5dec-4e1b-8c9c-8a243394e67c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:37.996246 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-36bf1185-0b76-446f-b555-fd1c151f993f req-1a0958e1-5dec-4e1b-8c9c-8a243394e67c service nova] Creating event network-changed:7dfcde93-0579-404b-9a73-84ed25ac4440 for instance e8cf6150-6315-4550-b87b-2d6af3e4633c on n-h1-849796-1 Jul 18 03:48:38.003302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:48:38.003945 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-36bf1185-0b76-446f-b555-fd1c151f993f req-1a0958e1-5dec-4e1b-8c9c-8a243394e67c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043056 Jul 18 03:48:38.004797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3885/7698] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:48:38.121200 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7131a9ee-42fa-42a5-821f-852542b69420 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 204 len: 0 microversion: 2.1 time: 0.171745 Jul 18 03:48:38.125235 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3814/7699] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:48:37 2022] DELETE /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:48:38.131421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:38.132294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:38.139689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:38.140150 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:38.140969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:38.141417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:38.319900 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:38.329369 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-775dcbfe-f30a-49b7-a977-fb45ddf2376b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1686 microversion: 2.1 time: 0.202700 Jul 18 03:48:38.330211 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3886/7700] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:38 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1686 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:39.349038 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:39.349980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:39.358345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:39.358833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:39.359630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:39.359913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:39.608453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:39.618505 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15d63e05-5c0e-4d25-9cda-dfcce4c03c00 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1686 microversion: 2.1 time: 0.273992 Jul 18 03:48:39.619117 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3815/7701] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:39 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1686 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:40.510152 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-bdbc0d3d-6f62-4310-9e9f-5444c9136cd2 req-aaa7aa62-e4e3-46c3-af43-871f80ad4f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cf6150-6315-4550-b87b-2d6af3e4633c", "name": "network-vif-deleted", "tag": "7dfcde93-0579-404b-9a73-84ed25ac4440"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:40.519071 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bdbc0d3d-6f62-4310-9e9f-5444c9136cd2 req-aaa7aa62-e4e3-46c3-af43-871f80ad4f31 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:40.519531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-bdbc0d3d-6f62-4310-9e9f-5444c9136cd2 req-aaa7aa62-e4e3-46c3-af43-871f80ad4f31 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:40.531544 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-bdbc0d3d-6f62-4310-9e9f-5444c9136cd2 req-aaa7aa62-e4e3-46c3-af43-871f80ad4f31 service nova] Creating event network-vif-deleted:7dfcde93-0579-404b-9a73-84ed25ac4440 for instance e8cf6150-6315-4550-b87b-2d6af3e4633c on n-h1-849796-1 Jul 18 03:48:40.537280 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-bdbc0d3d-6f62-4310-9e9f-5444c9136cd2 req-aaa7aa62-e4e3-46c3-af43-871f80ad4f31 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099132 Jul 18 03:48:40.537946 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3887/7702] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:48:40.636694 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:40.637572 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:40.644854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:40.645355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:40.646156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:40.646664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:40.680386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:40.680848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:40.681343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lazy-loading 'fault' on Instance uuid e8cf6150-6315-4550-b87b-2d6af3e4633c {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:48:40.726359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:40.735578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89567371-591e-4653-ab39-a5b4362e03a3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 200 len: 1355 microversion: 2.1 time: 0.102723 Jul 18 03:48:40.736185 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3816/7703] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:40 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:41.755250 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:41.756030 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: e8cf6150-6315-4550-b87b-2d6af3e4633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:41.762598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:41.763056 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:41.763875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:41.764325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:41.779163 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] HTTP exception thrown: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Request method failure captured: Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c HTTP/1.1 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ne8pHpwWr10mHq6hXsf0L52_RUHuISVjR5Vco-GvORGEjIx0Th-YKAuFik7DUYAHrYSRzoto4xhHGy1ytER9qbPmNyMnJp_35G9Z77B0bTEYTRNubprNbTPx5uCwb4EWYYFrXsLykyOkr_EV4y3EgdhWu4lpeZeaIGWjPIwBqqZKtc Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be1f392dc1cb4d7ca63acef79e1b5cc4 Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e8cf6150-6315-4550-b87b-2d6af3e4633c'} Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:48:41.780846 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Returning 404 to user: Instance e8cf6150-6315-4550-b87b-2d6af3e4633c could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-10db468c-0e5e-4001-aa5a-b0fc0e96d450 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c" status: 404 len: 111 microversion: 2.1 time: 0.032257 Jul 18 03:48:41.785504 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3888/7704] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:41 2022] GET /compute/v2.1/servers/e8cf6150-6315-4550-b87b-2d6af3e4633c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:48:45.402895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89cf040b-d159-4ac1-815b-d2a88fe05d8c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '.version_select at 0x7fab04818790>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:45.424572 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89cf040b-d159-4ac1-815b-d2a88fe05d8c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-717251805" status: 202 len: 0 microversion: 2.1 time: 0.025531 Jul 18 03:48:45.425364 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3817/7705] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 03:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-717251805 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:48:45.453962 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-27ca3883-654b-40a2-9597-6bb6cd55b884 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: .version_select at 0x7fab04bfe940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-124518359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1OmrRX4GLJpKkLtfppVh+zb2A3lO80CxULfNGDz3zPsnD5+pkKDjYWp95Sc+GKa7SwkgB1nWpwcgY0hiKccxvAkRJLqOHVMrkskEt0Q79fUlSqnkXn56kgNx7enRo/9g=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:45.469485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-27ca3883-654b-40a2-9597-6bb6cd55b884 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:48:45.476689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-27ca3883-654b-40a2-9597-6bb6cd55b884 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:48:45.501649 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-27ca3883-654b-40a2-9597-6bb6cd55b884 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051606 Jul 18 03:48:45.502259 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3889/7706] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:48:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:48:51.448089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1166753218", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "b2363647-8341-41b5-804b-4022f7ad05c7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-124518359", "security_groups": [{"name": "tempest-secgroup-smoke-313849335"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:51.457453 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:51.582386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] validate_networks() for [('b2363647-8341-41b5-804b-4022f7ad05c7', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:48:52.141308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:48:52.141717 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:48:52.142207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:48:52.142644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:48:52.143076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:48:52.153481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:52.153943 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:52.154768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:52.155219 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:52.173843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:48:52.181271 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:48:52.198927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:48:52.202872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:48:52.295214 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf7d3abf-088c-406b-95cc-5bc2c9999644 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.851893 Jul 18 03:48:52.308334 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3818/7707] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:48:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:48:52.309785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=32 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:48:52.319070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba5abb52-6181-493c-af2d-9030f5986e45 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:52.320275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba5abb52-6181-493c-af2d-9030f5986e45 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:52.391630 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba5abb52-6181-493c-af2d-9030f5986e45 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:52.401928 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba5abb52-6181-493c-af2d-9030f5986e45 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1266 microversion: 2.1 time: 0.093885 Jul 18 03:48:52.403529 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3890/7708] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:52 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:53.423309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10c2b343-989e-44e7-949a-397822c673d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:53.424897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10c2b343-989e-44e7-949a-397822c673d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:53.509706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10c2b343-989e-44e7-949a-397822c673d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:53.517917 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10c2b343-989e-44e7-949a-397822c673d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1266 microversion: 2.1 time: 0.101310 Jul 18 03:48:53.528906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3819/7709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:53 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:54.535217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:54.536605 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:54.554610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:54.555082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:54.555901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:54.556554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:54.632983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:54.643735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-cb000a6f-7246-4031-b1bf-c09ed820c819 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1318 microversion: 2.1 time: 0.112514 Jul 18 03:48:54.645030 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3891/7710] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:54 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1318 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:55.670762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:55.671696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:55.679335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:55.679869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:55.680786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:55.681366 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:55.925957 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:55.936370 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dfe2218b-46c0-48d9-988c-641eb51dc8d2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.270552 Jul 18 03:48:55.937463 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3820/7711] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:55 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:48:56.488749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-dca66cfb-9dee-419f-9598-e7ba9d2a3a2f req-6afdef3d-f362-4c8e-8f40-8d07b3be5539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf", "tag": "1f414e52-bf15-471e-9469-8314be879145"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:48:56.509232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dca66cfb-9dee-419f-9598-e7ba9d2a3a2f req-6afdef3d-f362-4c8e-8f40-8d07b3be5539 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:56.510342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-dca66cfb-9dee-419f-9598-e7ba9d2a3a2f req-6afdef3d-f362-4c8e-8f40-8d07b3be5539 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:56.525067 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-dca66cfb-9dee-419f-9598-e7ba9d2a3a2f req-6afdef3d-f362-4c8e-8f40-8d07b3be5539 service nova] Creating event network-changed:1f414e52-bf15-471e-9469-8314be879145 for instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf on n-h1-849796-1 Jul 18 03:48:56.531741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-dca66cfb-9dee-419f-9598-e7ba9d2a3a2f req-6afdef3d-f362-4c8e-8f40-8d07b3be5539 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049817 Jul 18 03:48:56.532755 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3892/7712] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:48:56.956292 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:56.956941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:56.965154 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:56.965670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:56.966718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:56.967195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:57.106434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:57.114835 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d37aa4c5-8bb5-40ff-8483-1ed97b06880a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.163209 Jul 18 03:48:57.116296 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3821/7713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:56 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:58.133970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:58.134645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:58.141942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:58.142400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:58.143196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:58.143645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:58.298992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:58.307221 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4d5c0803-56c4-4c56-ab3e-faec408b5679 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.177982 Jul 18 03:48:58.307800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3893/7714] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:58 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:48:59.323951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:48:59.324608 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:48:59.331598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:59.332063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:59.332858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:48:59.333335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:48:59.557204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:48:59.565384 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f0b6effa-e326-4794-b238-e80cf091d03d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.245389 Jul 18 03:48:59.565994 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3822/7715] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:48:59 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:00.584223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:00.584958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:00.591942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:00.592406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:00.593216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:00.593670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:00.729491 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:00.737249 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-29862568-7d90-44c5-98e2-13d83b6f3784 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.157592 Jul 18 03:49:00.737838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3894/7716] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:00 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:01.755007 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:01.755746 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:01.762723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:01.763197 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:01.763999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:01.764458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:01.899305 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:01.906987 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6f0cd60-b262-4792-bb7c-d61a78f29d50 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.156021 Jul 18 03:49:01.907573 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3823/7717] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:01 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:02.929689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:02.931207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:02.936987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:02.938297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:02.948294 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:02.948846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:02.949870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:02.950400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:03.015691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-8f45c219-0ad8-4aba-a3f6-4ba25b185910 req-868e7477-7d93-4615-a9ba-99700b617afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf", "name": "network-vif-plugged", "status": "completed", "tag": "1f414e52-bf15-471e-9469-8314be879145"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:49:03.020754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:03.022413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:03.027493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8f45c219-0ad8-4aba-a3f6-4ba25b185910 req-868e7477-7d93-4615-a9ba-99700b617afc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:03.028029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-8f45c219-0ad8-4aba-a3f6-4ba25b185910 req-868e7477-7d93-4615-a9ba-99700b617afc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:03.044147 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-8f45c219-0ad8-4aba-a3f6-4ba25b185910 req-868e7477-7d93-4615-a9ba-99700b617afc service nova] Creating event network-vif-plugged:1f414e52-bf15-471e-9469-8314be879145 for instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf on n-h1-849796-1 Jul 18 03:49:03.052543 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-8f45c219-0ad8-4aba-a3f6-4ba25b185910 req-868e7477-7d93-4615-a9ba-99700b617afc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040410 Jul 18 03:49:03.057893 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3824/7718] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:49:03.116260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:03.125731 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-58f32a54-b2fc-4c26-afb2-dc4c243731f0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.203733 Jul 18 03:49:03.132471 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3895/7719] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:02 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:04.145842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:04.146473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:04.148359 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=8 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:04.156473 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:04.157108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:04.158035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:04.158491 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:04.295538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:04.303084 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4769abf8-616f-4a76-b417-90cefbb84ec9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1391 microversion: 2.1 time: 0.162420 Jul 18 03:49:04.303657 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3825/7720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:04 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:05.320801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:05.322126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:05.329347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.329805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:05.330574 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.331019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:05.464361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:05.472050 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-095d9f3b-d17b-4016-8826-cfd7e1e4ce17 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1563 microversion: 2.1 time: 0.155191 Jul 18 03:49:05.472626 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3896/7721] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:05 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:05.488532 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:05.489204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:05.496744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.497362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:05.498152 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:05.498612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:05.642604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:05.650991 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6d1668ea-87d0-4ffb-a904-40e953b788b1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1563 microversion: 2.1 time: 0.166255 Jul 18 03:49:05.651654 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3826/7722] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:05 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:07.621838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:49:07.622555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:07.624341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b84f490e-2c5f-4361-a007-d3f22d4a107a req-55d731c2-6836-4087-8448-1bfe1ffd2618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf", "tag": "1f414e52-bf15-471e-9469-8314be879145"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:49:07.629837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:07.630541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:07.631505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:07.632119 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:07.634766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b84f490e-2c5f-4361-a007-d3f22d4a107a req-55d731c2-6836-4087-8448-1bfe1ffd2618 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:07.635753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b84f490e-2c5f-4361-a007-d3f22d4a107a req-55d731c2-6836-4087-8448-1bfe1ffd2618 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:07.647905 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b84f490e-2c5f-4361-a007-d3f22d4a107a req-55d731c2-6836-4087-8448-1bfe1ffd2618 service nova] Creating event network-changed:1f414e52-bf15-471e-9469-8314be879145 for instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf on n-h1-849796-1 Jul 18 03:49:07.654220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b84f490e-2c5f-4361-a007-d3f22d4a107a req-55d731c2-6836-4087-8448-1bfe1ffd2618 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Jul 18 03:49:07.655170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3827/7723] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:49:07.772645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:49:07.782057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-281b0f54-51ed-4518-b087-8b50c07478d9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1563 microversion: 2.1 time: 0.164889 Jul 18 03:49:07.782988 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3897/7724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:49:07 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:49:41.098081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:49:41.099916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:49:41.102503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=7 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:41.103172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=42 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:49:41.109523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:41.109996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:41.110802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:49:41.111259 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:49:41.163346 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e4f6e4ef-eb54-429f-8752-641de58c0753 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action" status: 200 len: 24568 microversion: 2.1 time: 0.069507 Jul 18 03:49:41.164314 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3828/7725] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:49:41 2022] POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:50:19.892564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:50:19.893562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:19.895934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:50:19.896992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=38 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:50:19.915149 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:19.915618 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:19.917144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:19.917933 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:20.019204 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-49789ec0-125f-4f3e-9a08-196c58cd6ce6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.133004 Jul 18 03:50:20.023189 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3898/7726] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:50:19 2022] POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:50:20.029719 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:20.030737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:20.033189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:50:20.034080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:50:20.042405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:20.043015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:20.044406 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:20.045310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:20.291330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:20.300509 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b832647c-524a-4585-a46a-e517354fd3c7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1674 microversion: 2.1 time: 0.275701 Jul 18 03:50:20.301134 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3829/7727] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:20 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:21.320420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:21.321158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:21.328261 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:21.328729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:21.329551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:21.330006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:21.480907 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:21.488785 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1789d4c9-91b5-4011-8454-8d17c2aa63a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.173849 Jul 18 03:50:21.489389 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3899/7728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:21 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:22.507000 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:22.507675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:22.519015 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:22.519485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:22.520286 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:22.520749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:22.659638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:22.667611 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a44cd61-79ea-4339-9b6a-f16e43341ce1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.164629 Jul 18 03:50:22.668196 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3830/7729] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:22 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:23.686560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:23.687105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:23.693968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:23.694417 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:23.695179 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:23.695619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:23.832719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:23.840396 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aacc5cf1-cfa9-4d10-a9ea-e607dee72082 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.158510 Jul 18 03:50:23.840980 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3900/7730] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:23 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:24.858637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:24.859190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:24.866304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:24.866769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:24.867561 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:24.868016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:25.009549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:25.018222 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b06e4212-bd71-417d-a61b-754fec3490ed tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.164194 Jul 18 03:50:25.018811 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3831/7731] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:24 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:26.036621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:26.037278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:26.045234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:26.045700 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:26.046482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:26.046932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:26.188161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:26.197457 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-324b5e1a-9091-49f5-895c-9def8ed9d70c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.164708 Jul 18 03:50:26.198333 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3901/7732] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:26 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:27.217309 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:27.217918 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:27.225314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:27.225790 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:27.226616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:27.227091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:27.374905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:27.382458 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d847a400-3959-43df-9f76-2acfe1ad0960 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.170720 Jul 18 03:50:27.383026 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3832/7733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:27 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:28.400319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:28.401436 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:28.407757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:28.408216 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:28.409021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:28.409586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:28.544077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:28.557128 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7faf3180-3ee2-469f-a976-b7212839edf0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.160772 Jul 18 03:50:28.557729 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3902/7734] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:28 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:29.574895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:29.575431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:29.582387 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:29.582851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:29.583631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:29.584081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:29.719300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:29.726904 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-177e38f6-89c3-43e4-91e1-ede06dcc017a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.156602 Jul 18 03:50:29.727491 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3833/7735] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:29 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:30.744749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:30.745420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:30.752441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:30.752899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:30.753707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:30.754158 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:30.889746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:30.897351 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4375b9a1-babe-42d0-ba4c-f12a9fa82586 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1679 microversion: 2.1 time: 0.156476 Jul 18 03:50:30.897934 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3903/7736] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:30 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:50:31.915854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:50:31.916493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:50:31.924324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:31.924795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:31.925622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:50:31.926083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:50:32.063189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:50:32.071452 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c573bf07-18c4-4d75-a609-633a0a173e99 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1682 microversion: 2.1 time: 0.159434 Jul 18 03:50:32.072511 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3834/7737] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:50:31 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:01.263592 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 18 03:51:01.264508 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:01.825099 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:51:01.825708 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:01.963529 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:51:01.963764 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:51:06.308906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.309837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:06.313741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:06.314667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:06.321974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.322424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.324011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:06.324269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:06.388117 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c48530d0-e9f7-437a-8900-c74d530ddc37 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action" status: 200 len: 69043 microversion: 2.1 time: 0.080161 Jul 18 03:51:06.388873 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3904/7738] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:51:06 2022] POST /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf/action => generated 69043 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:51:30.314416 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:30.314988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:30.317063 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:30.317980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:30.319288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:30.320719 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:30.326991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.327752 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.328568 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.329053 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.355768 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:51:30.395614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-25769a96-5aed-4fba-874c-feab2a01661d req-91f66f5a-abb8-447a-99b4-2f244a4daee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf", "tag": "1f414e52-bf15-471e-9469-8314be879145"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:30.406060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25769a96-5aed-4fba-874c-feab2a01661d req-91f66f5a-abb8-447a-99b4-2f244a4daee7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.406779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-25769a96-5aed-4fba-874c-feab2a01661d req-91f66f5a-abb8-447a-99b4-2f244a4daee7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.418237 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-25769a96-5aed-4fba-874c-feab2a01661d req-91f66f5a-abb8-447a-99b4-2f244a4daee7 service nova] Creating event network-changed:1f414e52-bf15-471e-9469-8314be879145 for instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf on n-h1-849796-1 Jul 18 03:51:30.424718 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-25769a96-5aed-4fba-874c-feab2a01661d req-91f66f5a-abb8-447a-99b4-2f244a4daee7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111552 Jul 18 03:51:30.425701 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3905/7739] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:51:30.452620 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ad69a3ec-34df-4728-8dec-fa2b48c045ae tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 204 len: 0 microversion: 2.1 time: 0.141996 Jul 18 03:51:30.456818 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3835/7740] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:51:30 2022] DELETE /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:51:30.464387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:30.468562 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:30.475262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.475716 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.476614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:30.478132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:30.634956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:30.644735 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-47aff44e-8790-4578-8d4c-a7c825c29b60 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1688 microversion: 2.1 time: 0.186268 Jul 18 03:51:30.645437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3906/7741] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:30 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:31.664385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:31.665166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:31.673479 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:31.673947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:31.674734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:31.675209 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:31.914976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:31.923135 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b86093a-22a0-4def-8593-b2467108261e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1688 microversion: 2.1 time: 0.263077 Jul 18 03:51:31.923712 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3836/7742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:31 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1688 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:32.771793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9bd6e5b3-43cd-447c-ba99-20795f377c26 req-5fa4d756-daa5-4b83-9ea0-2ee093a75a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf", "name": "network-vif-deleted", "tag": "1f414e52-bf15-471e-9469-8314be879145"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:32.783499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9bd6e5b3-43cd-447c-ba99-20795f377c26 req-5fa4d756-daa5-4b83-9ea0-2ee093a75a64 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.783978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9bd6e5b3-43cd-447c-ba99-20795f377c26 req-5fa4d756-daa5-4b83-9ea0-2ee093a75a64 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.797691 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9bd6e5b3-43cd-447c-ba99-20795f377c26 req-5fa4d756-daa5-4b83-9ea0-2ee093a75a64 service nova] Creating event network-vif-deleted:1f414e52-bf15-471e-9469-8314be879145 for instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf on n-h1-849796-1 Jul 18 03:51:32.804188 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9bd6e5b3-43cd-447c-ba99-20795f377c26 req-5fa4d756-daa5-4b83-9ea0-2ee093a75a64 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Jul 18 03:51:32.804797 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3907/7743] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:32.941141 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:32.941807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:32.949108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.949504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.950319 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.951543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.988282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:32.988665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:32.989178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lazy-loading 'fault' on Instance uuid 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:51:33.034215 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:33.042603 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6c2fff02-0a64-404e-8fa2-d46a4c8b0b6c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 200 len: 1356 microversion: 2.1 time: 0.105366 Jul 18 03:51:33.043193 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3837/7744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:32 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:34.063947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:34.064649 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:34.078633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:34.079103 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:34.079929 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:34.080388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:34.095804 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] HTTP exception thrown: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Request method failure captured: Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf HTTP/1.1 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ne8pHpwWr10mHq6hXsf0L52_RUHuISVjR5Vco-GvORGEjIx0Th-YKAuFik7DUYAHrYSRzoto4xhHGy1ytER9qbPmNyMnJp_35G9Z77B0bTEYTRNubprNbTPx5uCwb4EWYYFrXsLykyOkr_EV4y3EgdhWu4lpeZeaIGWjPIwBqqZKtc Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be1f392dc1cb4d7ca63acef79e1b5cc4 Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf'} Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:51:34.097561 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Returning 404 to user: Instance 7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e4c134b-baea-43be-8499-fe9475005a46 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf" status: 404 len: 111 microversion: 2.1 time: 0.040877 Jul 18 03:51:34.102652 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3908/7745] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:34 2022] GET /compute/v2.1/servers/7491f7b6-6ee4-4bca-b8e1-e4e6db6ae8bf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:51:37.212444 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2483ead0-e79b-4508-9481-57b0f391e437 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '.version_select at 0x7fab047cca60>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:37.237544 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2483ead0-e79b-4508-9481-57b0f391e437 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-124518359" status: 202 len: 0 microversion: 2.1 time: 0.028883 Jul 18 03:51:37.238421 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3838/7746] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 03:51:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-124518359 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:51:37.270065 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8d614bd8-ae54-4260-bd89-d068e556fc7e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: .version_select at 0x7fab0491bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-411496004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE967bIiUYsnWE2eXPO67HJZzheHxRF4NbhNgi2aAsJ58wGqoFm25f3NMPlt8yUGg28ADzvGXwv78eY6/y2mp1CwqcyF6umzE9HKby5CIYL21VYd4MGp/Fy7JhlH/hnArw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:37.285870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8d614bd8-ae54-4260-bd89-d068e556fc7e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:51:37.291011 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-8d614bd8-ae54-4260-bd89-d068e556fc7e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:51:37.319187 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8d614bd8-ae54-4260-bd89-d068e556fc7e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053061 Jul 18 03:51:37.319791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3909/7747] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:51:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:43.426613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:43.430971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1158927526", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "96862c44-62c7-4ce4-bd05-a2fb7e107f57"}], "key_name": "tempest-TestNetworkAdvancedServerOps-411496004", "security_groups": [{"name": "tempest-secgroup-smoke-145438303"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:43.541578 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] validate_networks() for [('96862c44-62c7-4ce4-bd05-a2fb7e107f57', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:51:44.337381 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:51:44.338204 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:51:44.338701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:51:44.339127 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:51:44.339558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:51:44.351146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:44.351611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:44.352613 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:44.353291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:44.375878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:51:44.381280 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:51:44.395352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:51:44.397721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:51:44.447415 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6ab86fce-5acd-407c-9ac5-6039b6e028a2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.022585 Jul 18 03:51:44.448140 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3839/7748] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:51:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:51:44.457569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:44.461760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12fb1aa9-13c1-48a1-a636-7ddc913fe134 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:44.463684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12fb1aa9-13c1-48a1-a636-7ddc913fe134 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:44.535176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12fb1aa9-13c1-48a1-a636-7ddc913fe134 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:44.542635 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12fb1aa9-13c1-48a1-a636-7ddc913fe134 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1266 microversion: 2.1 time: 0.086737 Jul 18 03:51:44.552553 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3910/7749] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:44 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:45.560945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:45.563677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:45.578658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:45.579133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:45.579956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:45.580411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:45.864443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:45.874132 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd2202a5-bfb7-4c01-b036-fffcdfb01d19 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1326 microversion: 2.1 time: 0.316996 Jul 18 03:51:45.874666 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3840/7750] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:45 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1326 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:46.891820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:46.892444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:46.900225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:46.900686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:46.901764 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:46.901969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:47.074628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:47.083940 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2248ab04-f3ea-424c-8712-5ab07a2b4828 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.196715 Jul 18 03:51:47.084950 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3911/7751] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:46 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:51:47.158374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-f80e02ff-6016-42cd-8512-54b81ad6ec5f req-ae603030-bd85-44e7-a01a-697a1dc534a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:47.170266 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f80e02ff-6016-42cd-8512-54b81ad6ec5f req-ae603030-bd85-44e7-a01a-697a1dc534a2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:47.171166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-f80e02ff-6016-42cd-8512-54b81ad6ec5f req-ae603030-bd85-44e7-a01a-697a1dc534a2 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:47.192954 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-f80e02ff-6016-42cd-8512-54b81ad6ec5f req-ae603030-bd85-44e7-a01a-697a1dc534a2 service nova] Creating event network-changed:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h1-849796-1 Jul 18 03:51:47.198797 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-f80e02ff-6016-42cd-8512-54b81ad6ec5f req-ae603030-bd85-44e7-a01a-697a1dc534a2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044808 Jul 18 03:51:47.199419 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3841/7752] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:48.101901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:48.102523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:48.110762 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:48.111223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:48.112007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:48.112460 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:48.247664 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:48.256056 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-184c785a-86a7-4629-b83d-a8b579f14c66 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.158042 Jul 18 03:51:48.256681 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3912/7753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:48 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:49.274472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:49.275187 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:49.283341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:49.283808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:49.284646 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:49.285130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:49.431516 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:49.440127 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2185de3d-fd20-450d-8051-7804f13e0be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.169879 Jul 18 03:51:49.440708 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3842/7754] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:49 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:50.457466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:50.458050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:50.464847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:50.465325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:50.466243 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:50.466687 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:50.600568 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:50.608884 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-375cfad2-93bc-44c6-ac4f-b4ad1e9d6a92 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.155384 Jul 18 03:51:50.609494 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3913/7755] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:50 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:51.625861 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:51.626699 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:51.633718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:51.634186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:51.634985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:51.635824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:51.781593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:51.797847 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c876ea63-d50e-4fb2-81b7-556075755cc0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.175838 Jul 18 03:51:51.812376 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3843/7756] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:51 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:51.853625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-8bdb7395-931f-4fdc-8c9f-99a92c407137 req-35d7d1ca-a96c-4324-ab58-bf4b03be0cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "name": "network-vif-plugged", "status": "completed", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:51.863820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8bdb7395-931f-4fdc-8c9f-99a92c407137 req-35d7d1ca-a96c-4324-ab58-bf4b03be0cbf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:51.864278 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-8bdb7395-931f-4fdc-8c9f-99a92c407137 req-35d7d1ca-a96c-4324-ab58-bf4b03be0cbf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:51.875418 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-8bdb7395-931f-4fdc-8c9f-99a92c407137 req-35d7d1ca-a96c-4324-ab58-bf4b03be0cbf service nova] Creating event network-vif-plugged:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h1-849796-1 Jul 18 03:51:51.880398 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-8bdb7395-931f-4fdc-8c9f-99a92c407137 req-35d7d1ca-a96c-4324-ab58-bf4b03be0cbf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095187 Jul 18 03:51:51.881071 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3914/7757] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:52.815195 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:52.815825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:52.822842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:52.823329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:52.824125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:52.824584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:52.972003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:52.979647 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f818695-9925-455f-ba44-33fd59be5db0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1391 microversion: 2.1 time: 0.168478 Jul 18 03:51:52.980241 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3844/7758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:52 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:53.998383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:53.999126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:54.005499 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:54.005963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:54.006738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:54.007188 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:54.144151 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:54.151730 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a736a05c-38cf-42fd-a8af-36efe8e66087 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1563 microversion: 2.1 time: 0.158962 Jul 18 03:51:54.152312 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3915/7759] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:53 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:54.168618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:54.169281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:54.177421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:54.177891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:54.178691 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:54.179153 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:54.319079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:54.326872 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ea768b78-4981-4f5f-be8f-90c4ea12c935 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1563 microversion: 2.1 time: 0.162086 Jul 18 03:51:54.327452 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3845/7760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:54 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:51:55.956577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cceec5d6-6a51-40fc-931b-a7432268ff35 req-51790a7e-4e06-4d3a-a870-0b5b11b6c75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:51:55.960126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:55.961050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:55.963301 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:51:55.963932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:51:55.966041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:51:55.976494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cceec5d6-6a51-40fc-931b-a7432268ff35 req-51790a7e-4e06-4d3a-a870-0b5b11b6c75a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:55.976981 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cceec5d6-6a51-40fc-931b-a7432268ff35 req-51790a7e-4e06-4d3a-a870-0b5b11b6c75a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:55.984320 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:55.984788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:55.985613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:51:55.986063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:51:56.000688 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-cceec5d6-6a51-40fc-931b-a7432268ff35 req-51790a7e-4e06-4d3a-a870-0b5b11b6c75a service nova] Creating event network-changed:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h1-849796-1 Jul 18 03:51:56.006316 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cceec5d6-6a51-40fc-931b-a7432268ff35 req-51790a7e-4e06-4d3a-a870-0b5b11b6c75a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053292 Jul 18 03:51:56.007226 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3846/7761] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:51:56.133928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:51:56.141560 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a97b5c99-1193-442d-b5f6-3f9d35a0759f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1563 microversion: 2.1 time: 0.192964 Jul 18 03:51:56.151786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3916/7762] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:51:55 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1563 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:52:31.452984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:52:31.453909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:52:31.507854 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:52:31.509148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:52:31.519891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:52:31.520382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:52:31.521238 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:52:31.521690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:52:31.577220 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8fc33df1-7b14-46bd-9edb-33d6d1b2b6ec tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action" status: 200 len: 24562 microversion: 2.1 time: 0.129271 Jul 18 03:52:31.577869 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3847/7763] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:52:31 2022] POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action => generated 24562 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:53:10.511585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:10.512394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=32 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:10.516641 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:10.517587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:10.525729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:10.526203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:10.526988 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:10.527438 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:10.619328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:10.626170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Old instance type m1.heat2, new instance type m1.heat {{(pid=119439) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 18 03:53:10.633828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:53:10.634262 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:53:10.634749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:53:10.635169 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:53:10.635592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:53:10.711469 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-feb0cd09-a225-408d-b598-0c630314c7ca tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action" status: 202 len: 0 microversion: 2.1 time: 0.201653 Jul 18 03:53:10.712436 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3917/7764] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:53:10 2022] POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:53:10.727190 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:10.728513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:10.733296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:10.734743 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:53:10.746754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:10.747527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:10.748449 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:10.749048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:10.936765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:10.950733 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-334f2827-ae11-4397-95a4-2813d7f232c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1691 microversion: 2.1 time: 0.231417 Jul 18 03:53:10.951545 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3848/7765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:10 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:11.973662 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:11.974657 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:11.986621 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:11.987232 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:11.988667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:11.989223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:12.222197 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:12.231659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d914c325-1d54-482a-b996-3a82cf084df3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1691 microversion: 2.1 time: 0.266020 Jul 18 03:53:12.232285 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3918/7766] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:11 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1691 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:13.256863 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:13.257564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:13.265006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:13.265478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:13.266277 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:13.266734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:13.412431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:13.421290 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-dea7d67d-0dba-4773-86d4-51132b476943 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.168834 Jul 18 03:53:13.421894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3849/7767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:13 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:14.438936 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:14.439620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:14.447385 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:14.447838 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:14.448625 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:14.449111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:14.594498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:14.603647 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f988fabb-a5e3-48f1-a9b2-25d9cd93463c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.168608 Jul 18 03:53:14.604258 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3919/7768] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:14 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:15.624635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:15.625300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:15.636033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:15.636492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:15.637601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:15.638168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:15.800138 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:15.809500 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e31fbd3-0ccd-4aa7-9d49-6069eb2f68d1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.188829 Jul 18 03:53:15.810111 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3850/7769] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:15 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:16.827492 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:16.828164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:16.836251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:16.836717 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:16.837551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:16.838004 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:16.989470 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:16.997934 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-79356812-5416-4e91-b198-436e5c6ebed8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.174365 Jul 18 03:53:16.998515 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3920/7770] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:16 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:18.017139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:18.017826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:18.024980 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:18.025486 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:18.026375 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:18.026856 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:18.186588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:18.195837 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec22ffdc-ca2b-4146-b625-34bff6914477 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.183196 Jul 18 03:53:18.196631 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3851/7771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:18 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:19.214246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:19.214895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:19.221919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:19.222376 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:19.223164 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:19.223616 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:19.365910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:19.374159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac434f25-d4a5-406c-adfb-430df8dc49a4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.164703 Jul 18 03:53:19.374749 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3921/7772] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:19 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:20.393224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:20.393860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:20.401194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:20.401664 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:20.402506 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:20.403074 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:20.556737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:20.565296 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2e02d197-4838-4da4-8af7-c9f42bb65343 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.177264 Jul 18 03:53:20.565906 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3852/7773] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:20 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:21.586819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:21.587505 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:21.595054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:21.595518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:21.596326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:21.596780 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:21.759049 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:21.773936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0c1774ad-ee2e-43ef-a9b6-840f8208583a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.191393 Jul 18 03:53:21.774465 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3922/7774] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:21 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:22.791692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:22.792346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:22.800125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:22.800600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:22.801464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:22.801922 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:22.953729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:22.962091 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1cbb6eb2-a88a-4541-8206-57290fb52e83 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.174282 Jul 18 03:53:22.962693 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3853/7775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:22 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:23.981837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:23.982464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:23.991472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:23.991942 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:23.992758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:23.993246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:24.157414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:24.166269 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-161c201d-89ea-4d4c-b39a-87fbd2878e47 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1696 microversion: 2.1 time: 0.188930 Jul 18 03:53:24.166885 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3923/7776] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:23 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:25.187541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:25.188438 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:25.200971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:25.201654 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:25.202659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:25.203413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:25.470909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:25.487411 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-82b58520-c244-4806-a2dc-dd59fcb25b76 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1695 microversion: 2.1 time: 0.304014 Jul 18 03:53:25.488404 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3854/7777] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:25 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1695 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:25.805244 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "name": "network-vif-unplugged", "status": "completed", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:25.815806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:25.816255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:25.829843 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] Creating event network-vif-unplugged:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h2-849796-1 Jul 18 03:53:25.837594 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] Instance 2f088032-b617-4930-9a4a-705bf04c1826 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119439) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:53:25.851577 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-504155b6-4b9c-4485-89e0-59c7eabd6590 req-4345d0cc-277a-47f2-bfc2-3aaf8342e257 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050088 Jul 18 03:53:25.852168 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3924/7778] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:53:26.513927 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:26.515163 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:26.530938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:26.531838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:26.533439 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:26.534329 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:26.821461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:26.831815 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-089a628f-b2d5-4ecc-b375-0772f15e8a58 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1695 microversion: 2.1 time: 0.326995 Jul 18 03:53:26.832616 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3855/7779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:26 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1695 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:27.862911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:27.863620 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:27.871327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:27.871938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:27.872598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:27.873094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:27.879821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:27.891110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:27.891869 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:27.907333 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] Creating event network-changed:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h2-849796-1 Jul 18 03:53:27.914085 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] Instance 2f088032-b617-4930-9a4a-705bf04c1826 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-849796-1', 'n-h2-849796-1'} {{(pid=119440) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 18 03:53:27.930429 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-d596e2ee-572b-445e-9c2a-3319be9d76c6 req-c9bca6eb-2881-449e-924a-17a235083efc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054167 Jul 18 03:53:27.931313 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3856/7780] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:53:28.055313 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:28.069998 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6023fb49-5c90-4f74-ab4b-015f018df4c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1693 microversion: 2.1 time: 0.212112 Jul 18 03:53:28.071095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3925/7781] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:27 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1693 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:29.098818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:29.100231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:29.109299 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:29.110124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:29.111618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:29.112434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:29.273925 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:29.281911 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8cba199a-ffa9-47ab-85c0-4f50fa8c3bb1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1693 microversion: 2.1 time: 0.191754 Jul 18 03:53:29.282524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3857/7782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:29 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:30.304947 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:30.305795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:30.313591 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.314053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.314859 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.315318 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.498034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:30.507759 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ba70e5d5-a080-455b-a2d7-5dc8c4df50ea tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1690 microversion: 2.1 time: 0.209191 Jul 18 03:53:30.508480 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3926/7783] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:30 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:30.539081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:30.540111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:30.550279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.550828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.551964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.552527 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.621702 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11ebc46d-8090-44b2-999d-66caa394eee5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action" status: 204 len: 0 microversion: 2.1 time: 0.090377 Jul 18 03:53:30.622832 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3858/7784] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:53:30 2022] POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:53:30.635608 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:30.636763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:30.648758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.649623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.651072 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.651899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.824246 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:30.834634 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fec748ad-1950-46cd-aa2b-eaa9c4c117aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1690 microversion: 2.1 time: 0.207154 Jul 18 03:53:30.835533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3927/7785] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:30 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:30.852753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:30.853502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:30.860785 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.861549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:30.862356 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:30.862808 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:31.129022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:31.138392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cd4f38d0-a155-477d-b0d3-1d5a2fbf7d40 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1690 microversion: 2.1 time: 0.290203 Jul 18 03:53:31.149328 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3859/7786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:30 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1690 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:32.156348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:53:32.157319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:53:32.165489 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.165981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:32.166793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.167239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:32.327623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:53:32.336215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26c33083-87cb-46ac-b900-75aa7297c264 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1682 microversion: 2.1 time: 0.183875 Jul 18 03:53:32.336800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3928/7787] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:53:32 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:53:32.910783 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2ceddb3f-7fba-4c1e-9130-2fb8b1d6490c req-80150a2a-fe14-4a3c-aa5f-0dc4be43d4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "name": "network-vif-plugged", "status": "completed", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:53:32.927336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ceddb3f-7fba-4c1e-9130-2fb8b1d6490c req-80150a2a-fe14-4a3c-aa5f-0dc4be43d4f1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:53:32.928068 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2ceddb3f-7fba-4c1e-9130-2fb8b1d6490c req-80150a2a-fe14-4a3c-aa5f-0dc4be43d4f1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:53:32.942109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2ceddb3f-7fba-4c1e-9130-2fb8b1d6490c req-80150a2a-fe14-4a3c-aa5f-0dc4be43d4f1 service nova] Creating event network-vif-plugged:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h2-849796-1 Jul 18 03:53:32.948588 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2ceddb3f-7fba-4c1e-9130-2fb8b1d6490c req-80150a2a-fe14-4a3c-aa5f-0dc4be43d4f1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043175 Jul 18 03:53:32.949514 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3860/7788] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:04.558352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:04.559192 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:04.561362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=28 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:04.562023 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:04.568453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:04.568914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:04.569770 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:04.570217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:04.633006 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee221960-4f2a-4f3a-910e-91c1554378f5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action" status: 200 len: 24576 microversion: 2.1 time: 0.079340 Jul 18 03:54:04.633657 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3929/7789] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:54:04 2022] POST /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826/action => generated 24576 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:54:21.273706 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:54:21.274256 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:54:21.834627 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:54:21.835306 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:54:28.247461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=26 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:28.248231 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:28.255814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-4161eb6e-458a-451a-87fe-065579bd6825 req-4a48f3cb-07da-46ac-a1a4-b9e6769cee9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:28.260068 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:28.260955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:28.267455 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:28.268072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:28.279551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4161eb6e-458a-451a-87fe-065579bd6825 req-4a48f3cb-07da-46ac-a1a4-b9e6769cee9c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:28.279996 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-4161eb6e-458a-451a-87fe-065579bd6825 req-4a48f3cb-07da-46ac-a1a4-b9e6769cee9c service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:28.289119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:28.289590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:28.290392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:28.290848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:28.292701 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-4161eb6e-458a-451a-87fe-065579bd6825 req-4a48f3cb-07da-46ac-a1a4-b9e6769cee9c service nova] Creating event network-changed:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h2-849796-1 Jul 18 03:54:28.298004 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-4161eb6e-458a-451a-87fe-065579bd6825 req-4a48f3cb-07da-46ac-a1a4-b9e6769cee9c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047254 Jul 18 03:54:28.298795 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3930/7790] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:28.320075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:54:28.414860 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-6dc57f7c-04e4-4468-87f2-2ed2bf443bf5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 204 len: 0 microversion: 2.1 time: 0.169027 Jul 18 03:54:28.416081 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3861/7791] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:54:28 2022] DELETE /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:54:28.426715 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:28.427488 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:28.434078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:28.434540 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:28.435336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:28.435784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:28.578464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:28.586936 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d11f7109-1dbe-41b7-b53a-f4b4b117fe5d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1688 microversion: 2.1 time: 0.165788 Jul 18 03:54:28.587533 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3931/7792] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:28 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:29.609308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:29.610408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:29.618168 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:29.618644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:29.619577 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:29.620062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:29.856121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:29.865284 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8785dd27-a093-4e1f-aa58-047125e4f77c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1688 microversion: 2.1 time: 0.260579 Jul 18 03:54:29.866207 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3862/7793] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:29 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:30.622888 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-cdefedbe-2d5d-4e0a-aa8c-af184c82c14f req-6defec51-f065-4fe7-8ef5-262dafdd9bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f088032-b617-4930-9a4a-705bf04c1826", "name": "network-vif-deleted", "tag": "11e87f59-1b5e-4dd4-9e6e-bb224bc3131a"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:30.631812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cdefedbe-2d5d-4e0a-aa8c-af184c82c14f req-6defec51-f065-4fe7-8ef5-262dafdd9bbf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:30.632254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-cdefedbe-2d5d-4e0a-aa8c-af184c82c14f req-6defec51-f065-4fe7-8ef5-262dafdd9bbf service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:30.644580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-cdefedbe-2d5d-4e0a-aa8c-af184c82c14f req-6defec51-f065-4fe7-8ef5-262dafdd9bbf service nova] Creating event network-vif-deleted:11e87f59-1b5e-4dd4-9e6e-bb224bc3131a for instance 2f088032-b617-4930-9a4a-705bf04c1826 on n-h2-849796-1 Jul 18 03:54:30.649882 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-cdefedbe-2d5d-4e0a-aa8c-af184c82c14f req-6defec51-f065-4fe7-8ef5-262dafdd9bbf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088244 Jul 18 03:54:30.650620 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3932/7794] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:30.883823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:30.884464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:30.891939 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:30.892410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:30.893311 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:30.894028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:30.931989 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:30.932463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:30.932963 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lazy-loading 'fault' on Instance uuid 2f088032-b617-4930-9a4a-705bf04c1826 {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:54:30.979548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:30.988652 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80e10dbe-8ddb-4b03-94dc-9dc028a2f7c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 200 len: 1356 microversion: 2.1 time: 0.108648 Jul 18 03:54:30.989298 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3863/7795] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:30 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:54:32.007904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:32.008639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 2f088032-b617-4930-9a4a-705bf04c1826] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:32.015012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:32.015471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:32.016247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:32.016694 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:32.031107 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] HTTP exception thrown: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Request method failure captured: Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 HTTP/1.1 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ne8pHpwWr10mHq6hXsf0L52_RUHuISVjR5Vco-GvORGEjIx0Th-YKAuFik7DUYAHrYSRzoto4xhHGy1ytER9qbPmNyMnJp_35G9Z77B0bTEYTRNubprNbTPx5uCwb4EWYYFrXsLykyOkr_EV4y3EgdhWu4lpeZeaIGWjPIwBqqZKtc Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be1f392dc1cb4d7ca63acef79e1b5cc4 Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '2f088032-b617-4930-9a4a-705bf04c1826'} Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:54:32.032746 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Returning 404 to user: Instance 2f088032-b617-4930-9a4a-705bf04c1826 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-34e94812-d704-47e3-b8d1-af943af47b8b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826" status: 404 len: 111 microversion: 2.1 time: 0.033125 Jul 18 03:54:32.038051 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3933/7796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:32 2022] GET /compute/v2.1/servers/2f088032-b617-4930-9a4a-705bf04c1826 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:54:35.502712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bd5cd442-8a65-4b23-a068-8339c468e0ba tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '.version_select at 0x7fab0482b040>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:35.529160 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bd5cd442-8a65-4b23-a068-8339c468e0ba tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-411496004" status: 202 len: 0 microversion: 2.1 time: 0.030460 Jul 18 03:54:35.533776 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3864/7797] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 03:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-411496004 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:54:35.557747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87dee063-deb6-42a6-8306-194dd519e5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: .version_select at 0x7fab048b6700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1879995136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbHS5TUDha6VAMIrXOgo1zxdALNllmqx/zIe/S20qGmHRVTVj1ZqGymSvi6UWosZGOTmYjSE7Agb4LOChXM7n41CUFNsMjt/KU/SDtI7m8DCH9Qz6BvvbZxYTHadREhQw=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:35.572721 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-87dee063-deb6-42a6-8306-194dd519e5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:54:35.583968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-87dee063-deb6-42a6-8306-194dd519e5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:54:35.615087 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87dee063-deb6-42a6-8306-194dd519e5fc tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061614 Jul 18 03:54:35.615708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3934/7798] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:54:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:41.309410 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1599757203", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ab383c39-0087-42d0-9355-1f20a81ec555"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1879995136", "security_groups": [{"name": "tempest-secgroup-smoke-518278338"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:41.321341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:41.429384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] validate_networks() for [('ab383c39-0087-42d0-9355-1f20a81ec555', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:54:41.908307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:54:41.909633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:54:41.910119 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:54:41.910545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:54:41.910971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:54:41.921973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:41.923885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:41.925543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:41.926079 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:41.945846 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:54:41.951968 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:54:41.966558 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:54:41.969327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:54:42.027395 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-53063b39-e10c-4de6-8b35-79510a64523f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.721984 Jul 18 03:54:42.034210 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3865/7799] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:54:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:54:42.038420 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=12 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:42.044101 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0a4b9a7e-51a0-4231-a085-31b4969a2da4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:42.046251 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0a4b9a7e-51a0-4231-a085-31b4969a2da4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:42.108446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0a4b9a7e-51a0-4231-a085-31b4969a2da4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:42.118212 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0a4b9a7e-51a0-4231-a085-31b4969a2da4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1267 microversion: 2.1 time: 0.082265 Jul 18 03:54:42.118791 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3935/7800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:42 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:43.139721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-623f019a-54b5-4151-8e9a-4e036569f0c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:43.140735 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-623f019a-54b5-4151-8e9a-4e036569f0c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:43.234016 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-623f019a-54b5-4151-8e9a-4e036569f0c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:43.243591 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-623f019a-54b5-4151-8e9a-4e036569f0c6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1267 microversion: 2.1 time: 0.110922 Jul 18 03:54:43.244385 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3866/7801] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:43 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:44.263355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4707f5e1-a714-47b1-b4a7-b993c85e2a5e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:44.263875 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4707f5e1-a714-47b1-b4a7-b993c85e2a5e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:44.323384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4707f5e1-a714-47b1-b4a7-b993c85e2a5e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:44.331396 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4707f5e1-a714-47b1-b4a7-b993c85e2a5e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1267 microversion: 2.1 time: 0.074185 Jul 18 03:54:44.331984 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3936/7802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:44 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:45.348947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8f8e44d8-e9c7-4fee-8c72-4ab63515b72f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:45.349582 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8f8e44d8-e9c7-4fee-8c72-4ab63515b72f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:45.404638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8f8e44d8-e9c7-4fee-8c72-4ab63515b72f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:45.412304 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8f8e44d8-e9c7-4fee-8c72-4ab63515b72f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1267 microversion: 2.1 time: 0.068585 Jul 18 03:54:45.412872 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3867/7803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:45 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1267 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:46.430053 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:46.430666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:46.437697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:46.438433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:46.438916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:46.439357 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:46.508383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:46.516417 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-65103aeb-20f2-41e4-9f51-e934eaa01a89 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1271 microversion: 2.1 time: 0.090234 Jul 18 03:54:46.517017 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3937/7804] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:46 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:47.534147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:47.534930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:47.542736 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:47.543207 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:47.544029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:47.544493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:47.627892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:47.636613 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-614ee4d8-f943-4973-880c-614d7d3b384e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1325 microversion: 2.1 time: 0.106412 Jul 18 03:54:47.637259 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3868/7805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:47 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:48.655742 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:48.656368 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:48.664367 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:48.664828 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:48.665639 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:48.667415 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9786af7b-875f-47c7-93c5-3f17a4773608 req-76900d6e-4668-4103-8a9c-8e2d4e69dbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8527b6b8-1ada-4401-93ce-78626253655b", "tag": "a7c8a631-4cbf-42f0-9d06-bf5643468d9e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:48.671381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:48.711457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9786af7b-875f-47c7-93c5-3f17a4773608 req-76900d6e-4668-4103-8a9c-8e2d4e69dbb1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:48.712258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9786af7b-875f-47c7-93c5-3f17a4773608 req-76900d6e-4668-4103-8a9c-8e2d4e69dbb1 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:48.731210 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9786af7b-875f-47c7-93c5-3f17a4773608 req-76900d6e-4668-4103-8a9c-8e2d4e69dbb1 service nova] Creating event network-changed:a7c8a631-4cbf-42f0-9d06-bf5643468d9e for instance 8527b6b8-1ada-4401-93ce-78626253655b on n-h1-849796-1 Jul 18 03:54:48.740122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9786af7b-875f-47c7-93c5-3f17a4773608 req-76900d6e-4668-4103-8a9c-8e2d4e69dbb1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079780 Jul 18 03:54:48.741406 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3869/7806] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:48.893839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:48.908320 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a983f41-c270-4639-b6f2-18272a82c7df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.256515 Jul 18 03:54:48.910618 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3938/7807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:48 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:49.929055 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:49.929761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:49.936173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:49.936641 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:49.937472 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:49.937938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:50.084708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:50.092951 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bacdb410-d40b-4021-99bc-7cb04171aaa3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.169702 Jul 18 03:54:50.093823 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3870/7808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:49 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:51.111069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:51.111684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:51.118774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:51.119234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:51.120022 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:51.120466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:51.258082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:51.266129 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6e0fba37-8381-4490-ab65-a1606c2aa940 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.159253 Jul 18 03:54:51.266708 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3939/7809] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:51 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:52.283729 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:52.284893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:52.287239 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:52.292721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:52.293213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:52.294013 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:52.294474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:52.446167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:52.454530 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-169094b5-20d1-4f46-8eca-6e51775fbd9d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.174665 Jul 18 03:54:52.455130 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3871/7810] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:52 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:53.474441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:53.475050 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:53.481946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:53.482422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:53.483166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:53.483607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:53.622293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:53.630405 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5f7a696e-42db-4a8b-a144-aa7b0499c8ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.160471 Jul 18 03:54:53.630996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3940/7811] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:53 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:54.647969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:54.648601 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:54.655826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:54.656291 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:54.657108 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:54.657559 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:54.797928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:54.806592 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-664a6ea1-0337-4cfe-bb19-ab4bd5cba885 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.162948 Jul 18 03:54:54.807286 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3872/7812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:54 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:55.823839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:55.824388 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:55.826234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:55.832387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:55.832960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:55.833745 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:55.834191 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:55.968710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:55.977069 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-373fe61c-9181-4714-8d69-c6499ce72de6 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.157219 Jul 18 03:54:55.977650 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3941/7813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:55 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:56.670452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e4d70f6f-6af5-4824-8329-7c9f7316d0c2 req-adf1c881-3be7-493c-957c-6af829ca2dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8527b6b8-1ada-4401-93ce-78626253655b", "name": "network-vif-plugged", "status": "completed", "tag": "a7c8a631-4cbf-42f0-9d06-bf5643468d9e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:54:56.674202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:56.681864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e4d70f6f-6af5-4824-8329-7c9f7316d0c2 req-adf1c881-3be7-493c-957c-6af829ca2dcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:56.682400 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e4d70f6f-6af5-4824-8329-7c9f7316d0c2 req-adf1c881-3be7-493c-957c-6af829ca2dcd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:56.694179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e4d70f6f-6af5-4824-8329-7c9f7316d0c2 req-adf1c881-3be7-493c-957c-6af829ca2dcd service nova] Creating event network-vif-plugged:a7c8a631-4cbf-42f0-9d06-bf5643468d9e for instance 8527b6b8-1ada-4401-93ce-78626253655b on n-h1-849796-1 Jul 18 03:54:56.699149 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e4d70f6f-6af5-4824-8329-7c9f7316d0c2 req-adf1c881-3be7-493c-957c-6af829ca2dcd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Jul 18 03:54:56.699755 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3873/7814] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:54:56.995214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:56.995839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:57.002992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:57.003451 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:57.005534 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:57.005992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:57.143310 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:57.151273 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3ac59d63-d024-46ba-8fdf-afc29dbc3ac3 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1392 microversion: 2.1 time: 0.160597 Jul 18 03:54:57.151841 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3942/7815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:56 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:58.170175 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:58.170876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:58.179234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:58.179742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:58.181046 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:58.181504 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:58.319705 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:58.327263 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-16082902-ef00-4d33-92f4-a2a30f730dcd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1564 microversion: 2.1 time: 0.162251 Jul 18 03:54:58.327835 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3874/7816] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:58 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:54:58.344469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:54:58.345148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:54:58.347175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:54:58.353510 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:58.353974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:58.354760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:54:58.355213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:54:58.494230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:54:58.501665 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-97ce27c9-9bee-4213-bee7-dc9c224297ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1564 microversion: 2.1 time: 0.161401 Jul 18 03:54:58.502235 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3943/7817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:54:58 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:55:00.150199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:55:00.150836 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:55:00.153728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:55:00.153860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-695a2c5d-ed7a-4152-9f11-74dee91c64b5 req-22922bea-1299-4a5c-ba7e-c48d2d3f0dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8527b6b8-1ada-4401-93ce-78626253655b", "tag": "a7c8a631-4cbf-42f0-9d06-bf5643468d9e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:55:00.159835 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:55:00.160374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:55:00.161335 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:55:00.161797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:55:00.162839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-695a2c5d-ed7a-4152-9f11-74dee91c64b5 req-22922bea-1299-4a5c-ba7e-c48d2d3f0dd9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:55:00.163541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-695a2c5d-ed7a-4152-9f11-74dee91c64b5 req-22922bea-1299-4a5c-ba7e-c48d2d3f0dd9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:55:00.175692 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-695a2c5d-ed7a-4152-9f11-74dee91c64b5 req-22922bea-1299-4a5c-ba7e-c48d2d3f0dd9 service nova] Creating event network-changed:a7c8a631-4cbf-42f0-9d06-bf5643468d9e for instance 8527b6b8-1ada-4401-93ce-78626253655b on n-h1-849796-1 Jul 18 03:55:00.183164 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-695a2c5d-ed7a-4152-9f11-74dee91c64b5 req-22922bea-1299-4a5c-ba7e-c48d2d3f0dd9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033330 Jul 18 03:55:00.184119 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3944/7818] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:55:00.392354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:55:00.400961 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-eda7a9f6-5a6a-4735-9c68-0a2804181607 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1564 microversion: 2.1 time: 0.254572 Jul 18 03:55:00.413018 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3875/7819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:55:00 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:55:35.702653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:55:35.703606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:55:35.705922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:55:35.706566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=44 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:55:35.713938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:55:35.714398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:55:35.715209 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:55:35.715686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:55:35.769215 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-686e845e-67da-4687-93ab-b88d221421c0 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action" status: 200 len: 24568 microversion: 2.1 time: 0.071347 Jul 18 03:55:35.769895 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3945/7820] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:55:35 2022] POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:56:01.975171 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:56:01.975924 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 03:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:56:06.203482 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 03:56:06.204089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:06.204784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=42 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:06.209424 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-60f3d391-9a0e-487d-8bfd-c5d6ee84e5fe tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:06.216345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60f3d391-9a0e-487d-8bfd-c5d6ee84e5fe tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:06.216815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-60f3d391-9a0e-487d-8bfd-c5d6ee84e5fe tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:06.240189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-60f3d391-9a0e-487d-8bfd-c5d6ee84e5fe tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Going to try to stop instance {{(pid=119440) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 03:56:06.283882 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-60f3d391-9a0e-487d-8bfd-c5d6ee84e5fe tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action" status: 202 len: 0 microversion: 2.1 time: 0.082451 Jul 18 03:56:06.284702 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3876/7821] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:56:06 2022] POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 03:56:06.295171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:06.296779 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:06.304223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:06.305582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:06.311180 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:06.311633 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:06.312412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:06.312854 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:06.453080 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:06.460854 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b91070d9-d443-4016-b13a-f057a0413570 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.170237 Jul 18 03:56:06.461388 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3946/7822] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:06 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:07.481659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:07.482396 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:07.490437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:07.491037 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:07.491841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:07.492302 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:07.497780 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56026. Jul 18 03:56:07.636482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:07.644107 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-654b19ed-e765-439a-9de2-176042f2b50c tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.168261 Jul 18 03:56:07.644690 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3877/7823] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:07 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:08.662792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:08.663352 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:08.671126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:08.671587 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:08.672373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:08.672822 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:08.811136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:08.819262 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6f87dbc5-296e-4ca0-aea6-05a0fa494211 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.161090 Jul 18 03:56:08.819822 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3947/7824] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:08 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:09.840289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:09.840940 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:09.848211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:09.849443 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:09.850342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:09.850804 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:09.991014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:09.998683 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9e00c54b-a3c1-4a5b-8a7d-c850d1348ab4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.162287 Jul 18 03:56:09.999423 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3878/7825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:09 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:11.016889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:11.017518 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:11.025122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:11.025585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:11.026362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:11.026805 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:11.160583 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:11.169580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f755321c-f8c1-45ef-8ef9-17f5e27d4c62 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.156662 Jul 18 03:56:11.170170 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3948/7826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:11 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:12.187886 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:12.188448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:12.195545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:12.196014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:12.196813 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:12.197316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:12.336480 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:12.344584 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9f02da4e-feea-4ee9-8c9a-2fb7a7a5a73b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.160802 Jul 18 03:56:12.345274 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3879/7827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:12 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:13.363937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:13.365230 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:13.373238 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:13.373684 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:13.374493 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:13.374937 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:13.510851 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:13.518541 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-19b89bf2-54f9-4d84-8b99-862b421cc1e8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.158878 Jul 18 03:56:13.519205 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3949/7828] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:13 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:14.536158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:14.536949 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:14.545148 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:14.545618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:14.546428 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:14.546913 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:14.687969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:14.696554 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0026d431-a88e-4b45-81f1-cafeeaa81be5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.164428 Jul 18 03:56:14.697171 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3880/7829] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:14 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:15.714870 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:15.715486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:15.722465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:15.722930 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:15.723712 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:15.724170 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:15.861210 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:15.870659 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4a2a66de-afcb-4195-b216-dd541c45014e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.159441 Jul 18 03:56:15.871115 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3950/7830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:15 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:56:16.887987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:16.888609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:16.895904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:16.896998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:16.897816 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:16.898270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:17.032509 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:17.040732 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-43580317-6711-4036-b72d-4ae70630aec7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.156658 Jul 18 03:56:17.041355 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3881/7831] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:16 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:18.058943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:18.059686 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:18.066669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:18.067130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:18.067908 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:18.069125 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:18.205910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:18.213849 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-87622c8c-674b-43b1-98f3-8798c58132f8 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.158788 Jul 18 03:56:18.214443 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3951/7832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:18 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:19.234011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:19.234682 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:19.243167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:19.243633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:19.244477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:19.244971 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:19.419769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:19.436024 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6be7b76-0aeb-449f-9d76-ce02f46c2bbf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.204242 Jul 18 03:56:19.437671 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3882/7833] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:19 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:56:20.455995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:20.456613 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:20.465239 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:20.465748 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:20.466901 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:20.467462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:20.653850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:20.661580 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f374211e-9974-42ac-a5ad-f36293c7b8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1693 microversion: 2.1 time: 0.209698 Jul 18 03:56:20.662715 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3952/7834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:20 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:21.679885 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:21.680584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:21.688495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:21.689317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:21.690178 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:21.690643 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:21.850150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:21.857962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-99a36455-8d8d-4a02-b006-93310cff317d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1670 microversion: 2.1 time: 0.182630 Jul 18 03:56:21.858547 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3883/7835] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:21 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1670 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:22.950561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:22.951486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:22.958887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:22.959343 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:22.960252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:22.960697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:23.020055 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a5bb1493-f3f0-496d-988d-71df2742aead tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action" status: 200 len: 36869 microversion: 2.1 time: 0.073174 Jul 18 03:56:23.020740 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3953/7836] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:56:22 2022] POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action => generated 36869 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:56:23.033599 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cf97da00-d90e-49cb-86ec-2d2f52d82ad5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:23.042411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf97da00-d90e-49cb-86ec-2d2f52d82ad5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:23.042884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cf97da00-d90e-49cb-86ec-2d2f52d82ad5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:23.074814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cf97da00-d90e-49cb-86ec-2d2f52d82ad5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Going to try to start instance {{(pid=119440) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 03:56:23.136488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cf97da00-d90e-49cb-86ec-2d2f52d82ad5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action" status: 202 len: 0 microversion: 2.1 time: 0.107870 Jul 18 03:56:23.137493 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3884/7837] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:56:23 2022] POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:56:23.147018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:23.148286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:23.159260 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:23.160005 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:23.161370 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:23.162638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:23.654960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:23.669763 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5552d422-220d-4d74-8e8d-6c750c4ef8fd tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1679 microversion: 2.1 time: 0.527169 Jul 18 03:56:23.670993 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3954/7838] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:23 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1679 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:56:24.700092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:56:24.700728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:24.707250 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:24.707709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:24.708501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:24.709711 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:24.857413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:56:24.866230 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0b3a4207-d0e8-4a4a-9559-f0e357fbf9f2 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1683 microversion: 2.1 time: 0.171791 Jul 18 03:56:24.866834 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3885/7839] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:56:24 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:56:59.122371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:56:59.123325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:56:59.125969 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=18 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:59.126761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=52 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:56:59.133185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:59.133648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:59.134443 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:56:59.134894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:56:59.187515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-600b3292-bd49-4a34-b3de-cd07689a7d22 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action" status: 200 len: 61430 microversion: 2.1 time: 0.069652 Jul 18 03:56:59.188678 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3955/7840] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:56:59 2022] POST /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b/action => generated 61430 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:57:23.045557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:23.046111 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:23.048597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=20 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:23.049503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:23.050036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:23.050841 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=4 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:23.055224 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:23.056177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:23.057248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:23.057934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:23.087011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:57:23.175675 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8160de1e-0b6f-4f52-b479-cf5e00bd29c4 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 204 len: 0 microversion: 2.1 time: 0.134517 Jul 18 03:57:23.176963 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3886/7841] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:57:23 2022] DELETE /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:57:23.190364 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:23.191097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:23.205742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:23.206332 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:23.207397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:23.207864 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:23.301287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-613ae345-4ce3-4df5-9346-7e05d29c9e83 req-72e015b7-24fb-4e0c-b16e-0061603fa41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8527b6b8-1ada-4401-93ce-78626253655b", "tag": "a7c8a631-4cbf-42f0-9d06-bf5643468d9e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:23.311255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-613ae345-4ce3-4df5-9346-7e05d29c9e83 req-72e015b7-24fb-4e0c-b16e-0061603fa41a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:23.311255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-613ae345-4ce3-4df5-9346-7e05d29c9e83 req-72e015b7-24fb-4e0c-b16e-0061603fa41a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:23.321919 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-613ae345-4ce3-4df5-9346-7e05d29c9e83 req-72e015b7-24fb-4e0c-b16e-0061603fa41a service nova] Creating event network-changed:a7c8a631-4cbf-42f0-9d06-bf5643468d9e for instance 8527b6b8-1ada-4401-93ce-78626253655b on n-h1-849796-1 Jul 18 03:57:23.327693 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-613ae345-4ce3-4df5-9346-7e05d29c9e83 req-72e015b7-24fb-4e0c-b16e-0061603fa41a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284318 Jul 18 03:57:23.328606 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3956/7842] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:57:23.547146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:23.555506 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-48a485f6-36ec-41f3-aa76-5c3ceeaa0816 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1689 microversion: 2.1 time: 0.372838 Jul 18 03:57:23.556204 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3887/7843] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:23 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1689 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:24.575619 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:24.577055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:24.584348 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:24.584809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:24.585638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:24.586092 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:24.733689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:24.742114 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d1aa5da3-a12a-43c7-93bb-e9fb797adf07 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1689 microversion: 2.1 time: 0.172210 Jul 18 03:57:24.742707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3957/7844] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:24 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:25.598837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-317629bc-c830-4a38-a3f2-d7b4bb341a68 req-ee99217e-1e76-4cf8-8fd1-f9d9fa5c7b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8527b6b8-1ada-4401-93ce-78626253655b", "name": "network-vif-deleted", "tag": "a7c8a631-4cbf-42f0-9d06-bf5643468d9e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:25.613452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-317629bc-c830-4a38-a3f2-d7b4bb341a68 req-ee99217e-1e76-4cf8-8fd1-f9d9fa5c7b28 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:25.613972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-317629bc-c830-4a38-a3f2-d7b4bb341a68 req-ee99217e-1e76-4cf8-8fd1-f9d9fa5c7b28 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:25.626310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-317629bc-c830-4a38-a3f2-d7b4bb341a68 req-ee99217e-1e76-4cf8-8fd1-f9d9fa5c7b28 service nova] Creating event network-vif-deleted:a7c8a631-4cbf-42f0-9d06-bf5643468d9e for instance 8527b6b8-1ada-4401-93ce-78626253655b on n-h1-849796-1 Jul 18 03:57:25.631151 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-317629bc-c830-4a38-a3f2-d7b4bb341a68 req-ee99217e-1e76-4cf8-8fd1-f9d9fa5c7b28 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036244 Jul 18 03:57:25.631764 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3888/7845] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:57:25.759820 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:25.760423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:25.767462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:25.767920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:25.768698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:25.769181 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:25.800607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:25.800997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:25.801462 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lazy-loading 'fault' on Instance uuid 8527b6b8-1ada-4401-93ce-78626253655b {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:57:25.843599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:25.851391 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1dbcbd06-090e-4d01-854d-ac7554fb93ce tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 200 len: 1357 microversion: 2.1 time: 0.095619 Jul 18 03:57:25.852176 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3958/7846] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:25 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 1357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:26.871080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:26.871709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 8527b6b8-1ada-4401-93ce-78626253655b] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:26.878397 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:26.878866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:26.879659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:26.880118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:26.893857 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] HTTP exception thrown: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Request method failure captured: Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b HTTP/1.1 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1Ne8pHpwWr10mHq6hXsf0L52_RUHuISVjR5Vco-GvORGEjIx0Th-YKAuFik7DUYAHrYSRzoto4xhHGy1ytER9qbPmNyMnJp_35G9Z77B0bTEYTRNubprNbTPx5uCwb4EWYYFrXsLykyOkr_EV4y3EgdhWu4lpeZeaIGWjPIwBqqZKtc Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: be1f392dc1cb4d7ca63acef79e1b5cc4 Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8527b6b8-1ada-4401-93ce-78626253655b'} Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:57:26.895513 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Returning 404 to user: Instance 8527b6b8-1ada-4401-93ce-78626253655b could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5847e509-cc7b-4110-8e13-a2ff00807d1e tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b" status: 404 len: 111 microversion: 2.1 time: 0.031101 Jul 18 03:57:26.900357 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3889/7847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:26 2022] GET /compute/v2.1/servers/8527b6b8-1ada-4401-93ce-78626253655b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:57:30.438338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c431048-2ed7-471e-8658-4ab6aef030cb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '.version_select at 0x7fab042f95e0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:30.446756 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9c431048-2ed7-471e-8658-4ab6aef030cb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [733ea8e7-f63c-4c0a-895f-442fa739b4c5] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:57:31.454184 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [None req-9c431048-2ed7-471e-8658-4ab6aef030cb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [733ea8e7-f63c-4c0a-895f-442fa739b4c5] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56132. Jul 18 03:57:31.475706 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c431048-2ed7-471e-8658-4ab6aef030cb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1879995136" status: 202 len: 0 microversion: 2.1 time: 1.042805 Jul 18 03:57:31.476741 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3959/7848] 10.222.0.67 () {58 vars in 1283 bytes} [Mon Jul 18 03:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1879995136 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:57:31.516495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: .version_select at 0x7faaf731b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-690224479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeOfCwat5XFJ25r63ge0LJxVIoP33yZNpMyoLp2DmRS4/GoD4fJ+rJXaQRA1H1b8rE2g8HwZXm6T1r2ebgXr9WvqPcvUQ1Q4dkbezhAfocZqCQkFvqRNs52Sx6NFl+/5g=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:31.531970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:57:31.538974 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:57:31.553409 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 03:57:32.559766 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [d79a31ba-3052-468f-b2f9-c026e98edbbd] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56136. Jul 18 03:57:32.576138 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-628e3ceb-fbc8-44c6-b8aa-47116ced7821 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.063933 Jul 18 03:57:32.576894 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3890/7849] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:57:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:57:38.483088 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=16 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:38.489521 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-665394167", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "networks": [{"uuid": "ed5da6a3-5660-45b7-845b-15ced95ba82a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-690224479", "security_groups": [{"name": "tempest-secgroup-smoke-697973039"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:38.633363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] validate_networks() for [('ed5da6a3-5660-45b7-845b-15ced95ba82a', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:57:39.084596 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:57:39.085267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:57:39.085824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:57:39.086208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:57:39.086660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:57:39.098099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:39.098564 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:39.099610 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:39.100372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:39.119622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:57:39.125709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Getting quotas for user be1f392dc1cb4d7ca63acef79e1b5cc4 and project dedbe084d60b487a9d8d04af9afcc69e. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:57:39.138819 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:57:39.141160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:57:39.191081 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-096b63e2-9549-487c-8c3e-57ea376a12a9 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709507 Jul 18 03:57:39.196694 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3960/7850] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:57:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:57:39.199883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:39.204584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7e4999b0-32cb-4739-af24-15558c73b07f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:39.205313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7e4999b0-32cb-4739-af24-15558c73b07f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:39.292706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7e4999b0-32cb-4739-af24-15558c73b07f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:39.301684 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7e4999b0-32cb-4739-af24-15558c73b07f tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1265 microversion: 2.1 time: 0.103394 Jul 18 03:57:39.302202 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3891/7851] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:39 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:40.321713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:40.322325 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:40.334159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:40.335032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:40.336070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:40.336788 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:40.416975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:40.427966 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5e2bee25-3a8b-4c02-ad55-d785ece6f534 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1325 microversion: 2.1 time: 0.110961 Jul 18 03:57:40.429207 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3961/7852] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:40 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1325 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:41.245998 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 03:57:41.246596 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 03:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 03:57:41.445845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:41.446860 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:41.455590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:41.456067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:41.456977 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:41.457459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:41.686501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:41.695627 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e955043b-47e5-41bc-b95c-ad04d04fd4bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.253637 Jul 18 03:57:41.696219 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3892/7853] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:41 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:57:42.018255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-ee74d781-e647-46c9-913c-270b187e23d2 req-915117cb-6091-4083-a8eb-84bf194789f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7", "tag": "e7a2842c-68df-460e-9a60-01da564f5a81"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:42.028275 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee74d781-e647-46c9-913c-270b187e23d2 req-915117cb-6091-4083-a8eb-84bf194789f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:42.028959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-ee74d781-e647-46c9-913c-270b187e23d2 req-915117cb-6091-4083-a8eb-84bf194789f4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:42.046765 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-ee74d781-e647-46c9-913c-270b187e23d2 req-915117cb-6091-4083-a8eb-84bf194789f4 service nova] Creating event network-changed:e7a2842c-68df-460e-9a60-01da564f5a81 for instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 on n-h1-849796-1 Jul 18 03:57:42.056688 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-ee74d781-e647-46c9-913c-270b187e23d2 req-915117cb-6091-4083-a8eb-84bf194789f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046090 Jul 18 03:57:42.057346 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3962/7854] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:57:42.713942 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:42.714697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:42.724843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:42.725425 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:42.726337 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:42.727005 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:42.867710 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:42.875607 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b742b39-7d19-4fe3-a83a-7ea4bdd1dd15 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.165861 Jul 18 03:57:42.876202 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3893/7855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:42 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:43.894327 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:43.894956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:43.902185 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:43.902648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:43.903441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:43.904866 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:44.038950 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:44.047752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1d42d971-3ed8-4686-a963-a8683d0bc661 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.157797 Jul 18 03:57:44.048381 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3963/7856] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:43 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:45.066070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:45.066616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:45.073470 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:45.073930 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:45.074708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:45.075182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:45.209892 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:45.217466 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-95487015-281b-4114-a9bf-c14afbe2b601 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.155460 Jul 18 03:57:45.218053 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3894/7857] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:45 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:46.234842 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:46.235464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:46.242725 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:46.243190 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:46.243977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:46.244431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:46.384938 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:46.393553 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dd44b7bb-06b7-4044-906e-e5ec7bd9098d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.162900 Jul 18 03:57:46.394136 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3964/7858] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:46 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:47.411650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:47.412198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:47.419198 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:47.419668 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:47.420467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:47.421086 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:47.562555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:47.570984 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-de741c96-406e-442d-8a25-1bc804686200 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.163288 Jul 18 03:57:47.571684 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3895/7859] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:47 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:48.589031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:48.589651 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:48.597234 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:48.597696 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:48.598478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:48.598919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:48.740240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:48.748505 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3524ecf-2be8-42a8-8bbf-6e2fc50313c1 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.162852 Jul 18 03:57:48.748718 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3965/7860] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:48 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:49.559696 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:49.619199 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-b8b977ec-806d-4410-9256-2be370759578 req-ab96b69b-87db-479e-8b40-8888599682dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7", "name": "network-vif-plugged", "status": "completed", "tag": "e7a2842c-68df-460e-9a60-01da564f5a81"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:49.645690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b8b977ec-806d-4410-9256-2be370759578 req-ab96b69b-87db-479e-8b40-8888599682dd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:49.646147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-b8b977ec-806d-4410-9256-2be370759578 req-ab96b69b-87db-479e-8b40-8888599682dd service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:49.658322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-b8b977ec-806d-4410-9256-2be370759578 req-ab96b69b-87db-479e-8b40-8888599682dd service nova] Creating event network-vif-plugged:e7a2842c-68df-460e-9a60-01da564f5a81 for instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 on n-h1-849796-1 Jul 18 03:57:49.663367 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-b8b977ec-806d-4410-9256-2be370759578 req-ab96b69b-87db-479e-8b40-8888599682dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110179 Jul 18 03:57:49.664297 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3896/7861] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:57:49.765970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:49.766523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:49.769904 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:49.770926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:49.778017 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:49.778710 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:49.779699 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:49.780763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:49.923806 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:49.931507 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f8f099f6-bda3-4d50-8f85-7ea1e96f0405 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.170173 Jul 18 03:57:49.932087 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3966/7862] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:49 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:50.950348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:50.950987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:50.958150 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:50.958623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:50.959420 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:50.959884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:51.104247 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:51.114781 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4a287a56-e8ee-436a-af4f-8514c589a230 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1390 microversion: 2.1 time: 0.169635 Jul 18 03:57:51.115821 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3897/7863] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:50 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:52.132454 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:52.133031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:52.140034 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:52.140504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:52.141307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:52.141761 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:52.282377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:52.290370 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbc092e8-58ea-42e1-8c28-2c48d5c36506 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1561 microversion: 2.1 time: 0.161957 Jul 18 03:57:52.290965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3967/7864] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:52 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:52.307279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:52.307910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:52.315461 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:52.315928 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:52.316718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:52.317212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:52.455894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:52.465042 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8e6f661b-5969-4e24-8e1b-5fb2b0fa37ab tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1561 microversion: 2.1 time: 0.161556 Jul 18 03:57:52.465634 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3898/7865] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:52 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:57:54.405629 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:57:54.406881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:57:54.408822 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-0f569044-8cb1-43f7-b355-bfc2ce393b8e req-b45fc6dc-4cb8-49d4-bf69-4886cabd659f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7", "tag": "e7a2842c-68df-460e-9a60-01da564f5a81"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:57:54.410311 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:54.415549 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:57:54.416345 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:54.416951 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:54.417830 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:54.418300 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:54.423529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0f569044-8cb1-43f7-b355-bfc2ce393b8e req-b45fc6dc-4cb8-49d4-bf69-4886cabd659f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:57:54.424283 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-0f569044-8cb1-43f7-b355-bfc2ce393b8e req-b45fc6dc-4cb8-49d4-bf69-4886cabd659f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:57:54.438637 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-0f569044-8cb1-43f7-b355-bfc2ce393b8e req-b45fc6dc-4cb8-49d4-bf69-4886cabd659f service nova] Creating event network-changed:e7a2842c-68df-460e-9a60-01da564f5a81 for instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 on n-h1-849796-1 Jul 18 03:57:54.444323 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-0f569044-8cb1-43f7-b355-bfc2ce393b8e req-b45fc6dc-4cb8-49d4-bf69-4886cabd659f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Jul 18 03:57:54.445246 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3899/7866] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:57:54.563280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:57:54.573167 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7dec447-7898-411a-a378-9f9d9042a627 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1561 microversion: 2.1 time: 0.171503 Jul 18 03:57:54.573757 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3968/7867] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:57:54 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:27.858718 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=40 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:27.859501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:27.864201 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:27.865346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:27.872889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:27.873437 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:27.874260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:27.874688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:27.931369 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3e934680-aec2-4c07-bb9c-8cbb64ba76a7 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action" status: 200 len: 24567 microversion: 2.1 time: 0.074630 Jul 18 03:58:27.932066 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3900/7868] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:58:27 2022] POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action => generated 24567 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 03:58:58.344456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:58.345228 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=46 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:58.349914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:58:58.350654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:58.358096 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:58.358563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:58.359361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:58.359814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:58.383813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lazy-loading 'flavor' on Instance uuid 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 03:58:58.456554 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b6c73484-8402-426e-bf38-377779620844 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action" status: 202 len: 0 microversion: 2.1 time: 0.113117 Jul 18 03:58:58.460347 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3969/7869] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:58:58 2022] POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:58:58.466826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:58.467576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:58.470260 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:58.471082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:58:58.477631 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:58.478024 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:58.478812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:58.479265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:58.620142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:58.628694 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1798c1c7-1a7b-43ba-b338-1ac32005e2b5 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1688 microversion: 2.1 time: 0.165607 Jul 18 03:58:58.629319 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3901/7870] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:58 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:58:59.649774 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:58:59.650408 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:58:59.656566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:59.657055 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:59.657826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:58:59.658267 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:58:59.845953 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:58:59.854520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-baf4a86d-7ecf-4ebc-b661-20ad13c7c30b tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1688 microversion: 2.1 time: 0.210906 Jul 18 03:58:59.855108 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3970/7871] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:58:59 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 03:59:00.872803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:00.873405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:00.881048 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:00.881520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:00.882314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:00.882773 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:01.020543 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:01.028494 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3741e7ab-2dc6-46eb-96e6-88a3f4ded2bf tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1671 microversion: 2.1 time: 0.159662 Jul 18 03:59:01.029102 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3902/7872] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:00 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:02.119754 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:02.120671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:02.127688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.128326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.129135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.129580 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.178999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f3d3c6d4-d403-4c14-91c8-03530c873b3a tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action" status: 200 len: 35231 microversion: 2.1 time: 0.062990 Jul 18 03:59:02.179649 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3971/7873] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:59:02 2022] POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action => generated 35231 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:59:02.191174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:02.191751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:02.198782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.199244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.200031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.200485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.271310 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c584b0d8-38bc-4fd1-9805-e8657dd5962d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action" status: 202 len: 0 microversion: 2.1 time: 0.083875 Jul 18 03:59:02.271975 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3903/7874] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:59:02 2022] POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:59:02.280975 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:02.281730 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:02.290060 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.290593 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.291329 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:02.291785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:02.435076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:02.442806 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40656000-a07d-4241-bf46-7b5080d7e8ad tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1677 microversion: 2.1 time: 0.166263 Jul 18 03:59:02.443391 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3972/7875] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:02 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:03.462633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:03.463544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:03.470351 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:03.470828 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:03.472371 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:03.473160 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:03.616961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:03.624455 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e34c155-a483-478d-b901-a02e5a4d9b36 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1677 microversion: 2.1 time: 0.167356 Jul 18 03:59:03.625055 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3904/7876] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:03 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:04.641319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:04.641932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:04.652412 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:04.652890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:04.653670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:04.654126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:04.787890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:04.795461 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8415d2c8-8a3e-4b89-8ebc-7f6612ef99ac tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1680 microversion: 2.1 time: 0.158089 Jul 18 03:59:04.796030 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3973/7877] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:04 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:04.896762 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:04.897740 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:04.904723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:04.905225 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:04.906022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:04.906481 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:04.948967 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4fdb9b5-4c1d-4b48-93f6-91fa854f4fbb tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action" status: 200 len: 35231 microversion: 2.1 time: 0.055998 Jul 18 03:59:04.949627 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3905/7878] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 03:59:04 2022] POST /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7/action => generated 35231 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 03:59:06.046747 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:06.047295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:06.052161 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e9e7611b-6037-4a87-86b2-60280365ccfb req-186072f4-5978-4762-a36f-d6dad62b4790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7", "tag": "e7a2842c-68df-460e-9a60-01da564f5a81"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:06.055052 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:06.055918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:06.056559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:06.057031 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:06.063174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e9e7611b-6037-4a87-86b2-60280365ccfb req-186072f4-5978-4762-a36f-d6dad62b4790 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:06.063723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e9e7611b-6037-4a87-86b2-60280365ccfb req-186072f4-5978-4762-a36f-d6dad62b4790 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:06.076002 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e9e7611b-6037-4a87-86b2-60280365ccfb req-186072f4-5978-4762-a36f-d6dad62b4790 service nova] Creating event network-changed:e7a2842c-68df-460e-9a60-01da564f5a81 for instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 on n-h1-849796-1 Jul 18 03:59:06.081989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e9e7611b-6037-4a87-86b2-60280365ccfb req-186072f4-5978-4762-a36f-d6dad62b4790 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033830 Jul 18 03:59:06.082895 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3906/7879] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:59:06.085138 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 03:59:06.177771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9c06743f-7013-42c8-9636-71e42cbc1417 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 204 len: 0 microversion: 2.1 time: 0.134703 Jul 18 03:59:06.178527 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3974/7880] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 03:59:06 2022] DELETE /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 03:59:06.189211 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:06.190014 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:06.198602 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:06.199072 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:06.199887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:06.200349 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:06.375588 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:06.384365 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fc75c9d7-8ddf-4886-afee-145338ced85d tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1686 microversion: 2.1 time: 0.200517 Jul 18 03:59:06.385284 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3907/7881] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:06 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:07.404637 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:07.405277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:07.412486 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:07.412960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:07.413739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:07.414186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:07.551992 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:07.559688 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-78c493f6-6d85-4d67-8bf1-2ffdfc284c65 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1686 microversion: 2.1 time: 0.159451 Jul 18 03:59:07.560268 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3975/7882] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:07 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:08.581234 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:08.582129 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:08.591408 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:08.591876 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:08.592670 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:08.593287 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:08.639826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c52bad4b-2b19-41b0-9013-c482ecefbbd0 req-f051c2e5-b1c0-4556-b756-edddd576df05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7", "name": "network-vif-deleted", "tag": "e7a2842c-68df-460e-9a60-01da564f5a81"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:08.650160 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c52bad4b-2b19-41b0-9013-c482ecefbbd0 req-f051c2e5-b1c0-4556-b756-edddd576df05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:08.650602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c52bad4b-2b19-41b0-9013-c482ecefbbd0 req-f051c2e5-b1c0-4556-b756-edddd576df05 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:08.662414 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c52bad4b-2b19-41b0-9013-c482ecefbbd0 req-f051c2e5-b1c0-4556-b756-edddd576df05 service nova] Creating event network-vif-deleted:e7a2842c-68df-460e-9a60-01da564f5a81 for instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 on n-h1-849796-1 Jul 18 03:59:08.667113 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f392dc1cb4d7ca63acef79e1b5cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedbe084d60b487a9d8d04af9afcc69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:08.669235 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c52bad4b-2b19-41b0-9013-c482ecefbbd0 req-f051c2e5-b1c0-4556-b756-edddd576df05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Jul 18 03:59:08.672803 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3976/7883] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 03:59:08.675445 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-0355ceef-76f8-4be6-aee6-9300a8116694 tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 200 len: 1500 microversion: 2.1 time: 0.100425 Jul 18 03:59:08.675986 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3908/7884] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:08 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 1500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:09.695124 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:09.695723 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] [instance: 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:09.702207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:09.702663 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:09.704026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:09.704026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:09.718190 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] HTTP exception thrown: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Request method failure captured: Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 HTTP/1.1 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1Ne8pHpwWr10mHq6hXsf0L52_RUHuISVjR5Vco-GvORGEjIx0Th-YKAuFik7DUYAHrYSRzoto4xhHGy1ytER9qbPmNyMnJp_35G9Z77B0bTEYTRNubprNbTPx5uCwb4EWYYFrXsLykyOkr_EV4y3EgdhWu4lpeZeaIGWjPIwBqqZKtc Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dedbe084d60b487a9d8d04af9afcc69e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: dedbe084d60b487a9d8d04af9afcc69e Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1559410239 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: be1f392dc1cb4d7ca63acef79e1b5cc4 Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1559410239-project Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': '1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7'} Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:59:09.719850 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Returning 404 to user: Instance 1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-979575b9-0ef2-4e05-9c75-c371ab76d1df tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7" status: 404 len: 111 microversion: 2.1 time: 0.032185 Jul 18 03:59:09.725968 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3977/7885] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:09 2022] GET /compute/v2.1/servers/1cd7bb81-2fcc-44cf-9ee7-6153dd3e60d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 03:59:13.126052 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2fed133a-af3a-41ad-ab7f-4a10af58d0aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] Calling method '.version_select at 0x7fab047cc310>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:13.146142 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2fed133a-af3a-41ad-ab7f-4a10af58d0aa tempest-TestNetworkAdvancedServerOps-1559410239 tempest-TestNetworkAdvancedServerOps-1559410239-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690224479" status: 202 len: 0 microversion: 2.1 time: 0.023926 Jul 18 03:59:13.146904 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3909/7886] 10.222.0.67 () {58 vars in 1280 bytes} [Mon Jul 18 03:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690224479 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 03:59:24.718338 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:24.719155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:24.897556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2e728b7a-5611-4366-a49a-e6f5ae431ee2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'create', calling method: .version_select at 0x7fab048dea60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1130310291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgtJ3M3lmSgGdxaeN5e8uYGkcoILdET9oLXRQP68WUfcAv3QpSDfaw8yPG0qO+a8iV5tuQpUlAmxLhAhAtM8H4LblvOBsqrjOwx1skmYohvGZKITThRnCxx9o9y0cIfDg=="}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:24.912980 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2e728b7a-5611-4366-a49a-e6f5ae431ee2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for project b6d7730570f94326990a32aaef903156. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:59:24.918155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-2e728b7a-5611-4366-a49a-e6f5ae431ee2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for user 7d0427329b2d42678966d35f5af1dfa8 and project b6d7730570f94326990a32aaef903156. Resources: {'key_pairs'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:59:24.948020 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2e728b7a-5611-4366-a49a-e6f5ae431ee2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235506 Jul 18 03:59:24.948722 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3978/7887] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 03:59:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:59:26.016784 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-519378766", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1130310291", "security_groups": [{"name": "tempest-secgroup-smoke-982005445"}], "networks": [{"uuid": "2ddf3698-0cec-4f39-adc6-dcd8f6103e0f"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:26.025998 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:26.026737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:26.143893 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] validate_networks() for [('2ddf3698-0cec-4f39-adc6-dcd8f6103e0f', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 03:59:26.589849 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 03:59:26.590635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 03:59:26.590781 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 03:59:26.591430 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 03:59:26.591868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 03:59:26.602157 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:26.602630 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:26.603464 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:26.603916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:26.623814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for project b6d7730570f94326990a32aaef903156. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 03:59:26.629753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for user 7d0427329b2d42678966d35f5af1dfa8 and project b6d7730570f94326990a32aaef903156. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 03:59:26.644206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 03:59:26.646897 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 03:59:26.701278 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f931317d-a563-4c5e-9edf-2b1ff469733f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688356 Jul 18 03:59:26.702518 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3910/7888] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 03:59:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 03:59:26.721076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d859010b-e3f7-4573-8ed2-fbf76616c1bd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:26.722353 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d859010b-e3f7-4573-8ed2-fbf76616c1bd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:26.797205 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d859010b-e3f7-4573-8ed2-fbf76616c1bd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:26.805135 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d859010b-e3f7-4573-8ed2-fbf76616c1bd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1246 microversion: 2.1 time: 0.095784 Jul 18 03:59:26.805732 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3979/7889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:26 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:27.823159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9bcc7652-1b27-44ba-975d-7dce83acd657 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:27.823837 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9bcc7652-1b27-44ba-975d-7dce83acd657 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:27.888200 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9bcc7652-1b27-44ba-975d-7dce83acd657 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:27.898322 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9bcc7652-1b27-44ba-975d-7dce83acd657 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1246 microversion: 2.1 time: 0.079031 Jul 18 03:59:27.898322 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3911/7890] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:27 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:28.914405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3501afc4-e5ec-4a22-8055-705f1cce3389 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:28.915045 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3501afc4-e5ec-4a22-8055-705f1cce3389 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:28.979691 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3501afc4-e5ec-4a22-8055-705f1cce3389 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:28.988694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3501afc4-e5ec-4a22-8055-705f1cce3389 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1246 microversion: 2.1 time: 0.077049 Jul 18 03:59:28.989257 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3980/7891] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:28 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:30.006182 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5132cbb6-88d1-4bde-9ad1-855a3d072c9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:30.006812 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5132cbb6-88d1-4bde-9ad1-855a3d072c9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:30.061820 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5132cbb6-88d1-4bde-9ad1-855a3d072c9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:30.069157 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5132cbb6-88d1-4bde-9ad1-855a3d072c9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1246 microversion: 2.1 time: 0.067757 Jul 18 03:59:30.069730 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3912/7892] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:30 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:31.086707 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:31.087363 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:31.094386 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:31.094846 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:31.095640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:31.096085 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:31.164732 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:31.172360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-aa665a51-046d-47ad-bba3-99bcd9fe9abe tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1250 microversion: 2.1 time: 0.089688 Jul 18 03:59:31.172969 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3981/7893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:31 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:32.191409 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:32.192902 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:32.203651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:32.205202 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:32.206765 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:32.207404 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:32.304996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:32.314145 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-56a16875-d52b-4a78-87ca-762f25b7a935 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1306 microversion: 2.1 time: 0.128236 Jul 18 03:59:32.315063 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3913/7894] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:32 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:33.333752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:33.334359 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:33.341810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:33.342200 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:33.342997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:33.343458 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:33.498801 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:33.507448 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51a24a1d-1e20-43dc-8ef7-621ba1590c99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.178242 Jul 18 03:59:33.508049 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3982/7895] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:33 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:33.773022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-2136db72-626b-44c0-acb0-9b80f24f31bc req-0b867ba0-01b7-42a7-bac9-3cc9c470b86a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:33.786027 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2136db72-626b-44c0-acb0-9b80f24f31bc req-0b867ba0-01b7-42a7-bac9-3cc9c470b86a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:33.786489 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-2136db72-626b-44c0-acb0-9b80f24f31bc req-0b867ba0-01b7-42a7-bac9-3cc9c470b86a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:33.798982 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-2136db72-626b-44c0-acb0-9b80f24f31bc req-0b867ba0-01b7-42a7-bac9-3cc9c470b86a service nova] Creating event network-changed:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 03:59:33.805102 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-2136db72-626b-44c0-acb0-9b80f24f31bc req-0b867ba0-01b7-42a7-bac9-3cc9c470b86a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120845 Jul 18 03:59:33.806064 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3914/7896] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:59:34.525559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:34.526176 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:34.533283 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:34.533736 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:34.535276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:34.535812 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:34.674142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:34.683157 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7b05e21e-a6bc-4520-aa07-6d3655b9e35d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.161539 Jul 18 03:59:34.683745 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3983/7897] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:34 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:35.701515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:35.702244 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:35.710181 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:35.710656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:35.711448 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:35.711905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:35.853460 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:35.860989 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9ed5e3d4-e0f1-4144-b65f-0d57af4abc9e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.163800 Jul 18 03:59:35.861566 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3915/7898] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:35 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:36.878847 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:36.879444 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:36.887039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:36.887504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:36.888299 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:36.888753 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:37.030075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:37.038519 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1e003a29-23b2-48d5-a54b-3bb68290b17f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.163790 Jul 18 03:59:37.039095 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3984/7899] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:36 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:38.055638 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:38.056411 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:38.058683 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:38.064848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:38.065385 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:38.066174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:38.066622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:38.207165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:38.215223 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-821708fd-95c9-40e7-b3ef-fb592d85ce5a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.163736 Jul 18 03:59:38.215817 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3916/7900] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:38 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:39.231750 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:39.232361 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:39.235066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=8 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:39.241335 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:39.241802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:39.242595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:39.243054 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:39.383196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:39.390791 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-102daf98-5518-4a98-b753-84f71140c65b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.162997 Jul 18 03:59:39.391374 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3985/7901] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:39 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:40.142116 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-57fb024e-ec74-4053-a5de-485d2cda0925 req-626c00bf-cf85-4de8-a016-3887b09d8a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "name": "network-vif-plugged", "status": "completed", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:40.146912 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 03:59:40.152807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-57fb024e-ec74-4053-a5de-485d2cda0925 req-626c00bf-cf85-4de8-a016-3887b09d8a8a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:40.153308 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-57fb024e-ec74-4053-a5de-485d2cda0925 req-626c00bf-cf85-4de8-a016-3887b09d8a8a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:40.167923 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-57fb024e-ec74-4053-a5de-485d2cda0925 req-626c00bf-cf85-4de8-a016-3887b09d8a8a service nova] Creating event network-vif-plugged:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 03:59:40.172880 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-57fb024e-ec74-4053-a5de-485d2cda0925 req-626c00bf-cf85-4de8-a016-3887b09d8a8a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034567 Jul 18 03:59:40.173725 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3917/7902] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 03:59:40.408406 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:40.410194 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:40.417274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:40.417741 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:40.418531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:40.418986 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:40.558497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:40.566206 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-09066ffc-af32-45aa-b906-8acaf12f3761 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1371 microversion: 2.1 time: 0.161789 Jul 18 03:59:40.566840 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3986/7903] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:40 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:41.585748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:41.586451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:41.593073 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:41.593544 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:41.594347 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:41.594826 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:41.739012 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:41.746578 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f788c834-d77a-4849-ae4d-2079bc0f8f33 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1555 microversion: 2.1 time: 0.166967 Jul 18 03:59:41.747167 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3918/7904] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:41 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:41.763276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 03:59:41.763902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 03:59:41.771634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:41.772091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:41.772899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:41.773374 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:41.926122 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 03:59:41.934054 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ed0cba6a-d8c4-463d-ab3d-03eab8427658 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1555 microversion: 2.1 time: 0.174737 Jul 18 03:59:41.934648 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3987/7905] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 03:59:41 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 03:59:44.024279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5c851a76-9429-4f75-9ac9-bd44027f96e7 req-e1f6cb85-bf1b-4394-b262-fe3bdf9de764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 03:59:44.037625 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5c851a76-9429-4f75-9ac9-bd44027f96e7 req-e1f6cb85-bf1b-4394-b262-fe3bdf9de764 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 03:59:44.038418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5c851a76-9429-4f75-9ac9-bd44027f96e7 req-e1f6cb85-bf1b-4394-b262-fe3bdf9de764 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 03:59:44.050294 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5c851a76-9429-4f75-9ac9-bd44027f96e7 req-e1f6cb85-bf1b-4394-b262-fe3bdf9de764 service nova] Creating event network-changed:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 03:59:44.055375 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5c851a76-9429-4f75-9ac9-bd44027f96e7 req-e1f6cb85-bf1b-4394-b262-fe3bdf9de764 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035240 Jul 18 03:59:44.056039 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3919/7906] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 03:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:02:20.498044 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:02:20.499206 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:02:20.499889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:20.501213 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=42 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:20.505751 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:02:20.506525 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:20.515118 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:20.515501 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:20.516414 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:20.516865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:20.542653 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lazy-loading 'flavor' on Instance uuid 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 04:02:20.805210 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7c055503-bb2e-4cba-b20c-b053d401447a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f/action" status: 202 len: 0 microversion: 2.1 time: 0.309280 Jul 18 04:02:20.805921 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3988/7907] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:02:20 2022] POST /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:02:20.813061 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:02:20.813896 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:02:20.814503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:20.815265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=32 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:20.820189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:20.820915 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:20.830499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:20.830966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:20.831771 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:20.832233 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:20.974466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:20.982398 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c99a4f9b-c312-42b3-bfe7-4eb98722933b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.171931 Jul 18 04:02:20.982979 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3920/7908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:20 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:22.003802 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:22.004519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:22.013868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:22.014337 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:22.015143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:22.015597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:22.019865 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56584. Jul 18 04:02:22.020582 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56582. Jul 18 04:02:22.161977 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:22.170289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ff5d6c90-8b41-475d-b904-a2d876330335 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.173808 Jul 18 04:02:22.170869 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3989/7909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:21 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:23.188658 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:23.189307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:23.202185 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:23.202675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:23.203457 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:23.203908 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:23.208330 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56592. Jul 18 04:02:23.210611 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56594. Jul 18 04:02:23.414019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:23.422767 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b4173c7c-9ec7-42e0-bd3b-3dbff6c0541e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.238819 Jul 18 04:02:23.423348 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3921/7910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:23 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:24.439469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:24.440075 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:24.447161 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:24.447623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:24.448407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:24.448860 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:24.583681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:24.591926 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e4b3073b-e7cf-4b1c-9467-c710e4fd0fe4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.156446 Jul 18 04:02:24.592500 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3990/7911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:24 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:25.609692 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:25.610858 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:25.618258 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:25.618731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:25.619530 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:25.619987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:25.765636 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:25.773261 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a0ed43b7-80cd-4028-82f5-c1e302006c92 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.167607 Jul 18 04:02:25.773851 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3922/7912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:25 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:26.790698 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:26.791334 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:26.798891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:26.799381 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:26.800129 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:26.800579 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:26.944175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:26.952387 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81f76cb7-12c6-4db2-bda0-4f2d0a1810fd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.165689 Jul 18 04:02:26.953181 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3991/7913] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:26 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:27.969832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:27.970465 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:27.977376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:27.977841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:27.978628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:27.979117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:28.117557 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:28.125731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-21e7f69d-9d60-4f6c-8ee4-409f306ab3cc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.159859 Jul 18 04:02:28.126317 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3923/7914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:27 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:29.143981 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:29.144638 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:29.151648 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:29.152111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:29.153916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:29.154373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:29.294569 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:29.302146 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-f0041ec6-95b5-40f0-b9bf-bdec4a8d426a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.162141 Jul 18 04:02:29.302720 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3992/7915] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:29 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:30.320478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:30.321184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:30.328859 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:30.329354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:30.330151 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:30.330609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:30.469494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:30.477463 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-839c899b-2387-44af-b099-6d1e79c1b12b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.160776 Jul 18 04:02:30.478079 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3924/7916] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:30 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:31.502631 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:31.503254 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:31.510369 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:31.510825 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:31.511600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:31.512044 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:31.665545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:31.673652 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f4788fb-9da4-4635-b4e8-8adb7c2aeeca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.175375 Jul 18 04:02:31.674243 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3993/7917] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:31 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:32.691848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:32.692471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:32.699586 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:32.700045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:32.700829 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:32.701310 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:32.833616 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:32.841459 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a4f4b7ba-c6ba-4d96-8c98-f77ebca275c1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1700 microversion: 2.1 time: 0.153351 Jul 18 04:02:32.842064 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3925/7918] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:32 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:33.860511 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:33.861106 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:33.868371 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:33.868837 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:33.869660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:33.870111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:34.010077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:34.017964 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-624a7354-9233-40dd-a474-a9c51df33e00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1700 microversion: 2.1 time: 0.162133 Jul 18 04:02:34.018542 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3994/7919] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:33 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:35.039972 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:35.041158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:35.053905 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:35.054744 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:35.056176 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:35.057029 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:35.238414 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:35.246366 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d9acdcd9-d64d-4972-8107-8ebc406c4c00 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1700 microversion: 2.1 time: 0.213626 Jul 18 04:02:35.247523 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3926/7920] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:35 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1700 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:36.266991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:36.267528 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:36.274894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:36.275356 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:36.276431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:36.277215 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:36.426665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:36.436133 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3f7b6cba-a778-48df-bc0e-3408cf229cf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1700 microversion: 2.1 time: 0.172609 Jul 18 04:02:36.437231 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3995/7921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:36 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:37.129496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "name": "network-vif-plugged", "status": "completed", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:02:37.140222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:37.140629 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:37.154331 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] Creating event network-vif-plugged:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 04:02:37.158179 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] [53d96505-1a5d-46ea-9ab4-4451fa858ecc] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:02:37.456340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:37.457128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:37.464552 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:37.465043 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:37.466660 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:37.467293 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:37.619995 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:37.629607 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a825f6c5-92c8-458f-8be3-82890f499237 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.179374 Jul 18 04:02:37.630310 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3996/7922] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:37 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:02:38.176066 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] [53d96505-1a5d-46ea-9ab4-4451fa858ecc] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56662. Jul 18 04:02:38.180779 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-889d1bfe-9d27-4730-b23f-ea544db18030 req-c13a5eae-72fb-4327-9a9f-f51b50227a87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.055164 Jul 18 04:02:38.186464 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3927/7923] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:02:38.648036 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:38.648867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:38.657126 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:38.657592 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:38.658379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:38.658833 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:38.819274 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:38.828211 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-00fcff4e-9b50-47ab-aeda-118f7ab0569f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.184087 Jul 18 04:02:38.828800 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3997/7924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:38 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:39.847642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:39.848353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:39.855269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:39.855728 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:39.856614 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:39.857226 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:40.026807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:40.036159 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-631007c4-7047-4a90-922c-d57e0890c713 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.193623 Jul 18 04:02:40.036754 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3928/7925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:39 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:41.057295 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:41.057920 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:41.068772 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:41.069277 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:41.070112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:41.070566 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:41.237603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:41.247359 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-67f88681-7084-469f-91fb-7bca71310639 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.194275 Jul 18 04:02:41.247959 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3998/7926] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:41 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:41.272112 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:41.272810 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:41.850107 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:41.850346 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:41.987724 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:02:41.988376 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:02:42.270819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:42.271484 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:42.282681 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:42.284590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:42.285907 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:42.286644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:42.440597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:42.451194 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bae1d8b8-5252-429f-a60f-51eb2f04ca01 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.186643 Jul 18 04:02:42.452694 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3929/7927] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:42 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:43.468658 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:43.469449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:43.480446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:43.480827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:43.482409 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:43.482865 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:43.638857 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:43.647349 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e9bbe6e3-7024-497d-b2d1-fe57f6bcdac2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.182659 Jul 18 04:02:43.653939 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 3999/7928] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:43 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:44.667267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:44.667827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:44.676167 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:44.676632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:44.677485 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:44.677945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:44.860377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:44.868686 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-91fa8715-75f0-4694-ba13-5d9a08f4f9ca tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.205643 Jul 18 04:02:44.869318 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3930/7929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:44 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:45.887634 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:45.888330 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:45.895078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:45.895556 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:45.896321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:45.896765 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:46.039411 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:46.048360 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-0d15d5b1-f009-48c4-b8eb-38919817deef tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1695 microversion: 2.1 time: 0.164813 Jul 18 04:02:46.048992 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4000/7930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:45 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:47.066039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:47.066595 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:47.073526 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:47.073988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:47.075938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:47.075938 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:47.220827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:47.228384 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d668abb9-633c-4e95-a622-35768426a2bc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1677 microversion: 2.1 time: 0.166342 Jul 18 04:02:47.228980 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3931/7931] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:47 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:48.246799 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:48.247749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:48.254612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:48.255078 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:48.255872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:48.256326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:48.390685 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:48.398323 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-634eb778-5f5a-4fdb-b7ad-d2d5127f81fb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1677 microversion: 2.1 time: 0.155558 Jul 18 04:02:48.398892 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4001/7932] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:48 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:49.202867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-cd55e984-e0aa-4839-92c5-e22650bfcdc1 req-c8b641d2-e8dd-454a-90c0-455af3daef2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:02:49.211556 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cd55e984-e0aa-4839-92c5-e22650bfcdc1 req-c8b641d2-e8dd-454a-90c0-455af3daef2f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.212017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-cd55e984-e0aa-4839-92c5-e22650bfcdc1 req-c8b641d2-e8dd-454a-90c0-455af3daef2f service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.224604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.compute.server_external_events [req-cd55e984-e0aa-4839-92c5-e22650bfcdc1 req-c8b641d2-e8dd-454a-90c0-455af3daef2f service nova] Unable to find a host for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f. Dropping event network-vif-unplugged {{(pid=119440) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 04:02:49.225549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-cd55e984-e0aa-4839-92c5-e22650bfcdc1 req-c8b641d2-e8dd-454a-90c0-455af3daef2f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090219 Jul 18 04:02:49.226164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3932/7933] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 04:02:49.415843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:49.416269 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:49.423459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.423919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.424706 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.425187 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.444508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:49.568972 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:49.578168 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1b2243f3-2fb0-4c5b-88bf-ed5189ca727d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1620 microversion: 2.1 time: 0.166483 Jul 18 04:02:49.578764 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4002/7934] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:49 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1620 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:49.599341 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:02:49.599924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:49.606353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.606825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.607609 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.608058 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.756741 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-11a280a2-fe98-4a11-9f91-de5139216e99 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f/action" status: 202 len: 0 microversion: 2.1 time: 0.161361 Jul 18 04:02:49.760366 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3933/7935] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:02:49 2022] POST /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:02:49.766508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:49.770473 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:49.776829 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.777536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.779026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:49.779472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:49.928891 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:49.937092 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac1d6c71-2887-4e30-ae4f-3fa861e89cc7 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1628 microversion: 2.1 time: 0.175304 Jul 18 04:02:49.937711 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4003/7936] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:49 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1628 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:50.955832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:50.956403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:50.958290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=31 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:50.963769 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:50.964232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:50.965041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:50.965550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:50.968502 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:51.102589 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:51.111282 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a59cd75f-d421-4ce1-9e41-cc474cf0a4ad tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1628 microversion: 2.1 time: 0.160282 Jul 18 04:02:51.111864 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3934/7937] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:50 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1628 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:52.131219 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:52.131835 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:52.133758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=33 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:02:52.139844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:52.140307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:52.141145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:52.141600 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:52.279186 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:52.286837 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-264d32ed-2984-4fdb-8273-dac9ccc19db0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1628 microversion: 2.1 time: 0.159901 Jul 18 04:02:52.287414 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4004/7938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:52 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1628 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:53.304542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:53.305130 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:53.312186 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:53.312659 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:53.313490 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:53.313976 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:53.446881 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:53.455177 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-cec98d6a-aaa6-4360-855c-a8a0fe3fe350 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1628 microversion: 2.1 time: 0.154733 Jul 18 04:02:53.455751 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3935/7939] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:53 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1628 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:54.472898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:54.473541 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:54.480695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:54.481807 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:54.482612 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:54.483069 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:54.619471 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:54.627367 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-d290139e-363f-46bc-9822-b93e5d520b45 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1628 microversion: 2.1 time: 0.158437 Jul 18 04:02:54.627943 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4005/7940] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:54 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1628 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:55.645314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:55.645987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:55.653686 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:55.654149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:55.654941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:55.655384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:55.892121 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:55.899924 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7287d4d9-58f9-4939-9bd2-246981035cf2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.258533 Jul 18 04:02:55.900509 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3936/7941] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:55 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:56.918923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:56.920469 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:56.927673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:56.928159 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:56.928836 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:56.929585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:57.078536 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:57.086744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3949040-085e-496c-be19-c6c07ab52cc9 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.172705 Jul 18 04:02:57.087426 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4006/7942] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:56 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:58.105376 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:58.106025 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:58.114628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:58.115126 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:58.116051 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:58.116432 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:58.278566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:58.287209 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4bb0a157-bdf2-4f65-a047-6cc8c13c430f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.185826 Jul 18 04:02:58.287822 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3937/7943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:58 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:02:59.305792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:02:59.307141 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:02:59.315815 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:59.316289 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:59.317497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:02:59.318032 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:02:59.462785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:02:59.478816 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a0abffd7-3351-4c18-8fc3-41ff66e9ddab tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.177035 Jul 18 04:02:59.486135 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4007/7944] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:02:59 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:00.497327 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:00.499237 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:00.506593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:00.507066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:00.507889 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:00.508382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:00.658961 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:00.668144 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7284ff7f-b557-4bd3-8ec7-5580c0353f90 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.174603 Jul 18 04:03:00.668738 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3938/7945] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:00 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:01.687018 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:01.687674 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:01.694869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:01.694869 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:01.695571 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:01.696021 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:01.844744 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:01.853781 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-26aa3328-8a21-4580-a8b1-78992a894b97 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.171107 Jul 18 04:03:01.854710 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4008/7946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:01 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:02.871935 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:02.873662 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:02.881212 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:02.881843 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:02.882868 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:02.883316 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:03.032089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:03.040501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-38ddee1b-3c56-4ba6-9804-61435a147914 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.172529 Jul 18 04:03:03.041396 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3939/7947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:02 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:04.058429 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:04.059165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:04.066676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:04.067140 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:04.067926 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:04.068384 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:04.204530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:04.214600 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-61665005-7f1c-4be9-a7ca-32225149bcf8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.160124 Jul 18 04:03:04.215182 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4009/7948] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:04 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:05.232091 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:05.232690 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:05.241102 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:05.241563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:05.242354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:05.242807 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:05.380751 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:05.388305 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7090c20e-bc89-4b51-b24c-c6b114c2c1a4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.160322 Jul 18 04:03:05.388878 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3940/7949] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:05 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:06.407039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:06.407667 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:06.414934 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:06.415407 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:06.416222 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:06.416672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:06.560171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:06.568851 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-56eb2ad5-d3d8-4efb-89d5-0899e04fc738 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.166508 Jul 18 04:03:06.569472 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4010/7950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:06 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:07.587789 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:07.588354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:07.596536 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:07.597035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:07.597842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:07.598300 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:07.740372 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:07.748014 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7a038204-e4d7-443d-a678-741c1456404f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.164341 Jul 18 04:03:07.748594 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3941/7951] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:07 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:08.767729 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:08.770523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:08.775111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:08.775466 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:08.776883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:08.776883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:08.927146 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:08.934752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4edfd430-7d92-4ad7-b6c9-cdc126c5aabf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.172707 Jul 18 04:03:08.935350 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4011/7952] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:08 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:09.955088 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:09.955749 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:09.962734 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:09.963203 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:09.963999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:09.964458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:10.102045 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:10.109962 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a7c9688a-b084-45f0-aafc-0d2685b618d0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.159958 Jul 18 04:03:10.110558 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3942/7953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:09 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:11.128038 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:11.128666 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:11.135872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:11.136342 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:11.137162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:11.137623 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:11.283956 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:11.291715 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-674a3b5f-2a7f-4d11-b9a8-d82ff9500e8b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.168201 Jul 18 04:03:11.292308 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4012/7954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:11 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:12.310114 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:12.310742 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:12.318722 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:12.319221 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:12.320017 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:12.320477 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:12.461078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:12.468827 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5d665c3f-f90a-4d31-b116-1ceb07447d10 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.162689 Jul 18 04:03:12.469449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3943/7955] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:12 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:13.294375 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-24112a8a-31a7-4782-89ba-e2edc4f72dee req-d73bce4d-7015-4aba-96a9-9733c6b38aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "name": "network-vif-plugged", "status": "completed", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:03:13.304640 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-24112a8a-31a7-4782-89ba-e2edc4f72dee req-d73bce4d-7015-4aba-96a9-9733c6b38aef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:13.305189 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-24112a8a-31a7-4782-89ba-e2edc4f72dee req-d73bce4d-7015-4aba-96a9-9733c6b38aef service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:13.319455 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-24112a8a-31a7-4782-89ba-e2edc4f72dee req-d73bce4d-7015-4aba-96a9-9733c6b38aef service nova] Creating event network-vif-plugged:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 04:03:13.324664 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-24112a8a-31a7-4782-89ba-e2edc4f72dee req-d73bce4d-7015-4aba-96a9-9733c6b38aef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034367 Jul 18 04:03:13.325395 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4013/7956] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:03:13.487848 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:13.488567 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:13.495685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:13.496159 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:13.496984 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:13.497476 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:13.639615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:13.647682 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e16637d4-2ed4-49ad-b56d-fcb1b7f49026 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.165191 Jul 18 04:03:13.648251 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3944/7957] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:13 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:14.665697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:14.666319 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:14.673599 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:14.674062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:14.674850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:14.675304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:14.813066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:14.820849 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-785572df-53a5-4ad9-83d1-9e609cdd02a5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1686 microversion: 2.1 time: 0.159700 Jul 18 04:03:14.821462 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4014/7958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:14 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:03:15.839035 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:03:15.839666 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:03:15.847651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:15.848112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:15.848904 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:03:15.849384 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:03:15.982944 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:03:15.991038 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d4bf5016-6cc0-4bb6-a3a6-2ffb50a7fd03 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1673 microversion: 2.1 time: 0.155941 Jul 18 04:03:15.991617 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3945/7959] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:03:15 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:04:21.290726 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:04:21.291430 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:04:55.888286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=21 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:04:55.889048 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=70 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:04:55.891482 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=23 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:04:55.892637 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=71 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:04:55.893853 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:55.894405 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:04:55.902145 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:55.902680 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:55.903494 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:55.904120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:55.931089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 04:04:55.954028 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-7d76f5f9-457c-4f90-9f2e-e9ebe433cb73 req-500c7c35-3423-48c1-820e-a87d23462b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:04:55.963275 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7d76f5f9-457c-4f90-9f2e-e9ebe433cb73 req-500c7c35-3423-48c1-820e-a87d23462b95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:55.964345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-7d76f5f9-457c-4f90-9f2e-e9ebe433cb73 req-500c7c35-3423-48c1-820e-a87d23462b95 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:55.976746 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-7d76f5f9-457c-4f90-9f2e-e9ebe433cb73 req-500c7c35-3423-48c1-820e-a87d23462b95 service nova] Creating event network-changed:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 04:04:55.982700 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-7d76f5f9-457c-4f90-9f2e-e9ebe433cb73 req-500c7c35-3423-48c1-820e-a87d23462b95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094345 Jul 18 04:04:55.983317 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3946/7960] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:04:56.024338 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e5ae6d4e-eba7-4883-90e2-3dc711c0c0a3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 204 len: 0 microversion: 2.1 time: 0.137854 Jul 18 04:04:56.025687 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4015/7961] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 04:04:55 2022] DELETE /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 04:04:56.035066 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:56.035720 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:04:56.043050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:56.043521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:56.044317 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:56.044775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:56.191382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:04:56.199731 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-57844fa7-9b7f-4f0c-9f6a-1c1b405fdb64 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.169413 Jul 18 04:04:56.200319 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3947/7962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:04:56 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:04:57.219155 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:57.219872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:04:57.227839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:57.228824 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:57.229647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:57.230094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:57.428441 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:04:57.437752 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-41370a02-799f-47dd-b31c-c5a382617282 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1679 microversion: 2.1 time: 0.222941 Jul 18 04:04:57.438340 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4016/7963] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:04:57 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:04:58.130563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-e3f2e2f5-77b8-4555-a140-ed9aa40ee4a2 req-248abf19-2507-4447-9da3-cceda24419ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f", "name": "network-vif-deleted", "tag": "beafcd92-7dc3-44e6-8bce-3d6fc873355e"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:04:58.142956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e3f2e2f5-77b8-4555-a140-ed9aa40ee4a2 req-248abf19-2507-4447-9da3-cceda24419ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:58.143517 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-e3f2e2f5-77b8-4555-a140-ed9aa40ee4a2 req-248abf19-2507-4447-9da3-cceda24419ea service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:58.156798 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-e3f2e2f5-77b8-4555-a140-ed9aa40ee4a2 req-248abf19-2507-4447-9da3-cceda24419ea service nova] Creating event network-vif-deleted:beafcd92-7dc3-44e6-8bce-3d6fc873355e for instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f on n-h1-849796-1 Jul 18 04:04:58.161822 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-e3f2e2f5-77b8-4555-a140-ed9aa40ee4a2 req-248abf19-2507-4447-9da3-cceda24419ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035059 Jul 18 04:04:58.162399 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3948/7964] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:04:58.455839 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:58.456467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:04:58.464766 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:58.465252 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:58.466120 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:58.466560 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:58.508611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:58.509111 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:58.510076 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lazy-loading 'fault' on Instance uuid 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 04:04:58.559410 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:04:58.568380 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-da84c6a7-7a57-4a76-9aee-055b601c704e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 200 len: 1336 microversion: 2.1 time: 0.116402 Jul 18 04:04:58.568996 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4017/7965] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:04:58 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:04:59.589089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:59.589715 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:04:59.596057 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:59.596523 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:59.597331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:04:59.597782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:04:59.611547 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] HTTP exception thrown: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Request method failure captured: Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f HTTP/1.1 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NqX8hWmBQlXA4R_c_ibLTe-of6rsiJXEcgAqyjNSAQIVjwXhMOxcW3zVNdME8lDYdcR0Nad4bs7V55xk-1xaqWQPe8IKfrG61CLgP4xmP2bpVKeJB4Tf08_M4L9l_7Dlxd_-wOfCw54BbknKP1R-q5i84ae2HuGOVQ7ST7_JXyKb-0 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b6d7730570f94326990a32aaef903156 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestShelveInstance-110061285 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6d7730570f94326990a32aaef903156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6d7730570f94326990a32aaef903156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6d7730570f94326990a32aaef903156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6d7730570f94326990a32aaef903156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestShelveInstance-110061285 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b6d7730570f94326990a32aaef903156 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestShelveInstance-110061285 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestShelveInstance-110061285-project Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7d0427329b2d42678966d35f5af1dfa8 Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestShelveInstance-110061285-project Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f'} Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:04:59.613503 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Returning 404 to user: Instance 6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fad99784-3778-4524-a5f8-f115ba67e6cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f" status: 404 len: 111 microversion: 2.1 time: 0.031191 Jul 18 04:04:59.619983 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3949/7966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:04:59 2022] GET /compute/v2.1/servers/6f3a0d2f-83b4-4e3b-aec5-9e3cdd0c0e2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 04:04:59.782447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-4e9e4bce-f1fe-4eb3-b835-aa34a7117cb1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '.version_select at 0x7fab0457c1f0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:04:59.807899 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-4e9e4bce-f1fe-4eb3-b835-aa34a7117cb1 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1130310291" status: 202 len: 0 microversion: 2.1 time: 0.029307 Jul 18 04:04:59.811786 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4018/7967] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Jul 18 04:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1130310291 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:04:59.838097 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2def81fd-ef45-4a34-9649-d76c0a9eace0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'create', calling method: .version_select at 0x7faaf74ef790>, body: {"keypair": {"name": "tempest-TestShelveInstance-782926002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEXcZNUrGkXjDkicYR5c9Kgjz9fTb8hy7pDFPxD7IrhNGx8Bl3J8qrXwrooTgN9mYjdr7oIGZmJZMgH/tWXtSY9hWPyP2SQ8bfxCdylFhDVragp3DbX8UpafwXsWVnvTg=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:04:59.851964 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2def81fd-ef45-4a34-9649-d76c0a9eace0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for project b6d7730570f94326990a32aaef903156. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 04:04:59.857791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-2def81fd-ef45-4a34-9649-d76c0a9eace0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for user 7d0427329b2d42678966d35f5af1dfa8 and project b6d7730570f94326990a32aaef903156. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 04:04:59.884219 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2def81fd-ef45-4a34-9649-d76c0a9eace0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050518 Jul 18 04:04:59.885048 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3950/7968] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 04:04:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:05:17.077497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-410985774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-782926002", "security_groups": [{"name": "tempest-secgroup-smoke-1560348719"}], "networks": [{"uuid": "2ddf3698-0cec-4f39-adc6-dcd8f6103e0f"}], "block_device_mapping_v2": [{"uuid": "a18db1df-3321-4cb7-a4cc-46f4626f8789", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:05:17.090850 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:17.091498 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:17.206404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] validate_networks() for [('2ddf3698-0cec-4f39-adc6-dcd8f6103e0f', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 04:05:17.958665 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 04:05:17.959105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 04:05:17.959595 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 04:05:17.960304 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 04:05:17.960738 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 04:05:17.970681 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:17.971139 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:17.971955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:17.972432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:17.990143 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for project b6d7730570f94326990a32aaef903156. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 04:05:17.995597 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Getting quotas for user 7d0427329b2d42678966d35f5af1dfa8 and project b6d7730570f94326990a32aaef903156. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 04:05:18.055784 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 04:05:18.058166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a18db1df-3321-4cb7-a4cc-46f4626f8789',volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 04:05:18.188179 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-6954a3ad-76b5-4cfa-a446-f0b0da44ab2d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115268 Jul 18 04:05:18.189148 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4019/7969] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 04:05:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 04:05:18.201044 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2f9ce5a1-f1e9-43ae-810a-46c48a070566 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:18.201672 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2f9ce5a1-f1e9-43ae-810a-46c48a070566 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:18.205478 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=12 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:18.206475 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=4 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:18.207352 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:18.266667 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2f9ce5a1-f1e9-43ae-810a-46c48a070566 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:18.274017 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2f9ce5a1-f1e9-43ae-810a-46c48a070566 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1087 microversion: 2.1 time: 0.078411 Jul 18 04:05:18.274625 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3951/7970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:18 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:19.294928 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:19.295604 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:19.302461 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:19.302919 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:19.303720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:19.304171 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:19.370614 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:19.378598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-40b64faf-2755-4dbd-a5fa-78e3fcdcb300 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1203 microversion: 2.1 time: 0.089699 Jul 18 04:05:19.379194 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4020/7971] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:19 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:20.399827 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:20.402941 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:20.411436 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:20.412241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:20.413338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:20.414174 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:20.649039 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:20.658971 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e2a1f950-b466-46c8-ac45-804fb4076d7b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1271 microversion: 2.1 time: 0.265630 Jul 18 04:05:20.659907 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3952/7972] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:20 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:20.738899 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-90abf7f8-71a2-4c24-81b8-1915c6a1009d req-dbd1dc8a-64d5-4278-941f-d76f6715ba62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:05:20.775563 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-90abf7f8-71a2-4c24-81b8-1915c6a1009d req-dbd1dc8a-64d5-4278-941f-d76f6715ba62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:20.776144 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-90abf7f8-71a2-4c24-81b8-1915c6a1009d req-dbd1dc8a-64d5-4278-941f-d76f6715ba62 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:20.803270 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-90abf7f8-71a2-4c24-81b8-1915c6a1009d req-dbd1dc8a-64d5-4278-941f-d76f6715ba62 service nova] Creating event network-changed:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:05:20.810714 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-90abf7f8-71a2-4c24-81b8-1915c6a1009d req-dbd1dc8a-64d5-4278-941f-d76f6715ba62 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082196 Jul 18 04:05:20.811983 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4021/7973] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:05:21.677555 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:21.678635 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:21.688265 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:21.688903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:21.689867 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:21.690451 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:21.949189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:21.958065 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-4e942f68-602a-4aba-b39d-0c6c9004e84b tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1271 microversion: 2.1 time: 0.284671 Jul 18 04:05:21.958706 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3953/7974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:21 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:22.977174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:22.977881 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:22.984430 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:22.984890 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:22.985692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:22.986142 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:23.126162 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:23.133969 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b1d571fa-29f0-4413-9ddc-b9c3a132701f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1271 microversion: 2.1 time: 0.162041 Jul 18 04:05:23.134547 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4022/7975] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:22 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:24.152269 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:24.152899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:24.159158 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:24.159675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:24.160564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:24.161078 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:24.310162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:24.318705 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e0ecc376-fae2-45aa-8a60-849d45d8ca09 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1271 microversion: 2.1 time: 0.171004 Jul 18 04:05:24.319332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3954/7976] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:24 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:25.335628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:25.336249 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:25.343422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:25.343889 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:25.344677 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:25.345154 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:25.481284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:25.489699 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-60a7b079-660c-4f66-9244-3b80c7714de2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.157928 Jul 18 04:05:25.490277 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4023/7977] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:25 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:26.507800 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:26.508458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:26.516382 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:26.516787 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:26.517623 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:26.518080 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:26.653979 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:26.661579 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-80c5d2e5-4118-49ae-b892-7df5c22f13eb tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.157884 Jul 18 04:05:26.662148 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3955/7978] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:26 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:05:27.679752 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:27.680323 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:27.688603 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:27.689167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:27.690082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:27.690529 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:27.827235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:27.834771 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8f6bf18e-3ef5-4b48-a05d-bbfb2c9f4490 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.159382 Jul 18 04:05:27.835349 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4024/7979] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:27 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:28.851739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:28.852279 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:28.855591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:28.861139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:28.861600 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:28.862650 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:28.863096 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:29.004357 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:29.012007 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-10761809-3fe1-4892-851e-1fcaeed29ea0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.164293 Jul 18 04:05:29.012589 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3956/7980] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:28 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:30.029214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:30.029816 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:30.031813 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:30.032481 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:05:30.039425 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:30.039887 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:30.040669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:30.041157 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:30.178165 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:30.186185 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3119b7b0-0b05-40a1-9eb3-28270c55f47c tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.161603 Jul 18 04:05:30.186787 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4025/7981] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:30 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:31.204336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:31.204987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:31.212348 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:31.212840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:31.213704 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:31.214434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:31.349695 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:31.358548 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1493e7c8-2089-4818-a431-e059f2518670 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.158265 Jul 18 04:05:31.359170 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3957/7982] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:31 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:32.375918 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:32.376508 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:32.383392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:32.383843 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:32.384606 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:32.385077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:32.522519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:32.531200 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e318e9ee-e17c-47d5-a4de-3a969a13227a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.159174 Jul 18 04:05:32.531903 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4026/7983] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:32 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:33.547899 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:33.548458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:33.555346 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:33.555814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:33.556632 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:33.557092 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:33.697888 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:33.706647 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-88b90696-d5d7-407d-bd6d-f833aec8b8be tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.162687 Jul 18 04:05:33.707236 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3958/7984] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:33 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:34.723759 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:34.724394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:34.731673 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:34.732135 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:34.732910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:34.733383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:34.872245 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:34.879789 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-81649aba-74b1-4da0-be7e-843b8ac3ab0a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.160001 Jul 18 04:05:34.880373 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4027/7985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:34 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:35.897124 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:35.897890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:35.904898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:35.905390 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:35.906184 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:35.906639 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:35.981868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-17768a09-ed2c-482a-8db6-d24b0c0fa4c6 req-6e65baad-5454-43dc-86cd-32486f7c25e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "name": "network-vif-plugged", "status": "completed", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:05:35.991963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-17768a09-ed2c-482a-8db6-d24b0c0fa4c6 req-6e65baad-5454-43dc-86cd-32486f7c25e4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:35.992500 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-17768a09-ed2c-482a-8db6-d24b0c0fa4c6 req-6e65baad-5454-43dc-86cd-32486f7c25e4 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:36.005653 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-17768a09-ed2c-482a-8db6-d24b0c0fa4c6 req-6e65baad-5454-43dc-86cd-32486f7c25e4 service nova] Creating event network-vif-plugged:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:05:36.011673 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-17768a09-ed2c-482a-8db6-d24b0c0fa4c6 req-6e65baad-5454-43dc-86cd-32486f7c25e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 Jul 18 04:05:36.012788 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4028/7986] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:05:36.062596 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:36.070405 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-65e5f306-512c-4a99-b9c2-b58afcd0f871 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.177215 Jul 18 04:05:36.070994 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3959/7987] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:35 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:37.090015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:37.090647 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:37.097089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:37.097555 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:37.098341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:37.098795 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:37.239607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:37.247234 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-24d7fb1e-246a-494f-ab2a-e27070d71357 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1259 microversion: 2.1 time: 0.162909 Jul 18 04:05:37.247817 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4029/7988] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:37 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:38.266270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:38.266970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:38.274618 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:38.275083 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:38.275878 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:38.276987 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:38.417966 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:38.425690 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5023eb93-3e53-4bae-bcac-68fb8fc65c25 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1442 microversion: 2.1 time: 0.163646 Jul 18 04:05:38.426269 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3960/7989] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:38 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:38.442131 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:05:38.442739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:05:38.450207 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:38.450654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:38.451423 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:38.451983 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:38.601809 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:05:38.610009 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-25b18d05-ca62-4823-8e0f-063f8a8bd5e0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1442 microversion: 2.1 time: 0.171711 Jul 18 04:05:38.610813 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4030/7990] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:05:38 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:05:40.358377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-9c981164-e5e5-4c2c-b296-93977f8c3a53 req-cb9d30f3-5507-45c6-9742-2160700dbbfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:05:40.367996 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9c981164-e5e5-4c2c-b296-93977f8c3a53 req-cb9d30f3-5507-45c6-9742-2160700dbbfc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:05:40.368540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-9c981164-e5e5-4c2c-b296-93977f8c3a53 req-cb9d30f3-5507-45c6-9742-2160700dbbfc service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:05:40.380832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-9c981164-e5e5-4c2c-b296-93977f8c3a53 req-cb9d30f3-5507-45c6-9742-2160700dbbfc service nova] Creating event network-changed:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:05:40.387250 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-9c981164-e5e5-4c2c-b296-93977f8c3a53 req-cb9d30f3-5507-45c6-9742-2160700dbbfc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032893 Jul 18 04:05:40.387950 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3961/7991] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:06:01.283848 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:06:01.284512 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:07:36.605181 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:07:36.606242 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:07:36.606808 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:07:36.607561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=60 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:07:36.611943 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:07:36.612749 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:36.620223 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:36.620688 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:36.621517 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:36.622026 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:36.646383 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.objects.instance [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lazy-loading 'flavor' on Instance uuid 8e9c0c0a-a372-4df6-96e2-12485d0c633c {{(pid=119439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 04:07:36.720678 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9dc00af5-63ec-4ff8-a542-bc67eddea9cf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c/action" status: 202 len: 0 microversion: 2.1 time: 0.117266 Jul 18 04:07:36.721372 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4031/7992] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:07:36 2022] POST /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:07:36.727883 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:07:36.728697 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:07:36.729324 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=24 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:07:36.730089 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=56 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:07:36.734909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:36.735628 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:36.743463 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:36.743931 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:36.744723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:36.745713 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:37.104474 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:37.112873 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8d715224-8278-4967-83ef-53c1b27e6db8 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.386538 Jul 18 04:07:37.113524 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3962/7993] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:36 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:38.135112 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:38.136347 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:38.145059 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:38.145509 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:38.146276 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:38.146714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:38.155131 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57196. Jul 18 04:07:38.158377 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57198. Jul 18 04:07:38.409519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:38.417915 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-93ddee1a-21e5-4f74-85d2-61eae92d2355 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.289363 Jul 18 04:07:38.418746 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4032/7994] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:38 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:39.436706 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:39.437363 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:39.447125 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:39.447538 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:39.449099 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:39.449565 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:39.456718 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57212. Jul 18 04:07:39.457580 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57210. Jul 18 04:07:39.594754 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:39.602546 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5b19477b-18df-4129-9514-7816fb422015 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.170923 Jul 18 04:07:39.603123 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3963/7995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:39 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:40.622757 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:40.623306 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:40.630362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:40.630826 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:40.631611 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:40.632066 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:40.769472 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:40.777402 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a00708b0-c783-437c-ab13-92d4b059dcdf tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.159287 Jul 18 04:07:40.777999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4033/7996] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:40 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:41.299334 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:07:41.299878 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:07:41.797022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:41.798213 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:41.806894 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:41.807389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:41.808956 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:41.809429 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:41.863894 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:07:41.864638 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:07:41.986162 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:41.995387 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ea973f3-aed4-4c51-b9e5-4be2c3441188 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.203543 Jul 18 04:07:41.996610 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3964/7997] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:41 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:41.999891 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:07:42.000084 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:07:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:07:43.014225 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:43.014994 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:43.022349 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:43.022800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:43.023572 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:43.024012 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:43.161051 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:43.169744 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-51f50c6f-a54a-4faf-8891-1704eb2eefa6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.159497 Jul 18 04:07:43.170341 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4034/7998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:43 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:44.188172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:44.188802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:44.196003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:44.196466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:44.197307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:44.197766 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:44.336011 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:44.349086 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c6a338a5-3d6c-4a24-8272-f76ca3333ff3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.164563 Jul 18 04:07:44.350003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3965/7999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:44 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:07:45.375134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:45.375760 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:45.382785 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:45.383240 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:45.384019 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:45.384465 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:45.531263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:45.539160 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-608dce7a-1c2b-4574-95d1-8b705f2e6b74 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.167997 Jul 18 04:07:45.539746 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4035/8000] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:45 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:46.557841 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:46.558737 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:46.566315 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:46.566903 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:46.567803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:46.568318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:46.713488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:46.721919 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-c8ac3617-b436-44b0-aacf-2f56916b7737 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.168357 Jul 18 04:07:46.722482 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3966/8001] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:46 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:07:47.740302 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:47.740902 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:47.748208 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:47.748661 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:47.749480 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:47.749927 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:47.892087 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:47.899861 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ee8d23b8-eb6e-49d4-8e37-416589cb023d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.163720 Jul 18 04:07:47.900442 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4036/8002] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:47 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:48.919446 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:48.920166 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:48.927313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:48.927875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:48.928786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:48.929761 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:49.085459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:49.094832 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2707298a-a6d3-48bd-8f36-7892b6014367 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.179939 Jul 18 04:07:49.095287 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3967/8003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:48 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:50.111873 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:50.112792 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:50.120867 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:50.121397 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:50.122196 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:50.122675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:50.267531 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:50.275513 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-59d0f458-7ede-4373-8c00-32d8fd326913 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.167523 Jul 18 04:07:50.276084 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4037/8004] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:50 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:51.294708 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:51.295389 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:51.302584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.303075 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:51.303866 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.304318 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:51.446314 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:51.454598 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30e27217-12c1-48a4-a178-2261027c2ad4 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1508 microversion: 2.1 time: 0.164701 Jul 18 04:07:51.455188 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3968/8005] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:51 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:51.471894 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:07:51.472485 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:51.480676 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.481163 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:51.481949 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.482389 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:51.584247 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88f094f9-d97d-4677-9491-6041fe0e9c0e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "POST /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c/action" status: 202 len: 0 microversion: 2.1 time: 0.116332 Jul 18 04:07:51.584890 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4038/8006] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:07:51 2022] POST /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:07:51.594169 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:51.594832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:51.601043 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.601665 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:51.602574 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:51.603008 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:52.084993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:52.092721 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5a0e11bb-da4a-4476-8356-9d5432e8c1e3 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1516 microversion: 2.1 time: 0.503345 Jul 18 04:07:52.093332 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3969/8007] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:51 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1516 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:52.609879 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-597322be-a85d-491a-ac5b-5eb99ac9d616 req-7e98d6f4-7a95-4d96-b535-e33548685e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "name": "network-vif-unplugged", "status": "completed", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:07:52.618800 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-597322be-a85d-491a-ac5b-5eb99ac9d616 req-7e98d6f4-7a95-4d96-b535-e33548685e09 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:52.619263 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-597322be-a85d-491a-ac5b-5eb99ac9d616 req-7e98d6f4-7a95-4d96-b535-e33548685e09 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:52.631895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.compute.server_external_events [req-597322be-a85d-491a-ac5b-5eb99ac9d616 req-7e98d6f4-7a95-4d96-b535-e33548685e09 service nova] Unable to find a host for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c. Dropping event network-vif-unplugged {{(pid=119439) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 04:07:52.632802 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-597322be-a85d-491a-ac5b-5eb99ac9d616 req-7e98d6f4-7a95-4d96-b535-e33548685e09 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080465 Jul 18 04:07:52.633442 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4039/8008] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 04:07:53.110621 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:53.111223 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:53.118367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:53.118842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:53.119634 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:53.120093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:53.268467 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:53.276915 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-96f501e1-bad9-42b5-a497-1b4b991d80f0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1516 microversion: 2.1 time: 0.170270 Jul 18 04:07:53.277525 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3970/8009] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:53 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:54.296046 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:54.296798 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:54.303895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:54.304355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:54.305167 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:54.305622 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:54.438578 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:54.446289 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-12cb9e3f-d6a4-485f-8143-599fd5a465e6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1516 microversion: 2.1 time: 0.154860 Jul 18 04:07:54.446870 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4040/8010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:54 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:55.463745 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:55.465282 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:55.472833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:55.473339 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:55.474143 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:55.474598 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:55.622649 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:55.630417 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb9a4cbb-6db8-45c7-af33-6d4a72f9d771 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1518 microversion: 2.1 time: 0.170667 Jul 18 04:07:55.631003 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3971/8011] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:55 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:56.648456 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:56.649099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:56.656435 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:56.656895 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:56.657724 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:56.658173 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:56.806892 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:56.815941 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a23a6a05-53bc-4686-91b6-7dacde178073 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1518 microversion: 2.1 time: 0.171496 Jul 18 04:07:56.816545 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4041/8012] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:56 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:57.833887 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:57.834519 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:57.842910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:57.843378 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:57.844183 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:57.844642 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:57.988748 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:57.997518 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-94c22243-e04f-4c7c-972c-ee6c0ca61951 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1518 microversion: 2.1 time: 0.167615 Jul 18 04:07:57.998329 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3972/8013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:57 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:07:59.015545 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:07:59.016148 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:07:59.023554 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:59.024006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:59.024783 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:07:59.025464 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:07:59.168703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:07:59.176844 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-dbf6954c-3562-4ec3-b442-cac4fa51e84f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1518 microversion: 2.1 time: 0.165797 Jul 18 04:07:59.177482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4042/8014] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:07:59 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:00.194819 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:00.195508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:00.203133 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:00.203604 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:00.204413 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:00.204872 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:00.362041 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:00.370228 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-15a4eea9-f078-4075-a24c-f616b4350ef5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1518 microversion: 2.1 time: 0.179501 Jul 18 04:08:00.371262 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3973/8015] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:00 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:08:01.387810 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:01.388424 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:01.395532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:01.395993 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:01.396791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:01.397266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:01.538490 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:01.547515 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ca6a3d56-49a1-4c61-bc98-6c5c6947fa42 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.163825 Jul 18 04:08:01.548144 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4043/8016] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:01 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:02.565529 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:02.566117 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:02.573022 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:02.573520 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:02.574296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:02.574741 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:02.713512 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:02.723644 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7c321f21-5090-4ae0-bad4-b9964dcd988e tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.162129 Jul 18 04:08:02.724244 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3974/8017] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:02 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:03.742804 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:03.743437 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:03.751558 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:03.752015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:03.752803 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:03.753280 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:03.895447 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:03.903567 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e1d02af3-74cb-446f-9651-028326284207 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.164636 Jul 18 04:08:03.904184 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4044/8018] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:03 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:04.921731 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:04.922350 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:04.929369 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:04.929831 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:04.930615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:04.931062 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:05.073815 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:05.081858 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8ad72875-f0b4-4294-adb1-8dfc15df9121 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.164881 Jul 18 04:08:05.082449 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3975/8019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:04 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:06.099039 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:06.099695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:06.107831 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:06.108288 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:06.109108 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:06.109561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:06.113955 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:08:06.247967 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:06.255881 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e50b8c2b-49bf-4908-837e-3ceefab1fdcd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.160731 Jul 18 04:08:06.256475 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4045/8020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:06 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:07.273393 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:07.274032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:07.278137 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=29 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:08:07.283994 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:07.284471 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:07.285421 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:07.285884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:07.288825 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=85 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:08:07.423982 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:07.431887 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-29975900-0612-48b1-afff-f7875366eacc tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.162391 Jul 18 04:08:07.433102 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3976/8021] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:07 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:08.450532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:08.451326 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:08.453305 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=33 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:08:08.458504 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:08.458960 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:08.459739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:08.460296 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:08.609233 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:08.617658 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-eeb94f2d-9406-4a9f-85c9-e8bb66cd1b7a tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.171364 Jul 18 04:08:08.618482 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4046/8022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:08 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:09.635973 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:09.636688 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:09.642782 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:09.643243 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:09.644020 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:09.644466 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:09.784379 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:09.792130 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-f4e259e9-245e-48c3-a23e-030a90fc57c6 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.160889 Jul 18 04:08:09.792716 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3977/8023] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:09 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:10.707532 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f0c73278-1bb3-4c36-8642-57d5723efb05 req-e9bdadd3-9253-421c-a266-cc91897cd732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "name": "network-vif-plugged", "status": "completed", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:08:10.717543 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f0c73278-1bb3-4c36-8642-57d5723efb05 req-e9bdadd3-9253-421c-a266-cc91897cd732 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:10.717987 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f0c73278-1bb3-4c36-8642-57d5723efb05 req-e9bdadd3-9253-421c-a266-cc91897cd732 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:10.730576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f0c73278-1bb3-4c36-8642-57d5723efb05 req-e9bdadd3-9253-421c-a266-cc91897cd732 service nova] Creating event network-vif-plugged:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:08:10.735867 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f0c73278-1bb3-4c36-8642-57d5723efb05 req-e9bdadd3-9253-421c-a266-cc91897cd732 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032190 Jul 18 04:08:10.736560 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4047/8024] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:08:10.810986 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:10.811797 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:10.818818 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:10.819290 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:10.820093 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:10.820548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:11.025165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:11.033566 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-68b5ebce-064a-45d7-87fb-48d9969b0d0f tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.228035 Jul 18 04:08:11.034164 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3978/8025] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:10 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:12.052307 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:12.053037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:12.061007 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:12.061477 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:12.062272 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:12.062720 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:12.202070 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:12.210510 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-88f2e0ce-c393-44ab-9e3b-c2a5b7752ba5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1574 microversion: 2.1 time: 0.163268 Jul 18 04:08:12.211110 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4048/8026] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:12 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:08:13.228499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:08:13.229206 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:08:13.236845 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:13.237651 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:13.238454 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:08:13.238909 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:08:13.381671 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:08:13.390508 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1fd7cc92-f652-4966-bfa2-9fc458574f29 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1561 microversion: 2.1 time: 0.166201 Jul 18 04:08:13.391086 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3979/8027] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:08:13 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:21.292354 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:09:21.292984 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:09:27.478607 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=5 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:27.480063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=18 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:27.484743 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:27.485285 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:27.493257 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:27.493722 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:27.494519 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:27.494964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:27.522758 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Going to try to terminate instance {{(pid=119439) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 04:09:27.600802 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=7 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:27.601726 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=23 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:27.607588 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-90fd4640-6ba2-4e63-86de-a7ccc6652239 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 204 len: 0 microversion: 2.1 time: 0.130602 Jul 18 04:09:27.608606 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4049/8028] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 04:09:27 2022] DELETE /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 04:09:27.620175 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:27.621287 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:27.627446 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:27.627906 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:27.628695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:27.629172 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:27.665254 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-5a24ced6-8a6c-4be9-8bda-977d1e2d868c req-8c765968-307e-4ac4-abd4-f8dd306933ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:09:27.673540 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5a24ced6-8a6c-4be9-8bda-977d1e2d868c req-8c765968-307e-4ac4-abd4-f8dd306933ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:27.674267 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-5a24ced6-8a6c-4be9-8bda-977d1e2d868c req-8c765968-307e-4ac4-abd4-f8dd306933ad service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:27.686918 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-5a24ced6-8a6c-4be9-8bda-977d1e2d868c req-8c765968-307e-4ac4-abd4-f8dd306933ad service nova] Creating event network-changed:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:09:27.692164 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-5a24ced6-8a6c-4be9-8bda-977d1e2d868c req-8c765968-307e-4ac4-abd4-f8dd306933ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097745 Jul 18 04:09:27.693037 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3980/8029] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:09:27.781467 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:27.790615 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-2388e944-227c-44ba-a5ef-8eebd80d55e5 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.176921 Jul 18 04:09:27.791197 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4050/8030] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:27 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:09:28.811644 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:28.812398 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:28.819669 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:28.820139 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:28.820951 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:28.821418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:29.001402 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:29.010057 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33684ca4-3860-42cf-8b03-39513e8e1bfd tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1567 microversion: 2.1 time: 0.205060 Jul 18 04:09:29.010651 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3981/8031] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:28 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:29.849453 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-c52f88b7-f45a-4e04-beb8-57f0c932ba03 req-f10de6b1-8d54-4bb9-b159-5c4e9f574f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c0c0a-a372-4df6-96e2-12485d0c633c", "name": "network-vif-deleted", "tag": "44defb48-fa59-410e-b4d8-97a0e6ca2715"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:09:29.861880 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c52f88b7-f45a-4e04-beb8-57f0c932ba03 req-f10de6b1-8d54-4bb9-b159-5c4e9f574f74 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:29.862585 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-c52f88b7-f45a-4e04-beb8-57f0c932ba03 req-f10de6b1-8d54-4bb9-b159-5c4e9f574f74 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:29.875838 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-c52f88b7-f45a-4e04-beb8-57f0c932ba03 req-f10de6b1-8d54-4bb9-b159-5c4e9f574f74 service nova] Creating event network-vif-deleted:44defb48-fa59-410e-b4d8-97a0e6ca2715 for instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c on n-h1-849796-1 Jul 18 04:09:29.883124 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-c52f88b7-f45a-4e04-beb8-57f0c932ba03 req-f10de6b1-8d54-4bb9-b159-5c4e9f574f74 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 Jul 18 04:09:29.883847 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4051/8032] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:09:30.028795 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:30.029503 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:30.035803 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:30.036342 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:30.038082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:30.038633 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:30.107222 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:30.116572 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-5e5b15f1-891b-4e68-a617-d5db3e69d8a2 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1218 microversion: 2.1 time: 0.091589 Jul 18 04:09:30.117320 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3982/8033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:30 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:31.134609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:31.135241 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:31.142672 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:31.143132 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:31.143921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:31.144373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:31.216713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:31.225860 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-63ae9986-25fe-406c-9128-5df4f9892a56 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1218 microversion: 2.1 time: 0.095025 Jul 18 04:09:31.226464 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4052/8034] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:31 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:32.244674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:32.245343 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:32.253677 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:32.254146 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:32.254978 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:32.255459 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:32.326590 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:32.334678 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-33ab6840-2f9a-45af-9551-9e5aecf4c12d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1218 microversion: 2.1 time: 0.094201 Jul 18 04:09:32.335258 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3983/8035] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:32 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:33.351958 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:33.352567 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:33.359814 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:33.360270 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:33.361128 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:33.361573 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:33.429344 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d0427329b2d42678966d35f5af1dfa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7730570f94326990a32aaef903156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:33.440574 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-b758908b-87d4-4897-a6a3-1321cab95e4d tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 200 len: 1218 microversion: 2.1 time: 0.092705 Jul 18 04:09:33.441218 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4053/8036] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:33 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:34.460386 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:34.461776 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] [instance: 8e9c0c0a-a372-4df6-96e2-12485d0c633c] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:34.471542 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:34.472392 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:34.473515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:34.474147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:34.493614 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] HTTP exception thrown: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Request method failure captured: Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c HTTP/1.1 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1NqX8hWmBQlXA4R_c_ibLTe-of6rsiJXEcgAqyjNSAQIVjwXhMOxcW3zVNdME8lDYdcR0Nad4bs7V55xk-1xaqWQPe8IKfrG61CLgP4xmP2bpVKeJB4Tf08_M4L9l_7Dlxd_-wOfCw54BbknKP1R-q5i84ae2HuGOVQ7ST7_JXyKb-0 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: b6d7730570f94326990a32aaef903156 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestShelveInstance-110061285 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6d7730570f94326990a32aaef903156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6d7730570f94326990a32aaef903156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6d7730570f94326990a32aaef903156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6d7730570f94326990a32aaef903156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestShelveInstance-110061285 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: b6d7730570f94326990a32aaef903156 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestShelveInstance-110061285 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestShelveInstance-110061285-project Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 7d0427329b2d42678966d35f5af1dfa8 Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestShelveInstance-110061285-project Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '8e9c0c0a-a372-4df6-96e2-12485d0c633c'} Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:09:34.495407 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Returning 404 to user: Instance 8e9c0c0a-a372-4df6-96e2-12485d0c633c could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 04:09:34.500794 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-bb17b14d-00b2-4a7f-8e10-11ea7b67dd06 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c" status: 404 len: 111 microversion: 2.1 time: 0.043833 Jul 18 04:09:34.505810 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3984/8037] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:34 2022] GET /compute/v2.1/servers/8e9c0c0a-a372-4df6-96e2-12485d0c633c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 04:09:34.673711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-838dba05-6595-43f1-b03d-a3fc475ac0b0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] Calling method '.version_select at 0x7fab04bfe3a0>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:34.715138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-838dba05-6595-43f1-b03d-a3fc475ac0b0 tempest-TestShelveInstance-110061285 tempest-TestShelveInstance-110061285-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-782926002" status: 202 len: 0 microversion: 2.1 time: 0.045992 Jul 18 04:09:34.715927 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4054/8038] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Jul 18 04:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-782926002 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 04:09:52.969354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=10 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:52.970189 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=22 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:53.148050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-fb0a5bfb-ba7f-4f37-a49f-dd991c4123aa tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Action: 'create', calling method: .version_select at 0x7faaf7312d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1901262072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbHrlcja9yvXSqu0Moaz6uAHrnu0bNXioBBL7/8/Ld53mLEDh5LFciOTFnh++WUldsQ4WFSBPWtelL+GmRHKPeBrosIxqqSboP3WcnrCZXb29huL9uugY6QxP0yoB4fPw=="}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:09:53.163112 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fb0a5bfb-ba7f-4f37-a49f-dd991c4123aa tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 04:09:53.168313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-fb0a5bfb-ba7f-4f37-a49f-dd991c4123aa tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for user 5188ba3f1cb74d13954ce478728a3308 and project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'key_pairs'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 04:09:53.197162 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-fb0a5bfb-ba7f-4f37-a49f-dd991c4123aa tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.239427 Jul 18 04:09:53.197771 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3985/8039] 10.222.0.67 () {60 vars in 1158 bytes} [Mon Jul 18 04:09:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:09:54.325099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:54.325844 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:09:54.329978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-159666457", "imageRef": "8c01d435-c8d4-440f-bb6f-419ec4a428ef", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1901262072", "security_groups": [{"name": "tempest-secgroup-smoke-657085985"}], "networks": [{"uuid": "22d23f7c-dd3b-464e-aeda-d0c3413065d4"}]}} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:09:54.441997 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.network.neutron [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] validate_networks() for [('22d23f7c-dd3b-464e-aeda-d0c3413065d4', None, None, None, None, None)] {{(pid=119439) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 04:09:54.872362 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Flavor limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 04:09:54.872861 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Image limits 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 04:09:54.873377 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Flavor pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 04:09:54.873790 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Image pref 0:0:0 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 04:09:54.874355 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.virt.hardware [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 04:09:54.884235 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:54.884689 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:54.885530 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:54.885974 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:54.904615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 04:09:54.910024 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.quota [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for user 5188ba3f1cb74d13954ce478728a3308 and project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 04:09:54.923703 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Going to run 1 instances... {{(pid=119439) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 04:09:54.926394 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c01d435-c8d4-440f-bb6f-419ec4a428ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 04:09:54.981445 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-76ab38bb-8fc2-4a81-9c38-778957b44f37 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.657758 Jul 18 04:09:54.982437 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4055/8040] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 04:09:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 04:09:54.993033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-964a12f6-f52a-47ad-963d-575222c6fc65 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:54.994194 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-964a12f6-f52a-47ad-963d-575222c6fc65 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:55.087552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-964a12f6-f52a-47ad-963d-575222c6fc65 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:55.098460 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-964a12f6-f52a-47ad-963d-575222c6fc65 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1248 microversion: 2.1 time: 0.109096 Jul 18 04:09:55.100006 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3986/8041] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:54 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1248 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:09:56.116704 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:56.118063 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:56.127094 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:56.127912 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:56.128991 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:56.129714 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:56.198421 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:56.207284 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-ac661dc5-abfd-49f2-a332-fb200460fd93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1306 microversion: 2.1 time: 0.095328 Jul 18 04:09:56.207965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4056/8042] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:56 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:57.227135 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:57.227770 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:57.247082 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:57.247884 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:57.248898 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:57.249563 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:57.539702 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:57.547510 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-140df714-e097-4034-b580-db2921915878 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.325081 Jul 18 04:09:57.548724 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3987/8043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:57 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:57.754695 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-9e5c1328-e211-4d3f-8d6c-750fc4a9f1cc req-71b3bd1d-f762-4fd4-b122-dfd576200423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:09:57.768692 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9e5c1328-e211-4d3f-8d6c-750fc4a9f1cc req-71b3bd1d-f762-4fd4-b122-dfd576200423 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:57.771373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-9e5c1328-e211-4d3f-8d6c-750fc4a9f1cc req-71b3bd1d-f762-4fd4-b122-dfd576200423 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:57.785000 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-9e5c1328-e211-4d3f-8d6c-750fc4a9f1cc req-71b3bd1d-f762-4fd4-b122-dfd576200423 service nova] Creating event network-changed:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:09:57.795138 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-9e5c1328-e211-4d3f-8d6c-750fc4a9f1cc req-71b3bd1d-f762-4fd4-b122-dfd576200423 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044505 Jul 18 04:09:57.799694 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4057/8044] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:09:58.565165 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:58.565786 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:58.572880 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:58.573367 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:58.574149 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:58.574594 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:58.706494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:58.715276 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b455b2cf-4114-4dd1-afc3-8201fe0396f6 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.154018 Jul 18 04:09:58.715860 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3988/8045] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:58 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:09:59.733551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:09:59.734286 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:09:59.742156 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:59.742615 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:59.743645 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:09:59.744100 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:09:59.884654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:09:59.892261 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-38b6b6f4-108d-4491-a490-f601002e1a11 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.164350 Jul 18 04:09:59.892838 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4058/8046] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:09:59 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:00.909753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:00.910326 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:00.917515 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:00.918003 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:00.918834 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:00.919304 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:01.059232 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:01.067030 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-b768003d-0fc0-4568-8d42-64e42709d387 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.161205 Jul 18 04:10:01.067614 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3989/8047] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:00 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:02.085439 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:02.086058 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:02.093099 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:02.093878 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:02.094668 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:02.095422 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:02.232514 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:02.240374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8292f3f8-5351-4fa3-9565-20c9b1b7feb7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.158855 Jul 18 04:10:02.240999 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4059/8048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:02 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:03.258377 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:03.259739 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:03.268257 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:03.269064 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:03.269622 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:03.269991 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:03.425433 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-f6ddd8bd-c2f4-4795-82d0-bbaf37f07a7a req-28f63842-bdeb-41ee-b3b1-23d6a167e802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "name": "network-vif-plugged", "status": "completed", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:10:03.436405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:03.439217 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f6ddd8bd-c2f4-4795-82d0-bbaf37f07a7a req-28f63842-bdeb-41ee-b3b1-23d6a167e802 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:03.439739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-f6ddd8bd-c2f4-4795-82d0-bbaf37f07a7a req-28f63842-bdeb-41ee-b3b1-23d6a167e802 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:03.449808 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-028fe12b-9c32-4306-bfd5-d59be582f4fb tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.195870 Jul 18 04:10:03.450411 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3990/8049] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:03 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:03.452520 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-f6ddd8bd-c2f4-4795-82d0-bbaf37f07a7a req-28f63842-bdeb-41ee-b3b1-23d6a167e802 service nova] Creating event network-vif-plugged:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:10:03.461585 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-f6ddd8bd-c2f4-4795-82d0-bbaf37f07a7a req-28f63842-bdeb-41ee-b3b1-23d6a167e802 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100846 Jul 18 04:10:03.462213 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4060/8050] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:10:04.467031 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:04.467701 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:04.475809 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:04.476296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:04.477142 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:04.477605 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:04.617493 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:04.625316 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-89985a4e-9061-4e97-b121-a185a453520e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1373 microversion: 2.1 time: 0.162254 Jul 18 04:10:04.625895 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3991/8051] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:04 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:05.641147 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:10:05.641923 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=6 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:10:05.646336 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:05.647340 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:05.654671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:05.655134 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:05.655922 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:05.656373 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:05.792203 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:05.799819 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-1ff2edb6-eaf0-4b0f-9c6e-36eb9319cf73 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1557 microversion: 2.1 time: 0.160538 Jul 18 04:10:05.800402 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4061/8052] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:05 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:05.816403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:10:05.817081 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:10:05.819993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:10:05.826193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:05.826652 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:05.827434 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:05.827882 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:05.962508 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:10:05.970904 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a1a754cd-1001-4c41-a811-93d1c8374318 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1557 microversion: 2.1 time: 0.158119 Jul 18 04:10:05.971620 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3992/8053] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:10:05 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:10:08.131387 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-21011666-9f8c-4d4d-8757-1961a0cc3929 req-8473c125-4cca-41aa-9498-50055a0dc2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:10:08.139682 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-21011666-9f8c-4d4d-8757-1961a0cc3929 req-8473c125-4cca-41aa-9498-50055a0dc2a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:10:08.140130 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-21011666-9f8c-4d4d-8757-1961a0cc3929 req-8473c125-4cca-41aa-9498-50055a0dc2a5 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:10:08.152812 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-21011666-9f8c-4d4d-8757-1961a0cc3929 req-8473c125-4cca-41aa-9498-50055a0dc2a5 service nova] Creating event network-changed:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:10:08.158403 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-21011666-9f8c-4d4d-8757-1961a0cc3929 req-8473c125-4cca-41aa-9498-50055a0dc2a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086602 Jul 18 04:10:08.159345 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4062/8054] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:12:41.301096 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:12:41.301739 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:12:41.309745 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:12:41.309915 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:12:41.878396 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:12:41.878976 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:12:42.010960 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:12:42.011153 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:12:44.868741 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:12:44.870213 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 04:12:44.870738 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:12:44.871591 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=36 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:12:44.875924 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1273789685"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:12:44.877144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:12:44.891056 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:12:44.891521 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:12:44.892338 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:12:44.892791 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:12:45.285271 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [53d96505-1a5d-46ea-9ab4-4451fa858ecc] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:12:45.877912 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57660. Jul 18 04:12:45.878691 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57658. Jul 18 04:12:46.292458 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [53d96505-1a5d-46ea-9ab4-4451fa858ecc] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57662. Jul 18 04:12:46.299776 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a5f17db7-661d-4af1-b868-1aaf1b438343 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "POST /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad/action" status: 202 len: 0 microversion: 2.1 time: 1.433030 Jul 18 04:12:46.300428 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3993/8055] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:12:44 2022] POST /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad/action => generated 0 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 04:12:54.051509 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:12:54.052358 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:12:54.052984 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:12:54.053868 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=32 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:12:54.059628 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "name": "network-vif-plugged", "status": "completed", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:12:54.073932 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:12:54.074963 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:12:54.088220 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] Creating event network-vif-plugged:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:12:54.092722 n-d-849796-1 devstack@n-api.service[119439]: ERROR oslo.messaging._drivers.impl_rabbit [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] [e29c7292-4931-4bfb-82c4-7db25680c04c] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:12:55.065073 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [84c545c3-f4a5-4d62-8f16-5f1301ae4c64] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57742. Jul 18 04:12:55.066850 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] [333b9ece-6bde-4565-8669-11d2cac2632e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57744. Jul 18 04:12:55.100333 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] [e29c7292-4931-4bfb-82c4-7db25680c04c] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57746. Jul 18 04:12:55.103893 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-2bff702e-7199-41f4-8cec-5a4db3f2aa25 req-3d7ef673-9555-45bc-aaca-833a849ae210 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.054272 Jul 18 04:12:55.104951 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4063/8056] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:13:03.904193 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:03.905010 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:03.909067 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1034455623", "imageRef": "5451c8aa-7287-4107-b408-a85272d4d0aa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1901262072", "security_groups": [{"name": "tempest-secgroup-smoke-657085985"}], "networks": [{"uuid": "22d23f7c-dd3b-464e-aeda-d0c3413065d4"}]}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:13:04.024969 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.network.neutron [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] validate_networks() for [('22d23f7c-dd3b-464e-aeda-d0c3413065d4', None, None, None, None, None)] {{(pid=119440) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 04:13:04.496450 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Flavor limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 04:13:04.496896 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Image limits 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 04:13:04.497418 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Flavor pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 04:13:04.497851 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Image pref 0:0:0 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 04:13:04.498281 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.virt.hardware [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 04:13:04.509712 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:04.510173 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:04.510988 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:04.511442 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:04.531906 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 04:13:04.537177 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.quota [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Getting quotas for user 5188ba3f1cb74d13954ce478728a3308 and project 14c5cb0c66754e2191e3cc45b85955e6. Resources: {'cores', 'ram', 'instances'} {{(pid=119440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 04:13:04.550033 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Going to run 1 instances... {{(pid=119440) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 04:13:04.552548 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5451c8aa-7287-4107-b408-a85272d4d0aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 04:13:04.599109 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-9754ddf3-7746-4abc-8df3-e08a4a577b6f tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697172 Jul 18 04:13:04.599751 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3994/8057] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Jul 18 04:13:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 04:13:04.608609 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:04.609872 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:04.614479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-bad3a0b0-79d7-4d01-8c0d-7569cb1eaa93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:04.615184 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-bad3a0b0-79d7-4d01-8c0d-7569cb1eaa93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:04.731479 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-bad3a0b0-79d7-4d01-8c0d-7569cb1eaa93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:04.741295 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-bad3a0b0-79d7-4d01-8c0d-7569cb1eaa93 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1249 microversion: 2.1 time: 0.135083 Jul 18 04:13:04.741877 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4064/8058] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:04 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1249 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:05.759172 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:05.760407 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:05.768488 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:05.769050 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:05.769842 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:05.770301 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:05.839307 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:05.848388 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-3571b39f-552f-4496-b0f4-d78901df4518 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1307 microversion: 2.1 time: 0.093949 Jul 18 04:13:05.848993 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3995/8059] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:05 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:06.866946 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:06.867670 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:06.876669 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:06.877559 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:06.878582 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:06.879242 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:07.032166 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:07.041466 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-e6574a8d-0d52-4bb5-a1e7-d2a0141ea7ae tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.178242 Jul 18 04:13:07.044973 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4065/8060] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:06 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:08.010910 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-af477c49-793a-49a4-827d-02304b6d4286 req-bbe32e97-069e-4e5b-8eb6-cbb04c6f182b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "name": "network-vif-unplugged", "status": "completed", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:13:08.021110 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-af477c49-793a-49a4-827d-02304b6d4286 req-bbe32e97-069e-4e5b-8eb6-cbb04c6f182b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:08.021615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-af477c49-793a-49a4-827d-02304b6d4286 req-bbe32e97-069e-4e5b-8eb6-cbb04c6f182b service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:08.039281 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-af477c49-793a-49a4-827d-02304b6d4286 req-bbe32e97-069e-4e5b-8eb6-cbb04c6f182b service nova] Creating event network-vif-unplugged:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:13:08.045179 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-af477c49-793a-49a4-827d-02304b6d4286 req-bbe32e97-069e-4e5b-8eb6-cbb04c6f182b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037907 Jul 18 04:13:08.046637 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3996/8061] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:13:08.060557 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:08.061227 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:08.072006 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:08.073037 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:08.074281 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:08.076976 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:08.253062 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:08.264576 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-74c11643-d83c-4756-a309-2fd017baeea5 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.209428 Jul 18 04:13:08.265213 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4066/8062] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:08 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:13:09.284256 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:09.284895 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:09.291288 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:09.291750 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:09.292541 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:09.293019 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:09.432545 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:09.442655 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-aa5d2a54-3ce9-4920-9685-b4fb098aeb81 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.163529 Jul 18 04:13:09.453886 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3997/8063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:09 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:10.461229 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:10.461916 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:10.469077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:10.469538 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:10.470321 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:10.470771 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:10.647917 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:10.656425 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-7747563d-c688-4bc1-bf30-b47e1f1b078c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.199322 Jul 18 04:13:10.657467 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4067/8064] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:10 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:11.674147 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:11.674821 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:11.683330 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:11.684353 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:11.686004 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:11.686550 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:11.847698 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:11.855432 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-7ceb0e3d-af7e-4da0-a02e-8fab58c7a828 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.185340 Jul 18 04:13:11.856047 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3998/8065] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:11 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:12.873551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:12.874174 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:12.881084 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:12.881542 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:12.882341 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:12.882823 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:13.049914 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:13.058057 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-c3e641f8-f071-4743-aa2d-204b174bc15e tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.188759 Jul 18 04:13:13.058773 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4068/8066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:12 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:13:14.075487 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:14.076510 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:14.083423 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:14.083890 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:14.084675 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:14.085164 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:14.218936 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:14.226295 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-2a6ee748-256d-4921-96d5-7b37d7181621 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.154873 Jul 18 04:13:14.226856 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 3999/8067] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:14 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:15.243711 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:15.244598 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:15.247418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell0:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:15.253247 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:15.253713 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:15.254523 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:15.254964 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:15.386590 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:15.394695 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-8c8dd9f1-c62e-4532-bc29-a69550211fc0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.154969 Jul 18 04:13:15.395281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4069/8068] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:15 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:16.285032 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-966e96f4-4e7f-403b-860a-dda22add84fd req-bc813951-fd89-4d27-aab5-8be35ce9b051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:13:16.288709 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:16.289492 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell0:SELECT=6 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:13:16.296496 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-966e96f4-4e7f-403b-860a-dda22add84fd req-bc813951-fd89-4d27-aab5-8be35ce9b051 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:16.297059 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-966e96f4-4e7f-403b-860a-dda22add84fd req-bc813951-fd89-4d27-aab5-8be35ce9b051 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:16.313971 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-966e96f4-4e7f-403b-860a-dda22add84fd req-bc813951-fd89-4d27-aab5-8be35ce9b051 service nova] Creating event network-changed:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:13:16.321330 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-966e96f4-4e7f-403b-860a-dda22add84fd req-bc813951-fd89-4d27-aab5-8be35ce9b051 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040422 Jul 18 04:13:16.322307 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4000/8069] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:13:16.411793 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:16.412418 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:16.420016 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:16.420550 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:16.421392 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:16.421845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:16.650959 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:16.658504 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-a7db4e1c-20ac-4555-9a9e-3b89a71001e7 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.250763 Jul 18 04:13:16.659081 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4070/8070] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:16 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:17.676983 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:17.677627 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:17.683824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:17.684313 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:17.685156 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:17.685612 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:17.819494 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:17.828241 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-a6a9ecd6-2ef1-4f78-8053-e8c2cdff2c6d tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.156404 Jul 18 04:13:17.828827 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4001/8071] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:17 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:18.845512 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:18.846136 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:18.853328 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:18.853791 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:18.854586 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:18.855042 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:19.094057 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:19.101694 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-05dab6d0-066b-45c3-b532-b27038b44b16 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.261237 Jul 18 04:13:19.102281 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4071/8072] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:18 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:20.119945 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:20.120562 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:20.128144 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:20.128611 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:20.129426 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:20.129916 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:20.260891 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:20.269126 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-1f5b719b-da62-470d-9be9-eef1c2573ccd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.153336 Jul 18 04:13:20.269704 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4002/8073] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:20 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:21.286266 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:21.286921 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:21.293978 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:21.294457 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:21.295483 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:21.295935 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:21.436105 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:21.445374 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-3d2cd9b2-4f6c-4fd4-8c33-c9d1d3acce3a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.162466 Jul 18 04:13:21.445494 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4072/8074] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:21 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:22.456248 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [req-73bad4b2-b36a-4552-8d77-ba988d09a744 req-1872d33d-78c0-4dee-83ea-d807de4f0bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "name": "network-vif-plugged", "status": "completed", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:13:22.463015 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:22.463561 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:22.467006 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73bad4b2-b36a-4552-8d77-ba988d09a744 req-1872d33d-78c0-4dee-83ea-d807de4f0bf7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:22.467674 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [req-73bad4b2-b36a-4552-8d77-ba988d09a744 req-1872d33d-78c0-4dee-83ea-d807de4f0bf7 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:22.471297 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:22.471763 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:22.472551 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:22.473041 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:22.483488 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.compute.server_external_events [req-73bad4b2-b36a-4552-8d77-ba988d09a744 req-1872d33d-78c0-4dee-83ea-d807de4f0bf7 service nova] Creating event network-vif-plugged:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:13:22.490234 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [req-73bad4b2-b36a-4552-8d77-ba988d09a744 req-1872d33d-78c0-4dee-83ea-d807de4f0bf7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Jul 18 04:13:22.491187 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4003/8075] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:13:22.654291 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:22.662023 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9be6121b-27a3-467f-81fc-38d436fbee2b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.203666 Jul 18 04:13:22.662701 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4073/8076] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:22 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:13:23.681155 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:23.681875 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:23.688952 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:23.689405 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:23.690196 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:23.690656 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:23.821331 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:23.829549 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8205d92a-959f-4619-bc9a-a358cd955e31 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1374 microversion: 2.1 time: 0.153623 Jul 18 04:13:23.830121 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4004/8077] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:23 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:24.847431 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:24.848089 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:24.855028 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:24.855482 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:24.856258 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:24.856709 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:24.988898 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:24.996661 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-71a5df79-776f-4084-a5e7-d8a13ff0c887 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1559 microversion: 2.1 time: 0.153206 Jul 18 04:13:24.997280 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4074/8078] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:24 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:25.013838 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:13:25.014469 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:13:25.021355 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:25.021824 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:25.022615 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:25.023076 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:25.166336 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:13:25.174392 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8b77e65f-6b86-44b1-90ec-9e7965de6580 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1559 microversion: 2.1 time: 0.165000 Jul 18 04:13:25.174994 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4005/8079] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:13:25 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:13:27.091970 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d59f8502-f786-4c04-a356-27c8099b4e9a req-eba9b9f3-6aff-4111-a210-494533b458ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:13:27.100697 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d59f8502-f786-4c04-a356-27c8099b4e9a req-eba9b9f3-6aff-4111-a210-494533b458ab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:13:27.101255 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d59f8502-f786-4c04-a356-27c8099b4e9a req-eba9b9f3-6aff-4111-a210-494533b458ab service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:13:27.113154 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d59f8502-f786-4c04-a356-27c8099b4e9a req-eba9b9f3-6aff-4111-a210-494533b458ab service nova] Creating event network-changed:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:13:27.118348 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d59f8502-f786-4c04-a356-27c8099b4e9a req-eba9b9f3-6aff-4111-a210-494533b458ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030630 Jul 18 04:13:27.119536 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4075/8080] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:15:40.718597 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:15:40.719374 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=56 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:15:40.770847 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1583995783"}} {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:15:40.771947 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:15:40.777883 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:15:40.778362 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:15:40.779118 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:15:40.779564 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:15:41.065471 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-d3620b4b-bed9-46b1-b4b2-e71e1f261e92 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "POST /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e/action" status: 202 len: 0 microversion: 2.1 time: 0.348340 Jul 18 04:15:41.066151 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4006/8081] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Jul 18 04:15:40 2022] POST /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 18 04:15:47.313776 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=26 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:15:47.314588 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=62 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:15:47.379845 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-150b0093-0cfe-455a-a1ea-f8a5005f1694 req-7c937497-8047-4e11-9db7-4854d35183a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "name": "network-vif-plugged", "status": "completed", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:15:47.388827 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-150b0093-0cfe-455a-a1ea-f8a5005f1694 req-7c937497-8047-4e11-9db7-4854d35183a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:15:47.389309 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-150b0093-0cfe-455a-a1ea-f8a5005f1694 req-7c937497-8047-4e11-9db7-4854d35183a9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:15:47.401741 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-150b0093-0cfe-455a-a1ea-f8a5005f1694 req-7c937497-8047-4e11-9db7-4854d35183a9 service nova] Creating event network-vif-plugged:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:15:47.406958 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-150b0093-0cfe-455a-a1ea-f8a5005f1694 req-7c937497-8047-4e11-9db7-4854d35183a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095914 Jul 18 04:15:47.407674 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4076/8082] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:16:00.825228 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:16:00.826060 n-d-849796-1 devstack@n-api.service[119440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 04:16:00.826693 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_api:SELECT=2 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:16:00.827576 n-d-849796-1 devstack@n-api.service[119440]: DEBUG dbcounter [-] [119440] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:16:00.832970 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:00.833478 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_api:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:16:00.833948 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:00.834372 n-d-849796-1 devstack@n-api.service[119439]: DEBUG dbcounter [-] [119439] Writing DB stats nova_cell1:SELECT=2 {{(pid=119439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 04:16:00.842495 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:00.842934 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:00.843833 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:00.844289 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:00.872566 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 04:16:00.899497 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-d1e50e7a-dae0-4a6b-a2e7-24bcfcaf063e req-56c46fd0-e724-4430-8242-6ba03ad56d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:16:00.908116 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d1e50e7a-dae0-4a6b-a2e7-24bcfcaf063e req-56c46fd0-e724-4430-8242-6ba03ad56d17 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:00.908911 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-d1e50e7a-dae0-4a6b-a2e7-24bcfcaf063e req-56c46fd0-e724-4430-8242-6ba03ad56d17 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:00.921159 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-d1e50e7a-dae0-4a6b-a2e7-24bcfcaf063e req-56c46fd0-e724-4430-8242-6ba03ad56d17 service nova] Creating event network-changed:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:16:00.926999 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-d1e50e7a-dae0-4a6b-a2e7-24bcfcaf063e req-56c46fd0-e724-4430-8242-6ba03ad56d17 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100977 Jul 18 04:16:00.928054 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4077/8083] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:16:00.955547 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-beb9552a-5aa0-4c3f-85f5-25e9cbec72bd tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 204 len: 0 microversion: 2.1 time: 0.131796 Jul 18 04:16:00.956243 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4007/8084] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 04:16:00 2022] DELETE /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 04:16:00.966602 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:00.967379 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:00.974626 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:00.975400 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:00.976655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:00.977495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:01.132495 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:16:01.140342 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5272a0c3-181a-4b67-b464-21003af49334 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1684 microversion: 2.1 time: 0.178611 Jul 18 04:16:01.141026 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4078/8085] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:00 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:16:01.309334 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:16:01.309543 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:16:01.317326 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:16:01.317502 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:16:01.886773 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:16:01.887266 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:16:02.019096 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:16:02.019326 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:16:02.159036 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:02.159832 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:02.170030 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:02.170499 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:02.171296 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:02.171753 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:02.178597 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [1839a6a3-9ff7-4593-b1d3-47965baf1641] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 58222. Jul 18 04:16:02.179421 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] [df949469-7f3b-4412-b736-1dfbc9bc3038] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 58224. Jul 18 04:16:02.311685 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:16:02.319931 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-ec1dcc1c-ec09-45df-9b56-2068ad139573 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1684 microversion: 2.1 time: 0.165401 Jul 18 04:16:02.320518 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4008/8086] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:02 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:16:03.193107 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-b9a68832-e1fe-486b-a905-de13ba4ae924 req-5011d4fd-e3a8-4115-a4dc-61d44fe9b30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83a8aa0-bda6-499e-92df-2b21a3b2b92e", "name": "network-vif-deleted", "tag": "895387cf-e8ab-492d-b6be-8ff8a2bd7996"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:16:03.206284 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b9a68832-e1fe-486b-a905-de13ba4ae924 req-5011d4fd-e3a8-4115-a4dc-61d44fe9b30a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:03.206739 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-b9a68832-e1fe-486b-a905-de13ba4ae924 req-5011d4fd-e3a8-4115-a4dc-61d44fe9b30a service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:03.218748 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-b9a68832-e1fe-486b-a905-de13ba4ae924 req-5011d4fd-e3a8-4115-a4dc-61d44fe9b30a service nova] Creating event network-vif-deleted:895387cf-e8ab-492d-b6be-8ff8a2bd7996 for instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e on n-h2-849796-1 Jul 18 04:16:03.226086 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-b9a68832-e1fe-486b-a905-de13ba4ae924 req-5011d4fd-e3a8-4115-a4dc-61d44fe9b30a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036826 Jul 18 04:16:03.227357 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4079/8087] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 04:16:03.337999 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:03.338730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:03.345721 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:03.346403 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:03.347354 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:03.347814 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:03.380874 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:03.381270 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:03.381730 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.objects.instance [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lazy-loading 'fault' on Instance uuid e83a8aa0-bda6-499e-92df-2b21a3b2b92e {{(pid=119440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 04:16:03.423070 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:16:03.430698 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-55ae2c8e-6edb-47bc-8850-c05e0d5fa5c8 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 200 len: 1339 microversion: 2.1 time: 0.096783 Jul 18 04:16:03.431265 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4009/8088] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:03 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:16:04.449419 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:04.450133 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: e83a8aa0-bda6-499e-92df-2b21a3b2b92e] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:04.457214 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:04.457675 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:04.458459 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:04.458910 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:04.472297 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.wsgi [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] HTTP exception thrown: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Request method failure captured: Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: request: GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e HTTP/1.1 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Accept: application/json Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Accept-Encoding: identity Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Connection: close Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Content-Length: 0 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Content-Type: application/json Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Host: 10.222.0.67 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: Openstack-System-Scope: None Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: User-Agent: python-urllib3/1.26.9 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Auth-Token: gAAAAABi1N0LogvcQrJobjfnyY_mcsqRE9ixfdC1BaB7uYXf4yQGmyLAtWrq0e0wiDN3ytibC0BLeuozRWJGlZ7blzoI8igNIsztBqlaZ5UKOHXRj9TNgj3wnGwMZ07MxKDiQ7U8ufDZBkh02obFcSf2-3lVFtBaOTq7eYpF_DS4YbK1Opkw5M0 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Id: None Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Domain-Name: None Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Identity-Status: Confirmed Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Is-Admin-Project: True Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Id: default Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Domain-Name: Default Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Id: 14c5cb0c66754e2191e3cc45b85955e6 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Project-Name: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Role: reader,member Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Roles: reader,member Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Id: 14c5cb0c66754e2191e3cc45b85955e6 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-Tenant-Name: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-User: tempest-TestSnapshotPattern-2049711953-project Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Id: default Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Domain-Name: Default Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Id: 5188ba3f1cb74d13954ce478728a3308 Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: X-User-Name: tempest-TestSnapshotPattern-2049711953-project Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: method: > Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: exception: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: action_args: {'id': 'e83a8aa0-bda6-499e-92df-2b21a3b2b92e'} Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:16:04.473961 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: ERROR nova.api.openstack.wsgi Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Returning 404 to user: Instance e83a8aa0-bda6-499e-92df-2b21a3b2b92e could not be found. {{(pid=119439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-5fe49ab4-67e7-4c73-94df-d74444b3dbdf tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e" status: 404 len: 111 microversion: 2.1 time: 0.030313 Jul 18 04:16:04.479883 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4080/8089] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:04 2022] GET /compute/v2.1/servers/e83a8aa0-bda6-499e-92df-2b21a3b2b92e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 04:16:05.835345 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:05.835985 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:05.836817 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-90ced94d-2b46-4afd-ba12-3a692913477d req-51e67501-f3f2-48ad-a7d5-defe8a364dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:16:05.843823 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:05.844593 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:05.845552 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:05.847431 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:05.848077 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-90ced94d-2b46-4afd-ba12-3a692913477d req-51e67501-f3f2-48ad-a7d5-defe8a364dc9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:05.848655 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-90ced94d-2b46-4afd-ba12-3a692913477d req-51e67501-f3f2-48ad-a7d5-defe8a364dc9 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:05.861598 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-90ced94d-2b46-4afd-ba12-3a692913477d req-51e67501-f3f2-48ad-a7d5-defe8a364dc9 service nova] Creating event network-changed:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:16:05.867362 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-90ced94d-2b46-4afd-ba12-3a692913477d req-51e67501-f3f2-48ad-a7d5-defe8a364dc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034154 Jul 18 04:16:05.867965 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4081/8090] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:16:05.881284 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Going to try to terminate instance {{(pid=119440) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 04:16:05.974122 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-8a2f922c-d0e2-42cf-a2f9-d800d9f2ed26 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 204 len: 0 microversion: 2.1 time: 0.143211 Jul 18 04:16:05.976552 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4010/8091] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Jul 18 04:16:05 2022] DELETE /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 04:16:05.985654 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:05.988082 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.compute.api [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119439) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:05.994671 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:05.995398 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:05.996432 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:05.997091 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:06.150948 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.policy [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119439) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:16:06.159991 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-fb0e90af-5143-48f3-be2b-20b2fbf514c0 tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1681 microversion: 2.1 time: 0.177535 Jul 18 04:16:06.160707 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4082/8092] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:05 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 04:16:07.178723 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:07.179452 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:07.188115 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:07.188584 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:07.192775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:07.192775 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:07.265218 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.policy [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5188ba3f1cb74d13954ce478728a3308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c5cb0c66754e2191e3cc45b85955e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119440) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 04:16:07.277689 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-30901802-a610-43a7-9b0d-7c4e1a75147c tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 200 len: 1496 microversion: 2.1 time: 0.103570 Jul 18 04:16:07.278450 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4011/8093] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:07 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 1496 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 04:16:07.882449 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [req-83369c68-8764-4217-92aa-6a80cec0ea2c req-6d967f8c-3b68-4dd1-a243-c98d94bb0c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fcb3204-7d3a-4cbb-989c-6b64f0174cad", "name": "network-vif-deleted", "tag": "2c140437-1ce2-4f81-ae1f-e1b833b417fd"}]} {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 04:16:07.891404 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-83369c68-8764-4217-92aa-6a80cec0ea2c req-6d967f8c-3b68-4dd1-a243-c98d94bb0c83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:07.891855 n-d-849796-1 devstack@n-api.service[119439]: DEBUG oslo_concurrency.lockutils [req-83369c68-8764-4217-92aa-6a80cec0ea2c req-6d967f8c-3b68-4dd1-a243-c98d94bb0c83 service nova] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:07.902738 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.compute.server_external_events [req-83369c68-8764-4217-92aa-6a80cec0ea2c req-6d967f8c-3b68-4dd1-a243-c98d94bb0c83 service nova] Creating event network-vif-deleted:2c140437-1ce2-4f81-ae1f-e1b833b417fd for instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad on n-h1-849796-1 Jul 18 04:16:07.907737 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [req-83369c68-8764-4217-92aa-6a80cec0ea2c req-6d967f8c-3b68-4dd1-a243-c98d94bb0c83 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028973 Jul 18 04:16:07.908945 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4083/8094] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Jul 18 04:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 04:16:08.295210 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '>' {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:08.295840 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.compute.api [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] [instance: 7fcb3204-7d3a-4cbb-989c-6b64f0174cad] Fetching instance by UUID {{(pid=119440) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 04:16:08.302993 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:08.303458 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:08.304242 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 04:16:08.304697 n-d-849796-1 devstack@n-api.service[119440]: DEBUG oslo_concurrency.lockutils [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Lock "e1b22adc-a2ca-4858-ac65-f680047bed9f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 04:16:08.318555 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.wsgi [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] HTTP exception thrown: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Request method failure captured: Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: request: GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad HTTP/1.1 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Accept: application/json Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Accept-Encoding: identity Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Connection: close Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Content-Length: 0 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Content-Type: application/json Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Host: 10.222.0.67 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: Openstack-System-Scope: None Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: User-Agent: python-urllib3/1.26.9 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Auth-Token: gAAAAABi1N0LogvcQrJobjfnyY_mcsqRE9ixfdC1BaB7uYXf4yQGmyLAtWrq0e0wiDN3ytibC0BLeuozRWJGlZ7blzoI8igNIsztBqlaZ5UKOHXRj9TNgj3wnGwMZ07MxKDiQ7U8ufDZBkh02obFcSf2-3lVFtBaOTq7eYpF_DS4YbK1Opkw5M0 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Id: None Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Domain-Name: None Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Identity-Status: Confirmed Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Is-Admin-Project: True Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Id: default Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Domain-Name: Default Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Id: 14c5cb0c66754e2191e3cc45b85955e6 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Project-Name: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Role: reader,member Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Roles: reader,member Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14c5cb0c66754e2191e3cc45b85955e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Id: 14c5cb0c66754e2191e3cc45b85955e6 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-Tenant-Name: tempest-TestSnapshotPattern-2049711953 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-User: tempest-TestSnapshotPattern-2049711953-project Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Id: default Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Domain-Name: Default Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Id: 5188ba3f1cb74d13954ce478728a3308 Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: X-User-Name: tempest-TestSnapshotPattern-2049711953-project Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: method: > Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: exception: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: action_args: {'id': '7fcb3204-7d3a-4cbb-989c-6b64f0174cad'} Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: {{(pid=119440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 04:16:08.320241 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: ERROR nova.api.openstack.wsgi Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: DEBUG nova.api.openstack.wsgi [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Returning 404 to user: Instance 7fcb3204-7d3a-4cbb-989c-6b64f0174cad could not be found. {{(pid=119440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: INFO nova.api.openstack.requestlog [None req-e9c146a9-3a13-416a-babd-126b671ec09a tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad" status: 404 len: 111 microversion: 2.1 time: 0.030399 Jul 18 04:16:08.325501 n-d-849796-1 devstack@n-api.service[119440]: [pid: 119440|app: 0|req: 4012/8095] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Jul 18 04:16:08 2022] GET /compute/v2.1/servers/7fcb3204-7d3a-4cbb-989c-6b64f0174cad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 04:16:08.484292 n-d-849796-1 devstack@n-api.service[119439]: DEBUG nova.api.openstack.wsgi [None req-9ee9ee6d-ac9a-4c3b-b78f-8920c734fa6b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] Calling method '.version_select at 0x7fab055b6280>' {{(pid=119439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 04:16:08.509038 n-d-849796-1 devstack@n-api.service[119439]: INFO nova.api.openstack.requestlog [None req-9ee9ee6d-ac9a-4c3b-b78f-8920c734fa6b tempest-TestSnapshotPattern-2049711953 tempest-TestSnapshotPattern-2049711953-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1901262072" status: 202 len: 0 microversion: 2.1 time: 0.029278 Jul 18 04:16:08.509871 n-d-849796-1 devstack@n-api.service[119439]: [pid: 119439|app: 0|req: 4084/8096] 10.222.0.67 () {58 vars in 1256 bytes} [Mon Jul 18 04:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1901262072 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 04:19:21.319160 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:19:21.319702 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:19:21.324977 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:19:21.325304 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:19:21.894881 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:19:21.895997 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:19:22.026986 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:19:22.027167 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:19:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:21:06.732226 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:21:06.732842 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:21:31.800811 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:21:31.801428 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:21:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:22:41.328120 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:22:41.328628 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:22:41.332723 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:22:41.332867 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:22:41.904428 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:22:41.905047 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:22:42.035503 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:22:42.035674 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:22:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:24:26.740520 n-d-849796-1 devstack@n-api.service[119440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:24:26.741175 n-d-849796-1 devstack@n-api.service[119440]: Mon Jul 18 04:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 04:24:51.810567 n-d-849796-1 devstack@n-api.service[119439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 04:24:51.811198 n-d-849796-1 devstack@n-api.service[119439]: Mon Jul 18 04:24:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!